I am a fourth-year Ph.D. student at the University of Maryland, College Park, advised by Prof. Ramani Duraiswami. I received my B.Eng. in Computer Science from Tsinghua University, with a minor in Statistics. I have interned at Meta Superintelligence Labs, Microsoft Research, NVIDIA Research, ByteDance Seed, and Microsoft Research Asia.

My research focuses on building multimodal models that can evaluate, learn from feedback, and continually improve themselves.

  • Critic and reward modeling: I build and benchmark multimodal judges for reliable evaluation and alignment across diverse criteria and physical reasoning tasks (LLaVA-Critic, Multi-Crit, PhyCritic).
  • Multimodal post-training: I study data selection and reinforcement learning for stronger multimodal reasoning and generation, with an emphasis on critic supervision and visual grounding (Self-Filter, LLaVA-Critic-R1, EVAN).
  • Recursive self-improvement: I explore feedback loops that let models iteratively refine their outputs and discover better inference strategies, toward systems that can improve their own capabilities (RubSE, AutoTTS).

I am actively looking for 2027 summer internships. Please contact me if you believe I am a good match! 😄

News

  • 10/2026 RubSE has been accepted to the NeurIPS’26 LCFM Workshop.
  • 09/2026 Three papers (AutoTTS, MARGO and EVAN) are accepted by NeurIPS 2026.
  • 07/2026 One paper is accepted by COLM 2026.
  • 06/2026 WaterGen is accepted by ECCV 2026.
  • 06/2026 Joined Meta MSL as a research intern with Annie Dong.
Earlier updates
  • 05/2026 Receive the Silver Reviewer Award from ICML 2026.
  • 04/2026 Multi-Crit is selected as a Highlight paper at CVPR 2026.
  • 02/2026 Multi-Crit and PhyCritic got accepted by CVPR 2026.
  • 02/2025 LLaVA-Critic got accepted by CVPR 2025.
  • 02/2025 Joined NVIDIA LPR as a research intern with Zhiding Yu, Guilin Liu and Yi Dong.
  • 09/2024 Released LLaVA-Critic, the first open-source LMM as a general evaluator for diverse multimodal scenarios.
  • 09/2024 Event3DGS got accepted by CoRL 2024.
  • 06/2024 Joined ByteDance as a research intern with Chunyuan Li.
  • 08/2023 Started my Ph.D. at UMD.
  • 07/2023 MasQCLIP got accepted by ICCV 2023.

Education

  • B.Eng. in Computer Science, Tsinghua University 2019 - 2023, with honor Minor in Statistics, 2020 - 2023
  • Ph.D. in Computer Science, University of Maryland, College Park 2023 - Present Master in Computer Science, 2023 - 2026

Selected Honors & Awards

  • Second Award, 35th Chinese Physics Olympiad (Final) 2018
  • National Scholarship 2020
  • Outstanding Undergraduate, Tsinghua Computer Science Dept. 2023
  • Dean's Fellowship, University of Maryland 2023 - 2024

Industry Experience

Invited Talks

  • Multi-Crit: Benchmarking Multimodal Judges on Pluralistic Criteria-Following [Slides] Vector Institute, Endless Summer School: Multimodal and Foundation Models — September 10, 2026 Adobe, AI Safety & Quality — June 24, 2026