Is this you? Claim this profile to correct it, add a bio and choose the work people see first.

Claim this profile

Academic lineage

Possible advisorsa guess from early papers, not confirmed

  • Yu–Gang Jiang

    Possible advisor · last author on 4 of their early first-author papers, 2024–2025

    Suggested from co-authorship
  • Xuanjing Huang

    Possible advisor · last author on 8 of their early first-author papers, 2022–2026

    Suggested from co-authorship

Is this you? Claim this profile to confirm or dismiss it.

Works91 from public data

TitleCited by
  • The rise and potential of large language model based agents: a survey

    Zhiheng Xi, Wen-Xiang Chen, Xin Hua Guo, Wei He, Yiwen Ding, Boyang Hong, Ming Zhang, Junzhe Wang, +20 more

    Science China Information Sciences · 2025

    A comprehensive survey on LLM-based agents is conducted, covering their construction frameworks, application scenarios, and the exploration of societies built upon LLM-based agents.

    906
  • Secrets of RLHF in Large Language Models Part I: PPO

    Rui Zheng, Shihan Dou, Songyang Gao, Hua Qiang Yuan, Wei Shen, Binghai Wang, Yan Liu, Senjie Jin, +19 more

    arXiv · 2023

    The PPO-max, an advanced version of PPO algorithm, is explored, to efficiently improve the training stability of the policy model, and a comprehensive analysis of RLHF abilities compared with SFT models and ChatGPT is performed.

    290
  • Memory in the Age of AI Agents

    Yuyang Hu, Shichun Liu, Yanwei Yue, Guibin Zhang, Boyang Liu, Fangyi Zhu, Jiaxu Lin, Guo, Honglin, +22 more

    arXiv · 2025

    This work aims to provide an up-to-date landscape of current agent memory research, clearly delineating the scope of agent memory and distinguishing it from related concepts such as LLM memory, retrieval augmented generation (RAG), and context engineering, and articulate a forward-looking perspective on emerging research frontiers.

    288
  • LoRAMoE: Alleviating World Knowledge Forgetting in Large Language Models via MoE-Style Plugin

    Shihan Dou, Enyu Zhou, Yan Liu, Songyang Gao, Wei Shen, Limao Xiong, Yuhao Zhou, Xiaohua Wang, +8 more

    Annual Meeting of the Association for Computational Linguistics (ACL) · 2024

    Experimental results show that, as the instruction data increases, Lo-RAMoE can significantly improve the ability to process downstream tasks, while maintaining the world knowledge stored in the LLM.

    186
  • Secrets of RLHF in Large Language Models Part II: Reward Modeling

    Binghai Wang, Rui Zheng, Lu Chen, Yan Liu, Shihan Dou, Caishuang Huang, Wei Shen, Senjie Jin, +19 more

    arXiv · 2024

    This report introduces contrastive learning to enhance the ability of reward models to distinguish between chosen and rejected responses, thereby improving model generalization and employs meta-learning to enable the reward model to maintain the ability to differentiate subtle differences in out-of-distribution samples.

    179
  • AgentGym: Evolving Large Language Model-based Agents across Diverse Environments

    Zhiheng Xi, Yiwen Ding, Wen-Xiang Chen, Boyang Hong, Honglin Guo, Junzhe Wang, Dingwen Yang, Chenyang Liao, +12 more

    arXiv · 2024

    This paper proposes AgentGym, a new framework featuring a variety of environments and tasks for broad, real-time, uni-format, and concurrent agent exploration, and proposes a novel method, AgentEvol, to investigate the potential of agent self-evolution beyond previously seen data across tasks and environments.

    113
  • StepCoder: Improve Code Generation with Reinforcement Learning from Compiler Feedback

    Shihan Dou, Yan Liu, Haoxiang Jia, Limao Xiong, Enyu Zhou, Shen, Wei, Shan, Junjie, Caishuang Huang, +9 more

    arXiv · 2024

    StepCoder is introduced, a novel RL framework for code generation, consisting of two main components: CCCS addresses the exploration challenge by breaking the long sequences code generation task into a Curriculum of Code Completion Subtasks, while FGO only optimizes the model by masking the unexecuted code segments to provide Fine-Grained Optimization.

    98
  • LoRAMoE: Alleviate World Knowledge Forgetting in Large Language Models via MoE-Style Plugin

    Shihan Dou, Enyu Zhou, Yan Liu, Songyang Gao, Jun Chang Zhao, Wei Shen, Yuhao Zhou, Zhiheng Xi, +8 more

    arXiv · 2023

    90
  • AgentPRM: Process Reward Models for LLM Agents via Step-Wise Promise and Progress

    Zhiheng Xi, Chenyang Liao, Guanyu Li, Z D Zhang, Wenxiang Chen, Binghai Wang, Senjie Jin, Y. Z. Zhou, +6 more

    ACM Web Conference (WWW) · 2026

    This work explores constructing process reward models (PRMs) to evaluate each decision and guide the agent's decision-making process, and proposes a re-defined PRM for agent tasks, named AgentPRM, to capture both the interdependence between sequential decisions and their contribution to the final goal.

    81
  • StepCoder: Improving Code Generation with Reinforcement Learning from Compiler Feedback

    Shihan Dou, Yan Liu, Haoxiang Jia, Enyu Zhou, Limao Xiong, Junjie Shan, Caishuang Huang, Xiao Wang, +8 more

    Annual Meeting of the Association for Computational Linguistics (ACL) · 2024

    StepCoder is introduced, a novel RL framework for code generation, consisting of two main components: CCCS addresses the exploration challenge by breaking the long sequences code generation task into a C urriculum of C ode C ompletion S ubtasks, while FGO only optimizes the model by masking the unexecuted code segments to provide F ine-G rained O ptimization.

    76
  • Below Chance: Code and Derived Data for an Audit of the TRACE Continual-Learning Benchmark and a Census of Published Sequential Baselines

    Xiao Wang, Yuansen Zhang, Tianze Chen, Songyang Gao, Senjie Jin, Xianjun Yang, Zhiheng Xi, Rui Zheng, +4 more

    arXiv · 2023

    TRACE is introduced, a novel benchmark designed to evaluate continual learning in LLMs and the Reasoning-augmented Continual Learning (RCL) approach, which integrates task-specific cues with meta-rationales, effectively reducing catastrophic forgetting in LLM while expediting convergence on novel tasks.

    70
  • AgentGym: Evaluating and Training Large Language Model-based Agents across Diverse Environments

    Zhiheng Xi, Yiwen Ding, Wen-Xiang Chen, Boyang Hong, Honglin Guo, Junzhe Wang, Xin Guo, Dingwen Yang, +12 more

    Annual Meeting of the Association for Computational Linguistics (ACL) · 2025

    A GENT G YM is proposed, a framework featuring 7 real-world scenarios, 14 environments, and 89 tasks for unified, real-time, and concurrent agent interaction that takes the initial step to develop LLM-based agents that can handle diverse tasks via methods like self-improvement or reinforcement learning.

    57
  • BAPO: Stabilizing Off-Policy Reinforcement Learning for LLMs via Balanced Policy Optimization with Adaptive Clipping

    Zhiheng Xi, Xin Guo, Nan Yang, Enyu Zhou, Shen, Junrui, Wen-Xiang Chen, Jiaqi Liu, Huang, Jixuan, +13 more

    arXiv · 2025

    This work proposes BAlanced Policy Optimization with Adaptive Clipping with Adaptive Clipping (BAPO), a simple yet effective method that dynamically adjusts clipping bounds to adaptively re-balance positive and negative contributions, preserve entropy, and stabilize RL optimization.

    56
  • Enhancing LLM Reasoning via Critique Models with Test-Time and Training-Time Supervision

    Zhiheng Xi, Dingwen Yang, Huang, Jixuan, Jiafu Tang, Guanyu Li, Yiwen Ding, He, Wei, Boyang Hong, +16 more

    arXiv · 2024

    This paper delves into a two-player paradigm that separates the roles of reasoning and critique models, where the critique model provides step-level feedback to supervise the reasoning (actor) model during both test-time and train-time, and proposes a critique-in-the-loop self-improvement method.

    54
  • MouSi: Poly-Visual-Expert Vision-Language Models

    Xiaoran Fan, Tao Ji, Changhao Jiang, Shuo Li, Senjie Jin, Sirui Song, Junke Wang, Boyang Hong, +16 more

    arXiv · 2024

    This paper proposes the use of ensemble experts technique to synergizes the capabilities of individual visual encoders, including those skilled in image-text matching, OCR, image segmentation, etc, while bridging the gap between image encoders and pre-trained LLMs.

    28
  • Improving Generalization of Alignment with Human Preferences through Group Invariant Learning

    Rui Zheng, Wei Shen, Hua, Yuan, Lai, Wenbin, Shihan Dou, Yuhao Zhou, Zhiheng Xi, Wang, Xiao, +4 more

    arXiv · 2023

    This work proposes a novel approach that can learn a consistent policy via RL across various data groups or domains, and significantly enhances training stability and model generalization.

    28
  • Have the VLMs Lost Confidence? A Study of Sycophancy in VLMs

    Li, Shuo, Ji, Tao, Xiaoran Fan, Lu, Linsheng, Yang, Leyi, Yuming Yang, Zhiheng Xi, Rui Zheng, +5 more

    arXiv · 2024

    To mitigate sycophancy, this work proposes a synthetic dataset for training and employ methods based on prompts, supervised fine-tuning, and DPO that effectively alleviate sycophancy in VLMs, and demonstrates that enhancing image attention at high layers proves beneficial in mitigating this issue.

    18
  • Nex-N1: Agentic Models Trained via a Unified Ecosystem for Large-Scale Environment Construction

    AGI Team, Yuxuan Cai, Lu Chen, Qiaoling Chen, Yuyang Ding, Liwen Fan, Fu, Wenjie, Yufei Gao, +22 more

    arXiv · 2025

    This work introduces a comprehensive method designed to systematically scale the diversity and complexity of interactive environments and trains Nex-N1 upon the diverse and complex interactive environments established by the infrastructure.

    16
  • Reward Modeling Requires Automatic Adjustment Based on Data Quality

    Binghai Wang, Rui Zheng, Lu Chen, Zhiheng Xi, Wei Shen, Yuhao Zhou, Dong Yan, Tao Gui, +2 more

    Findings of the Association for Computational Linguistics: EMNLP 2024 · 2024

    A method is introduced that automatically adjusts reward mod-019 eling based on data quality, reducing the impact of noise and making full use of dataset, and significantly enhances the alignment performance of RLHF.

    16
  • Self-Polish: Enhance Reasoning in Large Language Models via Problem Refinement

    Zhiheng Xi, Senjie Jin, Yuhao Zhou, Rui Zheng, Songyang Gao, Jia Liu, Tao Gui, Qi Zhang, +1 more

    Findings of the Association for Computational Linguistics: EMNLP 2023 · 2023

    16
  • Towards Understanding the Capability of Large Language Models on Code Clone Detection: A Survey

    Shihan Dou, Shan, Junjie, Haoxiang Jia, Wenhao Deng, Zhiheng Xi, Wei He, Yueming Wu, Tao Gui, +2 more

    arXiv · 2023

    9
  • Efficient Adversarial Training with Robust Early-Bird Tickets

    Zhiheng Xi, Rui Zheng, Tao Gui, Qi Zhang, Xuanjing Huang

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2022

    7
  • AI Deception: Risks, Dynamics, and Controls

    Boyuan Chen, Fang, Sitong, Jiaming Ji, Zhu, Yanxu, Pengcheng Wen, Wu, Jinzhou, Y. H. Tan, Boren Zheng, +22 more

    arXiv · 2025

    This project provides a comprehensive and up-to-date overview of the AI deception field, covering its core concepts, methodologies, genesis, and potential mitigations, and organizes the landscape of AI deception research as a deception cycle, consisting of two key components: deception emergence and deception treatment.

    6
  • EasyJailbreak: A Unified Framework for Jailbreaking Large Language Models

    Weikang Zhou, Xiao Wang, Limao Xiong, Xia Han, Yingshuang Gu, Mingxu Chai, Zhu, Fukang, Caishuang Huang, +13 more

    arXiv · 2024

    6
  • Distill Visual Chart Reasoning Ability from LLMs to MLLMs

    Wei He, Zhiheng Xi, Wanxu Zhao, Xiaoran Fan, Yiwen Ding, Ziyang Shan, Tao Gui, Qi Zhang, +1 more

    Findings of the Association for Computational Linguistics: EMNLP 2025 · 2025

    5

Show all 91 works

Publication data from OpenAlex, with missing venues and authors filled in from Crossref; citation counts are the higher of OpenAlex and Semantic Scholar, last synced 2026-10-13. One-sentence summaries under some papers are written by Semantic Scholar’s model. Citation counts may be lower than on Google Scholar, which indexes more sources.

Report an error

Wrong papers, two people merged into one, or a profile that should not be here? Tell us and we will fix or hide it.

Sign in to report