Is this you? Claim this profile to correct it, add a bio and choose the work people see first.

Claim this profile

Academic lineage

Possible advisorsa guess from early papers, not confirmed

  • Wei Lü

    Possible advisor · last author on 4 of their early first-author papers, 2022–2023

    Suggested from co-authorship

Is this you? Claim this profile to confirm or dismiss it.

Works17 from public data

TitleCited by
  • TinyLlama: An Open-Source Small Language Model

    Peiyuan Zhang, Guangtao Zeng, Tianduo Wang, Wei Lu

    arXiv · 2024

    TinyLlama is presented, a compact 1.1B language model pretrained on around 1 trillion tokens for approximately 3 epochs that significantly outperforms existing open-source language models with comparable sizes.

    934
  • Long Context Transfer from Language to Vision

    Peiyuan Zhang, Kaichen Zhang, Bo Li, Guangtao Zeng, Jingkang Yang, Yuanhan Zhang, Ziyue Wang, Haoran Tan, +2 more

    arXiv · 2024

    To effectively measure LMMs' ability to generalize to long contexts in the vision modality, V-NIAH (Visual Needle-In-A-Haystack), a purely synthetic long vision benchmark inspired by the language model's NIAH test is developed.

    590
  • RegMix: Data Mixture as Regression for Language Model Pre-training

    Qian Liu, Xiaosen Zheng, Niklas Muennighoff, Guangtao Zeng, Longxu Dou, Tianyu Pang, Jing Jiang, Min Lin

    arXiv · 2024

    RegMix is proposed to automatically identify a high-performing data mixture by formulating it as a regression task and consistently outperforms human selection in experiments involving models up to 7B models trained on 100B tokens, while matching or exceeding DoReMi using just 10% of the computational resources.

    196
  • MedDialog: Large-scale Medical Dialogue Datasets

    Guangtao Zeng, Wenmian Yang, Zeqian Ju, Yue Yang, Sicheng Wang, Ruisi Zhang, Meng Zhou, Jiaqi Zeng, +6 more

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2020

    It is shown that via transfer learning which finetunes the models pretrained on MedDialog, the performance on medical dialogue generation tasks with small datasets can be greatly improved, as shown in human evaluation and automatic evaluation.

    173
  • Satori: Reinforcement Learning with Chain-of-Action-Thought Enhances LLM Reasoning via Autoregressive Search

    Maohao Shen, Guangtao Zeng, Zhenting Qi, Zhang-Wei Hong, Zhenfang Chen, Wei Lu, Gregory W. Wornell, Subhro Das, +2 more

    arXiv · 2025

    This work explores an orthogonal direction focusing on post-training LLMs for autoregressive searching (i.e., an extended reasoning process with self-reflection and self-exploration of new strategies) and proposes the Chain-of-Action-Thought (COAT) reasoning and a two-stage training paradigm.

    58
  • On the Generation of Medical Dialogues for COVID-19

    Wenmian Yang, Guangtao Zeng, Bowen Tan, Zeqian Ju, Subrato Chakravorty, Xuehai He, Shu Chen, Xingyi Yang, +4 more

    medRxiv · 2020

    This work collects two dialogue datasets - CovidDialog - (in English and Chinese respectively) containing conversations between doctors and patients about COVID-19 and trains several dialogue generation models based on Transformer, GPT, and BERT-GPT to develop a medical dialogue system that can provide COVID19-related consultations.

    32
  • On the Generation of Medical Dialogs for COVID-19

    Meng Zhou, Zechen Li, Bowen Tan, Guangtao Zeng, Wenmian Yang, Xuehai He, Zeqian Ju, Subrato Chakravorty, +8 more

    Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 2: Short Papers) · 2021

    A multi-task learning approach is developed, which regularizes the data-deficient dialog generation task with a masked token prediction task, and shows that the generated responses are promising in being doctor-like, relevant to conversation history, clinically informative and correct.

    29
  • BETA-Rec: Build, Evaluate and Tune Automated Recommender Systems

    Zaiqiao Meng, Richard McCreadie, Craig Macdonald, Iadh Ounis, Siwei Liu, Yaxiong Wu, Xi Wang, Shangsong Liang, +4 more

    Fourteenth ACM Conference on Recommender Systems · 2020

    BETA-Rec, an open source project for Building, Evaluating and Tuning Automated Recommender Systems, aims to provide a practical data toolkit for building end-to-end recommendation systems in a standardized way and is designed to be both modular and extensible.

    17
  • EffiCoder: Enhancing Code Generation in Large Language Models through Efficiency-Aware Fine-tuning

    Dong Huang, Guangtao Zeng, Jianbo Dai, Luo, Meng, Han Weng, Yuhao Qing, Heming Cui, Zhijiang Guo, +1 more

    arXiv · 2024

    14
  • One Network, Many Masks: Towards More Parameter-Efficient Transfer Learning

    Guangtao Zeng, Peiyuan Zhang, Wei Lü

    Annual Meeting of the Association for Computational Linguistics (ACL) · 2023

    9
  • Sailor: Open Language Models for South-East Asia

    Longxu Dou, Qian Liu, Guangtao Zeng, Jia Guo, Jiahui Zhou, Xin Hua Mao, Ziqi Jin, Wei Lu, +1 more

    Conference on Empirical Methods in Natural Language Processing: System Demonstrations (EMNLP) · 2024

    6
  • BOAD: Discovering Hierarchical Software Engineering Agents via Bandit Optimization

    Iris Xu, Guangtao Zeng, Zexue He, Charles Jin, Aldo Pareja, Dan Gutfreund, Chuang Gan, Zhang-Wei Hong

    arXiv · 2025

    This work proposes structuring SWE agents as orchestrators coordinating specialized sub-agents for sub-tasks such as localization, editing, and validation, and demonstrates that automatically discovered hierarchical multi-agent systems significantly improve generalization on challenging long-horizon SWE tasks.

    5
  • Unsupervised Non-transferable Text Classification

    Guangtao Zeng, Wei Lü

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2022

    5
  • SailCompass: Towards Reproducible and Robust Evaluation for Southeast Asian Languages

    Jia Guo, Longxu Dou, Guangtao Zeng, Stanley Kok, Lu, Wei, Qian Liu

    arXiv · 2024

    SailCompass is introduced, a reproducible and robust evaluation benchmark for assessing Large Language Models (LLMs) on Southeast Asian Languages (SEA) and it is derived that SEA-specialized LLMs still outperform general LLMs, although the gap has narrowed.

    4
  • Towards a Mechanistic Interpretation of Multi-Step Reasoning Capabilities of Language Models

    Yifan Hou, Jiaoda Li, Yu Fei, Alessandro Stolfo, Wangchunshu Zhou, Guangtao Zeng, Antoine Bosselut, Mrinmaya Sachan

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2023

    2
  • Tailored Primitive Initialization is the Secret Key to Reinforcement Learning

    Association for Computational Linguistics 2026, Chuang Gan, Zhang-Wei Hong, Raina Wu, Yihang Yao, Guangtao Zeng, Yang Zhang, Ding Zhao

    Underline Science Inc. · 2026

    –
  • SW-$A^2$-Bench: Benchmarking Autonomous Software Agent Generation for Agentic Web

    Linyao Chen, Bo Huang, Qinlao Zhao, Shuai Shao, Zhi Han, Zicai Cui, Ziheng Zhang, Guangtao Zeng, +8 more

    arXiv · 2026

    This paper strictly defines the A2A-Agentization process, decomposing it into critical stages and identifying key technical hurdles on top of the A2A protocol, and develops an Agentization Agent to agentize digital assets for the Agentic Web.

    –

Publication data from OpenAlex, with missing venues and authors filled in from Crossref; citation counts are the higher of OpenAlex and Semantic Scholar, last synced 2026-10-11. One-sentence summaries under some papers are written by Semantic Scholar’s model. Citation counts may be lower than on Google Scholar, which indexes more sources.

Report an error

Wrong papers, two people merged into one, or a profile that should not be here? Tell us and we will fix or hide it. You will be asked to sign in.