Is this you? Claim this profile to correct it, add a bio and choose the work people see first.

Claim this profile

Academic lineage

Possible advisorsa guess from early papers, not confirmed

  • Xuanjing Huang

    Possible advisor · last author on 4 of their early first-author papers, 2014–2016

    Suggested from co-authorship

Is this you? Claim this profile to confirm or dismiss it.

Works113 from public data

TitleCited by
  • CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquing

    Zhibin Gou, Zhihong Shao, Yeyun Gong, Yelong Shen, Yujiu Yang, Nan Duan, Weizhu Chen

    arXiv · 2023

    A framework called CRITIC is introduced that allows LLMs, which are essentially"black boxes" to validate and progressively amend their own outputs in a manner similar to human interaction with tools.

    1,013
  • ProphetNet: Predicting Future N-gram for Sequence-to-SequencePre-training

    Weizhen Qi, Yu Yan, Yeyun Gong, Dayiheng Liu, Nan Duan, Jiusheng Chen, Ruofei Zhang, Ming Zhou

    Findings of the Association for Computational Linguistics: EMNLP 2020 · 2020

    A new sequence-to-sequence pre-training model called ProphetNet is presented, which introduces a novel self-supervised objective named future n-gram prediction and the proposed n-stream self-attention mechanism that predicts the next n tokens simultaneously based on previous context tokens at each time step.

    512
  • XGLUE: A New Benchmark Dataset for Cross-lingual Pre-training, Understanding and Generation

    Yaobo Liang, Nan Duan, Yeyun Gong, Ning Wu, Fenfei Guo, Weizhen Qi, Ming Gong, Linjun Shou, +16 more

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2020

    A recent cross-lingual pre-trained model Unicoder is extended to cover both understanding and generation tasks, which is evaluated on XGLUE as a strong baseline and the base versions of Multilingual BERT, XLM and XLM-R are evaluated for comparison.

    404
  • ToRA: A Tool-Integrated Reasoning Agent for Mathematical Problem Solving

    Zhibin Gou, Shao, Zhihong, Yeyun Gong, Yelong Shen, Yujiu Yang, Minlie Huang, Nan Duan, Weizhu Chen

    arXiv · 2023

    This paper proposes ToRA a series of Tool-integrated Reasoning Agents designed to solve challenging mathematical problems by seamlessly integrating natural language reasoning with the utilization of external tools, thereby amalgamating the analytical prowess of language and the computational efficiency of tools.

    331
  • Query Rewriting for Retrieval-Augmented Large Language Models

    Xinbei Ma, Yeyun Gong, Pengcheng He, Hai Zhao, Nan Duan

    arXiv · 2023

    A new framework, Rewrite-Retrieve-Read instead of the previous retrieve-then-read for the retrieval-augmented LLMs from the perspective of the query rewriting, which is proven effective and scalable, and brings a new framework for retrieval-AUgmentedLLM.

    317
  • Query Rewriting in Retrieval-Augmented Large Language Models

    Xinbei Ma, Yeyun Gong, Pengcheng He, Hai Zhao, Nan Duan

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2023

    260
  • Keyphrase Extraction Using Deep Recurrent Neural Networks on Twitter

    Qi Zhang, Yang Wang, Yeyun Gong, Xuanjing Huang

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2016

    A novel deep recurrent neural network model is proposed to combine keywords and context information to perform keyphrases from tweets and the experimental results showed that the proposed method performs significantly better than previous methods.

    198
  • Enhancing Retrieval-Augmented Large Language Models with Iterative Retrieval-Generation Synergy

    Zhihong Shao, Yeyun Gong, Yelong Shen, Minlie Huang, Nan Duan, Weizhu Chen

    Findings of the Association for Computational Linguistics: EMNLP 2023 · 2023

    192
  • Hashtag Recommendation for Multimodal Microblog Using Co-Attention Network

    Qi Zhang, Jiawen Wang, Haoran Huang, Xuanjing Huang, Yeyun Gong

    International Joint Conference on Artificial Intelligence · 2017

    This work proposes a co-attention network incorporating textual and visual information to recommend hashtags for multimodal tweets and demonstrates that the proposed method can achieve better performance than state-of-the-art methods using textual information only.

    139
  • Joint Type Inference on Entities and Relations via Graph Convolutional Networks

    Changzhi Sun, Yeyun Gong, Yuanbin Wu, Ming Gong, Daxin Jiang, Man Lan, Shiliang Sun, Nan Duan

    Annual Meeting of the Association for Computational Linguistics (ACL) · 2019

    A new paradigm for the task of joint entity relation extraction is developed that first identifies entity spans, then performs a joint inference on entity types and relation types and is competitive with the state-of-the-art in relation performance.

    127
  • Retweet Prediction with Attention-based Deep Neural Network

    Qi Zhang, Yeyun Gong, Jindou Wu, Haoran Huang, Xuanjing Huang

    Proceedings of the 25th ACM International on Conference on Information and Knowledge Management · 2016

    A novel attention-based deep neural network to incorporate contextual and social information for this task and experimental results showed that the proposed method could achieve better results than the previous state-of-the-art methods.

    120
  • Synthetic Prompting: Generating Chain-of-Thought Demonstrations for Large Language Models

    Zhihong Shao, Yeyun Gong, Yelong Shen, Minlie Huang, Nan Duan, Weizhu Chen

    arXiv · 2023

    Synthetic prompting is introduced, a method that leverages a few handcrafted examples to prompt the model to generate more examples by itself, and selects effective demonstrations to elicit better reasoning.

    103
  • CMMLU: Measuring massive multitask language understanding in Chinese

    Haonan Li, Yixuan Zhang, Fajri Koto, Yifei Yang, Hai Zhao, Yeyun Gong, Nan Duan, Timothy J. Baldwin

    Findings of the Association for Computational Linguistics ACL 2024 · 2024

    100
  • Not All Tokens Are What You Need for Pretraining

    Zhenghao Lin, Zhibin Gou, Yeyun Gong, Xiao Liu, Yelong Shen, Ruochen Xu, Lin Chen, Yujiu Yang, +3 more

    neural information processing systems · 2024

    This work proposes a new language model called R HO -1, which employs Selective Language Modeling (SLM), which selectively trains on useful tokens that aligned with the desired distribution, increasing both data efficiency and performance of the language model pre-training.

    100
  • AutoVerus: Automated Proof Generation for Rust Code

    Chenyuan Yang, X. Li, Md Rakib Hossain Misu, Jianan Yao, Weidong Cui, Yeyun Gong, Chris Hawblitzel, Shuvendu K. Lahiri, +5 more

    Proceedings of the ACM on Programming Languages · 2025

    A benchmark suite of 150 non-trivial proof tasks is built, which shows that AutoVerus can automatically generate correct proof for more than 90% of them, with more than half of them tackled in less than 30 seconds or 3 LLM calls.

    93
  • AnnoLLM: Making Large Language Models to Be Better Crowdsourced Annotators

    Xingwei He, Zhenghao Lin, Yeyun Gong, A-Long Jin, Hang Zhang, Lin Chen, Jian Jiao, Siu Ming Yiu, +2 more

    Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · 2024

    92
  • Mask Attention Networks: Rethinking and Strengthen Transformer

    Zhihao Fan, Yeyun Gong, Dayiheng Liu, Zhongyu Wei, Siyuan Wang, Jian Jiao, Nan Duan, Ruofei Zhang, +1 more

    Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · 2021

    A novel understanding of SAN and FFN are presented as Mask Attention Networks (MANs) and it is shown that they are two special cases of MANs with static mask matrices, which limit the capability for localness modeling in text representation learning.

    83
  • GLGE: A New General Language Generation Evaluation Benchmark

    Dayiheng Liu, Yu Yan, Yeyun Gong, Weizhen Qi, Hang Zhang, Jian Jiao, Weizhu Chen, Jie Fu, +10 more

    Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021 · 2021

    The General Language Generation Evaluation (GLGE), a new multi-task benchmark for evaluating the generalization capabilities of NLG models across eight language generation tasks, is presented and a leaderboard with strong baselines including MASS, BART, and ProphetNet is built.

    75
  • From intention to implementation: automating biomedical research via LLMs

    Yi Luo, Linghang Shi, Yihao Li, Aobo Zhuang, Yeyun Gong, Ling Liu, Lin Chen

    Science China Information Sciences · 2025

    This paper introduces BioResearcher, the first end-to-end automated system designed to streamline the entire biomedical research process involving dry lab experiments, and demonstrates significant potential to reduce researchers’ workloads and accelerate biomedical discoveries.

    65
  • Optimizing Large Language Model Training Using FP4 Quantization

    Ruizhe Wang, Yeyun Gong, Xiao Liu, Guoshuai Zhao, Ziyue Yang, Baining Guo, Zheng-Jun Zha, Peng Cheng

    arXiv · 2025

    This work introduces the first FP4 training framework for LLMs, addressing two key challenges with two key innovations: a differentiable quantization estimator for precise weight updates and an outlier clamping and compensation strategy to prevent activation collapse.

    64
  • DialogVED: A Pre-trained Latent Variable Encoder-Decoder Model for Dialog Response Generation

    Wei Chen, Yeyun Gong, Song Wang, Bolun Yao, Weizhen Qi, Zhongyu Wei, Xiaowu Hu, Bartuer Zhou, +4 more

    Annual Meeting of the Association for Computational Linguistics (ACL) · 2022

    A new dialog pre-training framework called DialogVED is proposed, which introduces continuous latent variables into the enhanced encoder-decoder pre- training framework to increase the relevance and diversity of responses.

    59
  • RikiNet: Reading Wikipedia Pages for Natural Question Answering

    Dayiheng Liu, Yeyun Gong, Jie Fu, Yu Yan, Jiusheng Chen, Daxin Jiang, Jiancheng Lv, Nan Duan

    Annual Meeting of the Association for Computational Linguistics (ACL) · 2020

    This paper introduces a new model, called RikiNet, which reads Wikipedia pages for natural question answering, which is the first single model that outperforms the single human performance.

    59
  • ProphetNet-X: Large-Scale Pre-training Models for English, Chinese, Multi-lingual, Dialog, and Code Generation

    Weizhen Qi, Yeyun Gong, Yu Yan, Can Xu, Bolun Yao, Bartuer Zhou, Biao Cheng, Daxin Jiang, +4 more

    Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing: System Demonstrations · 2021

    The ProphetNet family pre-training models, named ProphetNet-X, where X can be English, Chinese, Multi-lingual, and so on, are presented, and achieve new state-of-the-art performance on 10 benchmarks.

    56
  • Automated Proof Generation for Rust Code via Self-Evolution

    Tianyu Chen, Shuai Lu, Shan Lu, Yeyun Gong, Chenyuan Yang, X. Li, Md Rakib Hossain Misu, Hao Yu, +6 more

    arXiv · 2024

    This paper introduces SAFE, a framework that overcomes the lack of human-written proofs to enable automated proof generation of Rust code and improves the capability of open-source models, initially unacquainted with formal verification, to automatically write proofs for Rust code.

    54
  • Retweet Behavior Prediction Using Hierarchical Dirichlet Process

    Qi Zhang, Yeyun Gong, Ya Guo, Xuanjing Huang

    Proceedings of the AAAI Conference on Artificial Intelligence · 2015

    This work proposes a novel method using non-parametric statistical models to combine structural, textual, and temporal information together to predict retweet behavior and demonstrates that the proposed method can achieve better performance than state-of-the-art methods.

    54

Show all 113 works

Publication data from OpenAlex, with missing venues and authors filled in from Crossref; citation counts are the higher of OpenAlex and Semantic Scholar, last synced 2026-10-14. One-sentence summaries under some papers are written by Semantic Scholar’s model. Citation counts may be lower than on Google Scholar, which indexes more sources.

Report an error

Wrong papers, two people merged into one, or a profile that should not be here? Tell us and we will fix or hide it.

Sign in to report