Is this you? Claim this profile to correct it, add a bio and choose the work people see first.

Claim this profile

Academic lineage

Possible advisorsa guess from early papers, not confirmed

  • Jiancheng Lv

    Possible advisor · last author on 5 of their early first-author papers, 2018–2020

    Suggested from co-authorship
  • Nan Duan

    Possible advisor · last author on 4 of their early first-author papers, 2020–2021

    Suggested from co-authorship

Is this you? Claim this profile to confirm or dismiss it.

Works113 from public data

TitleCited by
  • Qwen2.5 Technical Report

    Qwen, :, Yang An, Baosong Yang, Beichen Zhang, Binyuan Hui, B. Zheng, Bowen Yu, +22 more

    arXiv · 2024

    The open-weight flagship Qwen2.5-72B-Instruct outperforms a number of open and proprietary models and demonstrates competitive performance to the state-of-the-art open-weight model, Llama-3-405B-Instruct, which is around 5 times larger.

    5,408
  • Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolution

    Peng Wang, Shuai Bai, Sinan Tan, Shijie Wang, Zhihao Fan, Jinze Bai, Keqin Chen, Xuejing Liu, +11 more

    arXiv · 2024

    The Qwen2-VL Series introduces the Naive Dynamic Resolution mechanism, which enables the model to dynamically process images of varying resolutions into different numbers of visual tokens, allowing the model to generate more efficient and accurate visual representations, closely aligning with human perceptual processes.

    5,204
  • Qwen Technical Report

    Jinze Bai, Shuai Bai, Chu, Yunfei, Zeyu Cui, Kai Dang, Xiaodong Deng, Fan, Yang, Wenbin Ge, +22 more

    arXiv · 2023

    Qwen is a comprehensive language model series that encompasses distinct models with varying parameter counts, and includes Qwen, the base pretrained language models, and Qwen-Chat, the chat models finetuned with human alignment techniques.

    4,443
  • Qwen3-VL Technical Report

    Bai, Shuai, Yuxuan Cai, Ruizhe Chen, Keqin Chen, Xionghui Chen, Zesen Cheng, Deng, Lianghao, Wei Ding, +22 more

    arXiv · 2025

    Qwen3-VL is introduced, the most capable vision-language model in the Qwen series to date, achieving superior performance across a broad range of multimodal benchmarks, and three key upgrades are introduced, including an enhanced interleaved-MRoPE for stronger spatial-temporal modeling across images and video.

    2,675
  • Qwen2 Technical Report

    Yang, An, Baosong Yang, Binyuan Hui, Zheng, Bo, Bowen Yu, Chang Zhou, Cheng‐Peng Li, Chengyuan Li, +22 more

    arXiv · 2024

    A comprehensive suite of foundational and instruction-tuned language models, encompassing a parameter range from 0.5 to 72 billion, featuring dense models and a Mixture-of-Experts model, which surpasses most prior open-weight models and demonstrates robust multilingual capabilities.

    2,548
  • ProphetNet: Predicting Future N-gram for Sequence-to-SequencePre-training

    Weizhen Qi, Yu Yan, Yeyun Gong, Dayiheng Liu, Nan Duan, Jiusheng Chen, Ruofei Zhang, Ming Zhou

    Findings of the Association for Computational Linguistics: EMNLP 2020 · 2020

    A new sequence-to-sequence pre-training model called ProphetNet is presented, which introduces a novel self-supervised objective named future n-gram prediction and the proposed n-stream self-attention mechanism that predicts the next n tokens simultaneously based on previous context tokens at each time step.

    512
  • Hallucination Detection: Robustly Discerning Reliable Answers in Large Language Models

    Yuyan Chen, Qiang Fu, Yichen Yuan, Zhihao Wen, Ge Fan, Dayiheng Liu, Dongmei Zhang, Zhixu Li, +1 more

    ACM International Conference on Information and Knowledge Management (CIKM) · 2023

    This research significantly contributes to the detection of reliable answers generated by LLMs and holds noteworthy implications for mitigating hallucination in the future work.

    155
  • Qwen3 Technical Report

    Yang, An, A. Li, Baosong Yang, Beichen Zhang, Binyuan Hui, Zheng, Bo, B. X. Yu, Chang Gao, +22 more

    arXiv · 2025

    111
  • Mask Attention Networks: Rethinking and Strengthen Transformer

    Zhihao Fan, Yeyun Gong, Dayiheng Liu, Zhongyu Wei, Siyuan Wang, Jian Jiao, Nan Duan, Ruofei Zhang, +1 more

    Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · 2021

    A novel understanding of SAN and FFN are presented as Mask Attention Networks (MANs) and it is shown that they are two special cases of MANs with static mask matrices, which limit the capability for localness modeling in text representation learning.

    83
  • GLGE: A New General Language Generation Evaluation Benchmark

    Dayiheng Liu, Yu Yan, Yeyun Gong, Weizhen Qi, Hang Zhang, Jian Jiao, Weizhu Chen, Jie Fu, +10 more

    Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021 · 2021

    The General Language Generation Evaluation (GLGE), a new multi-task benchmark for evaluating the generalization capabilities of NLG models across eight language generation tasks, is presented and a leaderboard with strong baselines including MASS, BART, and ProphetNet is built.

    75
  • RikiNet: Reading Wikipedia Pages for Natural Question Answering

    Dayiheng Liu, Yeyun Gong, Jie Fu, Yu Yan, Jiusheng Chen, Daxin Jiang, Jiancheng Lv, Nan Duan

    Annual Meeting of the Association for Computational Linguistics (ACL) · 2020

    This paper introduces a new model, called RikiNet, which reads Wikipedia pages for natural question answering, which is the first single model that outperforms the single human performance.

    59
  • Tailor: A Soft-Prompt-Based Approach to Attribute-Based Controlled Text Generation

    Kexin Yang, Dayiheng Liu, Wenqiang Lei, Baosong Yang, Mingfeng Xue, Boxing Chen, Jun Xie

    Annual Meeting of the Association for Computational Linguistics (ACL) · 2023

    The proposed Tailor represents each attribute as a pre- trained continuous vector i.e., single-attribute prompt, which guides the generation of a fixed pre-trained language model (PLM) to satisfy aPre-specified attribute.

    57
  • Revision in Continuous Space: Unsupervised Text Style Transfer without Adversarial Learning

    Dayiheng Liu, Jie Fu, Yidan Zhang, Chris Pal, Jiancheng Lv

    Proceedings of the AAAI Conference on Artificial Intelligence · 2020

    A new framework that utilizes the gradients to revise the sentence in a continuous space during inference to achieve text style transfer and significantly outperforms five state-of-the-art methods.

    53
  • How Abilities in Large Language Models are Affected by Supervised Fine-tuning Data Composition

    Guanting Dong, Hongyi Yuan, Keming Lu, Chengpeng Li, Mingfeng Xue, Dayiheng Liu, Wei Wang, Zheng Yuan, +2 more

    Annual Meeting of the Association for Computational Linguistics (ACL) · 2024

    51
  • Interactive Natural Language Processing

    Zekun Wang, Ge Zhang, Kexin Yang, Ning Shi, Wangchunshu Zhou, Shaochun Hao, Guangzheng Xiong, Yi‐Zhi Li, +14 more

    arXiv · 2023

    This paper provides a systematic classification of iNLP, dissecting its various components, including interactive objects, interaction interfaces, and interaction methods, and delves into the evaluation methodologies used in the field, exploring its diverse applications, and scrutinize its ethical and safety issues.

    51
  • μ-Forcing

    Dayiheng Liu, Xue Yang, Feng He, Yuanyuan Chen, Jiancheng Lv

    ACM Transactions on Asian and Low-Resource Language Information Processing · 2019

    The proposed method directly injects extra constraints on the posteriors of latent variables into the learning process of VRAE, which can flexibly and stably control the tradeoff between the Kullback-Leibler (KL) term and the reconstruction term, making the model learn dense and meaningful latent representations.

    49
  • UniTE: Unified Translation Evaluation

    Yu Xuan Wan, Dayiheng Liu, Baosong Yang, Haibo Zhang, Boxing Chen, Derek F. Wong, Lidia Sam Chao

    Annual Meeting of the Association for Computational Linguistics (ACL) · 2022

    This paper proposes monotonic regional attention to control the interaction among input segments, and unified pretraining to better adapt multi-task training and can universally surpass various state-of-the-art or winner methods across tasks.

    47
  • Qwen2.5-Coder Technical Report

    Binyuan Hui, Jian Yang, Cui, Zeyu, Jiaxi Yang, Dayiheng Liu, Lei Zhang, Tianyu Liu, Jiajun Zhang, +16 more

    arXiv · 2024

    44
  • AnchiBERT: A Pre-Trained Model for Ancient Chinese Language Understanding and Generation

    Huishuang Tian, Kexin Yang, Dayiheng Liu, Jiancheng Lv

    2021 International Joint Conference on Neural Networks (IJCNN) · 2021

    AnchiBERT is released, a pre-trained language model based on the architecture of BERT, which is trained on large-scale ancient Chinese corpora and outperforms BERT as well as the non-pretrained models and achieves state-of-the-art results in all cases.

    42
  • Tell Me How to Ask Again: Question Data Augmentation with Controllable Rewriting in Continuous Space

    Dayiheng Liu, Yeyun Gong, Jie Fu, Yu Yan, Jiusheng Chen, Jiancheng Lv, Nan Duan, Ming Zhou

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2020

    A novel data augmentation method, referred to as Controllable Rewriting based Question Data Augmentation (CRQDA), for machine reading comprehension, question generation, and question-answering natural language inference tasks.

    40
  • Frequency-Aware Contrastive Learning for Neural Machine Translation

    Tong Zhang, Wei Ye, Baosong Yang, Long Zhang, Xingzhang Ren, Dayiheng Liu, Jinan Sun, Shikun Zhang, +2 more

    Proceedings of the AAAI Conference on Artificial Intelligence · 2022

    A frequency-aware token-level contrastive learning method, in which the hidden state of each decoding step is pushed away from the counterparts of other target words in a soft contrastive way based on the corresponding word frequencies, which can not only significantly improve the translation quality but also enhance lexical diversity and optimize word representation space.

    36
  • Tailor: A Prompt-Based Approach to Attribute-Based Controlled Text Generation

    Kexin Yang, Dayiheng Liu, Wenqiang Lei, Baosong Yang, Mingfeng Xue, Boxing Chen, Jun Xie

    arXiv · 2022

    The proposed Tailor represents each attribute as a pre-trained continuous vector and guides the generation of a fixed PLM switch to aPre-specified attribute, which can be concatenated with any two single-attribute prompts to multi-attribute text generation.

    31
  • Should We Rely on Entity Mentions for Relation Extraction? Debiasing Relation Extraction with Counterfactual Analysis

    Yiwei Wang, Muhao Chen, Wenxuan Zhou, Yujun Cai, Yuxuan Liang, Dayiheng Liu, Baosong Yang, Juncheng Liu, +1 more

    Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · 2022

    29
  • A Multi-Modal Chinese Poetry Generation Model

    Dayiheng Liu, Quan Guo, Wubo Li, Jiancheng Lv

    2018 International Joint Conference on Neural Networks (IJCNN) · 2018

    A three-stage multi-modal Chinese poetry generation approach which can effectively capture character, phrase, and sentence information between contexts and improve the symmetry delivered in poems is proposed.

    28
  • BANG: Bridging Autoregressive and Non-autoregressive Generation with Large Scale Pretraining

    Weizhen Qi, Yeyun Gong, Jian Jiao, Yu Yan, Weizhu Chen, Dayiheng Liu, Kewen Tang, Houqiang Li, +4 more

    arXiv · 2020

    24

Show all 113 works

Publication data from OpenAlex, with missing venues and authors filled in from Crossref; citation counts are the higher of OpenAlex and Semantic Scholar, last synced 2026-10-13. One-sentence summaries under some papers are written by Semantic Scholar’s model. Citation counts may be lower than on Google Scholar, which indexes more sources.

Report an error

Wrong papers, two people merged into one, or a profile that should not be here? Tell us and we will fix or hide it.

Sign in to report