Is this you? Claim this profile to correct it, add a bio and choose the work people see first.

Claim this profile

Academic lineage

Possible advisorsa guess from early papers, not confirmed

  • Yinglin Wang

    Possible advisor · last author on 3 of their early first-author papers, 2010–2011

    Suggested from co-authorship

Is this you? Claim this profile to confirm or dismiss it.

Works93 from public data

TitleCited by
  • DocRED: A Large-Scale Document-Level Relation Extraction Dataset

    Yuan Yao, Deming Ye, Peng Li, Xu Han, Yankai Lin, Zhenghao Liu, Zhiyuan Liu, Lixin Huang, +2 more

    Annual Meeting of the Association for Computational Linguistics (ACL) · 2019

    Empirical results show that DocRED is challenging for existing RE methods, which indicates that document-level RE remains an open problem and requires further efforts.

    616
  • A Dynamic LLM-Powered Agent Network for Task-Oriented Agent Collaboration

    Zijun Liu, Yanzhe Zhang, Peng Li, Yang Liu, Diyi Yang

    arXiv · 2023

    A framework named Dynamic LLM-Agent Network ( DyLAN) is built for LLM-agent collaboration on complicated tasks like reasoning and code generation with reasonable computational cost and an automatic agent team optimization algorithm based on an unsupervised metric termed Agent Importance Score is designed.

    244
  • MAVEN: A Massive General Domain Event Detection Dataset

    Xiaozhi Wang, Ziqi Wang, Xu Han, Wangyi Jiang, Rong Han, Zhiyuan Liu, Juanzi Li, Peng Li, +2 more

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2020

    A MAssive eVENt detection dataset is presented, which contains 4,480 Wikipedia documents, 117,200 event mention instances, and 207 event types and shows that existing ED methods cannot achieve promising results as on the small datasets, which suggests ED in real world remains a challenging task and requires further research efforts.

    232
  • Learning from Context or Names? An Empirical Study on Neural Relation Extraction

    Hao Ming Peng, Tianyu Gao, Xu Han, Yankai Lin, Peng Li, Zhiyuan Liu, Maosong Sun, Jie Zhou

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2020

    An entity-masked contrastive pre-training framework for RE is proposed to gain a deeper understanding on both textual context and type information while avoiding rote memorization of entities or use of superficial cues in mentions.

    229
  • MoEfication: Transformer Feed-forward Layers are Mixtures of Experts

    Zhengyan Zhang, Yankai Lin, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou

    Findings of the Association for Computational Linguistics: ACL 2022 · 2022

    To verify whether functional partitions also emerge in FFNs, it is proposed to convert a model into its MoE version with the same parameters, namely MoEfication, which consists of splitting the parameters of FFNs into multiple functional partitions as experts, and building expert routers to decide which experts will be used for each input.

    214
  • RAP: Robustness-Aware Perturbations for Defending against Backdoor Attacks on NLP Models

    Wenkai Yang, Yankai Lin, Peng Li, Jie Zhou, Xu Sun

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2021

    This work constructs a word-based robustness-aware perturbation to distinguish poisoned samples from clean samples to defend against the backdoor attacks on natural language processing (NLP) models.

    164
  • Adversarial Training for Weakly Supervised Event Detection

    Xiaozhi Wang, Xu Han, Zhiyuan Liu, Maosong Sun, Peng Li

    Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · 2019

    The experiments show that the candidate selection and adversarial training can cooperate together to obtain more diverse and accurate training data for ED, and significantly outperform the state-of-the-art methods in various weakly supervised scenarios.

    157
  • Rethinking Stealthiness of Backdoor Attack against NLP Models

    Wenkai Yang, Yankai Lin, Peng Li, Jie Zhou, Xu Sun

    Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · 2021

    A novel word-based backdoor attacking method based on negative data augmentation and modifying word embeddings is proposed, making an important step towards achieving stealthy backdoor attacking.

    151
  • Hierarchical Relation Extraction with Coarse-to-Fine Grained Attention

    Xu Han, Pengfei Yu, Zhiyuan Liu, Maosong Sun, Peng Li

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2018

    The multiple layers of the hierarchical attention scheme provide coarse-to-fine granularity to better identify valid instances, which is especially effective for extracting those long-tail relations.

    146
  • ERICA: Improving Entity and Relation Understanding for Pre-trained Language Models via Contrastive Learning

    Yujia Qin, Yankai Lin, Ryuichi Takanobu, Zhiyuan Liu, Peng Li, Heng Ji, Minlie Huang, Maosong Sun, +1 more

    Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · 2021

    Experimental results demonstrate that ERICA can improve typical PLMs (BERT and RoBERTa) on several language understanding tasks, including relation extraction, entity typing and question answering, especially under low-resource settings.

    143
  • CLEVE: Contrastive Pre-training for Event Extraction

    Ziqi Wang, Xiaozhi Wang, Xu Han, Yankai Lin, Lei Hou, Zhiyuan Liu, Peng Li, Juanzi Li, +1 more

    Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · 2021

    CLEVE is proposed, a contrastive pre-training framework for EE to better learn event knowledge from large unsupervised data and their semantic structures (e.g. AMR) obtained with automatic parsers.

    133
  • Do Pre-trained Models Benefit Knowledge Graph Completion? A Reliable Evaluation and a Reasonable Approach

    Xin Lv, Yankai Lin, Yixin Cao, Lei Hou, Juanzi Li, Zhiyuan Liu, Peng Li, Jie Zhou

    Findings of the Association for Computational Linguistics: ACL 2022 · 2022

    This work highlights a more accurate evaluation setting under the open-world assumption (OWA), which manual checks the correctness of knowledge that is not in KGs and proposes a novel PLM-based KGC model named PKGC, motivated by prompt tuning.

    130
  • Relation Extraction with Multi-instance Multi-label Convolutional Neural Networks.

    Xiaotian Jiang, Quan Wang, Peng Li, Bin Wang

    International Conference on Computational Linguistics · 2016

    This paper proposes a multi-instance multi-label convolutional neural network for distantly supervised RE, which first relaxes the expressed-at-least-once assumption, and employs cross-sentence max-pooling so as to enable information sharing across different sentences.

    125
  • On Transferability of Prompt Tuning for Natural Language Processing

    Yusheng Su, Xiaozhi Wang, Yujia Qin, Chi-Min Chan, Yankai Lin, Huadong Wang, Kaiyue Wen, Zhiyuan Liu, +5 more

    Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · 2022

    It is found that the overlapping rate of activated neurons strongly reflects the transferability, which suggests how the prompts stimulate PLMs is essential, and that prompt transfer is promising for improving PT.

    122
  • MAVEN-ERE: A Unified Large-scale Dataset for Event Coreference, Temporal, Causal, and Subevent Relation Extraction

    Xiaozhi Wang, Yulin Chen, Ning Ding, Hao Ming Peng, Zimu Wang, Yankai Lin, Xu Han, Lei Hou, +4 more

    arXiv · 2022

    A unified large-scale human-annotated ERE dataset MAVEN-ERE, which contains 103,193 event coreference chains, 1,216,217 temporal relations, 57,992 causal relations, and 15,841 subevent relations, larger than existing datasets of all the ERE tasks by at least an order of magnitude.

    116
  • Multi-Granularity Chinese Word Embedding

    Rongchao Yin, Quan Wang, Peng Li, Rui Li, Bin Wang

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2016

    Quantitative evaluation demonstrates the superiority of MGE in word similarity computation and analogical reasoning, and Qualitative analysis further shows its capability to identify semantic meanings of words.

    106
  • HMEAE: Hierarchical Modular Event Argument Extraction

    Xiaozhi Wang, Ziqi Wang, Xu Han, Zhiyuan Liu, Juanzi Li, Peng Li, Maosong Sun, Jie Zhou, +1 more

    Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · 2019

    A Hierarchical Modular Event Argument Extraction model is proposed, to provide effective inductive bias from the concept hierarchy of event argument roles and significantly outperform the state-of-the-art baselines.

    102
  • Joint topic modeling for event summarization across news and social media streams

    Wei Guang Gao, Peng Li, Kareem Mohamed Darwish

    ACM International Conference on Information and Knowledge Management (CIKM) · 2012

    This paper proposes a novel unsupervised approach based on topic modeling to summarize trending subjects by jointly discovering the representative and complementary information from news and tweets by co-ranking the news sentences and tweets in both sides simultaneously.

    81
  • CascadeBERT: Accelerating Inference of Pre-trained Language Models via Calibrated Complete Models Cascade

    Lei Li, Yankai Lin, Deli Chen, Shuhuai Ren, Peng Li, Jie Zhou, Xu Sun

    Findings of the Association for Computational Linguistics: EMNLP 2021 · 2021

    CascadeBERT is proposed, which dynamically selects proper-sized and complete models in a cascading manner, providing comprehensive representations for predictions, and can achieve an overall 15% improvement under 4$\times speed-up compared with existing dynamic early exiting methods.

    69
  • Knowledge Inheritance for Pre-trained Language Models

    Yujia Qin, Yankai Lin, Yi Jing, Jiajie Zhang, Xu Han, Zhengyan Zhang, Yusheng Su, Zhiyuan Liu, +3 more

    Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · 2022

    A pre-training framework named “knowledge inheritance” (KI) is introduced and how could knowledge distillation serve as auxiliary supervision during pre- training to efficiently learn larger PLMs is explored, demonstrating the superiority of KI in training efficiency.

    66
  • Generating Templates of Entity Summaries with an Entity-Aspect Model and Pattern Mining

    Peng Li, Jing Jiang, Yinglin Wang

    Singapore Management University Institutional Knowledge (InK) (Singapore Management University) · 2010

    A novel approach to automatic generation of summary templates from given collections of summary articles by developing an entity-aspect LDA model that automatically grouping of semantically related sentence patterns and automatic identification of template slots that need to be filled in.

    61
  • Dataset and Neural Recurrent Sequence Labeling Model for Open-Domain Factoid Question Answering

    Peng Li, Wei Li, Zhengyan He, Xuguang Wang, Ying Shan Cao, Jie Zhou, Wei Hong Xu

    arXiv · 2016

    60
  • CodeIE: Large Code Generation Models are Better Few-Shot Information Extractors

    Peng Li, Tianxiang Sun, Qiong Tang, Hang Rui Yan, Yuanbin Wu, Xuanjing Huang, Xipeng Qiu

    Annual Meeting of the Association for Computational Linguistics (ACL) · 2023

    54
  • Key Fact as Pivot: A Two-Stage Model for Low Resource Table-to-Text Generation

    Shuming Ma, Pengcheng Yang, Tianyu Liu, Peng Li, Jie Zhou, Xu Sun

    Annual Meeting of the Association for Computational Linguistics (ACL) · 2019

    A novel model is proposed to separate the generation of table-to-text generation into two stages: key fact prediction and surface realization, which needs much fewer annotated data and can be trained with pseudo parallel corpus.

    50
  • Option Comparison Network for Multiple-choice Reading Comprehension

    Qiu Ran, Peng Li, Weiwei Hu, Jie Zhou

    arXiv · 2019

    46

Show all 93 works

Publication data from OpenAlex, with missing venues and authors filled in from Crossref; citation counts are the higher of OpenAlex and Semantic Scholar, last synced 2026-10-16. One-sentence summaries under some papers are written by Semantic Scholar’s model. Citation counts may be lower than on Google Scholar, which indexes more sources.

Report an error

Wrong papers, two people merged into one, or a profile that should not be here? Tell us and we will fix or hide it.

Sign in to report