Is this you? Claim this profile to correct it, add a bio and choose the work people see first.

Claim this profile

Academic lineage

Possible advisorsa guess from early papers, not confirmed

  • Ralph Grishman

    Possible advisor · last author on 5 of their early first-author papers, 2004–2006

    Suggested from co-authorship

Is this you? Claim this profile to confirm or dismiss it.

Works296 from public data

TitleCited by
  • Executable Code Actions Elicit Better LLM Agents

    Xingyao Wang, Yangyi Chen, Lifan Yuan, Yizhe Zhang, Yunzhu Li, Hao Peng, Heng Ji

    arXiv · 2024

    This work proposes to use executable Python code to consolidate LLM agents' actions into a unified action space (CodeAct), and collects an instruction-tuning dataset CodeActInstruct, which can be used with existing data to improve models in agent-oriented tasks without compromising their general capability.

    699
  • Cross-lingual Name Tagging and Linking for 282 Languages

    Xiaoman Pan, Boliang Zhang, Jonathan May, Joel Nothman, Kevin K. Knight, Heng Ji

    Annual Meeting of the Association for Computational Linguistics (ACL) · 2017

    This work develops a cross-lingual name tagging and linking framework for 282 languages that exist in Wikipedia that is able to identify name mentions, assign a coarse-grained or fine- grained type to each mention, and link it to an English Knowledge Base (KB) if it is linkable.

    595
  • Overview of the TAC 2010 knowledge base population track

    Heng Ji, Ralph Grishman, Hoa Trang Dang, Kira Griffitt, Joe Ellis

    2010

    An overview of the task definition and annotation challenges associated with KBP2010 is provided and the evaluation results and lessons that are learned are discussed based on detailed analysis.

    583
  • Efficient Attentions for Long Document Summarization

    Luyang Huang, Shuyang Cao, Nikolaus Nova Parulian, Heng Ji, Lu Wang

    Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · 2021

    Hepos, a novel efficient encoder-decoder attention with head-wise positional strides to effectively pinpoint salient information from the source is proposed, able to process ten times more tokens than existing models that use full attentions.

    488
  • Tool Learning with Foundation Models

    Yujia Qin, Shengding Hu, Yankai Lin, Weize Chen, Ning Ding, Ganqu Cui, Zheni Zeng, Xuanhe Zhou, +22 more

    ACM Computing Surveys · 2024

    A systematic investigation and comprehensive review of tool learning and discusses several open problems that require further investigation, such as ensuring trustworthy tool use, enabling tool creation with foundation models, and addressing personalization challenges.

    471
  • Large Language Models on Graphs: A Comprehensive Survey

    Bowen Jin, Gang Liu, Chi Han, Meng Jiang, Heng Ji, Jiawei Han

    IEEE Transactions on Knowledge and Data Engineering · 2024

    A systematic review of scenarios and techniques related to large language models on graphs, including LLM as Predictor, LLM as Encoder, and LLM as Aligner, and compare the advantages and disadvantages of different schools of models is provided.

    367
  • Training Software Engineering Agents and Verifiers with SWE-Gym

    Jiayi Pan, Xingyao Wang, Graham Neubig, Navdeep Jaitly, Heng Ji, Alane Suhr, Yizhe Zhang

    arXiv · 2024

    This work presents SWE-Gym, the first environment for training real-world software engineering (SWE) agents, and uses SWE-Gym to train language model based SWE agents, achieving up to 19% absolute gains in resolve rate on the popular SWE-Bench Verified and Lite test sets.

    360
  • A Survey of Knowledge-enhanced Text Generation

    Wenhao Yu, Chenguang Zhu, Zaitang Li, Zhiting Hu, Qingyun Wang, Heng Ji, Meng Jiang

    ACM Computing Surveys · 2022

    A comprehensive review of the research on knowledge-enhanced text generation over the past five years is presented, which includes two parts: (i) general methods and architectures for integrating knowledge into text generation; (ii) specific techniques and applications according to different forms of knowledge data.

    355
  • A Dependency-Based Neural Network for Relation Classification

    Yang Liu, Furu Wei, Sujian Li, Heng Ji, Ming Zhou, Houfeng Wang

    Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 2: Short Papers) · 2015

    A new structure, termed augmented dependency path (ADP), is proposed, which is composed of the shortest dependency path between two entities and the subtrees attached to the shortest path, and a dependency-based neural networks (DepNN) are developed to exploit the semantic representation behind the ADP.

    238
  • Text2Mol: Cross-Modal Molecule Retrieval with Natural Language Queries

    Carl Edwards, ChengXiang Zhai, Heng Ji

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2021

    This work constructs a paired dataset of molecules and their corresponding text descriptions, which it uses to learn an aligned common semantic embedding space for retrieval and extends this to create a cross-modal attention-based model for explainability and reranking by interpreting the attentions as association rules.

    219
  • Text Classification Using Label Names Only: A Language Model Self-Training Approach

    Meng Yu, Yunyi Zhang, Jiaxin Huang, Chenyan Xiong, Heng Ji, Chao Zhang, Jiawei Han

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2020

    This paper uses pre-trained neural language models both as general linguistic knowledge sources for category understanding and as representation learning models for document classification, and achieves around 90% accuracy on four benchmark datasets.

    205
  • Artificial intelligence for science in quantum, atomistic, and continuum systems

    Xuan Zhang, Limei Wang, Jacob Helwig, Youzhi Luo, Cong Fu, Yaochen Xie, Meng Liu, Yuchao Lin, +22 more

    Foundations and Trends® in Machine Learning · 2025

    This work aims to provide a technically thorough account of a subarea of AI4Science; namely, AI for quantum, atomistic, and continuum systems, and provides an in-depth yet intuitive account of techniques to achieve equivariance to symmetry transformations.

    189
  • Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners

    Zhenhailong Wang, Manling Li, Ruochen Xu, Luowei Zhou, Jie Lei, Xudong Lin, Shuohang Wang, Ziyi Yang, +5 more

    arXiv · 2022

    The goal of this work is to build flexible video-language models that can generalize to various video-to-text tasks from few examples, such as domain-specific captioning, question answering, and future event prediction, and to demonstrate the power of language models in understanding videos on a wide variety of video- language tasks.

    175
  • Unlearning Bias in Language Models by Partitioning Gradients

    Charles X. Yu, Sullam Jeoung, Anish Kasi, Pengfei Yu, Heng Ji

    Findings of the Association for Computational Linguistics: ACL 2023 · 2023

    162
  • CLIP-Event: Connecting Text and Images with Event Structures

    Manling Li, Ruochen Xu, Shuohang Wang, Luowei Zhou, Xudong Lin, Chenguang Zhu, Michael Zeng, Heng Ji, +1 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    A contrastive learning framework to enforce vision-language pretraining models to comprehend events and associated argument (participant) roles is proposed, which takes advantage of text information extraction technologies to obtain event structural knowledge, and utilizes multiple prompt functions to contrast difficult negative descriptions by manipulating event structures.

    159
  • Exploring Context and Content Links in Social Media: A Latent Space Method

    Guo-Jun Qi, Charų C. Aggarwal, Qi Tian, Heng Ji, Thomas S. Huang

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2011

    156
  • RM-R1: Reward Modeling as Reasoning

    Xiusi Chen, Guojian Li, Ziqi Wang, Bowen Jin, Cheng Qian, Wang, Yu, Wang, Hongru, Yu Zhang, +4 more

    arXiv · 2025

    It is hypothesized and validated that integrating reasoning into reward modeling significantly enhances RM's interpretability and performance, and a new class of generative reward models, Reasoning Reward Models (ReasRMs), are introduced, which formulate reward modeling as a reasoning task.

    149
  • Open Vocabulary Electroencephalography-to-Text Decoding and Zero-Shot Sentiment Classification

    Zhenhailong Wang, Heng Ji

    Proceedings of the AAAI Conference on Artificial Intelligence · 2022

    It is proposed that the human brain functions as a special text encoder and a novel framework leveraging pre-trained language models (e.g., BART) is proposed, which achieves a 40.1% BLEU-1 score on EEG-To-Text decoding and a 55.6% F1 scoreon zero-shot EEG-based ternary sentiment classification, which significantly outperforms supervised baselines.

    146
  • Mobile-Agent-E: Self-Evolving Mobile Assistant for Complex Tasks

    Zhenhailong Wang, Haiyang Xu, Junyang Wang, Xi Zhang, Ming Yan, Ji Zhang, Fei Huang, Heng Ji

    arXiv · 2025

    This work introduces Mobile-Agent-E, a hierarchical multi-agent framework capable of self-evolution through past experience capable of achieving 22% absolute improvement over previous state-of-the-art approaches across three foundation model backbones.

    145
  • ERICA: Improving Entity and Relation Understanding for Pre-trained Language Models via Contrastive Learning

    Yujia Qin, Yankai Lin, Ryuichi Takanobu, Zhiyuan Liu, Peng Li, Heng Ji, Minlie Huang, Maosong Sun, +1 more

    Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · 2021

    Experimental results demonstrate that ERICA can improve typical PLMs (BERT and RoBERTa) on several language understanding tasks, including relation extraction, entity typing and question answering, especially under low-resource settings.

    143
  • Translation between Molecules and Natural Language

    Carl Edwards, Tuan Lai, Kevin Ros, Garrett Honke, Kyunghyun Cho, Heng Ji

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2022

    139
  • If LLM Is the Wizard, Then Code Is the Wand: A Survey on How Code Empowers Large Language Models to Serve as Intelligent Agents

    Ke Yang, Jiateng Liu, John Wu, Chaoqi Yang, Yi R. Fung, Sha Li, Zixuan Huang, Xu Cao, +4 more

    arXiv · 2024

    An overview of the various benefits of integrating code into LLMs' training data and how these profound capabilities of LLMs, brought by code, have led to their emergence as intelligent agents in situations where the ability to understand instructions, decompose goals, plan and execute actions, and refine from feedback are crucial to their success on downstream tasks are traced.

    133
  • COVID-19 Literature Knowledge Graph Construction and Drug Repurposing Report Generation

    Qingyun Wang, Manling Li, Xuan Wang, Nikolaus Nova Parulian, Guangxing Han, Jiawei Ma, Jingxuan Tu, Ying Lin, +19 more

    Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies: Demonstrations · 2021

    A novel and comprehensive knowledge discovery framework, COVID-KG, to extract fine-grained multimedia knowledge elements (entities, relations and events) from scientific literature and exploit the constructed multimedia knowledge graphs (KGs) for question answering and report generation.

    130
  • A Multi-lingual Multi-task Architecture for Low-resource Sequence Labeling

    Ying Lin, Shengqi Yang, Veselin Stoyanov, Heng Ji

    Annual Meeting of the Association for Computational Linguistics (ACL) · 2018

    A multi-lingual multi-task architecture to develop supervised models with a minimal amount of labeled data for sequence labeling that proves to be particularly effective for low-resource settings, when there are less than 200 training sentences for the target task.

    117
  • Linking Tweets to News: A Framework to Enrich Short Text Data in Social Media

    Weiwei Guo, Hao Li, Heng Ji, Mona Diab

    Annual Meeting of the Association for Computational Linguistics · 2013

    This work proposes a graph based latent variable model that models the inter short text correlations (text-to-text information) and shows that using tweet specific feature and news specific feature as well as temporal constraints, it is able to extract text- to-text correlations, and thus completes the semantic picture of a short text.

    117
  • Overview of TAC-KBP2015 Tri-lingual Entity Discovery and Linking.

    Heng Ji, Joel Nothman, Ben Hachey, Radu Florian

    Theory and applications of categories · 2015

    This new end-to-end Tri-lingual entity discovery and linking task, which requires a system to take raw texts from three languages as input, automatically extract entity mentions, link them to an English knowledge base, and cluster NIL mentions across languages, is given an overview.

    110
  • Graph-based event coreference resolution

    Zheng Chen, Heng Ji

    Proceedings of the 2009 Workshop on Graph-based Methods for Natural Language Processing - TextGraphs-4 · 2009

    This paper models event coreference resolution as a spectral graph clustering problem and evaluates the clustering algorithm on ground truth event mentions using ECM F-Measure and obtains the ECM-F scores of 0.8363 and 0.8312 respectively.

    109
  • CREATOR: Tool Creation for Disentangling Abstract and Concrete Reasoning of Large Language Models

    Cheng Qian, Chi Han, Yi R. Fung, Yujia Qin, Zhiyuan Liu, Heng Ji

    Findings of the Association for Computational Linguistics: EMNLP 2023 · 2023

    The proposed CREATOR, a novel framework that enables LLMs to create their own tools using documentation and code realization, disentangles abstract tool creation and concrete decision execution, resulting in improved performance.

    107
  • Language specific issue and feature exploration in Chinese event extraction

    Zheng Chen, Heng Ji

    Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics, Companion Volume: Short Papers on - NAACL '09 · 2009

    This paper points out a language specific issue in Chinese trigger labeling, and then commits to discussing the contributions of lexical, syntactic and semantic features applied in trigger labeling and argument labeling.

    104
  • Abstract Meaning Representation Guided Graph Encoding and Decoding for Joint Information Extraction

    Zixuan Zhang, Heng Ji

    Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · 2021

    This work proposes a novel AMR-guided framework for joint information extraction to discover entities, relations, and events with the help of a pre-trained AMR parser to convert natural language texts into structured semantic representations.

    103
  • Unsupervised Entity Linking with Abstract Meaning Representation

    Xiaoman Pan, Taylor Cassidy, Ulf Hermjakob, Heng Ji, Kevin K. Knight

    Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · 2015

    Experimental results show that AMR captures contextual properties discriminative enough to make linking decisions, without the need for EL training data, and that system with AMR parsing output outperforms hand labeled traditional semantic roles as context representation for EL.

    99
  • GAIA: A Fine-grained Multimedia Knowledge Extraction System

    Manling Li, Alireza Zareian, Ying Lin, Xiaoman Pan, Spencer Whitehead, Brian Chen, Bo Wu, Heng Ji, +4 more

    Annual Meeting of the Association for Computational Linguistics: System Demonstrations (ACL Demo) · 2020

    The system, GAIA, enables seamless search of complex graph queries, and retrieves multimedia evidence including text, images and videos, and achieves top performance at the recent NIST TAC SM-KBP2019 evaluation.

    98
  • Word Embeddings Are Steers for Language Models

    Chi Han, Jialiang Xu, Manling Li, Yi R. Fung, Chenkai Sun, Nan Jiang, Tarek Abdelzaher, Heng Ji

    Annual Meeting of the Association for Computational Linguistics (ACL) · 2024

    The learned LM-Steer serves as a lens in text styles: it reveals that word embeddings are interpretable when associated with language model generations and can highlight text spans that most indicate the style differences.

    93
  • 93
  • Learning Shared Semantic Space for Speech-to-Text Translation

    Chi Han, Mingxuan Wang, Heng Ji, Lei Li

    Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021 · 2021

    By projecting audio and text features to a common semantic representation, Chimera unifies MT and ST tasks and boosts the performance on ST benchmarks, MuST-C and Augmented Librispeech, to a new state-of-the-art.

    92
  • Connecting the Dots: Event Graph Schema Induction with Path Language Modeling

    Manling Li, Qi Zeng, Ying Lin, Kyunghyun Cho, Heng Ji, Jonathan May, Nathanael Chambers, Clare R. Voss

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2020

    This work proposes a new Event Graph Schema, where two event types are connected through multiple paths involving entities that fill important roles in a coherent story, and introduces Path Language Model, an auto-regressive language model trained on event-event paths, to select salient and coherent paths to probabilistically construct these graph schemas.

    91
  • ReviewRobot: Explainable Paper Review Generation based on Knowledge Synthesis

    Qingyun Wang, Qi Zeng, Lifu Huang, Kevin Knight, Heng Ji, Nazneen Fatema Rajani

    International Conference on Natural Language Generation · 2020

    A novel ReviewRobot is built to automatically assign a review score and write comments for multiple categories such as novelty and meaningful comparison, and can serve as an assistant for paper reviewers, program chairs and authors.

    91
  • From Pixels to Insights: A Survey on Automatic Chart Understanding in the Era of Large Foundation Models

    Kung-Hsiang Huang, Hou Pong Chan, Yi R. Fung, Haoyi Qiu, Mingyang Zhou, Shafiq Joty, Shih‐Fu Chang, Heng Ji

    IEEE Transactions on Knowledge and Data Engineering · 2024

    This survey paper provides a comprehensive overview of the recent developments, challenges, and future directions in chart understanding within the context of large foundation models, and examines various modeling strategies that enhance chart understanding performance.

    89
  • New Tools for Web-Scale N-grams

    Dekang Lin, Kenneth Church, Heng Ji, Satoshi Sekine, David Yarowsky, Shane Bergsma, Kailash Patil, Emily Pitler, +4 more

    Language Resources and Evaluation Conference (LREC) · 2010

    A new set of search tools are described that make use of part-of-speech tags, and collectively lower the barrier for lexical learning and ambiguity resolution at web-scale, which will allow novel sources of information to be applied to long-standing natural language challenges.

    88
  • Aligning LLMs with Individual Preferences via Interaction

    Shujin Wu, May FUNG, Cheng Qian, Jeonghwan Kim, Dilek Z. Hakkani-Tur, Heng Ji

    arXiv · 2024

    This work trains LLMs that can ''interact to align'', essentially cultivating the meta-skill of LLMs to implicitly infer the unspoken personalized preferences of the current user through multi-turn conversations, and then dynamically align their following behaviors and responses to these inferred preferences.

    87
  • Cross-lingual Structure Transfer for Relation and Event Extraction

    Ananya Subburathinam, Di Lu, Heng Ji, Jonathan May, Shih-Fu Chang, Avirup Sil, Clare R. Voss

    Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · 2019

    It is found that language-universal symbolic and distributional representations are complementary for cross-lingual structure transfer, and the event argument role labeling model transferred from English to Chinese achieves similar performance as the model trained from Chinese.

    83
  • Distantly-Supervised Named Entity Recognition with Noise-Robust Learning and Language Model Augmented Self-Training

    Meng Yu, Yunyi Zhang, Jiaxin Huang, Xuan Wang, Yu Zhang, Heng Ji, Jiawei Han

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2021

    A noise-robust learning scheme comprised of a new loss function and a noisy label removal step, for training NER models on distantly-labeled data, and a self-training method that uses contextualized augmentations created by pre-trained language models to improve the generalization ability of the NER model are proposed.

    82
  • PaperRobot: Incremental Draft Generation of Scientific Ideas

    Qingyun Wang, Lifu Huang, Zhiying Jiang, Kevin K. Knight, Heng Ji, Mohit Bansal, Yi Luan

    Annual Meeting of the Association for Computational Linguistics (ACL) · 2019

    A PaperRobot who performs as an automatic research assistant by conducting deep understanding of a large collection of human-written papers in a target domain and constructing comprehensive background knowledge graphs is presented.

    80
  • Neural-Answering Logical Queries on Knowledge Graphs

    Lihui Liu, Boxin Du, Heng Ji, ChengXiang Zhai, Hanghang Tong

    Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining · 2021

    This paper proposes an embedding based method (NewLook), which supports four types of logical operations and can answer queries with multiple variable nodes, and goes beyond the linear transformation assumption and thus consistently outperforms the existing methods.

    79
  • Can LLMs Produce Faithful Explanations For Fact-checking? Towards Faithful Explainable Fact-Checking via Multi-Agent Debate

    Kyungha Kim, Sangyun Lee, Kung-Hsiang Huang, Hou Pong Chan, Manling Li, Heng Ji

    arXiv · 2024

    Experimental results demonstrate that MADR significantly improves the faithfulness of LLM-generated explanations to the evidence, advancing the credibility and trustworthiness of these explanations.

    77
  • InfoSurgeon: Cross-Media Fine-grained Information Consistency Checking for Fake News Detection

    Yi R. Fung, Christopher Thomas, Revanth Gangi Reddy, Sandeep Polisetty, Heng Ji, Shih‐Fu Chang, Kathleen R. McKeown, Mohit Bansal, +1 more

    Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · 2021

    This work contributes a novel benchmark for fake news detection at the knowledge element level, as well as a solution for this task which incorporates cross-media consistency checking to detect the fine-grained knowledge elements making news articles misinformative.

    77
  • OpenHands: An Open Platform for AI Software Developers as Generalist Agents

    Xingyao Wang, Boxuan Li, Yufan Song, Frank F. Xu, Xiangru Tang, Mingchen Zhuge, Jiayi Pan, Yueqi Song, +16 more

    arXiv · 2024

    76
  • The Future is not One-dimensional: Complex Event Schema Induction by Graph Modeling for Event Prediction

    Manling Li, Sha Li, Zhenhailong Wang, Lifu Huang, Kyunghyun Cho, Heng Ji, Jiawei Han, Clare R. Voss

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2021

    A new concept of Temporal Complex Event Schema is introduced: a graph-based schema representation that encompasses events, arguments, temporal connections and argument relations and a Temporal Event Graph Model that predicts event instances following the temporal complex event schema is proposed.

    74
  • Joint Biomedical Entity and Relation Extraction with Knowledge-Enhanced Collective Inference

    Tuan Lai, Heng Ji, ChengXiang Zhai, Quan Hung Tran

    Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · 2021

    KECI takes a collective approach to link mention spans to entities by integrating global relational information into local representations using graph convolutional networks and fuses the initial span graph and the knowledge graph into a more refined graph using an attention mechanism.

    73
  • A Pairwise Event Coreference Model, Feature Impact and Evaluation for Event Coreference Resolution

    Zheng Chen, Heng Ji, Robert M. Haralick

    2009

    The problem of event coreference resolution in the ACE program is formally state, an agglomerative clustering algorithm for the task is presented, the feature impact in theevent coreference model is explored, and three evaluation metrics that were previously adopted in entity coreferenceresolution are compared.

    73
  • CUNY-BLENDER TAC-KBP2010 Entity Linking and Slot Filling System Description

    Zheng Chen, Suzanne R Tamang, Adam J. Lee, Xiang Li, Wen-Pin Lin, Matthew Snover, Javier Artiles, Marissa Passantino, +1 more

    Theory and applications of categories · 2010

    In the KBP2010 evaluation, the CUNY-BLENDER entity linking system explored the slot filling attributes that may potentially help disambiguate entity mentions and results show that this feedback approach can achieve 9.1% absolute improvement on micro-average accuracy over the baseline using vector space model.

    70
  • Do LVLMs Understand Charts? Analyzing and Correcting Factual Errors in Chart Captioning

    Kung-Hsiang Huang, Mingyang Zhou, Hou Pong Chan, Yi R. Fung, Zhenhailong Wang, Lingyu Zhang, Shih‐Fu Chang, Heng Ji

    arXiv · 2023

    A new task of Chart Caption Factual Error Correction is established and CHARTVE, a model for visual entailment that outperforms proprietary and open-source LVLMs in evaluating factual consistency is introduced, and an interpretable two-stage framework that excels at correcting factual errors is proposed.

    69
  • Expertise-Aware Truth Analysis and Task Allocation in Mobile Crowdsourcing

    Xiaomei Zhang, Yibo Wu, Lifu Huang, Heng Ji, Guohong Cao

    IEEE Transactions on Mobile Computing · 2019

    68
  • Semi-supervised New Event Type Induction and Event Detection

    Lifu Huang, Heng Ji

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2020

    A Semi-Supervised Vector Quantized Variational Autoencoder framework is designed to automatically learn a discrete latent type representation for each seen and unseen type and optimize them using seen type event annotations.

    65
  • A Survey on Post-training of Large Language Models

    Guiyao Tie, Zhao, Zeli, Song, Dingjie, Wei, Fuyang, Rong Ping Zhou, Yi Dai, Yin, Wen, Yang, Zhejian, +18 more

    arXiv · 2025

    This paper presents the first comprehensive survey of PoLMs, systematically tracing their evolution across five core paradigms: Fine-tuning, which enhances task-specific accuracy; Alignment, which ensures ethical coherence and alignment with human preferences; Reasoning, which advances multi-step inference despite challenges in reward design; Efficiency, which optimizes resource utilization amidst increasing complexity; Integration and Adaptation, which extend capabilities across diverse modalities while addressing coherence issues.

    59
  • Near-imperceptible Neural Linguistic Steganography via Self-Adjusting Arithmetic Coding

    Jiaming Shen, Heng Ji, Jiawei Han

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2020

    A new linguistic steganography method which encodes secret messages using self-adjusting arithmetic coding based on a neural language model which outperforms the previous state-of-the-art methods on four datasets by 15.3% and 38.9% in terms of bits/word and KL metrics, respectively.

    59
  • Collective Tweet Wikification based on Semi-supervised Graph Regularization

    Hongzhao Huang, Yunbo Cao, Xiaojiang Huang, Heng Ji, Chin-Yew Lin

    Annual Meeting of the Association for Computational Linguistics (ACL) · 2014

    A novel semi-supervised graph regularization model is proposed to incorporate both local and global evidence from multiple tweets through three fine-grained relations in order to identify semanticallyrelated mentions for collective inference.

    59
  • Code4Struct: Code Generation for Few-Shot Event Structure Prediction

    Xingyao Wang, Sha Li, Heng Ji

    arXiv · 2022

    This work proposes C ODE 4S TRUCT to leverage text-to-structure translation capability to tackle structured prediction tasks in NLP, and uses C ODE 4S TRUCT to tackle the EAE task us-ing code generation.

    58
  • Joint bilingual name tagging for parallel corpora

    Qi Li, Haibo Li, Heng Ji, Wen Wang, Jing Wen Zheng, Fei Huang

    ACM International Conference on Information and Knowledge Management (CIKM) · 2012

    Two novel approaches to jointly and consistently extract names from parallel corpora using standard linear-chain Conditional Random Fields as the learning framework, incorporating cross-lingual features propagated between two languages are proposed.

    58
  • Speech segmentation and spoken document processing

    Mari Ostendorf, Benoît Favre, Ralph Grishman, Dilek Zeynep Hakkani-Tür, Mary P. Harper, Dustin Hillard, Julia Hirschberg, Heng Ji, +9 more

    IEEE Signal Processing Magazine · 2008

    Different levels of speech segmentation, approaches to automatically recovering segment boundary locations, and experimental results demonstrating impact on several language processing tasks show a need for optimizing segmentation for the end task rather than independently.

    57
  • The Science of Precision Prevention

    Thomas A. Pearson, Debbie Vitalis, CHARLOTTE A. PRATT, Rebecca Campo, Antonis A. Armoundas, David H. Au, Bettina M. Beech, Olga Brazhnik, +20 more

    JACC Advances · 2023

    This state-of-the-art review is based on a workshop convened to identify current gaps in knowledge and methods used in precision prevention intervention research, discuss opportunities to expand trials of implementation science to close the health equity gaps, and expand the education and training of a diverse precision prevention workforce.

    55
  • Overview of TAC-KBP2017 13 Languages Entity Discovery and Linking.

    Heng Ji, Xiaoman Pan, Boliang Zhang, Joel Nothman, James Mayfield, Paul McNamee, Cash J. Costello

    Theory and applications of categories · 2017

    An overview of the Tri-lingual Entity Discovery and Linking task at the Knowledge Base Population (KBP) track at TAC2017, and of the Ten Low Resource Language EDL Pilot is given.

    55
  • Gender and Animacy Knowledge Discovery from Web-Scale N-Grams for Unsupervised Person Mention Detection

    Heng Ji, Dekang Lin

    Institutional Repositories DataBase (IRDB) · 2009

    A simple approach to discover gender and animacy knowledge for person mention detection by learning noun-gender and noun-animacy pair counts from web-scale n-grams using specific lexical patterns and applying confidence estimation metrics to filter noise.

    54
  • Using semantic relations to refine coreference decisions

    Heng Ji, David Westbrook, Ralph Grishman

    Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing - HLT '05 · 2005

    A novel mechanism for improving reference resolution by using the output of a relation tagger to rescore coreference hypotheses is presented, which can improve performance on two quite different languages - English and Chinese.

    54
  • Deep Learning on Graphs for Natural Language Processing

    Lingfei Wu, Yu Chen, Heng Ji, Bang Liu

    International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · 2021

    This tutorial will cover relevant and interesting topics on applying deep learning on graph techniques to NLP, including automatic graph construction for NLP), graph representation learning for N LP, advanced GNN based models (e.g., graph2seq, graph2tree, and graph2graph) for NLS, and the applications of GNNs in various NLP tasks.

    51
  • An Attentive Fine-Grained Entity Typing Model with Latent Type Representation

    Ying Lin, Heng Ji

    Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · 2019

    A fine-grained entity typing model with a novel attention mechanism and a hybrid type classifier, which predicts a low-dimensional vector that encodes latent type features and reconstructs the type vector from this latent representation.

    48
  • LEMMA: Towards LVLM-Enhanced Multimodal Misinformation Detection with External Knowledge Augmentation

    Keyang Xuan, Yi Li, Fan Yang, Ruochen Wu, Yi R. Fung, Heng Ji

    arXiv · 2024

    This paper proposes LEMMA: LVLM-Enhanced Multimodal Misinformation Detection with External Knowledge Augmentation, which leverages LVLM intuition and reasoning capabilities while augmenting them with external knowledge to enhance the accuracy of misinformation detection.

    46
  • Analysis and Enhancement of Wikification for Microblogs with Context Expansion

    Taylor Cassidy, Heng Ji, Lev-Arie Ratinov, Arkaitz Zubiaga, Hongzhao Huang

    International Conference on Computational Linguistics · 2012

    This work evaluates an existing Twitter dataset as well as the D2W task in general and test the effects of two tweet context expansion methods, based on tweet authorship and topic-based clustering, on a state-of-the-art D1W system and evaluates the results.

    44
  • Understanding Emergent In-Context Learning from a Kernel Regression Perspective

    Chi Han, Ziqi Wang, Han Zhao, Heng Ji

    arXiv · 2023

    This paper investigates the reason why a transformer-based language model can accomplish in- Context learning after pre-training on a general language corpus by proposing one hypothesis that LLMs can simulate kernel regression algorithms when faced with in-context examples and empirically investigates the in- context behaviors of language models.

    43
  • ADEPT: A DEbiasing PrompT Framework

    Yang, Ke, Charles X. Yu, Yi R. Fung, Manling Li, Heng Ji

    arXiv · 2022

    ADEPT is proposed, a method to debias PLMs using prompt tuning while maintaining the delicate balance between removing biases and ensuring representation ability, and achieves competitive results while maintaining (and in some cases even improving) the PLM's representation ability.

    43
  • Improving name tagging by reference resolution and relation detection

    Heng Ji, Ralph Grishman

    Annual Meeting of the Association for Computational Linguistics (ACL) · 2005

    This work uses an N-best approach to generate multiple hypotheses and have them re-ranked by subsequent stages of processing to reduce the errors produced by a Chinese name tagger.

    43
  • KompaRe: A Knowledge Graph Comparative Reasoning System

    Lihui Liu, Boxin Du, Yi R. Fung, Heng Ji, Jiejun Xu, Hanghang Tong

    Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining · 2021

    This paper develops KompaRe, the first of its kind prototype system that provides comparative reasoning capability over large knowledge graphs, and presents both the system architecture and its core algorithms, including knowledge segment extraction, pairwise reasoning and collective reasoning.

    42
  • Cross-document Misinformation Detection based on Event Graph Reasoning

    Xueqing Wu, Kung-Hsiang Huang, Yi R. Fung, Heng Ji

    Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · 2022

    A graph-based detector that constructs a cross- document knowledge graph using cross-document event coreference resolution and employs a heterogeneous graph neural network to conduct detection at two levels of misinformation detection, which significantly outperforms existing methods on this new task.

    41
  • Separating Skills and Concepts for Novel Visual Question Answering

    Spencer Whitehead, Hui Wu, Heng Ji, Rogério Feris, Kate Saenko

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2021

    This work presents a novel method for learning to compose skills and concepts that separates these two factors implicitly within a model by learning grounded concept representations and disentangling the encoding of skills from that of concepts.

    40
  • Discovery with Data: Leveraging Statistics with Computer Science to Transform Science and Society

    Cynthia D Rudin, David B. Dunson, Rafael A. Irizarry, Heng Ji, Eric B. Laber, Jeffrey T. Leek, Tyler H. McCormick, Sherri Rose, +4 more

    2014

    40
  • Toward Generalizable Evaluation in the LLM Era: A Survey Beyond Benchmarks

    Yixin Cao, Shibo Hong, Xinze Li, Jiahao Ying, Ma, Yubo, Haiyuan Liang, Yantao Liu, Zijun Yao, +19 more

    arXiv · 2025

    This survey probes the core challenges that the rise of LLMs poses for evaluation, and identifies and analyzes two pivotal transitions: from task-specific to capability-based evaluation and from manual to automated evaluation.

    39
  • Faking Fake News for Real Fake News Detection: Propaganda-Loaded Training Data Generation

    Kung-Hsiang Huang, Kathleen R. McKeown, Preslav Nakov, Yejin Choi, Heng Ji

    Annual Meeting of the Association for Computational Linguistics (ACL) · 2023

    38
  • Graph-Based Clustering for Computational Linguistics: A Survey

    Zheng Chen, Heng Ji

    TextGraphs@ACL · 2010

    This survey overviews graph-based clustering and its applications in computational linguistics as a five-part story: hypothesis, modeling, measure, algorithm and evaluation, and envision that graph- based clustering is a promising solution for some emerging NLP problems.

    38
  • Social-Group-Agnostic Bias Mitigation via the Stereotype Content Model

    Ali Omrani, Alireza S. Ziabari, Charles Yu, Preni Golazizian, Brendan Kennedy, Mohammad Atari, Heng Ji, Morteza Dehghani

    Annual Meeting of the Association for Computational Linguistics (ACL) · 2023

    37
  • MuMuQA: Multimedia Multi-Hop News Question Answering via Cross-Media Knowledge Extraction and Grounding

    Revanth Gangi Reddy, Xilin Rui, Manling Li, Xudong Lin, Haoyang Wen, Jaemin Cho, Lifu Huang, Mohit Bansal, +4 more

    Proceedings of the AAAI Conference on Artificial Intelligence · 2022

    A new QA evaluation benchmark with 1,384 questions over news articles that require cross- media grounding of objects in images onto text, and introduces a novel multimedia data augmentation framework, based on cross-media knowledge extraction and synthetic question-answer generation, to automatically augment data that can provide weak supervision for this task.

    37
  • NewsClaims: A New Benchmark for Claim Detection from News with Attribute Knowledge

    Revanth Gangi Reddy, Sai Chetan Chinthakindi, Zhenhailong Wang, Yi R. Fung, Kathryn Conger, Ahmed ELsayed, Martha Stone Palmer, Preslav Nakov, +3 more

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2022

    This work extends the claim detection problem to include extraction of additional attributes related to each claim and releases 889 claims annotated over 143 news articles, seeing that zero-shot and prompt-based baselines show promising performance on this benchmark, while still considerably behind human performance.

    37
  • Fine-grained Information Extraction from Biomedical Literature based on Knowledge-enriched Abstract Meaning Representation

    Zixuan Zhang, Nikolaus Nova Parulian, Heng Ji, Ahmed Elsayed, Skatje Myers, Martha Stone Palmer

    Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · 2021

    A novel biomedical Information Extraction (IE) model to tackle two challenges and extract scientific entities and events from English research papers, and performs Abstract Meaning Representation (AMR) to compress the wide context to uncover a clear semantic structure for each complex sentence.

    37
  • Syntax-aware Multi-task Graph Convolutional Networks for Biomedical Relation Extraction

    Diya Li, Heng Ji

    International Workshop on Health Text Mining and Information Analysis (LOUHI) · 2019

    A novel graph convolutional networks model is proposed that incorporates dependency parsing and contextualized embedding to effectively capture comprehensive contextual information in biomedical relation extraction.

    37
  • Open-Domain Multi-Document Summarization via Information Extraction: Challenges and Prospects

    Heng Ji, Benoît Favre, Wen-Pin Lin, Dan Gillick, Dilek Z. Hakkani-Tur, Ralph Grishman

    Theory and applications of natural language processing · 2012

    Novel approaches to taking advantage of cross-document IE for multi-document summarization are explored and one of them, re-ranking the output of a high performing summarization system with IE-informed metrics, leads to improvements in both manually-evaluated content quality and readability.

    37
  • Who, what, when, where, why?: comparing multiple approaches to the cross-lingual 5W task

    Kristen Parton, Adam Meyers, Sara Stolbach, Ang Sun, Gökhan Tür, Wei Hong Xu, Sibel Yaman, Kathleen R. McKeown, +7 more

    Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 1 - ACL-IJCNLP '09 · 2009

    An error analysis of a new cross-lingual task: the 5W task, a sentence-level understanding task which seeks to return the English 5W's corresponding to a Chinese sentence, which shows that MT significantly degrades sentence- level understanding.

    37
  • Acting Less is Reasoning More! Teaching Model to Act Efficiently

    Hongru Wang, Qian Cheng, Wanjun Zhong, Xiusi Chen, Qiu, Jiahao, Shijue Huang, Jin, Bowen, Mengdi Wang, +2 more

    arXiv · 2025

    This work proposes Optimal Tool Call-controlled Policy Optimization (OTC-PO), a simple yet effective RL-based framework that encourages models to produce accurate answers with minimal tool calls and is the first RL-based framework that explicitly optimizes tool-use efficiency in TIR 1.

    36
  • BERT might be Overkill: A Tiny but Effective Biomedical Entity Linker based on Residual Convolutional Neural Networks

    Tuan Lai, Heng Ji, ChengXiang Zhai

    Findings of the Association for Computational Linguistics: EMNLP 2021 · 2021

    This work proposes an efficient convolutional neural network with residual connections for biomedical entity linking that achieves comparable or even better linking accuracy than the state-of-the-art BERT-based models while having about 60 times fewer parameters.

    36
  • Tweet Ranking Based on Heterogeneous Networks

    Hongzhao Huang, Arkaitz Zubiaga, Heng Ji, Hongbo Deng, Dong Wang, Hieu Le, Tarek Abdelzaher, Jiawei Han, +3 more

    International Conference on Computational Linguistics · 2012

    This paper introduces Tri-HITS, a model to iteratively propagate ranking scores across heterogeneous networks and shows that integrating both formal genre and inferred social networks with tweet networks produces a higher-quality ranking than the tweet networks alone.

    36
  • CUNY-UIUC-SRI TAC-KBP2011 Entity Linking System Description

    Taylor Cassidy, Zheng Chen, Javier Artiles, Heng Ji, Hongbo Deng, Lev-Arie Ratinov, Jiawei Han, Dan Roth, +1 more

    Theory and applications of categories · 2011

    This paper describes a joint effort by the City University of New York (CUNY), University of Illinois at Urbana-Champaign (UIUC) and SRI International at participating in the mono-lingual entity linking (MLEL) and cross-lingUAL entities linking (CLEL) tasks for the NIST Text Analysis Conference (TAC) Knowledge Base Population (KBP2011) track.

    36
  • MultiAgentBench : Evaluating the Collaboration and Competition of LLM agents

    Kunlun Zhu, Hongyi Du, Zhaochen Hong, Xiaocheng Yang, Shuyi Guo, Zhe Wang, Zhihua Wang, Cheng Qian, +3 more

    Annual Meeting of the Association for Computational Linguistics (ACL) · 2025

    35
  • Corpus-based Open-Domain Event Type Induction

    Jiaming Shen, Yunyi Zhang, Heng Ji, Jiawei Han

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2021

    This work presents a corpus-based open-domain event type induction method that automatically discovers a set of event types from a given corpus by selecting salient predicates and object heads, and obtains event types by jointly embedding and clustering pairs in a latent spherical space.

    35
  • Joint Multimedia Event Extraction from Video and Article

    Brian Chen, Xudong Lin, Christopher Thomas, Manling Li, Shoya Yoshida, Lovish Chum, Heng Ji, Shih‐Fu Chang

    Findings of the Association for Computational Linguistics: EMNLP 2021 · 2021

    This work introduces the new task of Video MultiMedia Event Extraction (Video M2E2) and proposes the first self-supervised multimodal event coreference model that can determine coreference between video events and text events without any manually annotated pairs and introduces the first multimodals transformer which extracts structured event information jointly from both videos and text documents.

    35
  • Controllable and Diverse Text Generation in E-commerce

    Huajie Shao, Jun Wang, Haohong Lin, Xuezhou Zhang, Aston Zhang, Heng Ji, Tarek Abdelzaher

    Proceedings of the Web Conference 2021 · 2021

    A fine-grained controllable generative model that uses an algorithm borrowed from automatic control to precisely manipulate the diversity/accuracy trade-off of generated text and outperforms existing generative models in terms of diversity and relevance.

    35
  • The Gun Violence Database: A new task and data set for NLP

    Ellie Pavlick, Heng Ji, Xiaoman Pan, Chris Callison-Burch

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2016

    A new and growing dataset, the Gun Violence Database, is introduced in order to facilitate the adaptation of current NLP technologies to the domain of gun violence, thus enabling better social science research on this important and under-resourced problem.

    35
  • ChemReasoner: Heuristic Search over a Large Language Model's Knowledge Space using Quantum-Chemical Feedback

    Henry W. Sprueill, Edwards, Carl, Khushbu Agarwal, Mariefel V. Olarte, Udishnu Sanyal, Conrad S.N. Johnston, Hongbin Liu, Heng Ji, +1 more

    arXiv · 2024

    This work introduces an AI-guided computational screening framework unifying linguistic reasoning with quantum-chemistry based feedback from 3D atomistic representations, and pioneers AI-accelerated, trustworthy catalyst discovery.

    34
  • Genre Separation Network with Adversarial Training for Cross-genre Relation Extraction

    Ge Shi, Chong Feng, Lifu Huang, Boliang Zhang, Heng Ji, Lejian Liao, Heyan Huang

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2018

    A genre-separation network is designed, which applies two encoders, one genre-independent and onegenre-shared, to explicitly extract genre-specific and genre-agnostic features, and which outperforms the state-of-the-art by 1.7% absolute F1 gain.

    34
  • Mining Name Translations from Comparable Corpora by Creating Bilingual Information Networks.

    Heng Ji

    BUCC@ACL/IJCNLP · 2011

    A novel approach to acquire name translation pairs in a bootstrapping framework is designed and the experimental results show this approach can generate highly accurate nametranslation pairs for persons, geopolitical and organization entities.

    32
  • KEBLM: Knowledge-Enhanced Biomedical Language Models

    Tuan Lai, ChengXiang Zhai, Heng Ji

    Journal of Biomedical Informatics · 2023

    This work proposes a general framework for incorporating various types of domain knowledge from multiple sources into biomedical PLMs and shows that the proposed framework consistently improves the performance of the underlying PLMs on various downstream tasks such as natural language inference, question answering, and entity linking.

    30
  • A Context-Dependent Gated Module for Incorporating Symbolic Semantics into Event Coreference Resolution

    Tuan Lai, Heng Ji, Trung Bui, Quan Hung Tran, Franck Dernoncourt, Walter Hong‐Shong Chang

    Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · 2021

    A novel context-dependent gated module to adaptively control the information flows from the input symbolic features and achieve state-of-the-art results on two datasets: ACE 2005 and KBP 2016.

    30
  • Improving Question Answering with External Knowledge

    Xiaoman Pan, Kai Sun, Dian Yu, Jianshu Chen, Heng Ji, Claire Cardie, Dong Yu

    arXiv · 2019

    30
  • Overview of TAC-KBP2016 Tri-lingual EDL and Its Impact on End-to-End KBP.

    Heng Ji, Joel Nothman

    Theory and applications of categories · 2016

    An overview of the Tri-lingual Entity Discovery and Linking task at the Knowledge Base Population (KBP) track at TAC2016 is given and several new and effective research directions including cross-lingUAL knowledge transfer and exploiting language-specific resources are summarized.

    30
  • What should I Ask: A Knowledge-driven Approach for Follow-up Questions Generation in Conversational Surveys

    Yubin Ge, Ziang Xiao, Jana Diesner, Heng Ji, Karrie G. Karahalios, Hari Sundaram

    arXiv · 2022

    This paper constructed a new human-annotated dataset of human-written follow-up questions with dialogue history and labeled knowledge in the context of conversational surveys and proposes a two-staged knowledge-driven model for the task, which generates informative and coherent follow- up questions by using knowledge to steer the generation process.

    29
  • IMPACT OF AUTOMATIC COMMA PREDICTION ON POS/NAME TAGGING OF SPEECH

    Dustin Hillard, Zhou Huang, Heng Ji, Ralph Grishman, Dilek Zeynep Hakkani-Tür, Mary P. Harper, Mari Ostendorf, W. Wang

    IEEE Spoken Language Technology Workshop (SLT) · 2006

    29
  • Towards Fast Adaptation of Pretrained Contrastive Models for Multi-channel Video-Language Retrieval

    Xudong Lin, Simran Tiwari, Shiyuan Huang, Manling Li, Mike Zheng Shou, Heng Ji, Shih‐Fu Chang

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023

    It is found that discrete text tokens coupled with a pretrained contrastive text model yields the best performance, which can even outperform state-of-the-art on the iVQA and How2QA datasets without additional training on millions of video-text data.

    28
  • Event Schema Induction with Double Graph Autoencoders

    Xiaomeng Jin, Manling Li, Heng Ji

    Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · 2022

    This work proposes a new event schema induction framework using double graph autoencoders, which captures the global dependencies among nodes in event graphs and induces high-quality event schemas with global consistency.

    28
  • Improving Slot Filling Performance with Attentive Neural Networks on Dependency Structures

    Lifu Huang, Avirup Sil, Heng Ji, Radu Florian

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2017

    This paper proposes an effective DNN architecture for SF with the following new strategies: take a regularized dependency graph instead of a raw sentence as input to DNN, to compress the wide contexts between query and candidate filler.

    28
  • Harnessing web page directories for large-scale classification of tweets

    Arkaitz Zubiaga, Heng Ji

    International World Wide Web Conference (WWW) · 2013

    This paper introduces an inexpensive way of labeling large sets of tweets, which can be easily regenerated or updated when needed, and uses human-edited web page directories to infer categories from URLs contained in tweets.

    28
  • Combining Social Cognitive Theories with Linguistic Features for Multi-genre Sentiment Analysis

    Hao Li, Yu Chen, Heng Ji, Smaranda Muresan, Dequan Zheng

    Institutional Repositories DataBase (IRDB) · 2012

    This paper combines local linguistic features and global social evidence in a propagation scheme to improve sentiment analysis results and obtains significant improvement for various genres in the domain of presidential election.

    28
  • Enhanced Chart Understanding via Visual Language Pre-training on Plot Table Pairs

    Mingyang Zhou, Yi R. Fung, Long Chen, Christopher Thomas, Heng Ji, Shih‐Fu Chang

    Findings of the Association for Computational Linguistics: ACL 2023 · 2023

    27
  • Two-Stage Hashing for Fast Document Retrieval

    Hao Li, Wei Liu, Heng Ji

    Annual Meeting of the Association for Computational Linguistics (ACL) · 2014

    A two-stage unsupervised hashing framework which harmoniously integrates two state-of-theart hashing algorithms Locality Sensitive Hashing and Iterative Quantization is proposed, which capitalizes on both term and topic similarity among documents, leading to precise document retrieval.

    27
  • Unsupervised Language-Independent Name Translation Mining from Wikipedia Infoboxes

    Wen-Pin Lin, Matthew Snover, Heng Ji

    Empirical Methods in Natural Language Processing · 2011

    This paper describes an unsupervised and language-independent approach to mine name translation pairs from entity profiles, using Wikipedia Infoboxes as a stand-in for high quality entity profile extraction.

    26
  • Re-ranking algorithms for name tagging

    Heng Ji, Cynthia D Rudin, Ralph Grishman

    Proceedings of the Workshop on Computationally Hard Problems and Joint Inference in Speech and Language Processing - CHSLP '06 · 2006

    It is demonstrated how re-ranking can improve name tagging in a Chinese information extraction system by incorporating information from relation extraction, event extraction, and coreference.

    26
  • SynerGPT: In-Context Learning for Personalized Drug Synergy Prediction and Drug Design

    Carl Edwards, Aakanksha Naik, Tushar Khot, Martin D. Burke, Heng Ji, Tom Hope

    bioRxiv (Cold Spring Harbor Laboratory) · 2023

    A novel setting and models for in-context drug synergy learning are proposed, inspired by recent work that pre-trains a GPT language model (LM) to “in-context learn” common function classes, and novel pre-training schemes that enable a G PT model to in- context learn “drug synergy functions” are devised.

    25
  • Improving Candidate Retrieval with Entity Profile Generation for Wikidata Entity Linking

    Tuan Lai, Heng Ji, ChengXiang Zhai

    Findings of the Association for Computational Linguistics: ACL 2022 · 2022

    This work proposes a novel candidate retrieval paradigm based on entity profiling that complements the traditional approach of using a Wikipedia anchor-text dictionary, enabling it to further design a highly effective hybrid method for candidate retrieval.

    25
  • EventCube

    Fangbo Tao, Kin Hou Lei, Jiawei Han, ChengXiang Zhai, Xiao Cheng, Marina Danilevsky, Nihit Desai, Bolin Ding, +14 more

    ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD) · 2013

    This proposed EventCube demo will show the power of the system not only on the originally designed ASRS (Aviation Safety Report System) data sets, but also on news datasets collected from multiple news agencies, and academic datasets constructed from the DBLP and web data.

    25
  • Enhancing Multi-Document Summarization with Cross-Document Graph-based Information Extraction

    Zixuan Zhang, Heba Elfardy, Markus Dreyer, Kevin Small, Heng Ji, Mohit Bansal

    Conference of the European Chapter of the Association for Computational Linguistics · 2023

    This work focuses on improving Multi-Document Summarization (MDS) performance by using cross-document IE output, incorporating two novel components: the use of auxiliary entity and event recognition systems to focus the summary generation model and incorporating an alignment loss between IE nodes and their text spans to reduce inconsistencies between the IE graphs and text representations.

    24
  • The Battlefront of Combating Misinformation and Coping with Media Bias

    Yi R. Fung, Kung-Hsiang Huang, Preslav Nakov, Heng Ji

    ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · 2022

    This tutorial dives into the important research questions of how to develop a robust fake news detection system, which not only fact-check information pieces provable by background knowledge but also reason about the consistency and the reliability of subtle details for emerging events.

    24
  • Logical Entity Representation in Knowledge-Graphs for Differentiable Rule Learning

    Chi Han, Qizheng He, Charles X. Yu, Xinya Du, Hanghang Tong, Heng Ji

    arXiv · 2023

    Empirical results demonstrate that the proposed Logical Entity RePresentation (LERP) model outperforms other rule learning methods in knowledge graph completion and is comparable or even superior to state-of-the-art black-box methods.

    23
  • CONCRETE: Improving Cross-lingual Fact-checking with Cross-lingual Retrieval

    Kung-Hsiang Huang, ChengXiang Zhai, Heng Ji

    arXiv · 2022

    The proposed Cross-lingual Inverse Cloze Task (X-ICT), a self-supervised algorithm that creates training instances by translating the title of a passage, is presented, a first fact-checking framework augmented with cross-lingually retrieval that aggregates evidence retrieved from multiple languages through a cross-lingsual retriever.

    23
  • EA2E: Improving Consistency with Event Awareness for Document-Level Argument Extraction

    Qi Zeng, Qiusi Zhan, Heng Ji

    Findings of the Association for Computational Linguistics: NAACL · 2022

    23
  • Event Time Extraction and Propagation via Graph Attention Networks

    Haoyang Wen, Yanru Qu, Heng Ji, Qiang Ning, Jiawei Han, Avi Sil, Hanghang Tong, Dan Roth

    Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · 2021

    This paper first formulates this problem based on a 4-tuple temporal representation used in entity slot filling, which allows us to represent fuzzy time spans more conveniently, and proposes a graph attention network-based approach to propagate temporal information over document-level event graphs constructed by shared entity arguments and temporal relations.

    23
  • Cross-lingual predicate cluster acquisition to improve bilingual event extraction by inductive learning

    Heng Ji

    Proceedings of the Workshop on Unsupervised and Minimally Supervised Learning of Lexical Semantics - UMSLLS '09 · 2009

    A new inductive learning framework is proposed to automatically augment background data for low-confidence events and then conduct global inference and obtained significant improvement over a state-of-the-art bilingual (English and Chinese) event extraction system.

    23
  • Enhanced Knowledge Selection for Grounded Dialogues via Document Semantic Graphs

    Sha Li, Namazifar, Mahdi, Di Jin, Mohit Bansal, Heng Ji, Yang Liu, Dilek Zeynep Hakkani-Tür

    arXiv · 2022

    This work proposes to automatically convert the background knowledge documents into document semantic graphs and then perform knowledge selection over such graphs to preserve sentence-level information through the use of sentence nodes and provide concept connections between sentences.

    22
  • Identifying and Tracking Sentiments and Topics from Social Media Texts during Natural Disasters

    Min Yang, Jincheng Mei, Heng Ji, zhao wei, Zhou Li Zhao, Xiaojun Chen

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2017

    The experimental results demonstrate that LDST performs very well at discovering topics and sentiments from social media and tracking their shifts in different geographical regions during emergencies and disasters.

    22
  • Can Language Models Follow Multiple Turns of Entangled Instructions?

    Chi Han, Xin Liu, Haodong Wang, Shiyang Li, Jingfeng Yang, Haoming Jiang, Zhengyang Wang, Yin, Qingyu, +7 more

    arXiv · 2025

    This work presents a systematic investigation of LLMs' capabilities in handling multiple turns of instructions, covering three levels of difficulty: retrieving information from instructions, tracking and reasoning across turns, and (3) resolving conflicts among instructions.

    21
  • 21
  • Be Appropriate and Funny: Automatic Entity Morph Encoding

    Boliang Zhang, Hongzhao Huang, Xiaoman Pan, Heng Ji, Kevin K. Knight, Zhen Wen, Yizhou Sun, Jiawei Han, +1 more

    Annual Meeting of the Association for Computational Linguistics (ACL) · 2014

    A wide variety of novel approaches to automatically encode proper and interesting morphs, which can effectively pass decoding tests are developed.

    21
  • Open-Vocabulary Argument Role Prediction for Event Extraction

    Yizhu Jiao, Sha Li, Yiqing Xie, Ming Zhong, Heng Ji, Jiawei Han

    arXiv · 2022

    This paper formulate the role prediction problem as an in-filling task and construct prompts for a pre-trained language model to generate candidate roles to infer a set of argument roles for a given event type, resulting in a novel unsupervised framework, RolePred.

    20
  • Analysis and repair of name tagger errors

    Heng Ji, Ralph Grishman

    Proceedings of the COLING/ACL on Main conference poster sessions - · 2006

    A joint inference model to improve Chinese name tagging by incorporating feedback from subsequent stages in an information extraction pipeline: name structure parsing, cross-document coreference, semantic relation extraction and event extraction is presented.

    20
  • Creative Language Encoding under Censorship

    Heng Ji, Kevin K. Knight

    2018

    This position paper systematically categorize human-created obfuscated language on various levels, investigates their basic mechanisms, gives an overview on automated techniques needed to simulate human encoding, and summarizes remaining challenges for future research on the interaction between Natural Language Processing and encryption.

    19
  • Heterogeneous Supervision for Relation Extraction: A Representation Learning Approach

    Liyuan Liu, Xiang Ren, Qi Zhu, Shi Zhi, Gui, Huan, Heng Ji, Jiawei Han

    arXiv · 2017

    19
  • Must Read: A Comprehensive Survey of Computational Persuasion

    Nimet Beyza Bozdag, Shuhaib Mehri, Xiaocheng Yang, Hyeonjeong Ha, Zirui Cheng, Esin Durmus, Jiaxuan You, Heng Ji, +2 more

    ACM Computing Surveys · 2026

    A taxonomy for persuasion research is introduced and key challenges for future research are discussed to enhance the safety, fairness, and effectiveness of AI-powered persuasion while addressing the risks posed by increasingly capable language models.

    18
  • CALM: Unleashing the Cross-Lingual Self-Aligning Ability of Language Model Question Answering

    Yumeng Wang, Zhiyuan Fan, Qingyun Wang, Fung, May, Heng Ji

    arXiv · 2025

    Evaluations on the MEDQA and X-CSQA datasets demonstrate CALM's effectiveness in enhancing cross-lingual knowledge question answering, both in zero-shot and retrieval-augmented settings and offer a qualitative analysis of how cross-lingual consistency can enhance knowledge alignment.

    18
  • Community Moderation and the New Epistemology of Fact Checking on Social Media

    Isabelle Augenstein, Michiel A. Bakker, Tanmoy Chakraborty, David P. A. Corney, Emilio Ferrara, Iryna Gurevych, Scott A. Hale, Eduard H. Hovy, +8 more

    TUbilio (Technical University of Darmstadt) · 2025

    The current approaches to misinformation detection across major platforms are examined, the emerging role of community-driven moderation is explored, and both the promises and challenges of crowd-checking at scale are critically evaluated.

    18
  • Geometry Informed Tokenization of Molecules for Language Model Generation

    Xiner Li, Limei Wang, Youzhi Luo, Edwards, Carl, Shurui Gui, Yuchao Lin, Heng Ji, Shuiwang Ji

    arXiv · 2024

    The Geo2Seq is proposed, which converts molecular geometries into $SE(3)$-invariant 1D discrete sequences and consists of canonical labeling and invariant spherical representation steps, which together maintain geometric and atomic fidelity in a format conducive to LMs.

    18
  • Enhancing Knowledge Selection for Grounded Dialogues via Document Semantic Graphs

    Sha Li, Mahdi Namazifar, Di Jin, Mohit Bansal, Heng Ji, Yang Liu, Dilek Zeynep Hakkani-Tür

    Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · 2022

    18
  • Context-aware Entity Morph Decoding

    Boliang Zhang, Hongzhao Huang, Xiaoman Pan, Sujian Li, Chin-Yew Lin, Heng Ji, Kevin K. Knight, Zhen Wen, +3 more

    Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · 2015

    This paper presents the first end-to-end context-aware entity morph decoding system that can automatically identify, disambiguate, verify morph mentions based on specific contexts, and resolve them to target entities.

    18
  • RPI BLENDER TAC-KBP2015 system description

    Di Lu, Xiaoman Pan, Lifu Huang, Yadong Chen, Xiaobin Wang, Hong Yu, Heng Ji, Dian Yu

    Theory and applications of categories · 2015

    To extract English name mentions, a linear-chain CRFs model trained from ACE 20032005 corpora is applied and several regular expression based rules are encoded to extract poster name mentions in discussion forum posts.

    18
  • NORMSAGE: Multi-Lingual Multi-Cultural Norm Discovery from Conversations On-the-Fly

    Yi R. Fung, Tuhin Chakrabarty, Hao Guo, Owen Rambow, Smaranda Muresan, Heng Ji

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2023

    17
  • Open-Domain Hierarchical Event Schema Induction by Incremental Prompting and Verification

    Sha Li, Ruining Zhao, Manling Li, Heng Ji, Chris Callison-Burch, Jiawei Han

    Annual Meeting of the Association for Computational Linguistics (ACL) · 2023

    17
  • Global Attention for Name Tagging

    Boliang Zhang, Spencer Whitehead, Lifu Huang, Heng Ji

    Conference on Computational Natural Language Learning · 2018

    This work proposes a model that learns to incorporate document-level and corpus-level contextual information alongside local contextual information via document- level and Corpus-level attentions, which dynamically weight their respective contextual information and determines the influence of this information through gating mechanisms.

    17
  • Challenges from Information Extraction to Information Fusion

    Heng Ji

    International Conference on Computational Linguistics · 2010

    The requirements and possible solutions to perform information fusion are specified and it is believed this is a critical step to advance IE to a higher level of performance and portability.

    17
  • Scientific Opinion Summarization: Paper Meta-review Generation Dataset, Methods, and Evaluation

    Qi Zeng, Mankeerat Sidhu, Ansel Blume, Hou Pong Chan, Lu Wang, Heng Ji

    Lecture notes in computer science · 2025

    The experiments show that human-written summaries do not always satisfy all necessary criteria such as depth of discussion, and identifying consensus and controversy for the specific domain, and the combination of task decomposition and iterative self-refinement shows strong potential for enhancing the opinions and can be applied to other complex text generation using black-box LLMs.

    16
  • Zero-shot Faithful Factual Error Correction

    Kung-Hsiang Huang, Hou Pong Chan, Heng Ji

    Annual Meeting of the Association for Computational Linguistics (ACL) · 2023

    16
  • Uncertainty Reduction for Knowledge Discovery and Information Extraction on the World Wide Web

    Heng Ji, Hongbo Deng, Jiawei Han

    Proceedings of the IEEE · 2012

    16
  • Measuring and Improving Chain-of-Thought Reasoning in Vision-Language Models

    Yangyi Chen, Karan Sikka, Michael Cogswell, Heng Ji, Ajay Divakaran

    Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · 2024

    15
  • Name-aware Machine Translation

    Haibo Li, Jing Wen Zheng, Heng Ji, Qi Li, Wen Wang

    Annual Meeting of the Association for Computational Linguistics · 2013

    A Name-aware Machine Translation approach which can tightly integrate name processing into MT model is proposed, by jointly annotating parallel corpora, extracting name-aware translation grammar and rules, adding name phrase table and name translation driven decoding.

    15
  • NYU-Fair Issac-RWTH Chinese to English entity translation 07 system

    Heng Ji, M. Blume, Dayne Freitag, Ralph Grishman, Shahram Khadivi, Richard Zens

    2007

    15
  • PropaInsight: Toward Deeper Understanding of Propaganda in Terms of Techniques, Appeals, and Intent

    Liu, Jiateng, Ai, Lin, Zizhou Liu, Payam Karisani, Hui Zheng, May FUNG, Preslav Nakov, Julia Hirschberg, +1 more

    arXiv · 2024

    14
  • Multimedia Generative Script Learning for Task Planning

    Qingyun Wang, Manling Li, Hou Pong Chan, Lifu Huang, Julia Hockenmaier, Girish Vinayak Chowdhary, Heng Ji

    Findings of the Association for Computational Linguistics: ACL 2023 · 2023

    This work proposes a new task, Multimedia Generative Script Learning, to generate subsequent steps by tracking historical states in both text and vision modalities, as well as presenting the first benchmark containing 5,652 tasks and 79,089 multimedia steps.

    14
  • Domain-Independent Novel Event Discovery and Semi-Automatic Event Annotation

    Hao Li, Xiang Li, Heng Ji, Yuval Marton

    Institutional Repositories DataBase (IRDB) · 2010

    This work exploits both monolingual texts and bilingual sentence-aligned parallel texts to cluster event triggers and discover novel event types, and generates event argument annotations semiautomatically, framed as a sentence ranking and semantic role labeling task.

    14
  • Collaborative entity extraction and translation

    Heng Ji, Ralph Grishman

    Amsterdam studies in the theory and history of linguistic science. Series 4, Current issues in linguistic theory · 2009

    The use of a new source of data is proposed: the information gleaned from large bitexts and captured by a statistical, phrase-based machine translation system, which can significantly improve Chinese entity extraction and machine translation systems.

    14
  • Information Association for Language Model Updating by Mitigating LM-Logical Discrepancy

    Pengfei Yu, Heng Ji

    Conference on Computational Natural Language Learning · 2024

    This work proposes a new task formulation of the information updating task that only requires the provision of an unstructured updating corpus and evaluates the performance of information updating on the generalizability to question-answer pairs pertaining to the updating information.

    13
  • Semi-supervised New Event Type Induction and Description via Contrastive Loss-Enforced Batch Attention

    Carl Edwards, Heng Ji

    Conference of the European Chapter of the Association for Computational Linguistics · 2023

    This work presents a novel approach to semi-supervised new event type induction using a masked contrastive loss, which learns similarities between event mentions by enforcing an attention mechanism over the data minibatch.

    13
  • Learning to Learn Words from Visual Scenes

    Dídac Surís, Dave Epstein, Heng Ji, Shih‐Fu Chang, Carl Vondrick

    Lecture notes in computer science · 2020

    A meta-learning framework that learns how to learn word representations from unconstrained scenes using the natural compositional structure of language to create training episodes that cause a meta-learner to learn strong policies for language acquisition is introduced.

    13
  • Leveraging Entity Linking and Related Language Projection to Improve Name Transliteration

    Ying Lin, Xiaoman Pan, Aliya Deri, Heng Ji, Kevin K. Knight

    Proceedings of the Sixth Named Entity Workshop · 2016

    A novel approach to leverage state-of-the-art Entity Linking techniques to automatically correct name transliteration results, us-ing collective inference from source contexts and additional evidence from knowledge base is proposed.

    13
  • Towards LifeSpan Cognitive Systems

    Yu Wang, Chi Han, Tongtong Wu, Xiaoxin He, Wangchunshu Zhou, Nafis Sadeq, Xiusi Chen, Zexue He, +4 more

    arXiv · 2024

    This paper proposes a potential instantiation for LSCS that can integrate all four classes of technologies based on a conceptual metric called Storage Complexity, which measures the relative space required to store past experiences.

    12
  • CoRNStack: High-Quality Contrastive Data for Better Code Ranking

    Tarun Suresh, Revanth Gangi Reddy, Yifei Xu, Zach Nussbaum, Andriy Mulyar, Brandon Duderstadt, Heng Ji

    arXiv · 2024

    It is demonstrated that contrastive training of embedding models using C O RNS TACK leads to state-of-the-art performance across a variety of code retrieval tasks, and significant improvements in function localization for GitHub issues, an important component of real-world software development.

    12
  • Decoding the Silent Majority: Inducing Belief Augmented Social Graph with Large Language Model for Response Forecasting

    Chenkai Sun, Jinning Li, Yi R. Fung, Hou Pong Chan, Tarek Abdelzaher, ChengXiang Zhai, Heng Ji

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2023

    12
  • COVID-19 Claim Radar: A Structured Claim Extraction and Tracking System

    Manling Li, Revanth Gangi Reddy, Ziqi Wang, Yi-Shyuan Chiang, Tuan Lai, Pengfei Yu, Zixuan Zhang, Heng Ji

    Annual Meeting of the Association for Computational Linguistics: System Demonstrations (ACL Demo) · 2022

    A COVID-19 Claim Radar is presented to automatically extract supporting and refuting claims on a daily basis, enabling users to explore equivalent, refuting, or supporting claims with structural evidence, such as shared claimers, similar centroid events and arguments.

    12
  • Weakly-Supervised Temporal Article Grounding

    Long Chen, Yulei Niu, Brian Chen, Xudong Lin, Guangxing Han, Christopher Thomas, Hammad Ayyubi, Heng Ji, +1 more

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2022

    12
  • Joint Detection and Coreference Resolution of Entities and Events with Document-level Context Aggregation

    Samuel Kriman, Heng Ji

    Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing: Student Research Workshop · 2021

    By extending the jointly trained model to document-level, this work can improve the results by incorporating cross-sentence dependencies and additional contextual information that might not be available at the sentence level, which allows for more globally optimized predictions.

    12
  • A study of using an out-of-box commercial MT system for query translation in CLIR

    Dan Wu, Daqing He, Heng Ji, Ralph Grishman

    Proceedings of the 2nd ACM workshop on Improving non english web searching · 2008

    The experiments show that MT is an excellent tool for the query translation task, and with the help of relevance feedback, it can achieve significant improvement over the monolingual baseline.

    12
  • Adversarial Robustness for Large Language NER models using Disentanglement and Word Attributions

    Xiaomeng Jin, Bhanukiran Vinzamuri, Sriram Venkatapathy, Heng Ji, Pradeep Natarajan

    Findings of the Association for Computational Linguistics: EMNLP 2023 · 2023

    11
  • The Shifted and The Overlooked: A Task-oriented Investigation of User-GPT Interactions

    Siru Ouyang, Shuohang Wang, Yang Liu, Ming Zhong, Yizhu Jiao, Dan Iter, Reid Pryzant, Chenguang Zhu, +2 more

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2023

    11
  • Non-Sequential Graph Script Induction via Multimedia Grounding

    Yu Zhou, Sha Li, Manling Li, Xudong Lin, Shih-Fu Chang, Mohit Bansal, Heng Ji

    arXiv · 2023

    This paper designs a multimodal framework to ground procedural videos to WikiHow textual steps and thus transform each video into an observed step path on the latent ground truth graph script, enabling a script knowledge model capable of both generating explicit graph scripts for learnt tasks and predicting future steps given a partial step sequence.

    11
  • External Knowledge Acquisition for End-to-End Document-Oriented Dialog Systems

    Tuan Lai, Giuseppe Castellucci, Saar Kuzi, Heng Ji, Oleg Rokhlenko

    Conference of the European Chapter of the Association for Computational Linguistics · 2023

    EKo-Doc is presented, an architecture for document-oriented conversations with access to external knowledge: it is assumed that a conversation is centered around a topic document and that external knowledge is needed to produce responses.

    11
  • New Frontiers of Information Extraction

    Muhao Chen, Lifu Huang, Manling Li, Ben Zhi Zhou, Heng Ji, Dan Roth

    Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies: Tutorial Abstracts · 2022

    This tutorial will provide audience with a systematic introduction to recent advances of IE, by answering several important research questions, including how to develop an robust IE system from noisy, insufficient training data, while ensuring the reliability of its prediction.

    11
  • Personalized Entity Resolution with Dynamic Heterogeneous KnowledgeGraph Representations

    Ying Lin, Han Wang, Jiangning Chen, Tong Wang, Yue Liu, Heng Ji, Yang Liu, Prem Natarajan

    Proceedings of The 4th Workshop on e-Commerce and NLP · 2021

    This work proposes a new framework that leverages personalized features to improve the accuracy of product ranking, and incorporates product, customer, and history representations into a neural reranking model to predict which candidate is most likely to be purchased by a specific customer.

    11
  • Learning Hierarchical Relationships among Partially Ordered Objects with Heterogeneous Attributes and Links

    Chi Wang, Jiawei Han, Qi Li, Xiang Li, Wen-Pin Lin, Heng Ji

    SIAM International Conference on Data Mining · 2012

    This paper studies a generic form of relationship along which objects can form a treelike structure, a pervasive structure in various domains, and proposes a discriminative undirected graphical model that integrates a wide range of features and rules by defining potential functions with simple forms.

    11
  • Analysis and Refinement of Cross-Lingual Entity Linking

    Taylor Cassidy, Heng Ji, Hongbo Deng, Jing Wen Zheng, Jiawei Han

    Lecture notes in computer science · 2012

    A strong baseline system derived from a combination of state-of-the-art machine translation and monolingual entity linking is enhanced to achieve 11.2% improvement in B-Cubed+ F-measure.

    11
  • Phonetic name matching for cross-lingual Spoken Sentence Retrieval

    Heng Ji, Ralph Grishman, Wen Wang

    IEEE Spoken Language Technology Workshop (SLT) · 2008

    11
  • SyncMind: Measuring Agent Out-of-Sync Recovery in Collaborative Software Engineering

    Guo, Xuehang, Xingyao Wang, Yangyi Chen, Sha Li, Chi Han, M Li, Heng Ji

    arXiv · 2025

    This work introduces SyncMind, a framework that systematically defines the out-of-sync problem faced by large language model (LLM) agents in collaborative software engineering (CSE) and creates SyncBench, a benchmark featuring 24,332 instances of agent out-of-sync scenarios in real-world CSE derived from 21 popular GitHub repositories with executable verification tests.

    10
  • Video Event Extraction via Tracking Visual States of Arguments

    Guang Yang, Manling Li, Jiajie Zhang, Xudong Lin, Heng Ji, Shih‐Fu Chang

    Proceedings of the AAAI Conference on Artificial Intelligence · 2023

    10
  • Sketching as a Tool for Understanding and Accelerating Self-attention for Long Sequences

    Yifan Chen, Qi Zeng, Dilek Zeynep Hakkani-Tür, Di Jin, Heng Ji, Yun Long Yang

    Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · 2022

    This work proposes Skeinformer to accelerate self-attention and further improve the accuracy of matrix approximation to self-Attention with column sampling, adaptive row normalization and pilot sampling reutilization.

    10
  • 10
  • Linguistic Resources for Entity Linking Evaluation: from Monolingual to Cross-lingual

    Xuansong Li, Stephanie M. Strassel, Heng Ji, Kira Griffitt, Joe Ellis

    Language Resources and Evaluation Conference (LREC) · 2012

    The linguistic resource creation efforts at the Linguistic Data Consortium (LDC) in support of Named Entity Linking evaluation of KBP are described, focusing on annotation methodologies, process, and features of corpora from 2009 to 2011, with a highlighted analysis of the cross-lingual NEL data.

    10
  • Finer: Investigating and Enhancing Fine-Grained Visual Concept Recognition in Large Vision Language Models

    Jeonghwan Kim, Heng Ji

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2024

    A multiple granularity attribute-centric benchmark and training mixture, Finer, is proposed, which aims to establish a ground to evaluate LVLMs’ fine-grained visual comprehension ability and provide significantly improved explainability.

    9
  • Relabeling Distantly Supervised Training Data for Temporal Knowledge Base Population

    Suzanne R Tamang, Heng Ji

    AKBC-WEKEX@NAACL-HLT · 2012

    A temporal knowledge base population system is enhanced to improve the quality of distantly supervised training data and identify a minimal feature set for classification and results in notably less computational cost than a parallel system trained on the full feature set.

    9
  • 9
  • Automatic recognition of logical relations for English, Chinese and Japanese in the GLARF framework

    Adam Meyers, Michiko Kosaka, Nianwen Xue, Heng Ji, Ang Sun, Shasha Liao, Wei Hong Xu

    Proceedings of the Workshop on Semantic Evaluations: Recent Achievements and Future Directions - DEW '09 · 2009

    GLARF, a framework for representing three linguistic levels and systems for generating this representation, focuses on a logical level, like LFG's F-structure, but compatible with Penn Treebanks.

    9
  • Atomic Reasoning for Scientific Table Claim Verification

    Zhang, Yuji, Qingyun Wang, Cheng Qian, Liu, Jiateng, Chenkai Sun, Zhang, Denghui, Tarek Abdelzaher, ChengXiang Zhai, +2 more

    arXiv · 2025

    This work proposes that enhancing a model's ability to interpret table-based claims involves reducing cognitive load by developing modular, reusable reasoning components (i.e., atomic skills), and introduces a skill-chaining schema that dynamically composes these skills to facilitate more accurate and generalizable reasoning with a reduced cognitive load.

    8
  • Defining a New NLP Playground

    Sha Li, Chi Han, Pengfei Yu, Carl Edwards, Manling Li, Xingyao Wang, Yi R. Fung, Charles X. Yu, +3 more

    Findings of the Association for Computational Linguistics: EMNLP 2023 · 2023

    8
  • Future is not One-dimensional: Graph Modeling based Complex Event Schema Induction for Event Prediction.

    Manling Li, Sha Li, Zhenhailong Wang, Lifu Huang, Kyunghyun Cho, Heng Ji, Jiawei Han, Clare R. Voss

    arXiv · 2021

    8
  • Cross-media Structured Common Space for Multimedia Event Extraction

    Manling Li, Alireza Zareian, Qi Zeng, Spencer Whitehead, Di Lu, Heng Ji, Shih‐Fu Chang

    arXiv · 2020

    8
  • Cross-lingual Joint Entity and Word Embedding to Improve Entity Linking and Parallel Sentence Mining

    Xiaoman Pan, Thamme Gowda, Heng Ji, Jonathan May, Scott Miller

    Proceedings of the 2nd Workshop on Deep Learning Approaches for Low-Resource NLP (DeepLo 2019) · 2019

    A novel method is proposed, CLEW, to generate cross-lingual data that is a mix of entities and contextual words based on Wikipedia that provides reliable alignment on both the word/entity level and the sentence level, and thus it is used to mine parallel sentences for all (302, 2) language pairs in Wikipedia.

    8
  • Applying Coreference to Improve Name Recognition

    Heng Ji, Ralph Grishman

    2004

    A novel method of applying the results of coreference resolution to improve Name Recognition for Chinese by considering first some methods for gauging the confidence of individual tags assigned by a statistical name tagger and presenting rules which use coreference information to correct some name tagging errors.

    8
  • Interpretable Automatic Fine-grained Inconsistency Detection in Text Summarization

    Hou Pong Chan, Qi Zeng, Heng Ji

    Findings of the Association for Computational Linguistics: ACL 2023 · 2023

    7
  • Towards a Unified Multi-Dimensional Evaluator for Text Generation

    Ming Zhong, Yang Liu, Yin, Da, Yuning Mao, Yizhu Jiao, Pengfei Liu, Chenguang Zhu, Heng Ji, +1 more

    arXiv · 2022

    7
  • A Unified Transformer-based Framework for Duplex Text Normalization

    Tuan Lai, Yang Zhang, Evelina Bakhturina, Boris Ginsburg, Heng Ji

    arXiv · 2021

    7
  • GENE: Global Event Network Embedding

    Qi Zeng, Manling Li, Tuan Lai, Heng Ji, Mohit Bansal, Hanghang Tong

    Proceedings of the Fifteenth Workshop on Graph-Based Methods for Natural Language Processing (TextGraphs-15) · 2021

    7
  • How to Speak a Language without Knowing It

    Xing Shi, Kevin K. Knight, Heng Ji

    Annual Meeting of the Association for Computational Linguistics (ACL) · 2014

    This work develops a system that lets people overcome language barriers by letting them speak a language they do not know by converts the translation into a phonetic spelling in the user’s own orthography.

    7
  • Cross-lingual Slot Filling from Comparable Corpora

    Matthew Snover, Xiang Li, Wen-Pin Lin, Zheng Chen, Suzanne R Tamang, Mingmin Ge, Adam J. Lee, Qi Li, +3 more

    BUCC@ACL · 2011

    A novel supervised rescoring based validation approach to incorporate global evidence from very large bilingual comparable corpora to overcome information extraction and machine translation errors in this new task of crosslingual slot filling.

    7
  • ARMADA: Attribute-Based Multimodal Data Augmentation

    Xiaomeng Jin, Jeonghwan Kim, Zhou, Yu, Kuan-Hao Huang, Te-Lin Wu, Nanyun Peng, Heng Ji

    arXiv · 2024

    ARMADA is a novel multimodal data generation framework that extracts knowledge-grounded attributes from symbolic KBs for semantically consistent yet distinctive image-text pair generation, and uses the commonsense knowledge of LLMs to modulate auxiliary visual attributes such as backgrounds for more robust representation of original entities.

    6
  • Schema-Guided Culture-Aware Complex Event Simulation with Multi-Agent Role-Play

    Sha Li, Revanth Gangi Reddy, Khanh Duy Nguyen, Qingyun Wang, Yi R. Fung, Chi Han, Jiawei Han, Kartik Natarajan, +2 more

    Conference on Empirical Methods in Natural Language Processing: System Demonstrations (EMNLP) · 2024

    This work develops a controllable complex news event simulator guided by both the event schema representing domain knowledge about the scenario and user-provided assumptions representing case-specific conditions and introduces a geo-diverse commonsense and cultural norm-aware knowledge enhancement component.

    6
  • Zemi: Learning Zero-Shot Semi-Parametric Language Models from Multiple Tasks

    Zhenhailong Wang, Xiaoman Pan, Dian Yu, Dong Yu, Jianshu Chen, Heng Ji

    Findings of the Association for Computational Linguistics: ACL 2023 · 2023

    6
  • Cross-lingual Structure Transfer for Zero-resource Event Extraction

    Di Lu, Ananya Subburathinam, Heng Ji, Jonathan May, Shih‐Fu Chang, Avirup Sil, Clare R. Voss

    Language Resources and Evaluation · 2020

    A novel share-and-transfer framework to reach the goal of transferring graph structures across languages with comparable performance to a state-of-the-art supervised model trained from more than 1,500 manually annotated event mentions.

    6
  • Cross-lingual

    Kevin Blissett, Heng Ji

    Proceedings of the Second Workshop on Computational Models of Reference, Anaphora and Coreference · 2019

    6
  • Adding smarter systems instead of human annotators: re-ranking for system combination

    Suzanne R Tamang, Heng Ji

    Proceedings of the 1st international workshop on Search and mining entity-relationship data · 2011

    The impact of the learning-to-rank framework is demonstrated to combine output from multiple slot filling systems to populate entity-attribute facts in a knowledge base and it is shown that the approach can be used to create answer keys more efficiently and at a lower cost than laborious human annotation.

    6
  • Summarizing based on concept counting and hierarchy analysis

    Heng Ji, Zhensheng Luo, Min Wan, Xiaoyun Gao

    Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · 2003

    6
  • Self-Correction is More than Refinement: A Learning Framework for Visual and Language Reasoning Tasks

    Jiayi He, Hehai Lin, Qingyun Wang, Yi R. Fung, Heng Ji

    Findings of the Association for Computational Linguistics: ACL 2025 · 2025

    5
  • Discovery of a molecular adsorbent for efficient CO 2 /CH 4 separation using a computation-ready experimental database of porous molecular materials

    Siyuan Yang, Qianqian Mao, Heng Ji, Dingyue Hu, Jinjin Zhang, Linjiang Chen, Ming Liu

    Chemical Science · 2025

    5
  • Named Entity Recognition Under Domain Shift via Metric Learning for Life Sciences

    Hongyi Liu, Qingyun Wang, Payam Karisani, Heng Ji

    Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · 2024

    This work investigates the applicability of transfer learning for enhancing a named entity recognition model trained in the biomedical domain to be used in the chemical domain, and proposes a model to transfer the knowledge from the source domain to the target domain, but, at the same time, to project the source entities and target entities into separate regions of the feature space.

    5
  • L+M-24: Building a Dataset for Language+Molecules @ ACL 2024

    Carl Edwards, Qingyun Wang, Lawrence Zhao, Heng Ji

    Proceedings of the 1st Workshop on Language + Molecules (L+M 2024) · 2024

    5
  • MIMIR: A Customizable Agent Tuning Platform for Enhanced Scientific Applications

    Xiangru Tang, Chunyuan Deng, Hanminwang Hanminwang, Haoran Wang, Yilun Zhao, Wenqi Shi, Yi R. Fung, Wangchunshu Zhou, +4 more

    Conference on Empirical Methods in Natural Language Processing: System Demonstrations (EMNLP) · 2024

    MIMIR is a streamlined platform that leverages large LLMs to generate agent-tuning data for fine-tuning smaller, specialized models, and enables larger models to simulate various roles and create interaction data, which can be used to fine-tune open-source models like LLaMA2.

    5
  • Knowledge-Enriched Natural Language Generation

    Wenhao Yu, Meng Jiang, Zhiting Hu, Qingyun Wang, Heng Ji, Nazneen Fatema Rajani

    Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing: Tutorial Abstracts · 2021

    This tutorial presents a roadmap to line up the state-of-the-art methods to tackle knowledge-enriched text generation challenges, and dives deep into various technical components: how to represent knowledge, how to feed knowledge into a generation model, and how to evaluate generation results.

    5
  • Learning to Learn Words from Narrated Video.

    Dídac Surís, Dave Epstein, Heng Ji, Shih‐Fu Chang, Carl Vondrick

    arXiv · 2019

    Experiments show that the proposed framework significantly outperforms the state-of-the-art in visual language modeling for acquiring new words and predicting new compositions and suggest that the visual modality helps the approach more robustly generalize at these tasks.

    5
  • Joint Learning of Chinese Words, Terms and Keywords

    Ziqiang Cao, Sujian Li, Heng Ji

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2014

    A four-level Dirichlet Process based model (DP-4) to jointly learn the word distributions from the corpus, domain and document levels simultaneously simultaneously is proposed and a sentence-wise Gibbs sampler is adopted to obtain proper segmentation results.

    5
  • Combining Flat and Structured Approaches for Temporal Slot Filling or: How Much to Compress?

    Qi Li, Javier Artiles, Taylor Cassidy, Heng Ji

    Lecture notes in computer science · 2012

    Experiments on the KBP2011 temporal training data set show that both surface and structured approaches outperform a baseline bag-of-word based classifier and the proposed hybrid method can further improve the performance significantly.

    5
  • Enhancing Multi-lingual Information Extraction via Cross-Media Inference and Fusion

    Adam J. Lee, Marissa Passantino, Heng Ji, Guo-Jun Qi, Thomas S. Huang

    International Conference on Computational Linguistics · 2010

    A new information fusion approach to integrate facts extracted from cross-media objects (videos and texts) into a coherent common representation including multi-level knowledge (concepts, relations and events) is described.

    5
  • Information Extraction

    Heng Ji

    Encyclopedia of Database Systems · 2009

    5
  • The effects of high quality translations of named entities in cross-language information exploration

    Dan Wu, Daqing He, Heng Ji, Ralph Grishman

    International Conference on Natural Language Processing and Knowledge Engineering (NLPKE) · 2008

    5
  • A Chinese name identifying system based on inverse name frequency model and rules

    Heng Ji, Zhensheng Luo

    Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · 2002

    5
  • Artificial intelligence unlocks the future of oral organoid research

    Ying Shi, Lin Wang, Heng Ji, Kin Liao, Vincent Chan, Weitao Li, Nicolae Goga, Winfred Ofoe Larkotey, +3 more

    Translational dental research. · 2025

    4
  • MolCap-Arena: A Comprehensive Captioning Benchmark on Language-Enhanced Molecular Property Prediction

    Edwards, Carl, Ziqing Lu, Ehsan Hajiramezanali, Tommaso Biancalani, Heng Ji, Gabriele Scalia

    arXiv · 2024

    This study presents Molecule Caption Arena: the first comprehensive benchmark of LLM-augmented molecular property prediction, and introduces a novel, battle-based rating system to confirm the ability of LLM-extracted knowledge to enhance state-of-the-art molecular representations.

    4
  • Understanding the Effect of Data Augmentation on Knowledge Distillation

    Ziqi Wang, Chi Han, Wenxuan Bao, Heng Ji

    arXiv · 2023

    This work observes that KD prefers as much data as possible, which is different from fine-tuning that too much data will not gain more performance, and sheds light on the preference difference in data augmentation between fine- tuning and knowledge distillation.

    4
  • Monte Carlo Thought Search: Large Language Model Querying for Complex Scientific Reasoning in Catalyst Design

    Henry W. Sprueill, Carl Edwards, Mariefel V. Olarte, Udishnu Sanyal, Heng Ji, Sutanay Choudhury

    Findings of the Association for Computational Linguistics: EMNLP 2023 · 2023

    4
  • ManiTweet: A New Benchmark for Identifying Manipulation of News on Social Media

    Kung-Hsiang Huang, Hou Pong Chan, Kathleen R. McKeown, Heng Ji

    arXiv · 2023

    An exploratory analysis of human-written tweets reveals intriguing connections between manipulation and the domain and factuality of news articles, as well as revealing that manipulated sentences are more likely to encapsulate the main story or consequences of a news outlet.

    4
  • Weakly-Supervised Aspect-Based Sentiment Analysis via Joint Aspect-Sentiment Topic Embedding

    Jiaxin Huang, Meng Yu, Fang Guo, Heng Ji, Jiawei Han

    arXiv · 2020

    4
  • Low-Resource Name Tagging Learned with Weakly Labeled Data

    Yixin Cao, Zikun Hu, Tat‐Seng Chua, Zhiyuan Liu, Heng Ji

    arXiv · 2019

    4
  • Re-ranking Summaries Based on Cross-Document Information Extraction

    Heng Ji, Juan Liu, Benoît Favre, Dan Gillick, Dilek Z. Hakkani-Tur

    Lecture notes in computer science · 2010

    A method to automatically incorporate IE results into sentence ranking based on cross-document information extraction results is described, which can significantly improve a high-performing multi-document summarization system.

    4
  • Alice: Proactive Learning with Teacher's Demonstrations for Weak-to-Strong Generalization

    S.Q. Wu, Qian, Cheng, Yi R. Fung, Paul Pu Liang, Heng Ji

    arXiv · 2025

    Alice is introduced, a framework that leverages complementary knowledge between teacher and student to enhance the learning process and significantly enhances the W2SG performance, yielding substantial improvements in three key tasks compared to the original W2SG.

    3
  • MIRACLE: An Online, Explainable Multimodal Interactive Concept Learning System

    Ansel Blume, Khanh Duy Nguyen, Zhenhailong Wang, Yangyi Chen, Michal Shlapentokh-Rothman, Xiaomeng Jin, Jeonghwan Kim, Zhen Zhu, +22 more

    ACM International Conference on Multimedia (ACM MM) · 2024

    With its ability to learn new concepts in an online, few-shot manner and its support of dynamic changes to its knowledge base, MIRACLE represents a step forward in interpretable multimodal learning systems.

    3
  • LETI: Learning to Generate from Textual Interactions

    Xingyao Wang, Hao Ming Peng, Reyhaneh Jabbarvand, Heng Ji

    Findings of the Association for Computational Linguistics: NAACL · 2024

    3
  • GLaD: Synergizing Molecular Graphs and Language Descriptors for Enhanced Power Conversion Efficiency Prediction in Organic Photovoltaic Devices

    Thao Nguyen, Tiara Torres-Flores, Changhyun Hwang, Carl Edwards, Ying Diao, Heng Ji

    ACM International Conference on Information and Knowledge Management (CIKM) · 2024

    GLaD achieves precise predictions of PCE, thereby facilitating the synthesis of new OPV molecules with improved efficiency and proving valuable for tasks in low-data regimes within the chemical space, as it enriches molecular representations by incorporating molecular property descriptions learned from large-scale pretraining.

    3
  • ViStruct: Visual Structural Knowledge Extraction via Curriculum Guided Code-Vision Representation

    Yangyi Chen, Xingyao Wang, Manling Li, Derek Hoiem, Heng Ji

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2023

    3
  • REACTCLASS: Cross-Modal Supervision for Subword-Guided Reactant Entity Classification

    Xuan Wang, Vivian J. Hu, Minhao Jiang, Yu Zhang, Jinfeng Xiao, Danielle C. Loving, Heng Ji, Martin D. Burke, +1 more

    IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · 2022

    3
  • VAULT: VAriable Unified Long Text Representation for Machine Reading Comprehension

    Haoyang Wen, Anthony Ferritto, Heng Ji, Radu Florian, Avi Sil

    Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 2: Short Papers) · 2021

    VAULT is proposed: a light-weight and parallel-efficient paragraph representation for MRC based on contextualized representation from long document input, trained using a new Gaussian distribution-based objective that pays close attention to the partially correct instances that are close to the ground-truth.

    3
  • MUSE: Textual Attributes Guided Portrait Painting Generation

    Xiaodan Hu, Pengfei Yu, Kevin K. Knight, Heng Ji, Bo Li, Honghui Shi

    IEEE International Conference on Multimedia Information Processing and Retrieval (MIPR) · 2021

    A novel approach to automatically generate portrait paintings guided by textual attributes takes a set of attributes written in text, in addition to facial features extracted from a photo of the subject as input, and designs a novel stacked neural network architecture by extending an image-to-image generative model to accept textual attributes.

    3
  • Raw-to-End Name Entity Recognition in Social Media

    Liyuan Liu, Zihan Wang, Jingbo Shang, Dandong Yin, Heng Ji, Xiang Ren, Shaowen Wang, Jiawei Han

    arXiv · 2019

    3
  • Acquiring Background Knowledge to Improve Moral Value Prediction

    Ying Lin, Joe Hoover, Morteza Dehghani, Marlon Mooijman, Heng Ji

    arXiv · 2017

    3
  • Information Extraction

    Heng Ji

    Encyclopedia of Database Systems · 2016

    3
  • Free-form text summarization in social sensing

    Hongzhao Huang, Sam Anzaroot, Heng Ji, Hieu Le, Dong Wang, Tarek Abdelzaher

    International Conference on Information Processing in Sensor Networks (IPSN) · 2012

    A system which can automatically summarize real-time textual data common to social sensing applications, focusing on text messages that describe events in the environment is demonstrated.

    3
  • A toolkit for knowledge base population

    Zheng Chen, Suzanne R Tamang, Adam Lee, Heng Ji

    International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · 2011

    This work intends to release an open source KBP toolkit that is publicly available for research purposes and aims to distill entity information from multiple unstructured and semi-structured data sources and incorporate the information into a knowledge base (KB).

    3
  • Transducing logical relations from automatic and manual GLARF

    Adam Meyers, Michiko Kosaka, Heng Ji, Nianwen Xue, Mary P. Harper, Ang Sun, Wei Hong Xu, Shasha Liao

    Proceedings of the Third Linguistic Annotation Workshop on - ACL-IJCNLP '09 · 2009

    GLARF relations are generated from treebank and parses for English, Chinese and Japanese and evaluation of system output for these input types requires consideration of multiple correct answers.

    3
  • Establishing Knowledge Preference in Language Models

    Sizhe Zhou, Sha Li, Meng Yu, Yizhu Jiao, Heng Ji, Jiawei Han

    arXiv · 2024

    It is demonstrated that a 7B model, fine-tuned on only a few thousand examples automatically generated by the proposed method, effectively achieves superior performance in adhering to the desired knowledge preference hierarchy.

    2
  • Automating Intervention Discovery from Scientific Literature: A Progressive Ontology Prompting and Dual-LLM Framework

    Yuting Hu, Dancheng Liu, Qingyun Wang, Charles Yu, Chenhui Xu, Qingxiao Zheng, Heng Ji, Jinjun Xiong

    Proceedings of the Thirty-ThirdInternational Joint Conference on Artificial Intelligence · 2024

    A novel framework leveraging large language models (LLMs), which integrates a progressive ontology prompting (POP) algorithm with a dual-agent system, named LLM-Duo, culminating in the creation of a publicly accessible intervention knowledge base with great potential to benefit the speech-language pathology community.

    2
  • ReFIT: Relevance Feedback from a Reranker during Inference

    Revanth Gangi Reddy, Pradeep Dasigi, Md Arafat Sultan, Arman Cohan, Avirup Sil, Heng Ji, Hannaneh Hajishirzi

    arXiv · 2023

    This work leverages the re-ranker to also improve retrieval by providing inference-time relevance feedback to the retriever by updating the retriever’s query representation using a lightweight inference-time distillation of the re-ranker’s prediction for that instance.

    2
  • RESIN-EDITOR: A Schema-guided Hierarchical Event Graph Visualizer and Editor

    Khanh Duy Nguyen, Zixuan Zhang, Reece Suchocki, Sha Li, Martha Stone Palmer, Susan Windisch Brown, Jiawei Han, Heng Ji

    Conference on Empirical Methods in Natural Language Processing: System Demonstrations (EMNLP) · 2023

    An interactive event graph visualizer and editor designed for analyzing complex events that allows users to render and freely edit hierarchical event graphs extracted from multimedia and multi-document news clusters with guidance from human-curated event schemas.

    2
  • Measuring the Effect of Influential Messages on Varying Personas

    Chenkai Sun, Jinning Li, Hou Pong Chan, ChengXiang Zhai, Heng Ji

    Annual Meeting of the Association for Computational Linguistics (ACL) · 2023

    2
  • NLUBot101 at SemEval-2023 Task 3: An Augmented Multilingual NLI Approach Towards Online News Persuasion Techniques Detection

    Genglin Liu, Yi R. Fung, Heng Ji

    Proceedings of the The 17th International Workshop on Semantic Evaluation (SemEval-2023) · 2023

    This work tackled a novel task of classifying persuasion techniques in online news articles at a paragraph level with a cross-lingual data augmentation approach and leveraged a recently proposed multilingual natural language inference model to address these challenges.

    2
  • Zero-Shot Classification by Logical Reasoning on Natural Language Explanations

    Chi Han, Hengzhi Pei, Xinya Du, Heng Ji

    Findings of the Association for Computational Linguistics: ACL 2023 · 2023

    2
  • New Frontiers of Scientific Text Mining

    Xuan Wang, Hongwei Wang, Heng Ji, Jiawei Han

    ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · 2022

    This tutorial presents a comprehensive overview of recent research and development on scientific text mining, focusing on the biomedical and chemistry domains and introduces a set of methods that perform effective scientific information extraction, such as named entity recognition, relation extraction, and event extraction.

    2
  • Modulation Recognition Based on Lightweight Residual Network via Hybrid Pruning

    Heng Ji, Wangyang Xu, Lu Gan, Zhengwu Xu

    International Conference on Computer and Communications (ICCC) · 2021

    2
  • HySPA: Hybrid Span Generation for Scalable Text-to-Graph Extraction

    Liliang Ren, Chenkai Sun, Heng Ji, Julia Hockenmaier

    arXiv · 2021

    2
  • Overview of TAC-KBP 2019 Fine-grained Entity Extraction.

    Heng Ji, Avirup Sil, Hoa Trang Dang, Ian M. Soboroff, Joel Nothman

    Theory and applications of categories · 2019

    2
  • Aligning Coordinated Text Streams through Burst Information Network Construction and Decipherment

    Tao Ge, Qing Dou, Xiaoman Pan, Heng Ji, Lei Cui, Baobao Chang, Zhifang Sui, Ming Zhou

    arXiv · 2016

    2
  • Annotating Event Chains for Carbon Sequestration Literature

    Heng Ji, Xiang Li, Ángelo Lucia, Jianting Zhang

    Language Resources and Evaluation Conference (LREC) · 2010

    This project of annotating event chains for an important scientific domain ― carbon sequestration ― aims to reduce carbon emissions and has been identified by the U.S. National Academy of Engineering as a grand challenge problem for the 21st century.

    2
  • EMCompress: Video-LLMs with Endomorphic Multimodal Compression

    Zheyu Fan, Jiateng Liu, Yuji Zhang, Zihan Wang, Yi R. Fung, Manling Li, Heng Ji

    Findings of the Association for Computational Linguistics: ACL 2026 · 2026

    This work proposes a novel, cognitively-inspired task -- Endomorphic Multimodal Compression (EMC) -- as a structurally-constrained sufficient-statistic problem for VideoQA, and forms it as an endomorphic transformation F_EMC that compresses the multimodal input while preserving answer invariance across reasonable downstream models.

    1
  • mCLM: A Modular Chemical Language Model that Generates Functional and Makeable Molecules

    Edwards, Carl, Chi Han, Lee, Gawon, Thao Ngoc Nguyen, Sara Szymkuć, Chetan Kumar Prasad, Bowen Jin, Jiawei Han, +6 more

    arXiv · 2025

    1
  • Beyond Reactive Safety: Risk-Aware LLM Alignment via Long-Horizon Simulation

    Chuanbin Sun, Denghui Zhang, ChengXiang Zhai, Heng Ji

    Findings of the Association for Computational Linguistics: ACL 2025 · 2025

    1
  • SmartBook: AI-Assisted Situation Report Generation for Intelligence Analysts

    Revanth Gangi Reddy, Daniel C. Lee, Yi R. Fung, Khanh Duy Nguyen, Qi Zeng, Manling Li, Ziqi Wang, Clare R. Voss, +1 more

    Frontiers in artificial intelligence and applications · 2025

    1
  • Building a computational ready database for macrocycles and organic cages

    Siyuan Yang, Heng Ji, Jinjin Zhang, Linjiang Chen, Ming Liu

    ChemRxiv · 2024

    1
  • Gene-Metabolite Association Prediction with Interactive Knowledge Transfer Enhanced Graph for Metabolite Production

    Kexuan Xin, Qingyun Wang, Junyu Chen, Pengfei Yu, Huimin Zhao, Heng Ji

    IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · 2024

    An Interactive Knowledge Transfer mechanism based on Metabolism Graphs (IKT4Meta) is introduced to enhance prediction accuracy by integrating cross-metabolism knowledge and using Pretrained Language Models (PLMs) to generate inter-graph links mitigates heterogeneity issues, while intra-graph links are propagated via these anchors.

    1
  • Invariant Tokenization of Crystalline Materials for Language Model Enabled Generation

    Keqiang Yan, Xiner Li, Hongyi Ling, Kenna Ashen, Carl Edwards, Raymundo Arróyave, Marinka Žitnik, Heng Ji, +3 more

    neural information processing systems · 2024

    1
  • Incorporating Task-Specific Concept Knowledge into Script Learning

    Chenkai Sun, Tie Jun Xu, ChengXiang Zhai, Heng Ji

    Conference of the European Chapter of the Association for Computational Linguistics · 2023

    1
  • SumREN: Summarizing Reported Speech about Events in News

    Revanth Gangi Reddy, Heba Elfardy, Hou Pong Chan, Kevin Small, Heng Ji

    Proceedings of the AAAI Conference on Artificial Intelligence · 2023

    1
  • Ensemble Transfer Learning for Multilingual Coreference Resolution

    Tuan Lai, Heng Ji

    Proceedings of the 4th Workshop on Computational Approaches to Discourse (CODI 2023) · 2023

    1
  • Improving Consistency for Text Summarization with Energy Functions

    Qi Zeng, Qingyu Yin, Zheng Li, Yifan Gao, Sreyashi Nag, Zhengyang Wang, Bing Yin, Heng Ji, +1 more

    Findings of the Association for Computational Linguistics: EMNLP 2023 · 2023

    To improve the general consistency of abstractive summarization models, EnergySum is introduced, where the Residual Energy-based Model is applied by designing energy scorers that reflect each type of consistency.

    1
  • Language Model Pre-Training with Sparse Latent Typing

    Liliang Ren, Zixuan Zhang, Han Wang, Clare R. Voss, ChengXiang Zhai, Heng Ji

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2022

    1
  • Seeded Hierarchical Clustering for Expert-Crafted Taxonomies

    Anish Saha, Amith Ananthram, Emily Allaway, Heng Ji, Kathleen R. McKeown

    Findings of the Association for Computational Linguistics: EMNLP 2022 · 2022

    1
  • Zero-Shot Cross-lingual Name Retrieval for Low-Resource Languages

    Kevin Blissett, Heng Ji

    Proceedings of the 2nd Workshop on Deep Learning Approaches for Low-Resource NLP (DeepLo 2019) · 2019

    A novel method is presented which is able to perform name retrieval on a new language without any additional training data by leveraging freely available, cross-lingual resources and a small amount of training data from another language.

    1
  • Collaborative ranking and collaborative clustering

    Heng Ji, Zheng Chen

    2013

    Comparing to the tradition non-collaborative schemes, collaborative ranking leverages strengths from multiple query collaborators and ranker collaborators while collaborative clustering leverages strength from multiple instance collaborators and clusterer collaborators.

    1
  • Demo abstract: Free-form text summarization in social sensing

    Hongzhao Huang, Sam Anzaroot, Heng Ji, Hieu Khac Le, Dong Wang, Tarek Abdelzaher

    ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN) · 2012

    1
  • Improving information extraction and translation using component interactions

    Ralph Grishman, Heng Ji

    2007

    A new framework based on component interactions to approach the creation of a high-performance NLP pipeline that applies all stages in a suitable order, with each stage generating multiple hypotheses and propagating them through the whole pipeline.

    1
  • Pavlov’s Dog and Large Language Models: The Double-Edged Power of Context Conditioning

    Denghui Zhang, Rushi Wang, Jiateng Liu, Kezia Oketch, Yiyu Shi, Heng Ji, Ahmed Farhan Abbasi

    IEEE Intelligent Systems · 2026

    –
  • Position:Agents should invoke external tools ONLY when epistemically necessary

    Hongru Wang, Cheng Qian, Manling Li, Jiahao Qiu, Boyang Xue, Mengdi Wang, Heng Ji, AMOS J. STORKEY, +1 more

    Edinburgh Research Explorer (University of Edinburgh) · 2026

    –
  • Copyright Detective: A Forensic System to Evidence LLMs Flickering Copyright Leakage Risks

    Guangwei Zhang, Jianing Zhu, Cheng Qian, Neil Zhenqiang Gong, Rada Mihalcea, Zhaozhuo Xu, Jingrui He, Jiaqi W. Ma, +6 more

    Annual Meeting of the Association for Computational Linguistics (ACL) · 2026

    –
  • LMBuild: Evaluating LLM Agents for Generating Buildable and Functional Structures

    Jiateng Liu, Rushi Wang, Cheng Qian, Xuejun Zhang, Sun Li, Jiayu Liu, Yifan Shen, Xu Cao, +4 more

    arXiv · 2026

    –
  • From Talk to Triage: Pluralism is Necessary but Not Sufficient for AI Alignment

    Brian Hu, Jennifer McVay, Alice Leung, David Chan, Rosina O. Weber, Ewart J. de Visser, Amy L. Summerville, Bharadwaj Ravichandran, +4 more

    2025

    –
  • Variational Supervised Contrastive Learning

    Ziwen Wang, Jiajun Fan, Thao D. Nguyen, Heng Ji, Ge Liu

    neural information processing systems · 2025

    –
  • That's Deprecated! Understanding, Detecting, and Steering Knowledge Conflicts in Language Models for Code Generation

    Bae, Jaesung, Cameron Churchwell, Mitchell Hermon, Tsun-An Hsieh, Jocelyn Xu, Yekaterina Yegorova, Mark Hasegawa‐Johnson, Heng Ji

    arXiv · 2025

    A domain-agnostic framework for constructing and interpreting such conflicts, along with a novel evaluation method and dataset tailored to code conflict scenarios, are proposed.

    –
  • Entailment-Preserving First-order Logic Representations in Natural Language Entailment

    Jinu Lee, Qi Liu, R. Ma, Vincent Han, Ziqi Wang, Heng Ji, Julia Hockenmaier

    Annual Meeting of the Association for Computational Linguistics (ACL) · 2025

    –
  • A Roadmap for Alignable Algorithmic Decision-Makers in the Medical Triage Domain

    Brian Hu, David Chan, Taylor Sorensen, Xiusi Chen, Heng Ji, Yejin Choi, Trevor J. Darrell, Arslan Basharat

    IEEE Conference on Artificial Intelligence (CAI) · 2025

    –
  • SYNTHIA: Novel Concept Design with Affordance Composition

    Hyeonjeong Ha, Xiaomeng Jin, Jeonghwan Kim, Jiateng Liu, Zhenhailong Wang, Khanh Duy Nguyen, Ansel Blume, Nanyun Peng, +2 more

    Annual Meeting of the Association for Computational Linguistics (ACL) · 2025

    –
  • pnnl/chemreasoner

    Sutanay Choudhury, Henry W. Sprueill, Khushbu Agarwal, Udishnu Sanyal, Mariefel V. Olarte, Edwards, Carl, Heng Ji

    OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) · 2024

    –
  • Optimal Power Control Strategy for Distribution Networks Considering Active Support of Distributed Photovoltaic Power Sources

    Yisong Liang, Heng Ji, Hongyang Jin, Donglai Wang, Yan Zhao

    IEEE Conference on Energy Internet and Energy System Integration (EI2) · 2024

    –
  • Optimal Scheduling Method of Integrated Energy System Considering Hybrid Energy Storage

    Pan Yu, Yan Zhao, Heng Ji, Hongyang Jin, Donglai Wang

    IEEE Conference on Energy Internet and Energy System Integration (EI2) · 2024

    –
  • Language + Molecules

    Carl Edwards, Qingyun Wang, Heng Ji

    Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics: Tutorial Abstracts · 2024

    This tutorial is designed to provide an introduction to this area of research and highlight the key roles language can fill for 1) abstract, compositional control of generative models, 2) bridging different biochemical modalities, 3) planning experimental procedures, and 4) broadening access to computational approaches.

    –
  • Enriching Conceptual Knowledge in Language Models through Metaphorical Reference Explanation

    Zixuan Zhang, Heng Ji

    Proceedings of The Seventh Workshop on Computational Models of Reference, Anaphora and Coreference · 2024

    Experimental results show that the approach significantly enhances the model’s ability to understand and apply enriched concepts, demonstrating the potential of metaphorical reference identification in improving conceptual knowledge of LMs.

    –
  • Human-in-the-Loop Schema Induction

    Tianyi Zhang, Isaac Tham, Hou, Zhaoyi, Jiaxuan Ren, Zhou, Leon, Hainiu Xu, Li Zhang, Lara J. Martin, +7 more

    arXiv · 2023

    –
  • InfoPattern: Unveiling Information Propagation Patterns in Social Media

    Chi Han, Jialiang Xu, Manling Li, Hanning Zhang, Tarek Abdelzaher, Heng Ji

    arXiv · 2023

    The demo InfoPattern centers on the interplay between language and human ideology, capable of red teaming to simulate adversary responses from opposite ideology communities, and information propagation graph discovery to reveal the evolution of claims across various communities over time.

    –
  • Social Commonsense-Guided Search Query Generation for Open-Domain Knowledge-Powered Conversations

    Revanth Gangi Reddy, Hao Bai, Wentao Yao, Sharath Chandra Etagi Suresh, Heng Ji, ChengXiang Zhai

    Findings of the Association for Computational Linguistics: EMNLP 2023 · 2023

    –
  • Skyformer: Remodel Self-Attention with Gaussian Kernel and Nyström Method

    Yifan Chen, Qi Zeng, Heng Ji, Yun Yang

    arXiv · 2021

    –
  • Fine-Grained Chemical Entity Typing with Multimodal Knowledge Representation

    Chenkai Sun, Weijiang Li, Jinfeng Xiao, Nikolaus Nova Parulian, ChengXiang Zhai, Heng Ji

    arXiv · 2021

    –
  • White Paper: Challenges and Considerations for the Creation of a Large Labelled Repository of Online Videos with Questionable Content

    Thamar Solorio, Mahsa Shafaei, Christos V. Smailis, Mona Diab, Theodore Giannakopoulos, Heng Ji, Yang Liu, Rada F. Mihalcea, +2 more

    arXiv · 2021

    –
  • MUSE: Illustrating Textual Attributes by Portrait Generation.

    Xiaodan Hu, Pengfei Yu, Kevin K. Knight, Heng Ji, Bo Li, Humphrey Shi

    arXiv · 2020

    A novel approach, MUSE, to illustrate textual attributes visually via portrait generation by extending an image-to-image generative model to accept textual attributes and proposes a new attribute reconstruction metric to evaluate whether the generated portraits preserve the subject's attributes.

    –
  • A Baseline Fine-Grained Entity Extraction System for TAC-KBP2019.

    Ying Lin, Xiaoman Pan, Manling Li, Heng Ji

    Theory and applications of categories · 2019

    –
  • PANEL

    Shih‐Fu Chang, Louis‐Philippe Morency, Alexander G. Hauptmann, Alberto Del Bimbo, Cathal G. Gurrin, Hayley Hung, Heng Ji, Alan F. Smeaton

    ACM International Conference on Multimedia (ACM MM) · 2019

    –
  • Research on the Coordinative Development of Interactive Design and Local Traditional Culture Communication

    Heng Ji

    International Conference on Arts, Design and Contemporary Education (ICADCE) · 2019

    The transformation of local traditional culture from “one-way communication” to multi-dimensional “interactive communication” under the mode of media development is discussed, and the relationship between interactive design and the communication of local traditional culture is explained.

    –
  • Narrating a Knowledge Base

    Qingyun Wang, Xiaoman Pan, Lifu Huang, Boliang Zhang, Zhiying Jiang, Heng Ji, Kevin K. Knight

    arXiv · 2018

    This work builds a generation framework based on a pointer network which can copy facts from the input KB, and adds two attention mechanisms: (i) slot-aware attention to capture the association between a slot type and its corresponding slot value; and (ii) a new table position self-attention to captured the inter-dependencies among related slots.

    –
  • Multimedia knowledge extraction: Get things right about complex information

    Heng Ji

    Journal of Computer Engineering and Information Technology · 2017

    –
  • Information Network Construction and Alignment from Automatically Acquired Comparable Corpora

    Heng Ji, Adam J. Lee, Wen-Pin Lin

    Springer eBooks · 2013

    A novel approach to discover cross-lingual comparable corpora based on video comparison, and a weakly-supervised and language-independent approach to mine name translation pairs that can produce highly reliable name pairs are described.

    –
  • Speech and Spoken Document

    Mari Ostendorf, Benoît Favre, Ralph Grishman, Dilek Zeynep Hakkani-Tür, Mary P. Harper, Dustin Hillard, Julia Hirschberg, Heng Ji, +9 more

    2010

    Different levels of speech segmentation, approaches to automatically recovering segment bound-ary locations, and experimental results demonstrating impact on several language pro-cessing tasks are described.

    –
  • Punctuating Speech for Information Extraction

    Benoît Favre, Ralph Grishman, Dustin Hillard, Heng Ji, Dilek Zeynep Hakkani-Tür, Mari Ostendorf

    2008

    –
  • Theoretical and experimental study on polymer microstructured fibers

    Yejin Zhang, Xiaoming Shi, Sigang Yang, Linlu He, Heng Ji, Jie Sun, Shian Guo, Shuang Xie

    Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · 2006

    –

Publication data from OpenAlex, with missing venues and authors filled in from Crossref; citation counts are the higher of OpenAlex and Semantic Scholar, last synced 2026-10-12. One-sentence summaries under some papers are written by Semantic Scholar’s model. Citation counts may be lower than on Google Scholar, which indexes more sources.

Report an error

Wrong papers, two people merged into one, or a profile that should not be here? Tell us and we will fix or hide it.

Sign in to report