Is this you? Claim this profile to correct it, add a bio and choose the work people see first.

Claim this profile

Academic lineage

Possible advisorsa guess from early papers, not confirmed

  • Khanh Vu

    Possible advisor · last author on 3 of their early first-author papers, 2007–2008

    Suggested from co-authorship

Is this you? Claim this profile to confirm or dismiss it.

Works86 from public data

TitleCited by
  • Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing

    裕二 池谷, Robert Tinn, Hao Cheng, MICHAEL A. LUCAS, Naoto Usuyama, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, +1 more

    ACM Transactions on Computing for Healthcare · 2021

    It is shown that for domains with abundant unlabeled text, such as biomedicine, pretraining language models from scratch results in substantial gains over continual pretraining of general-domain language models.

    2,830
  • Language Models for Image Captioning: The Quirks and What Works

    Jacob Devlin, Hao Cheng, Hao Fang, Saurabh Gupta, Li Deng, Xiaodong He, Geoffrey Zweig, Margaret Mitchell

    Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 2: Short Papers) · 2015

    By combining key aspects of the ME and RNN methods, this paper achieves a new record performance over previously published results on the benchmark COCO dataset, however, the gains the authors see in BLEU do not translate to human judgments.

    293
  • Augmenting Language Models with Long-Term Memory

    Weizhi Wang, Li Dong, Hao Cheng, Xiaodong Liu, Xifeng Yan, Jianfeng Gao, Furu Wei

    arXiv · 2023

    Experiments show that the proposed framework, Language Models Augmented with Long-Term Memory (LongMem), outperforms strong long-context models on ChapterBreak, a challenging long- context modeling benchmark, and achieves remarkable improvements on memory-augmented in-context learning over LLMs.

    263
  • Fine-tuning large neural language models for biomedical natural language processing

    Robert Tinn, Hao Cheng, 裕二 池谷, Naoto Usuyama, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon

    Patterns · 2023

    Overall, domain-specific vocabulary and pretraining facilitate robust models for fine-tuning and establish a new state of the art on a wide range of biomedical NLP applications.

    203
  • Dialogue State Tracking with a Language Model using Schema-Driven Prompting

    Chia‐Hsuan Lee, Hao Cheng, Mari Ostendorf

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2021

    A new variation of the language modeling approach that uses schema-driven prompting to provide task-aware history encoding that is used for both categorical and non-categorical slots is introduced.

    151
  • High-efficiency chaotic time series prediction based on time convolution neural network

    Wei Xin Cheng, Yan Wang, Zheng Peng, Xiaodong Ren, Yubei Shuai, Shengyin Zang, Hao Liu, Hao Cheng, +1 more

    Chaos Solitons & Fractals · 2021

    110
  • MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts

    Pan Lu, Hritik Bansal, Tony Xia, Liu, Jiacheng, Chunyuan Li, Hannaneh Hajishirzi, Hao Cheng, Kai-Wei Chang, +2 more

    arXiv · 2023

    93
  • Adversarial Training for Large Neural Language Models

    Xiaodong Liu, Hao Cheng, Pengcheng He, Weizhu Chen, Yu Wang, Hoifung Poon, Jianfeng Gao

    arXiv · 2020

    89
  • Self-Verification Improves Few-Shot Clinical Information Extraction

    Zelalem Gero, Chandan Singh, Hao Cheng, Tristan Naumann, Michel Galley, Jianfeng Gao, Hoifung Poon

    arXiv · 2023

    This work explores a general mitigation framework using self-verification, which leverages the LLM to provide provenance for its own extraction and check its own outputs and consistently improves accuracy for various LLMs in standard clinical information extraction tasks.

    85
  • Constrained locally weighted clustering

    Hao Cheng, Kien A. Hua, Khanh Vu

    Proceedings of the VLDB Endowment · 2008

    The theoretical analysis shows that the probability of points being assigned to the correct clusters is much higher by the new algorithm, compared to the conventional methods, indicating that the design produces clusters which are closer to the ground truth than clusters created by the current state of theart algorithms.

    75
  • ExACT: Teaching AI Agents to Explore with Reflective-MCTS and Exploratory Learning

    Yu Xiao, Baolin Peng, Vineeth Vajipey, Hao Cheng, Michel Galley, Jianfeng Gao, Zhou Yu

    arXiv · 2024

    ExACT, an approach to combine test-time search and self-learning to build o1-like models for agentic applications, is presented, suggesting a promising research direction to enhance VLMs' capabilities for agentic applications via test-time search and self-learning.

    67
  • UnitedQA: A Hybrid Approach for Open Domain Question Answering

    Hao Cheng, Yelong Shen, Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao

    Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · 2021

    It is demonstrated that a simple hybrid approach by combining answers from both readers can efficiently take advantages of extractive and generative answer inference strategies and outperforms single models as well as homogeneous ensembles.

    67
  • NeurIPS 2020 EfficientQA Competition: Systems, Analyses and Lessons Learned

    Sewon Min, Jordan Lee Boyd-Graber, Chris Alberti, Danqi Chen, Eunsol Choi, Collins, Michael, Kelvin Guu, Hannaneh Hajishirzi, +22 more

    arXiv · 2021

    64
  • The Microsoft Toolkit of Multi-Task Deep Neural Networks for Natural Language Understanding

    Xiaodong Liu, Yu Wang, Jianshu Ji, Hao Cheng, Xueyun Zhu, Emmanuel Awa, Pengcheng He, Weizhu Chen, +3 more

    Annual Meeting of the Association for Computational Linguistics: System Demonstrations (ACL Demo) · 2020

    MT-DNN is presented, an open-source natural language understanding (NLU) toolkit that makes it easy for researchers and developers to train customized deep learning models, designed to facilitate rapid customization for a broad spectrum of NLU tasks.

    63
  • Sounding Board: A User-Centric and Content-Driven Social Chatbot

    Hao Fang, Hao Cheng, Maarten Sap, Elizabeth Clark, Ari Holtzman, Yejin Choi, Noah A. Smith, Mari Ostendorf

    Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Demonstrations · 2018

    The system architecture consists of several components including spoken language processing, dialogue management, language generation, and content management, with emphasis on user-centric and content-driven design.

    61
  • Disentangled Feature Representation for Few-Shot Image Classification

    Hao Cheng, Yufei Wang, Haoliang Li, Alex Chichung Kot, Bihan Wen

    IEEE Transactions on Neural Networks and Learning Systems · 2023

    This work proposes a novel disentangled feature representation (DFR) framework, dubbed DFR, for few-shot learning applications, which can adaptively decouple the discriminative features that are modeled by the classification branch, from the class-irrelevant component of the variation branch.

    57
  • Frequency Guidance Matters in Few-Shot Learning

    Hao Cheng, Siyuan Yang, Joey Tianyi Zhou, Lanqing Guo, Bihan Wen

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2023

    57
  • Open-Domain Name Error Detection using a Multi-Task RNN

    Hao Cheng, Hao Fang, Mari Ostendorf

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2015

    A multi-task recurrent neural network language model for sentence-level name detection is proposed for use in combination with out-of-vocabulary word detection, which shows a 26% improvement in name-error detection F-score over a system using n-gram lexical features.

    48
  • Bi-directional Attention with Agreement for Dependency Parsing

    Hao Cheng, Hao Fang, Xiaodong He, Jianfeng Gao, Li Deng

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2016

    A novel bi-directional attention model for dependency parsing, which learns to agree on headword predictions from the forward and backward parsing directions, which achieves state-of-the-art unlabeled attachment scores on 6 languages.

    47
  • Defending against Backdoor Attack on Deep Neural Networks

    Hao Cheng, Kaidi Xu, Sijia Liu, Pin‐Yu Chen, Pu Zhao, Xue Lin

    arXiv · 2020

    36
  • A non-linear dimensionality-reduction technique for fast similarity search in large databases

    Khanh Vu, Kien A. Hua, Hao Cheng, Sheau-Dong Lang

    Proceedings - ACM-SIGMOD International Conference on Management of Data · 2006

    A non-linear transformation scheme that extracts two important parameters specifying the data is presented, and it is proved that these parameters correspond to a bounded volume around the search sphere, irrespective of dimensionality.

    36
  • Graph Neural Networks With Triple Attention for Few-Shot Learning

    Hao Cheng, Joey Tianyi Zhou, Wee Peng Tay, Bihan Wen

    IEEE Transactions on Multimedia · 2023

    The proposed Attentive GNN model outperforms the state-of-the-art few-shot learning methods using both GNN and non-GNN approaches and is consistent over the mini-Image net, tiered-ImageNet, CUB-200-2011, and Flowers-102 benchmarks.

    33
  • Posterior Differential Regularization with f-divergence for Improving Model Robustness

    Hao Cheng, Xiaodong Liu, Lis Kanashiro Pereira, Yaoliang Yu, Jianfeng Gao

    Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · 2021

    It is shown that regularizing the posterior difference with f-divergence can result in well-improved model robustness, indicating the great potential of the proposed framework for enhancing NLPmodel robustness.

    33
  • Reassessing Layer Pruning in LLMs: New Insights and Methods

    Yao Lu, Hao Cheng, Fang, Yujie, Zeyu Wang, Jiaheng Wei, Dongwei Xu, Qi Xuan, Xiaoniu Yang, +1 more

    arXiv · 2024

    The results demonstrate that a simple approach, i.e., pruning the final 25\% of layers followed by fine-tuning the remaining last three layer, yields remarkably strong performance.

    30
  • Scalable and Sound Low-Rank Tensor Learning

    Hao Cheng, Yaoliang Yu, Zhang Xin-hua, Eric P. Xing, Dale Schuurmans

    International Conference on Artificial Intelligence and Statistics · 2016

    This work proposes directly optimizing the tensor trace norm by approximating its dual spectral norm, and shows that the approximation bounds can be efficiently converted to the original problem via the generalized conditional gradient algorithm.

    28

Show all 86 works

Publication data from OpenAlex, with missing venues and authors filled in from Crossref; citation counts are the higher of OpenAlex and Semantic Scholar, last synced 2026-10-12. One-sentence summaries under some papers are written by Semantic Scholar’s model. Citation counts may be lower than on Google Scholar, which indexes more sources.

Report an error

Wrong papers, two people merged into one, or a profile that should not be here? Tell us and we will fix or hide it.

Sign in to report