Is this you? Claim this profile to correct it, add a bio and choose the work people see first.

Claim this profile

Works371 from public data

TitleCited by
  • ERNIE 2.0: A Continual Pre-Training Framework for Language Understanding

    Yu Sun, Shuohuan Wang, Yukun Li, Shikun Feng, Hao Tian, Hua Ren Wu, Haifeng Wang

    Proceedings of the AAAI Conference on Artificial Intelligence · 2020

    A continual pre-training framework named ERNIE 2.0 which incrementally builds pre- training tasks and then learns pre-trained models on these constructed tasks via continual multi-task learning is proposed.

    914
  • RocketQA: An Optimized Training Approach to Dense Passage Retrieval for Open-Domain Question Answering

    Yingqi Qu, Yuchen Ding, Jing Liu, Kai Liu, Ruiyang Ren, Wayne Xin Zhao, Daxiang Dong, Hua Ren Wu, +1 more

    Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · 2021

    This work proposes an optimized training approach, called RocketQA, to improving dense passage retrieval, which significantly outperforms previous state-of-the-art models on both MSMARCO and Natural Questions and demonstrates that the performance of end-to-end QA can be improved based on theRocketQA retriever.

    794
  • Geometry-enhanced molecular representation learning for property prediction

    Xiaomin Fang, Lihang Liu, Jieqiong Lei, Donglong He, Shanzhuo Zhang, Jingbo Zhou, Fan Wang, Hua Ren Wu, +1 more

    Nature Machine Intelligence · 2022

    A novel geometry-enhanced molecular representation learning method that uses this geometric data in graph neural networks to predict a range of molecular properties and can considerably outperform various state-of-the-art baselines on different benchmarks.

    708
  • Multi-Task Learning for Multiple Language Translation

    Daxiang Dong, Hua Ren Wu, Wei Ping He, Dianhai Yu, Haifeng Wang

    Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · 2015

    The recently proposed neural machine translation model is extended to a multi-task learning framework which shares source language representation and separates the modeling of different target language translation.

    657
  • A support vector machine-based ensemble algorithm for breast cancer diagnosis

    Haifeng Wang, Bichen Zheng, Sang Won Yoon, Hoo Sang Ko

    European Journal of Operational Research · 2017

    The proposed WAUCE model achieves a higher accuracy with a significantly lower variance for breast cancer diagnosis compared to five other ensemble mechanisms and two common ensemble models, i.e., adaptive boosting and bagging classification tree.

    440
  • UNIMO: Towards Unified-Modal Understanding and Generation via Cross-Modal Contrastive Learning

    Wei Li, Can Gao, Guocheng Niu, Xinyan Xiao, Hao Liu, Jiachen Liu, Hua Ren Wu, Haifeng Wang

    Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · 2021

    A UNIfied-MOdal pre-training architecture, namely UNIMO, which can effectively adapt to both single- modal and multi-modal understanding and generation tasks, and is able to learn more generalizable representations.

    431
  • ERNIE-ViL: Knowledge Enhanced Vision-Language Representations through Scene Graphs

    Fei Richard Yu, Jiji Tang, Weichong Yin, Yu Sun, Hao Tian, Hua Ren Wu, Haifeng Wang

    Proceedings of the AAAI Conference on Artificial Intelligence · 2021

    A knowledge-enhanced approach, ERNIE-ViL, which incorporates structured knowledge obtained from scene graphs to learn joint representations of vision-language and ranks the first place on the VCR leaderboard with an absolute improvement of 3.7%.

    424
  • Pre-Trained Language Models and Their Applications

    Haifeng Wang, Jiwei Li, Hua Ren Wu, Eduard H. Hovy, Yu Sun

    Engineering · 2022

    399
  • STACL: Simultaneous Translation with Implicit Anticipation and Controllable Latency using Prefix-to-Prefix Framework

    Mingbo Ma, Liang Huang, Hao Xiong, Renjie Zheng, Kaibo Liu, Baigong Zheng, Chuanqiang Zhang, Zhongjun He, +4 more

    Annual Meeting of the Association for Computational Linguistics (ACL) · 2019

    A novel prefix-to-prefix framework for si- multaneous translation that implicitly learns to anticipate in a single translation model that achieves low latency and reasonable quality (compared to full-sentence translation) on 4 directions.

    341
  • RocketQAv2: A Joint Training Method for Dense Passage Retrieval and Passage Re-ranking

    Ruiyang Ren, Yingqi Qu, Jing Liu, Wayne Xin Zhao, Qiaoqiao She, Hua Ren Wu, Haifeng Wang, Ji-Rong Wen

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2021

    A novel joint training approach for dense passage retrieval and passage reranking is proposed, where the dynamic listwise distillation is introduced, where a unified listwise training approach is designed for both the retriever and the re-ranker.

    321
  • DuReader: a Chinese Machine Reading Comprehension Dataset from Real-world Applications

    Wei Ping He, Kai Liu, Jing Liu, Yajuan Lyu, Shiqi Zhao, Xinyan Xiao, Yuan Liu, Yizhong Wang, +5 more

    Proceedings of the Workshop on Machine Reading for Question Answering · 2018

    This paper introduces DuReader, a new large-scale, open-domain Chinese machine reading comprehension (MRC) dataset, designed to address real-world MRC, and organizes a shared competition to encourage the exploration of more models.

    313
  • SKEP: Sentiment Knowledge Enhanced Pre-training for Sentiment Analysis

    Hao Tian, Can Gao, Xinyan Xiao, Hao Liu, Bolei He, Hua Ren Wu, Haifeng Wang, Feng Wu

    Annual Meeting of the Association for Computational Linguistics (ACL) · 2020

    Sentiment Knowledge Enhanced Pre-training (SKEP) is introduced in order to learn a unified sentiment representation for multiple sentiment analysis tasks, and significantly outperforms strong pre-training baseline, and achieves new state-of-the-art results on most of the test datasets.

    299
  • PLATO: Pre-trained Dialogue Generation Model with Discrete Latent Variable

    Siqi Bao, He Huang, Fan Wang, Hua Ren Wu, Haifeng Wang

    Annual Meeting of the Association for Computational Linguistics (ACL) · 2020

    This work proposes a novel dialogue generation pre-training framework to support various kinds of conversations, including chit-chat, knowledge grounded dialogues, and conversational question answering, and introduces discrete latent variables to tackle the inherent one-to-many mapping problem in response generation.

    297
  • Learning Semantic Hierarchies via Word Embeddings

    Ruiji Fu, Jiang Hong Guo, Bing Qin, Wanxiang Che, Haifeng Wang, Ting Liu

    Annual Meeting of the Association for Computational Linguistics (ACL) · 2014

    This paper proposes a novel and effective method for the construction of semantic hierarchies based on word embeddings, which can be used to measure the semantic relationship between words.

    289
  • Towards Conversational Recommendation over Multi-Type Dialogs

    Zeming Liu, Haifeng Wang, Zheng-Yu Niu, Hua Ren Wu, Wanxiang Che, Ting Liu

    Annual Meeting of the Association for Computational Linguistics (ACL) · 2020

    This work creates a human-to-human Chinese dialog dataset DuRecDial, where there are multiple sequential dialogs for a pair of a recommendation seeker and a recommender, where the recommender proactively leads a multi-type dialog to approach recommendation targets and then makes multiple recommendations with rich interaction behavior.

    254
  • Pivot language approach for phrase-based statistical machine translation

    Hua Ren Wu, Haifeng Wang

    Machine Translation · 2007

    This paper proposes a novel method for phrase-based statistical machine translation based on the use of a pivot language, using BLEU as a metric, that significantly outperforms the standard model trained on a small bilingual corpus.

    245
  • Rare earth element geochemistry characteristics of seawater and porewater from deep sea in western Pacific

    Yinan Deng, Jiangbo Ren, Qingjun Guo, Jun Cao, Haifeng Wang, Chenhui Liu

    Scientific Reports · 2017

    This study suggests that porewater flux in the western Pacific basin is a minor source of REEs to seawater, and abundant REEs are enriched in sediments, which is mainly caused by the extensive oxic condition, low sedimentation rate and strong adsorption capacity of sediments.

    238
  • Progress in Machine Translation

    Haifeng Wang, Hua Ren Wu, Zhongjun He, Liang Huang, Kenneth Church

    Engineering · 2021

    The history of machine translation is reviewed, including the basic framework and the current dominant framework, Transformer, as well as multilingual translation models to deal with the data sparseness problem and cutting-edge simultaneous translation methods that achieve a balance between translation quality and latency.

    225
  • Proactive Human-Machine Conversation with Explicit Conversation Goal

    Wenquan Wu, Zhen Guo, Xiangyang Zhou, Hua Ren Wu, Xiyuan Zhang, Rongzhong Lian, Haifeng Wang

    Annual Meeting of the Association for Computational Linguistics (ACL) · 2019

    Experimental results show that dialogue models that plan over the knowledge graph can make full use of related knowledge to generate more diverse multi-turn conversations.

    219
  • Cross-lingual Dependency Parsing Based on Distributed Representations

    Jiang Hong Guo, Wanxiang Che, David Yarowsky, Haifeng Wang, Ting Liu

    Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · 2015

    This paper provides two algorithms for inducing cross-lingual distributed representations of words, which map vocabularies from two different languages into a common vector space and bridges the lexical feature gap by using distributed feature representations and their composition.

    201
  • ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generation

    Yu Sun, Shuohuan Wang, Shikun Feng, Siyu Ding, Chao Pang, Junyuan Shang, Jiaxiang Liu, Xuyi Chen, +14 more

    arXiv · 2021

    186
  • ConSTGAT

    Xiaomin Fang, Jizhou Huang, Fan Wang, Lingke Zeng, Haijin Liang, Haifeng Wang

    ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (KDD) · 2020

    A spatial-temporal graph neural network that adopts a novel graph attention mechanism, which is designed to fully exploit the joint relations of spatial and temporal information, and a computationally efficient model that applies convolutions over local windows to capture a route's contextual information and further employs multi-task learning to improve the performance.

    177
  • End-to-End Speech Translation with Knowledge Distillation

    Yuchen Liu, Hao Xiong, Jiajun Zhang, Zhongjun He, Hua Ren Wu, Haifeng Wang, Chengqing Zong

    Interspeech (USB) · 2019

    This paper proposes a knowledge distillation approach to improve end-to-end speech translation model by transferring the knowledge from text translation model throughknowledge distillation.

    177
  • ERNIE-ViLG 2.0: Improving Text-to-Image Diffusion Model with Knowledge-Enhanced Mixture-of-Denoising-Experts

    Zhida Feng, Zhenyu Zhang, Xintong Yu, Yewei Fang, Lanxin Li, Xuyi Chen, Yuxiang Lu, Jiaxiang Liu, +7 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023

    166
  • Federated Learning with Class Imbalance Reduction

    Miao Yang, Ximin Wang, Hongbin Zhu, Haifeng Wang, Hua Lin Qian

    European Signal Processing Conference (EUSIPCO) · 2021

    An estimation scheme to reveal the class distribution without the awareness of raw data is designed and a multi-arm bandit based algorithm is proposed that can select the client set with minimal class imbalance and can significantly improve the convergence performance of the global model.

    166

Show all 371 works

Publication data from OpenAlex, with missing venues and authors filled in from Crossref; citation counts are the higher of OpenAlex and Semantic Scholar, last synced 2026-10-14. One-sentence summaries under some papers are written by Semantic Scholar’s model. Citation counts may be lower than on Google Scholar, which indexes more sources.

Report an error

Wrong papers, two people merged into one, or a profile that should not be here? Tell us and we will fix or hide it.

Sign in to report