Is this you? Claim this profile to correct it, add a bio and choose the work people see first.

Claim this profile

Academic lineage

Possible advisorsa guess from early papers, not confirmed

  • Chengqi Zhang

    Possible advisor · last author on 4 of their early first-author papers, 2018

    Suggested from co-authorship

Is this you? Claim this profile to confirm or dismiss it.

Works68 from public data

TitleCited by
  • DiSAN: Directional Self-Attention Network for RNN/CNN-Free Language Understanding

    Tao Shen, Tianyi Zhou, Guodong Long, Jing Bo Jiang, Shirui Pan, Chengqi Zhang

    Proceedings of the AAAI Conference on Artificial Intelligence · 2018

    A novel attention mechanism in which the attention between elements from input sequence(s) is directional and multi-dimensional (i.e., feature-wise) and a light-weight neural net is proposed, based solely on the proposed attention without any RNN/CNN structure, which outperforms complicated RNN models on both prediction quality and time efficiency.

    794
  • Multi-center federated learning: clients clustering for better personalization

    Guodong Long, Ming Xiao Xie, Tao Shen, Tianyi Zhou, Xianzhi Wang, Jing Bo Jiang

    World Wide Web · 2022

    A novel multi-center aggregation mechanism to cluster clients using their models’ parameters is proposed that learns multiple global models from data as the cluster centers, and simultaneously derives the optimal matching between users and centers and outperforms several popular baseline methods.

    399
  • Federated unsupervised representation learning

    Fengda Zhang, Kun Kuang, Long Chen, Zhaoyang You, Tao Shen, Jun Xiao, Yin Zhang⋆, Chao Wu, +3 more

    Frontiers of Information Technology & Electronic Engineering · 2023

    The federated contrastive averaging with dictionary and alignment (FedCA) algorithm, composed of two key modules: a dictionary module to aggregate the representations of samples from each client which can be shared with all clients for consistency of representation space, is adopted for local model training.

    174
  • Reinforced Self-Attention Network: a Hybrid of Hard and Soft Attention for Sequence Modeling

    Tao Shen, Tianyi Zhou, Guodong Long, Jing Bo Jiang, Sen Wang, Chengqi Zhang

    International Joint Conference on Artificial Intelligence · 2018

    An RNN/CNN-free sentence-encoding model, "reinforced self-attention network (ReSAN)", solely based on ReSA is proposed, which achieves state-of-the-art performance on both the Stanford Natural Language Inference and the Sentences Involving Compositional Knowledge datasets.

    148
  • Thread of Thought Unraveling Chaotic Contexts

    Yucheng Zhou, Xiubo Geng, Tao Shen, Chongyang Tao, Guodong Long, Jian–Guang Lou, Jianbing Shen

    arXiv · 2023

    This work introduces the "Thread of Thought" strategy, which draws inspiration from human cognitive processes and systematically segments and analyzes extended contexts while adeptly selecting pertinent information within the chaotic context.

    93
  • Self-Attention Enhanced Selective Gate with Entity-Aware Embedding for Distantly Supervised Relation Extraction

    Yang Li, Guodong Long, Tao Shen, Tianyi Zhou, Lina Yao, Huan Huo, Jing Bo Jiang

    Proceedings of the AAAI Conference on Artificial Intelligence · 2020

    A brand-new light-weight neural framework to address the distantly supervised relation extraction problem and alleviate the defects in previous selective attention framework is proposed, which achieves a new state-of-the-art performance in terms of both AUC and top-n precision metrics.

    90
  • Multi-Task Learning for Conversational Question Answering over a Large-Scale Knowledge Base

    Tao Shen, Xiubo Geng, Tao Qin, Daya Guo, Duyu Tang, Nan Duan, Guodong Long, Daxin Jiang

    Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · 2019

    This work proposes an innovative multi-task learning framework where a pointer-equipped semantic parsing model is designed to resolve coreference in conversations, and naturally empower joint learning with a novel type-aware entity detection model.

    85
  • Federated Learning for Privacy-Preserving Open Innovation Future on Digital Health

    Guodong Long, Tao Shen, Yue Tan, Leah Gerrard, Allison Clarke, Jing Bo Jiang

    Springer eBooks · 2021

    This chapter will discuss how federated learning can enable the development of an open health ecosystem with the support of AI.

    78
  • Re-Reading Improves Reasoning in Large Language Models

    Xiaohan Xu, Chongyang Tao, Tao Shen, Can Xu, Hongbo Xu, Guodong Long, Jian-Guang Lou, Shuai Ma

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2024

    RE2 demonstrates strong generality and compatibility with most thought-eliciting prompting methods, including CoT, and its adaptability is revealed, showing how it can be effectively integrated with different LLMs, thought-eliciting prompting, and ensemble strategies.

    74
  • Improving Zero-Shot Cross-lingual Transfer for Multilingual Question Answering over Knowledge Graph

    Yucheng Zhou, Xiubo Geng, Tao Shen, Wenqiang Zhang, Daxin Jiang

    Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · 2021

    74
  • Exploiting Structured Knowledge in Text via Graph-Guided Representation Learning

    Tao Shen, Yi Mao, Pengcheng He, Guodong Long, Adam Trischler, Weizhu Chen

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2020

    This work proposes an entity masking scheme that exploits relational knowledge underlying the text, and uses knowledge graphs to obtain distractors for the masked entities, and proposes a novel distractor-suppressed ranking objective which is optimized jointly with masked language model.

    74
  • Bi-Directional Block Self-Attention for Fast and Memory-Efficient Sequence Modeling

    Tao Shen, Tianyi Zhou, Guodong Long, Jing Bo Jiang, Chengqi Zhang

    arXiv · 2018

    70
  • EventBERT: A Pre-Trained Model for Event Correlation Reasoning

    Yucheng Zhou, Xiubo Geng, Tao Shen, Guodong Long, Daxin Jiang

    ACM Web Conference (WWW) · 2022

    EventBERT is proposed, a pre-trained model to encapsulate eventuality knowledge from unlabeled text and outperforms existing pre- trained models by a large margin, e.g., 6.5 ∼ 23%, in zero-shot learning of these tasks.

    69
  • Federated Mutual Learning

    Tao Shen, Jie Zhang, Xinkang Jia, Fengda Zhang, Gang Huang, Pan Zhou, Kuang, Kun, Chao Wu, +1 more

    arXiv · 2020

    66
  • Modeling Event-Pair Relations in External Knowledge Graphs for Script Reasoning

    Yucheng Zhou, Xiubo Geng, Tao Shen, Jian Pei, Wenqiang Zhang, Daxin Jiang

    Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021 · 2021

    A knowledge model to learn the inferential relations between events from the whole eventuality KG and a neural script adapter to extend the knowledge model for inferring the associated relations be-tween an event chain and a subsequent event candidate is presented.

    57
  • Large Language Models are Strong Zero-Shot Retriever

    Tao Shen, Guodong Long, Xiubo Geng, Chongyang Tao, Tianyi Zhou, Daxin Jiang

    arXiv · 2023

    The Language language model as Retriever (LameR), is built upon no other neural models but an LLM, while breaking brute-force combinations of retrievers with LLMs and lifting the performance of zero-shot retrieval to be very competitive on benchmark datasets.

    54
  • BianCang: A Traditional Chinese Medicine Large Language Model

    Sibo Wei, Xueping Peng, Yifei Wang, Tao Shen, Jiasheng Si, Weiyu Zhang, Fa Zhu, Athanasios V. Vasilakos, +3 more

    IEEE Journal of Biomedical and Health Informatics · 2025

    BianCang is proposed, a TCM-specific LLM, using a two-stage training process that first injects domainspecific knowledge and then aligns it through targeted stimulation to enhance diagnostic and differentiation capabilities.

    50
  • PCL: Peer-Contrastive Learning with Diverse Augmentations for Unsupervised Sentence Embeddings

    Qiyu Wu, Chongyang Tao, Tao Shen, Can Xu, Xiubo Geng, Daxin Jiang

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2022

    A novel Peer-Contrastive Learning (PCL) with diverse augmentations is proposed, which performs peer-positive contrast as well as peer-network cooperation, which offers an inherent anti-bias ability and an effective way to learn from diverse augmentation.

    50
  • LexMAE: Lexicon-Bottlenecked Pretraining for Large-Scale Retrieval

    Tao Shen, Xiubo Geng, Chongyang Tao, Can Xu, Xiaolong Huang, Binxing Jiao, Linjun Yang, Daxin Jiang

    arXiv · 2022

    A brand-new pre-training framework, lexicon-bottlenecked masked autoencoder (LexMAE), to learn importance-aware lexicon representations, which shows state-of-the-art zero-shot transfer capability on BEIR benchmark with 12 datasets.

    48
  • Prompt Federated Learning for Weather Forecasting: Toward Foundation Models on Meteorological Data

    Shengchao Chen, Guodong Long, Tao Shen, Jing Bo Jiang

    International Joint Conference on Artificial Intelligence · 2023

    42
  • UnifieR: A Unified Retriever for Large-Scale Retrieval

    Tao Shen, Xiubo Geng, Chongyang Tao, Can Xu, Guodong Long, Kai Zhang, Daxin Jiang

    ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · 2023

    This work proposes a new learning framework, Unifier, which unifies dense-vector and lexicon-based retrieval in one model with a dual-representing capability, and experiments on passage retrieval benchmarks verify its effectiveness in both paradigms.

    37
  • ClarET: Pre-training a Correlation-Aware Context-To-Event Transformer for Event-Centric Generation and Classification

    Yucheng Zhou, Tao Shen, Xiubo Geng, Guodong Long, Daxin Jiang

    Annual Meeting of the Association for Computational Linguistics (ACL) · 2022

    37
  • LexLIP: Lexicon-Bottlenecked Language-Image Pre-Training for Large-Scale Image-Text Sparse Retrieval

    Ziyang Luo, Pu Zhao, Can Xu, Xiubo Geng, Tao Shen, Chongyang Tao, Jing Ma, Qingwei Lin, +1 more

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2023

    36
  • Sequential Diagnosis Prediction with Transformer and Ontological Representation

    Xueping Peng, Guodong Long, Tao Shen, Sen Wang, Jing Bo Jiang

    Proceedings · 2021

    An end-to-end robust transformer-based model called SETOR is proposed, which exploits neural ordinary differential equation to handle both irregular intervals between a patient’s visits with admitted timestamps and length of stay in each visit, and to alleviate the limitation of insufficient data by integrating medical ontology.

    36
  • Temporal Self-Attention Network for Medical Concept Embedding

    Xueping Peng, Guodong Long, Tao Shen, Sen Wang, Jing Bo Jiang, Michael Blumenstein

    Proceedings · 2019

    This work proposes a novel attention mechanism which captures the contextual information and temporal relationships between medical concepts and is the first to exploit temporal self-attentive relations between medical events.

    35

Show all 68 works

Publication data from OpenAlex, with missing venues and authors filled in from Crossref; citation counts are the higher of OpenAlex and Semantic Scholar, last synced 2026-10-15. One-sentence summaries under some papers are written by Semantic Scholar’s model. Citation counts may be lower than on Google Scholar, which indexes more sources.

Report an error

Wrong papers, two people merged into one, or a profile that should not be here? Tell us and we will fix or hide it.

Sign in to report