Is this you? Claim this profile to correct it, add a bio and choose the work people see first.

Claim this profile

Works97 from public data

TitleCited by
  • C-Eval: A Multi-Level Multi-Discipline Chinese Evaluation Suite for Foundation Models

    Yuzhen Huang, Yuzhuo Bai, Zhihao Zhu, Junlei Zhang, Jinghan Zhang, Tangjun Su, Junteng Liu, Chuancheng Lv, +5 more

    arXiv · 2023

    C-Eval is presented, the first comprehensive Chinese evaluation suite designed to assess advanced knowledge and reasoning abilities of foundation models in a Chinese context, and is anticipated to help analyze important strengths and shortcomings of foundation Models, and foster their development and growth for Chinese users.

    963
  • On the Sentence Embeddings from Pre-trained Language Models

    Bohan Li, Hao Zhou, Junxian He, Mingxuan Wang, Yiming Yang, Lei Li

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2020

    This paper proposes to transform the anisotropic sentence embedding distribution to a smooth and isotropic Gaussian distribution through normalizing flows that are learned with an unsupervised objective and achieves significant performance gains over the state-of-the-art sentence embeddings on a variety of semantic textual similarity tasks.

    572
  • Revisiting Self-Training for Neural Sequence Generation

    Junxian He, Jiatao Gu, Jiajun Shen, Marc’Aurelio Ranzato

    Rare & Special e-Zone (The Hong Kong University of Science and Technology) · 2020

    Empirical study on standard machine translation and text summarization benchmarks shows that noisy self-training is able to effectively utilize unlabeled data and improve the performance of the supervised baseline by a large margin.

    301
  • Choosing Transfer Languages for Cross-Lingual Learning

    Yu-Hsiang Lin, Chian-Yu Chen, Jean Lee, Zirui Li, Yuyan Zhang, Mengzhou Xia, Shruti Rijhwani, Junxian He, +5 more

    Annual Meeting of the Association for Computational Linguistics (ACL) · 2019

    This paper considers the task of automatically selecting optimal transfer languages as a ranking problem, and builds models that consider the aforementioned features to perform this prediction, and demonstrates that this model predicts good transfer languages much better than ad hoc baselines considering single features in isolation.

    282
  • Towards a Unified View of Parameter-Efficient Transfer Learning

    Junxian He, Chunting Zhou, Xuezhe Ma, Taylor Berg-Kirkpatrick, Graham Neubig

    arXiv · 2021

    268
  • Mega: Moving Average Equipped Gated Attention

    Xuezhe Ma, Chunting Zhou, Xiang Kong, Junxian He, Liangke Gui, Graham Neubig, Jonathan May, Luke Zettlemoyer

    arXiv · 2022

    This paper introduces Mega, a simple, theoretically grounded, single-head gated attention mechanism equipped with (exponential) moving average to incorporate inductive bias of position-aware local dependencies into the position-agnostic attention mechanism.

    256
  • Lagging Inference Networks and Posterior Collapse in Variational Autoencoders

    Junxian He, Daniel Spokoyny, Graham Neubig, Taylor Berg-Kirkpatrick

    arXiv · 2019

    189
  • CTRLsum: Towards Generic Controllable Text Summarization

    Junxian He, Wojciech Kryściński, Bryan McCann, Nazneen Fatema Rajani, Caiming Xiong

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2022

    CTRLsum is a generic framework to control generated summaries through a set of keywords, comparable or better than strong pretrained systems in a standard, unconstrained summarization setting.

    165
  • A Survey of Reasoning with Foundation Models: Concepts, Methodologies, and Outlook

    Jiankai Sun, Chuanyang Zheng, Enze Xie, Zhengying Liu, Ruihang Chu, Jianing Qiu, Jiaqi Xu, Mingyu Ding, +22 more

    ACM Computing Surveys · 2025

    This article introduces seminal foundation models proposed or adaptable for reasoning, highlighting the latest advancements in various reasoning tasks, methods, and benchmarks, and delves into the potential future directions behind the emergence of reasoning abilities within foundation models.

    142
  • K2: A Foundation Language Model for Geoscience Knowledge Understanding and Utilization

    Cheng Deng, Tianhang Zhang, Zhongmou He, Qiyuan Chen, Yuanyuan Shi, Yi Xin Xu, Luoyi Fu, Weinan Zhang, +4 more

    ACM International Conference on Web Search and Data Mining (WSDM) · 2024

    The first-ever LLM in geoscience, K2, is presented alongside a suite of resources developed to further promote LLM research within geoscience, and a protocol is shared that can efficiently gather domain-specific data and construct domain-supervised data, even in situations where manpower is scarce.

    142
  • Efficient Nearest Neighbor Language Models

    Junxian He, Graham Neubig, Taylor Berg-Kirkpatrick

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2021

    The recently proposed k-nearest neighbors language model is taken as an example, and methods to improve its efficiency along various dimensions are explored, able to achieve up to a 6x speed-up in inference speed while retaining comparable performance.

    129
  • StructVAE: Tree-structured Latent Variable Models for Semi-supervised Semantic Parsing

    Pengcheng Yin, Chunting Zhou, Junxian He, Graham Neubig

    Annual Meeting of the Association for Computational Linguistics (ACL) · 2018

    StructVAE is introduced, a variational auto-encoding model for semi-supervised semantic parsing, which learns both from limited amounts of parallel data, and readily-available unlabeled NL utterances, and outperforms strong supervised models.

    103
  • A Survey of Reasoning with Foundation Models

    Jiankai Sun, Chuanyang Zheng, Enze Xie, Zhengying Liu, Ruihang Chu, Jianing Qiu, Jiaqi Xu, Mingyu Ding, +22 more

    arXiv · 2023

    This paper introduces seminal foundation models proposed or adaptable for reasoning, highlighting the latest advancements in various reasoning tasks, methods, and benchmarks and discusses the relevance of multimodal learning, autonomous agents, and super alignment in the context of reasoning.

    73
  • A Surprisingly Effective Fix for Deep Latent Variable Modeling of Text

    Bohan Li, Junxian He, Graham Neubig, Taylor Berg-Kirkpatrick, Yiming Yang

    Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · 2019

    A simple fix for posterior collapse is investigated which yields surprisingly effective results and is used to argue that the typical surrogate objective for VAEs may not be sufficient or necessarily appropriate for balancing the goals of representation learning and data distribution modeling.

    73
  • ATP homeostasis and signaling in plants

    Jiaqi Xiao, Yijie Zhou, Yunyun Xie, Taotao Li, Xinguo Su, Junxian He, Yueming Jiang, Hong Mei Zhu, +1 more

    Plant Communications · 2024

    Recent advances in understanding the regulatory control of the cellular ATP pool are reviewed and possible interactions among key regulators of ATP-pool homeostasis and crosstalk between iATP/eATP signaling pathways are discussed.

    64
  • Texar: A Modularized, Versatile, and Extensible Toolkit for Text Generation

    Zhiting Hu, Haoran Shi, Bowen Tan, Wentao Wang, Zichao Yang, Tiancheng Zhao, Junxian He, Lianhui Qin, +7 more

    Annual Meeting of the Association for Computational Linguistics: System Demonstrations (ACL Demo) · 2019

    This work introduces Texar, an open-source toolkit aiming to support the broad set of text generation tasks that transform any inputs into natural language, such as machine translation, summarization, dialog, content manipulation, and so forth.

    56
  • TripleBrain: A Compact Neuromorphic Hardware Core With Fast On-Chip Self-Organizing and Reinforcement Spike-Timing Dependent Plasticity

    Haibing Wang, Zhen He, Tengxiao Wang, Junxian He, Xichuan Zhou, Ying Wang, Liyuan Liu, Nanjian Wu, +2 more

    IEEE Transactions on Biomedical Circuits and Systems · 2022

    50
  • A Probabilistic Formulation of Unsupervised Text Style Transfer

    Junxian He, Xinyi Wang, Graham Neubig, Taylor Berg-Kirkpatrick

    arXiv · 2020

    49
  • Efficient Correlated Topic Modeling with Topic Embedding

    Junxian He, Zhiting Hu, Taylor Berg-Kirkpatrick, Ying Huang, Eric P. Xing

    ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD) · 2017

    A new model which learns compact topic embeddings and captures topic correlations through the closeness between the topic vectors is proposed, enabling efficient inference in the low-dimensional embedding space.

    49
  • Unsupervised Learning of Syntactic Structure with Invertible Neural Projections

    Junxian He, Graham Neubig, Taylor Berg-Kirkpatrick

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2018

    A novel generative model is proposed that jointly learns discrete syntactic structure and continuous word representations in an unsupervised fashion by cascading an invertible neural network with a structured generative prior so long as the prior is well-behaved.

    45
  • Prompt Consistency for Zero-Shot Task Generalization

    Chunting Zhou, Junxian He, Xuezhe Ma, Taylor Berg-Kirkpatrick, Graham Neubig

    Findings of the Association for Computational Linguistics: EMNLP 2022 · 2022

    41
  • DeepTempo: A Hardware-Friendly Direct Feedback Alignment Multi-Layer Tempotron Learning Rule for Deep Spiking Neural Networks

    Cong Shi, Tengxiao Wang, Junxian He, Jianghao Zhang, Liyuan Liu, Nanjian Wu

    IEEE Transactions on Circuits & Systems II Express Briefs · 2021

    36
  • High-accuracy deep ANN-to-SNN conversion using quantization-aware training framework and calcium-gated bipolar leaky integrate and fire neuron

    Haoran Gao, Junxian He, Haibing Wang, Tengxiao Wang, Zhengqing Zhong, Jianyi Yu, Ying Wang, Min Tian, +1 more

    Frontiers in Neuroscience · 2023

    A calcium-gated bipolar leaky integrate and fire (Ca-LIF) spiking neuron model is proposed to better approximate the functions of the ReLU neurons widely adopted in ANNs and a quantization-aware training (QAT)-based framework leveraging an off-the-shelf QAT toolkit for easy ANN-to-SNN conversion is proposed.

    35
  • CompSNN: A lightweight spiking neural network based on spatiotemporally compressive spike features

    Tengxiao Wang, Cong Shi, Xichuan Zhou, Yingcheng Lin, Junxian He, Ping Gan, Li Ping, Ying Wang, +3 more

    Neurocomputing · 2020

    This paper proposes efficient spatiotemporally compressive spike features and presents a lightweight SNN framework that includes a feature extraction layer to extract such compressive features and has a potential to be applied in low-cost or resource-limited edge computing systems and embedded devices.

    33
  • FacTool: Factuality Detection in Generative AI -- A Tool Augmented Framework for Multi-Task and Multi-Domain Scenarios

    I-Chun Chern, Steffi Chern, Shiqi Chen, Weizhe Yuan, Kehua Feng, Chunting Zhou, Junxian He, Graham Neubig, +1 more

    arXiv · 2023

    24

Show all 97 works

Publication data from OpenAlex, with missing venues and authors filled in from Crossref; citation counts are the higher of OpenAlex and Semantic Scholar, last synced 2026-10-13. One-sentence summaries under some papers are written by Semantic Scholar’s model. Citation counts may be lower than on Google Scholar, which indexes more sources.

Report an error

Wrong papers, two people merged into one, or a profile that should not be here? Tell us and we will fix or hide it.

Sign in to report