Is this you? Claim this profile to correct it, add a bio and choose the work people see first.

Claim this profile

Academic lineage

Possible advisorsa guess from early papers, not confirmed

  • Qi Chuan Tian

    Possible advisor · last author on 4 of their early first-author papers, 2018–2020

    Suggested from co-authorship
  • Jinhui Tang

    Possible advisor · last author on 3 of their early first-author papers, 2020–2021

    Suggested from co-authorship

Is this you? Claim this profile to confirm or dismiss it.

Works63 from public data

TitleCited by
  • Egocentric Video-Language Pretraining

    Kevin Qinghong Lin, Alex Jinpeng Wang, Mattia Soldan, Michael Wray, Rui Yan, Zhongcong Xu, Difei Gao, Rong-Cheng Tu, +8 more

    arXiv · 2022

    The recently released Ego4D dataset is exploited to pioneer Egocentric VLP along three directions, and a novel pretraining objective is proposed, dubbed EgoNCE, which adapts video-text contrastive learning to the egocentric domain by mining egOCentric-aware positive and negative samples.

    306
  • All in One: Exploring Unified Video-Language Pre-Training

    Jinpeng Wang, Yixiao Ge, Rui Yan, Yuying Ge, Kevin Qinghong Lin, Satoshi Tsutsui, Xudong Lin, Guanyu Cai, +4 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023

    This work introduces an end-to-end VLP model, namely all-in-one Transformer, that embeds raw video and textual signals into joint representations using a unified backbone architecture and introduces a novel and effective token rolling operation to encode temporal representations from video clips in a non-parametric manner.

    258
  • Coherence Constrained Graph LSTM for Group Activity Recognition

    Jinhui Tang, Xiangbo Shu, Rui Yan, Liyan Zhang

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2019

    239
  • HiGCIN: Hierarchical Graph-Based Cross Inference Network for Group Activity Recognition

    Rui Yan, Lingxi Xie, Jinhui Tang, Xiangbo Shu, Qi Chuan Tian

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2020

    231
  • Expansion-Squeeze-Excitation Fusion Network for Elderly Activity Recognition

    Xiangbo Shu, Jiawen Yang, Rui Yan, Yan Song

    IEEE Transactions on Circuits and Systems for Video Technology · 2022

    This work attempts to effectively aggregate the discriminative information of actions and interactions from both RGB videos and skeleton sequences by attentively fusing multi-modal features by implementing a novel Expansion-Squeeze-Excitation Fusion Network (ESE-FN).

    195
  • Participation-Contributed Temporal Dynamic Model for Group Activity Recognition

    Rui Yan, Jinhui Tang, Xiangbo Shu, Zechao Li, Qi Chuan Tian

    ACM International Conference on Multimedia (ACM MM) · 2018

    A novel Participation-Contributed Temporal Dynamic Model (PC-TDM) to recognize group activity, which mainly consists of a "One" network and a " one to Key" network, which aims at modeling the individual dynamic of each person.

    142
  • M3Net: Multi-view Encoding, Matching, and Fusion for Few-shot Fine-grained Action Recognition

    Hao Tang, Jun Liu, Shuanglin Yan, Rui Yan, Zechao Li, Jinhui Tang

    ACM International Conference on Multimedia (ACM MM) · 2023

    M3Net is proposed, a matching-based framework for FS-FG action recognition, which incorporates multi-view encoding, multi- view matching, and multi-View fusion to facilitate embedding encoding, similarity matching,and decision making across multiple viewpoints.

    134
  • Social Adaptive Module for Weakly-Supervised Group Activity Recognition

    Rui Yan, Lingxi Xie, Jinhui Tang, Xiangbo Shu, Qi Chuan Tian

    Lecture notes in computer science · 2020

    This paper presents a new task named weakly-supervised group activity recognition (GAR) which differs from conventional GAR tasks in that only video-level labels are available, yet the important persons within each frame are not provided even in the training data.

    121
  • Progressive Instance-Aware Feature Learning for Compositional Action Recognition

    Rui Yan, Lingxi Xie, Xiangbo Shu, Liyan Zhang, Jinhui Tang

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2023

    109
  • Object-aware Video-language Pre-training for Retrieval

    Alex Jinpeng Wang, Yixiao Ge, Guanyu Cai, Rui Yan, Xudong Lin, Ying Shan, Xiaohu Qie, Mike Zheng Shou

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    Object-aware Transformers is presented, an object-centric approach that extends video-language transformer to incorporate object representations to leverage the bounding boxes and object tags to guide the training process.

    92
  • Dual-AI: Dual-path Actor Interaction Learning for Group Activity Recognition

    Mingfei Han, David Junhao Zhang, Yali Wang, Rui Yan, Lina Yao, Xiaojun Chang, Yu Qiao

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    This work proposes a distinct Dual-path Actor Interaction (Dual-AI) framework, which flexibly arranges spatial and temporal transformers in two complementary orders, enhancing actor relations by integrating merits from different spatio-temporal paths, and introduces a novel Multi-scale Actor Contrastive Loss (MAC-Loss) between two interactive paths of Dual-AI.

    87
  • MVP-Shot: Multi-Velocity Progressive-Alignment Framework for Few-Shot Action Recognition

    Hongyu Qu, Rui Yan, Xiangbo Shu, Hailiang Gao, Peng Huang, Guo-Sen Xie

    IEEE Transactions on Multimedia · 2025

    A novel Multi-Velocity Progressive-alignment (MVP-Shot) framework to progressively learn and align semantic-related action features at multi-velocity levels and outperforms current state-of-the-art methods on multiple standard few-shot benchmarks.

    69
  • Position-Aware Participation-Contributed Temporal Dynamic Model for Group Activity Recognition

    Rui Yan, Xiangbo Shu, Yuan Chengcheng, Qi Chuan Tian, Jinhui Tang

    IEEE Transactions on Neural Networks and Learning Systems · 2021

    63
  • Audio Deep Fake Detection System with Neural Stitching for ADD 2022

    Rui Yan, Wen Ming Cheng, Shuran Zhou, Guo, Tingwei, Wei Zou, Xiangang Li

    arXiv · 2022

    This paper describes the best system and methodology for ADD 2022: The First Audio Deep Synthesis Detection Challenge and outperforms all other systems with 10.1% equal error rate(EER) in Track 3.2.

    33
  • Video-Text Pre-training with Learned Regions for Retrieval

    Rui Yan, Mike Zheng Shou, Yixiao Ge, Jinpeng Wang, Xudong Lin, Guanyu Cai, Jinhui Tang

    Proceedings of the AAAI Conference on Artificial Intelligence · 2023

    This work proposes a simple yet effective module for video-text representation learning, namely RegionLearner, which can take into account the structure of objects during pre-training on large-scale video- text pairs and is much more computationally efficient.

    30
  • Spatio-Temporal Decoupled Knowledge Compensator for Few-Shot Action Recognition

    Hongyu Qu, Xiangbo Shu, Rui Yan, Hailiang Gao, Wenguan Wang, Jinhui Tang

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2026

    DiST, an innovative Decomposition-incorporation framework for FSAR that makes use of decoupled Spatial and Temporal knowledge provided by large language models to learn expressive multi-granularity prototypes, is proposed.

    26
  • Locality-Aware Cross-Modal Correspondence Learning for Dense Audio-Visual Events Detection

    Ling Xing, Hongyu Qu, Rui Yan, Xiangbo Shu, Jinhui Tang

    IEEE Transactions on Circuits and Systems for Video Technology · 2025

    24
  • GPT4Ego: Unleashing the Potential of Pre-Trained Models for Zero-Shot Egocentric Action Recognition

    Guangzhao Dai, Xiangbo Shu, Wenhao Wu, Rui Yan, Jiachao Zhang

    IEEE Transactions on Multimedia · 2024

    A straightforward yet remarkably potent VLM framework, GPT4Ego, designed to enhance the fine-grained alignment of concept and description between vision and language, which can sustainably evolve with the advancement of ever-growing pre-trained foundational models.

    24
  • DVF: Advancing Robust and Accurate Fine-Grained Image Retrieval with Retrieval Guidelines

    Xin Jiang, Hao Tang, Rui Yan, Jinhui Tang, Zechao Li

    ACM International Conference on Multimedia (ACM MM) · 2024

    This paper designs a novel Dual Visual Filtering mechanism for the plain visual transformer, denoted as DVF, to capture subcategory-specific discrepancies and implements a discriminative model training strategy to improve the discriminability and generalization ability of DVF.

    21
  • Tackling Micro-Expression Data Shortage via Dataset Alignment and Active Learning

    Xianye Ben, Chen Gong, Tianhuan Huang, Chuanye Li, Rui Yan, Yujun Li

    IEEE Transactions on Multimedia · 2022

    20
  • Look Less Think More: Rethinking Compositional Action Recognition

    Rui Yan, Peng Fei Huang, Xiangbo Shu, Junhao Zhang, Yonghua Pan, Jinhui Tang

    ACM International Conference on Multimedia (ACM MM) · 2022

    A simple yet effective framework, Look Less Think More (LLTM), to reduce the strong association between visual objects and action-level labels (Look Less), and then discover the commonsense relationships between object categories and human actions (Think More).

    19
  • DiffusionVMR: Diffusion Model for Joint Video Moment Retrieval and Highlight Detection

    Henghao Zhao, Kevin Qinghong Lin, Rui Yan, Zechao Li

    IEEE Transactions on Neural Networks and Learning Systems · 2024

    A novel framework, DiffusionVMR, is proposed to redefine the two tasks as a unified conditional denoising generation process by combining the diffusion model, inheriting the advantages of diffusion models that allow for iteratively refined results during inference, enhancing the boundary transition from coarse to fine.

    17
  • VideoExpert: Augmented LLM for Temporal-Sensitive Video Understanding

    Henghao Zhao, Ge-Peng Ji, Rui Yan, Huan Xiong, Zechao Li

    IEEE Transactions on Circuits and Systems for Video Technology · 2026

    VideoExpert is a general-purpose MLLM suitable for several temporal-sensitive video tasks and integrates two parallel modules: the Temporal Expert and the Spatial Expert, which handles specially designed spatial tokens and language input, aiming to generate content-related responses.

    16
  • SVMFN-FSAR: Semantic-Guided Video Multimodal Fusion Network for Few-Shot Action Recognition

    Ran Wei, Rui Yan, Hongyu Qu, Xing Li, Qiaolin Ye, Liyong Fu

    Big Data Mining and Analytics · 2025

    15
  • Appearance-Agnostic Representation Learning for Compositional Action Recognition

    Peng Fei Huang, Xiangbo Shu, Rui Yan, Zhewei Tu, Jinhui Tang

    IEEE Transactions on Circuits and Systems for Video Technology · 2024

    15

Show all 63 works

Publication data from OpenAlex, with missing venues and authors filled in from Crossref; citation counts are the higher of OpenAlex and Semantic Scholar, last synced 2026-10-12. One-sentence summaries under some papers are written by Semantic Scholar’s model. Citation counts may be lower than on Google Scholar, which indexes more sources.

Report an error

Wrong papers, two people merged into one, or a profile that should not be here? Tell us and we will fix or hide it.

Sign in to report