Is this you? Claim this profile to correct it, add a bio and choose the work people see first.

Claim this profile

Academic lineage

Possible advisorsa guess from early papers, not confirmed

  • Tieniu Tan

    Possible advisor · last author on 7 of their early first-author papers, 2018–2020

    Suggested from co-authorship

Is this you? Claim this profile to confirm or dismiss it.

Works49 from public data

TitleCited by
  • VBench: Comprehensive Benchmark Suite for Video Generative Models

    Ziqi Huang, Yinan He, Jiashuo Yu, Fan Zhang, Chenyang Si, Yuming Jiang, Yuanhan Zhang, Tianxing Wu, +8 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    VBench is a comprehensive benchmark suite that dissects “video generation quality” into specific, hierarchical, and disentangled dimensions, each with tailored prompts and evaluation methods, and investi-gate the gaps between video and image generation models.

    2,062
  • MetaFormer is Actually What You Need for Vision

    Weihao Yu, Mi Luo, Pan Zhou, Chenyang Si, Yichen Zhou, Xinchao Wang, Jiashi Feng, Shuicheng Yan

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    It is argued that MetaFormer is the key player in achieving superior results for recent transformer and MLP-like models on vision tasks, and calls for more future research dedicated to improving MetaFormer instead of focusing on the token mixer modules.

    1,462
  • An Attention Enhanced Graph Convolutional LSTM Network for Skeleton-Based Action Recognition

    Chenyang Si, Wentao Chen, Wei Wang, Liang Wang, Tieniu Tan

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2019

    A novel Attention Enhanced Graph Convolutional LSTM Network (AGC-LSTM) for human action recognition from skeleton data can not only capture discriminative features in spatial configuration and temporal dynamics but also explore the co-occurrence relationship between spatial and temporal domains.

    941
  • LaVie: High-Quality Video Generation with Cascaded Latent Diffusion Models

    Yaohui Wang, Yaohui Wang, Xinyuan Chen, Xin Ma, Shangchen Zhou, Ziqi Huang, Ceyuan Yang, Yi Wang, +14 more

    International Journal of Computer Vision · 2024

    The incorporation of simple temporal self-attentions, coupled with rotary positional encoding, adequately captures the temporal correlations inherent in video data and proves that the process of joint image-video fine-tuning plays a pivotal role in producing high-quality and creative outcomes.

    426
  • Skeleton-Based Action Recognition with Spatial Reasoning and Temporal Stack Learning

    Chenyang Si, Ya Jing, Wei Wang, Liang Wang, Tieniu Tan

    Lecture notes in computer science · 2018

    A novel model with spatial reasoning and temporal stack learning (SR-TSL) for skeleton-based action recognition, which consists of a spatial reasoning network (SRN) and a temporal stacklearning network (TSLN).

    412
  • MetaFormer Baselines for Vision

    Weihao Yu, Chenyang Si, Pan Zhou, Mi Luo, Yichen Zhou, Jiashi Feng, Shuicheng Yan, Xinchao Wang

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2023

    The capacity of MetaFormer is explored, again, by migrating the focus away from the token mixer design, and several baseline models under MetaFormer are introduced using the most basic or common mixers, and demonstrate their gratifying performance.

    384
  • FreeU: Free Lunch in Diffusion U-Net

    Chenyang Si, Ziqi Huang, Yuming Jiang, Ziwei Liu

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    This paper proposes a simple yet effective method, termed “FreeU”, which enhances generation quality without additional training or finetuning, and can be readily integrated to ex-isting diffusion models, e.g., Stable Diffusion, DreamBooth and ControlNet.

    297
  • VBench++: Comprehensive and Versatile Benchmark Suite for Video Generative Models

    Ziqi Huang, Fan Zhang, Xiaojie Xu, Yinan He, Jiashuo Yu, Ziyue Dong, Qianli Ma, Nattapol Chanpaisit, +9 more

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2025

    278
  • Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Control

    Zekai Gu, Rui Yan, Jiahao Lu, Peng Li, Zhiyang Dou, Chenyang Si, Zhen Dong, Qifeng Liu, +4 more

    ACM SIGGRAPH Conference Papers (SIGGRAPH) · 2025

    This paper introduces Diffusion as Shader (DaS), a novel approach that supports multiple video control tasks within a unified architecture that leverages 3D tracking videos as control inputs, making the video diffusion process inherently 3D-aware.

    202
  • Pose-Guided Multi-Granularity Attention Network for Text-Based Person Search

    Ya Jing, Chenyang Si, Junbo Wang, Wei Wang, Liang Wang, Tieniu Tan

    Proceedings of the AAAI Conference on Artificial Intelligence · 2020

    A pose-guided multi-granularity attention network (PMA) is proposed, which employs pose information to learn latent semantic alignment between visual body part and textual noun phrase and Experimental results show that this approach outperforms the state-of-the-art methods by 15 % in terms of the top-1 metric.

    197
  • VideoBooth: Diffusion-based Video Generation with Image Prompts

    Yuming Jiang, Tianxing Wu, Shuai Yang, Chenyang Si, Dahua Lin, Yu Qiao, Chen Change Loy, Ziwei Liu

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    This paper proposes a feed-forward framework VideoBooth, a generalizable framework where a single model works for a wide range of image prompts with only feed-forward passes, and proposes to embed image prompts in a coarse-to-fine manner.

    159
  • FasterCache: Training-Free Video Diffusion Model Acceleration with High Quality

    Zhengyao Lv, Chenyang Si, Song, Junhao, Zhenyu Yang, Qiao, Yu, Ziwei Liu, Wong, Kwan-Yee K.

    arXiv · 2024

    A novel training-free strategy designed to accelerate the inference of video diffusion models with high-quality generation, and CFG-Cache which optimizes the reuse of conditional and unconditional outputs to further enhance inference speed without compromising video quality.

    127
  • Skeleton-based action recognition with hierarchical spatial reasoning and temporal stack learning network

    Chenyang Si, Ya Jing, Wei Wang, Liang Wang, Tieniu Tan

    Pattern Recognition · 2020

    This work proposes a novel model with hierarchical spatial reasoning and temporal stack learning network (HSR-TSL) to explore the discriminative spatial and temporal features for human action recognition, which consists of a hierarchical spatial Reasoning Network (HSRN) and a temporal stacklearning network (TSLN).

    94
  • Notice of Removal: Semantic Prompt for Few-Shot Image Recognition

    Wentao Chen, Chenyang Si, Zhang Zhang, Liang Wang, Zilei Wang, Tieniu Tan

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023

    This paper designs two complementary mechanisms to insert semantic prompts into the feature extractor, one is to enable the interaction between semantic prompts and patch embeddings along the spatial dimension via self-attention, another is to supplement visual features with the transformed semantic prompts along the channel dimension.

    89
  • Adversarial Self-supervised Learning for Semi-supervised 3D Action Recognition

    Chenyang Si, Xuecheng Nie, Wei Wang, Liang Wang, Tieniu Tan, Jiashi Feng

    Lecture notes in computer science · 2020

    Adversarial Self-Supervised Learning (ASSL) is presented, a novel framework that tightly couples SSL and the semi-supervised scheme via neighbor relation exploration and adversarial learning to improve the discrimination capability of learned representations for 3D action recognition.

    80
  • Multistage Adversarial Losses for Pose-Based Human Image Synthesis

    Chenyang Si, Wei Wang, Liang Wang, Tieniu Tan

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2018

    77
  • Mugs: A Multi-Granular Self-Supervised Learning Framework

    Pan Zhou, Yichen Zhou, Chenyang Si, Weihao Yu, Teck Khim Ng, Shuicheng Yan

    arXiv · 2022

    This work proposes an effective MUlti-Granular Self-supervised learning (Mugs) framework to explicitly learn multi-granular visual features and surpasses SoTAs on other tasks, e.g. transfer learning, detection and segmentation.

    73
  • Contrast-Reconstruction Representation Learning for Self-Supervised Skeleton-Based Action Recognition

    Peng Wang, Jun Wen, Chenyang Si, Yuntao Qian, Liang Wang

    IEEE Transactions on Image Processing · 2022

    A novel Contrast-Reconstruction Representation Learning network (CRRL) that simultaneously captures postures and motion dynamics for unsupervised skeleton-based action recognition and demonstrates the promise of the method by outperforming state-of-the-art approaches.

    62
  • Vchitect-2.0: Parallel Transformer for Scaling Up Video Diffusion Models

    Fan, Weichen, Chenyang Si, Song, Junhao, Yang, Zhenyu, Yinan He, Zhuo, Long, Ziqi Huang, Ziyue Dong, +11 more

    arXiv · 2025

    This work presents Vchitect-2.0, a parallel transformer architecture designed to scale up video diffusion models for large-scale text-to-video generation, and proposes a Memory-efficient Training framework that incorporates hybrid parallelism and other memory reduction techniques, enabling efficient training of long video sequences on distributed systems.

    61
  • Towards Language-Driven Video Inpainting via Multimodal Large Language Models

    Jianzong Wu, Xiangtai Li, Chenyang Si, Shangchen Zhou, Jingkang Yang, Jiangning Zhang, Yining Li, Kai Chen, +3 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    This work introduces a new task - language-driven video inpainting, which uses natural language instructions to guide the inpainting process, integrating Multimodal Large Language Models to understand and execute complex language-based inpaintingrequests effectively.

    48
  • CoS: Chain-of-Shot Prompting for Long Video Understanding

    Jianhua Hu, Cheng, Zixu, Chenyang Si, Li, Wei, Shaogang Gong

    arXiv · 2025

    Chain-of-Shot prompting is proposed, to frame shot selection as test-time visual prompt optimisation, choosing shots adaptive to video understanding semantic task by optimising shots-task alignment.

    31
  • Inception Transformer

    Chenyang Si, Weihao Yu, Pan Zhou, Yichen Zhou, Xinchao Wang, Shuicheng Yan

    neural information processing systems · 2022

    31
  • FreeInit: Bridging Initialization Gap in Video Diffusion Models

    Tianxing Wu, Chenyang Si, Yuming Jiang, Ziqi Huang, Ziwei Liu

    Lecture notes in computer science · 2024

    29
  • LongVie: Multimodal-Guided Controllable Ultra-Long Video Generation

    Jianxiong Gao, Zhaoxi Chen, Xian Liu, Jianfeng Feng, Chenyang Si, Yanwei Fu, Yu Qiao, Ziwei Liu

    arXiv · 2025

    LongVie, an end-to-end autoregressive framework for controllable long video generation, introduces two core designs to ensure temporal consistency: a unified noise initialization strategy that maintains consistent generation across clips, and global control signal normalization that enforces alignment in the control space throughout the entire video.

    22
  • Rethinking Cross-Modal Interaction in Multimodal Diffusion Transformers

    Zhengyao Lv, Tianlin Pan, Chenyang Si, Zhaoxi Chen, Wangmeng Zuo, Ziwei Liu, Kwan-Yee K. Wong

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2025

    Temperature-Adjusted Cross-modal Attention (TACA), a parameter-efficient method that dynamically rebalances multimodal interactions through temperature scaling and timestep-dependent adjustment, significantly enhances text-image alignment on the T2I-CompBench benchmark with minimal computational overhead.

    22
  • FreeMorph: Tuning-Free Generalized Image Morphing with Diffusion Model

    Yukang Cao, Chenyang Si, Jinghao Wang, Ziwei Liu

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2025

    This paper introduces FreeMorph, the first tuning-free method for image morphing that accommodates inputs with different semantics or layouts and proposes a guidance-aware spherical interpolation design that incorporates explicit guidance from the input images by modifying the self-attention modules, thereby addressing identity loss and ensuring directional transitions throughout the generated sequence.

    19
  • Generalizable Person Re-identification via Self-Supervised Batch Norm Test-Time Adaption

    Ke Han, Chenyang Si, Yan Huang, Liang Wang, Tieniu Tan

    Proceedings of the AAAI Conference on Artificial Intelligence · 2022

    19
  • Scaling Supervised Local Learning with Augmented Auxiliary Networks

    Chenxiang Ma, Jibin Wu, Chenyang Si, Kay Chen Tan

    arXiv · 2024

    The proposed AugLocal method opens up a myriad of opportunities for training high-performance deep neural networks on resource-constrained platforms by effectively scale up to tens of local layers with a comparable accuracy to BP-trained networks while reducing GPU memory usage by around 40%.

    15
  • Pose-Guided Joint Global and Attentive Local Matching Network for Text-Based Person Search

    Ya Jing, Chenyang Si, Junbo Wang, Wei Wang, Liang Wang, Tieniu Tan

    arXiv · 2018

    Experimental results show that the proposed pose-guided joint global and attentive local matching network (GALM) outperforms the state-of-the-art methods by 15 \% in terms of top-1 metric.

    14
  • Cascade Attention Network for Person Search: Both Image and Text-Image Similarity Selection.

    Ya Jing, Chenyang Si, Junbo Wang, Wei Wang, Liang Wang, Tieniu Tan

    arXiv · 2018

    A cascade attention network (CAN) to progressively select from person image and text-image similarity to select the description-related similarity scores from those local similarities is proposed.

    14
  • RepVideo: Rethinking Cross-Layer Representation for Video Generation

    Chenyang Si, Fan, Weichen, Lv, Zhengyao, Ziqi Huang, Qiao Yu, Ziwei Liu

    arXiv · 2025

    This paper proposes RepVideo, an enhanced representation framework for text-to-video diffusion models that enhances the ability to generate accurate spatial appearances, such as capturing complex spatial relationships between multiple objects, but also improves temporal consistency in video generation.

    13
  • FSAR: Federated Skeleton-based Action Recognition with Adaptive Topology Structure and Knowledge Distillation

    Jingwen Guo, Hong Liu, Shitong Sun, Tianyu Guo, Min Zhang, Chenyang Si

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2023

    This paper pioneers a novel Federated Skeleton-based Action Recognition (FSAR) paradigm, which enables the construction of a globally generalized model without accessing local sensitive data, and introduces an Adaptive Topology Structure (ATS), separating generalization and personalization by learning a domain-invariant topology shared across clients and a domain-specific topology decoupled from global model aggregation.

    13
  • Exploring Semantic Attributes from A Foundation Model for Federated Learning of Disjoint Label Spaces

    Shitong Sun, Chenyang Si, Guile Wu, Shaogang Gong

    arXiv · 2022

    A new Federated Zero-Shot Learning (FZSL) paradigm is formulated to learn mid-level semantic knowledge at multiple local clients with non-shared local data and cumulatively aggregate a globally generalised central model for deployment.

    13
  • Few-Shot Learning with Part Discovery and Augmentation from Unlabeled Images

    Wentao Chen, Chenyang Si, Wei Wang, Liang Wang, Zilei Wang, Tieniu Tan

    Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence · 2021

    A novel part-based self-supervised representation learning scheme to learn transferable representations by maximizing the similarity of an image to its discriminative part and a part augmentation strategy by retrieving extra images from a base dataset is proposed.

    13
  • Federated zero-shot learning with mid-level semantic knowledge transfer

    Shitong Sun, Chenyang Si, Guile Wu, Shaogang Gong

    Pattern Recognition · 2024

    11
  • Semantic Prompt for Few-Shot Image Recognition

    Wentao Chen, Chenyang Si, Zhang Zhang, Liang Wang, Zilei Wang, Tieniu Tan

    arXiv · 2023

    8
  • Pose-Based Two-Stream Relational Networks for Action Recognition in Videos

    Wei Wang, Jinjin Zhang, Chenyang Si, Liang Wang

    arXiv · 2018

    7
  • Momentum Auxiliary Network for Supervised Local Learning

    Junhao Su, Changpeng Cai, Feiyu Zhu, Chenghao He, Xiaojie Xu, Dongzhi Guan, Chenyang Si

    Lecture notes in computer science · 2024

    3
  • One-to-More: High-Fidelity Training-Free Anomaly Generation with Attention Control

    Haoxiang Rao, Zhao Wang, Chenyang Si, Yan Lyu, Yuanyi Duan, Fang Zhao, Caifeng Shan

    arXiv · 2026

    A training-free few-shot anomaly generation method, namely O2MAG, which leverages the self-attention in One reference anomalous image to synthesize More realistic anomalies, supporting effective downstream anomaly detection and bridge the semantic gap between encoded anomaly text prompts and true anomaly semantics.

    2
  • AniFeats: Animate 3D Feature Meshes for Character Video Generation

    Beijia Lu, Zekai Gu, Zhiyang Dou, Haotian Yuan, Peng Li, Chenyang Si, Yukang Cao, Yuming Jiang, +3 more

    IEEE Transactions on Visualization and Computer Graphics · 2026

    1
  • DiverseAR: Boosting Diversity in Bitwise Autoregressive Image Generation

    Ying Yang, Zhengyao Lv, Pan, Tianlin, Haofan Wang, Binxin Yang, Hubery Yin, Li Chen, Chenyang Si

    arXiv · 2025

    DiverseAR is proposed, a principled and effective method that enhances image diversity without sacrificing visual quality by introducing an adaptive logits distribution scaling mechanism that dynamically adjusts the sharpness of the binary output distribution during sampling, resulting in smoother predictions and greater diversity.

    1
  • GOOD: Training-Free Guided Diffusion Sampling for Out-of-Distribution Detection

    Xin Gao, Jiyao Liu, Guanghao Li, Yueming Lyu, Jianxiong Gao, Weichen Yu, Ningsheng Xu, Liang Wang, +3 more

    neural information processing systems · 2025

    1
  • HPFF: Hierarchical Locally Supervised Learning with Patch Feature Fusion

    Junhao Su, Chenghao He, Feiyu Zhu, Xiaojie Xu, Dongzhi Guan, Chenyang Si

    Lecture notes in computer science · 2024

    1
  • Progressive Cluster Purification for Transductive Few-shot Learning

    Chenyang Si, Wentao Chen, Wei Wang, Liang Wang, Tieniu Tan

    arXiv · 2019

    1
  • CoSec: Benchmarking Agent Security in Communities

    Hao Mark Chen, Wenhui Dong, Ye Chen, Jiezhi Yao, Chenbo Xia, 曲玉文, Renxiang Wang, 袁复栋, +7 more

    arXiv · 2026

    –
  • Spatial Memory Intelligence: Endowing World Models with Understanding-Driven Long-Term Memory

    Ying Yang, Guiyu Zhang, Lianghua Huang, Chang Nie, Chenyang Si, Haofan Wang, Shaoshuai Shi, Li Jiang

    arXiv · 2026

    –
  • PosterCopilot: Toward Layout Reasoning and Controllable Editing for Professional Graphic Design

    Jiazhe Wei, Kezhi Li, Tianyu Lao, Haofan Wang, Yueming Lyu, Liang Wang, Caifeng Shan, Chenyang Si

    Lecture notes in computer science · 2026

    –
  • V-STaR: Benchmarking Video-LLMs on Video Spatio-Temporal Reasoning

    Cheng, Zixu, Jianhua Hu, Ziquan Liu, Chenyang Si, Wei Li, Shaogang Gong

    arXiv · 2025

    –
  • Boosting Diffusion U-Net with Free Lunch for Text-to-Image and Text-to-Video Generation

    Chenyang Si, Ziqi Huang, Yuming Jiang, Ziwei Liu

    Advances in computer vision and pattern recognition · 2025

    –

Publication data from OpenAlex, with missing venues and authors filled in from Crossref; citation counts are the higher of OpenAlex and Semantic Scholar, last synced 2026-10-12. One-sentence summaries under some papers are written by Semantic Scholar’s model. Citation counts may be lower than on Google Scholar, which indexes more sources.

Report an error

Wrong papers, two people merged into one, or a profile that should not be here? Tell us and we will fix or hide it.

Sign in to report