Is this you? Claim this profile to correct it, add a bio and choose the work people see first.

Claim this profile

Academic lineage

Possible advisorsa guess from early papers, not confirmed

  • Nenghai Yu

    Possible advisor · last author on 4 of their early first-author papers, 2018–2022

    Suggested from co-authorship
  • Baining Guo

    Possible advisor · last author on 4 of their early first-author papers, 2020–2023

    Suggested from co-authorship

Is this you? Claim this profile to confirm or dismiss it.

Works49 from public data

TitleCited by
  • CSWin Transformer: A General Vision Transformer Backbone with Cross-Shaped Windows

    Xiaoyi Dong, Jianmin Bao, Dongdong Chen, Weiming Zhang, Nenghai Yu, Lu Yuan, Dong Chen, Baining Guo

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    The Cross-Shaped Window self-attention mechanism for computing self-Attention in the horizontal and vertical stripes in parallel that form a cross-shaped window is developed, with each stripe obtained by splitting the input feature into stripes of equal width.

    1,458
  • Mobile-Former: Bridging MobileNet and Transformer

    Yinpeng Chen, Xiyang Dai, Dongdong Chen, Mengchen Liu, Xiaoyi Dong, Lu Yuan, Zicheng Liu

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    The proposed light-weight cross attention to model the bridge enables bidirectional fusion of local and global features and builds an efficient end-to-end detector by replacing backbone, encoder and decoder in DETR with Mobile-Former, which outperforms DETR but saves 52% of computational cost and 36% of parameters.

    727
  • VLMEvalKit: An Open-Source ToolKit for Evaluating Large Multi-Modality Models

    Haodong Duan, Junming Yang, Yuxuan Qiao, Xinyu Fang, Lin Chen, Yuan Liu, Xiaoyi Dong, Yuhang Zang, +4 more

    ACM International Conference on Multimedia (ACM MM) · 2024

    The VLMEvalKit toolkit aims to provide a user-friendly and comprehensive framework for researchers and developers to evaluate existing multi-modality models and publish reproducible evaluation results.

    628
  • Open-Sora Plan: Open-Source Large Video Generation Model

    Bin Lin, Yunyang Ge, Xinhua Cheng, Zongjian Li, Zhu, Bin, Shaodong Wang, He, Xianyi, Ye Yang, +16 more

    arXiv · 2024

    This work introduces Open-Sora Plan, an open-source project that aims to contribute a large generation model for generating desired high-resolution videos with long durations based on various user inputs, and hopes it can inspire the video generation research community.

    325
  • PeCo: Perceptual Codebook for BERT Pre-training of Vision Transformers

    Xiaoyi Dong, Jianmin Bao, Ting Zhang, Dongdong Chen, Weiming Zhang, Lu Yuan, Dong Chen, Fang Wen, +2 more

    AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · 2023

    A self-supervised transformer model for deep feature extraction and it is shown that it works well for calculating perceptual similarity, and such learned visual tokens indeed exhibit better semantic meanings, and help pre-training achieve superior transfer performance in various downstream tasks.

    289
  • ShareGPT4V: Improving Large Multi-modal Models with Better Captions

    Lin Chen, Jinsong Li, Xiaoyi Dong, Pan Zhang, Conghui He, Jiaqi Wang, Feng Zhao, Dahua Lin

    Lecture notes in computer science · 2024

    237
  • InternLM-XComposer-2.5: A Versatile Large Vision Language Model Supporting Long-Contextual Input and Output

    Pan Zhang, Xiaoyi Dong, Yuhang Zang, Yuhang Cao, Rui Qian, Lin Chen, Qipeng Guo, Haodong Duan, +19 more

    arXiv · 2024

    A versatile large-vision language model that supports long-contextual input and output, InternLM-XComposer-2.5 excels in various text-image comprehension and composition applications, achieving GPT-4V level capabilities with merely 7B LLM backend.

    216
  • OVO-Bench: How Far is Your Video-LLMs from Real-World Online Video Understanding?

    Junbo Niu, Yifei Li, Ziyang Miao, Chunjiang Ge, Yuanhang Zhou, Qingwen He, Xiaoyi Dong, Haodong Duan, +7 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2025

    OVO-Bench evaluates the ability of video LLMs to reason and respond to events occurring at specific timestamps under three distinct scenarios: Backward tracing, real-time understanding, and forward active responding.

    159
  • LG-GAN: Label Guided Adversarial Network for Flexible Targeted Attack of Point Cloud Based Deep Networks

    Hang Zhou, Dongdong Chen, Jing Liao, Kejiang Chen, Xiaoyi Dong, Kunlin Liu, Weiming Zhang, Gang Hua, +1 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2020

    The proposed LG-GAN can support flexible targeted attack on the fly while guaranteeing good attack performance and higher efficiency simultaneously, and is the first generation based 3D point cloud attack method.

    130
  • Shape-invariant 3D Adversarial Point Clouds

    Qidong Huang, Xiaoyi Dong, Dongdong Chen, Hang Zhou, Weiming Zhang, Nenghai Yu

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    A novel Point-Cloud Sensitivity Map is proposed to boost both the efficiency and imperceptibility of point perturbations and reveals the vulnerability of point cloud recognition models when encountering shape-invariant adversarial noises.

    120
  • SAM2LONG: Enhancing SAM 2 for Long Video Segmentation with a Training-Free Memory Tree

    Shuangrui Ding, Rui Qian, Xiaoyi Dong, Pan Zhang, Yuhang Zang, Yuhang Cao, Yuwei Guo, Dahua Lin, +1 more

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2025

    111
  • Are We on the Right Way for Evaluating Large Vision-Language Models?

    Lin Chen, Jinsong Li, Xiaoyi Dong, Pan Zhang, Yuhang Zang, Zehui Chen, Haodong Duan, Jiaqi Wang, +3 more

    neural information processing systems · 2024

    103
  • Local Geometric Distortions Resilient Watermarking Scheme Based on Symmetry

    Zehua Ma, Weiming Zhang, Han Fang, Xiaoyi Dong, Linfeng Geng, Nenghai Yu

    IEEE Transactions on Circuits and Systems for Video Technology · 2021

    Experimental results demonstrate the excellent robustness of the proposed watermarking scheme to local geometric distortion, global geometric distortions, common image processing operations, and some kinds of combined attacks.

    85
  • Self-Robust 3D Point Recognition via Gather-Vector Guidance

    Xiaoyi Dong, Dongdong Chen, Hang Zhou, Gang Hua, Weiming Zhang, Nenghai Yu

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2020

    83
  • Robust Superpixel-Guided Attentional Adversarial Attack

    Xiaoyi Dong, Jiangfan Han, Dongdong Chen, Jiayang Liu, Huanyu Bian, Zehua Ma, Hongsheng Li, Xiaogang Wang, +2 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2020

    72
  • ShareGPT4Video: Improving Video Understanding and Generation with Better Captions

    Lin Chen, Xilin Wei, Jinsong Li, Xiaoyi Dong, Pan Zhang, Yuhang Zang, Zehui Chen, Haodong Duan, +7 more

    neural information processing systems · 2024

    65
  • Bootstrapped Masked Autoencoders for Vision BERT Pretraining

    Xiaoyi Dong, Jianmin Bao, Ting Zhang, Dongdong Chen, Weiming Zhang, Lu Yuan, Dong Chen, Fang Wen, +1 more

    Lecture notes in computer science · 2022

    64
  • Spatial-SSRL: Enhancing Spatial Understanding via Self-Supervised Reinforcement Learning

    Yuhong Liu, Beichen Zhang, Yuhang Zang, Yuhang Cao, Long Xing, Xiaoyi Dong, Haodong Duan, Dahua Lin, +1 more

    arXiv · 2025

    Spatial-SSRL is introduced, a self-supervised RL paradigm that derives verifiable signals directly from ordinary RGB or RGB-D images and provides a practical route to stronger spatial intelligence in LVLMs.

    44
  • Adaptive Face Forgery Detection in Cross Domain

    Luchuan Song, Zheng Fang, Xiaodan Li, Xiaoyi Dong, Zhenchao Jin, Yuefeng Chen, Siwei Lyu

    Lecture notes in computer science · 2022

    43
  • Maximum Entropy Reinforcement Learning with Diffusion Policy

    Xiaoyi Dong, Jian Cheng, Xi Sheryl Zhang

    arXiv · 2025

    The diffusion model is employed, a powerful generative model capable of capturing complex multimodal distributions, as the policy representation to fulfill the MaxEnt RL objective, developing a method named MaxEnt RL with Diffusion Policy (MaxEntDP), which enables efficient exploration and brings the policy closer to the optimal MaxEnt policy.

    41
  • Beyond Fixed: Training-Free Variable-Length Denoising for Diffusion Large Language Models

    Jingsong Li, Xiaoyi Dong, Yuhang Zang, Yuhang Cao, Jiaqi Wang, Dahua Lin

    arXiv · 2025

    DAEDAL is introduced, a novel training-free denoising strategy that enables Dynamic Adaptive Length Expansion for Diffusion Large Language Models and achieves performance comparable, and in some cases superior, to meticulously tuned fixed-length baselines, while simultaneously enhancing computational efficiency by achieving a higher effective token ratio.

    36
  • Once a MAN: Towards Multi-Target Attack via Learning Multi-Target Adversarial Network Once

    Jiangfan Han, Xiaoyi Dong, Ruimao Zhang, Dongdong Chen, Weiming Zhang, Nenghai Yu, Ping Luo, Xiaogang Wang

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2019

    This paper proposes the first Multi-target Adversarial Network (MAN), which can generate multi-target adversarial samples with a single model and can achieve better classification accuracy than other methods when attacked by various methods.

    33
  • RAR: Retrieving and Ranking Augmented MLLMs for Visual Recognition

    Ziyu Liu, Zeyi Sun, Yuhang Zang, Wei Li, Pan Zhang, Xiaoyi Dong, Yuanjun Xiong, Dahua Lin, +1 more

    IEEE Transactions on Image Processing · 2026

    RAR, a Retrieving And Ranking augmented method for Multimodal Large Language Models, demonstrates a significant improvement in performance on 5 fine-grained visual recognition benchmarks, 11 few-shot image recognition datasets, and the 2 object detection datasets under the zero-shot recognition setting.

    31
  • PointCAT: Contrastive Adversarial Training for Robust Point Cloud Recognition

    Qidong Huang, Xiaoyi Dong, Dongdong Chen, Hang Zhou, Weiming Zhang, Kui Zhang, Gang Hua, Yueqiang Cheng, +1 more

    IEEE Transactions on Image Processing · 2024

    30
  • Streaming Long Video Understanding with Large Language Models

    Rui Qian, Xiaoyi Dong, Pan Zhang, Yuhang Zang, Shuangrui Ding, Dahua Lin, Jiaqi Wang

    neural information processing systems · 2024

    30

Show all 49 works

Publication data from OpenAlex, with missing venues and authors filled in from Crossref; citation counts are the higher of OpenAlex and Semantic Scholar, last synced 2026-10-15. One-sentence summaries under some papers are written by Semantic Scholar’s model. Citation counts may be lower than on Google Scholar, which indexes more sources.

Report an error

Wrong papers, two people merged into one, or a profile that should not be here? Tell us and we will fix or hide it.

Sign in to report