Is this you? Claim this profile to correct it, add a bio and choose the work people see first.

Claim this profile

Academic lineage

Possible advisorsa guess from early papers, not confirmed

  • Mike Zheng Shou

    Possible advisor · last author on 7 of their early first-author papers, 2022–2025

    Suggested from co-authorship

Is this you? Claim this profile to confirm or dismiss it.

Works19 from public data

TitleCited by
  • Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation

    Jay Zhangjie Wu, Yixiao Ge, Xintao Wang, Stan Weixian Lei, Yuchao Gu, Yufei Shi, Wynne Hsu, Ying Shan, +2 more

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2023

    This work proposes a new T2V generation setting—One-Shot Video Tuning, where only one text-video pair is presented, and introduces Tune-A-Video, which involves a tailored spatio-temporal attention mechanism and an efficient one-shot tuning strategy.

    1,235
  • DatasetDM: Synthesizing Data with Perception Annotations Using Diffusion Models

    Weijia Wu, Yuzhong Zhao, Hao Chen, Yuchao Gu, Rui Zhao, Yefei He, Hong Zhou, Mike Zheng Shou, +1 more

    arXiv · 2023

    This paper builds upon the pre-trained diffusion model and extends text-guided image synthesis to perception data generation, and shows that the rich latent code of the diffusion model can be effectively decoded as accurate perception annotations using a decoder module.

    193
  • VQFR: Blind Face Restoration with Vector-Quantized Dictionary and Parallel Decoder

    Yuchao Gu, Xintao Wang, Liangbin Xie, Chao Dong, Gen Li, Ying Shan, Ming‐Ming Cheng

    Lecture notes in computer science · 2022

    135
  • Long-Context Autoregressive Video Modeling with Next-Frame Prediction

    Yuchao Gu, Weijia Mao, Mike Zheng Shou

    arXiv · 2025

    This paper proposes the long short-term context modeling using asymmetric patchify kernels, which apply large kernels to distant frames to reduce redundant tokens, and standard kernels to local frames to preserve fine-grained detail, providing an effective baseline for long-context autoregressive video modeling.

    126
  • VideoSwap: Customized Video Subject Swapping with Interactive Semantic Point Correspondence

    Yuchao Gu, Yipin Zhou, Bichen Wu, Licheng Yu, Jiawei Liu, Rui Zhao, Jay Zhangjie Wu, David Junhao Zhang, +2 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    This work introduces the Video Swap framework that exploits semantic point correspondences, inspired by the observation that only a small number of semantic points are necessary to align the subject's motion trajectory and modify its shape.

    81
  • Rethinking the Objectives of Vector-Quantized Tokenizers for Image Synthesis

    Yuchao Gu, Xintao Wang, Yixiao Ge, Ying Shan, Mike Zheng Shou

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    It is found that improving the reconstruction fidelity of VQ tokenizers does not necessarily improve the generation, instead, learning to compress semantic features within VQ tokenizers significantly improves generative transformers' ability to capture textures and structures.

    37
  • MIND: Benchmarking Memory Consistency and Action Control in World Models

    Yixuan Ye, Xuanyu Lu, Yuxin Jiang, Yuchao Gu, Rui Zhao, Qiwei Liang, Jiachun Pan, Fengda Zhang, +2 more

    arXiv · 2026

    This work designs an efficient evaluation framework to measure two core abilities: memory consistency and action control, capturing temporal stability and contextual coherence across viewpoints and introduces MIND, the first open-domain closed-loop revisited benchmark for evaluating Memory stability and action control in worlD models.

    29
  • MAG-Edit: Localized Image Editing in Complex Scenarios via Mask-Based Attention-Adjusted Guidance

    Qi Mao, Lan Chen, Yuchao Gu, Zhen Fang, Mike Zheng Shou

    ACM International Conference on Multimedia (ACM MM) · 2024

    MAG-Edit is proposed, a plug-and-play, inference-stage optimization method that empowers attention-based editing approaches, such as P2P, to enhance localized image editing in intricate scenarios and optimizes the noise latent feature by encouraging two mask-based cross-attention ratios of the edit token.

    29
  • Mix-of-Show: Decentralized Low-Rank Adaptation for Multi-Concept Customization of Diffusion Models

    Yuchao Gu, Xintao Wang, Jay Zhangjie Wu, Yujun Shi, Yunpeng Chen, Zihan Fan, Wuyou Xiao, Rui Zhao, +5 more

    neural information processing systems · 2023

    25
  • Personalized Vision via Visual In-Context Learning

    Yuxin Jiang, Yuchao Gu, Yiren Song, Ivor Wai-Hung Tsang, Mike Zheng Shou

    arXiv · 2025

    This work introduces Personalized In-Context Operator (PICO), a simple four-panel framework that repurposes diffusion transformers as visual in-context learners that surpasses fine-tuning and synthetic-data baselines, flexibly adapts to novel user-defined tasks, and generalizes across both recognition and generation.

    17
  • MaskINT: Video Editing via Interpolative Non-autoregressive Masked Transformers

    Haoyu Ma, Shahin Mahdizadehaghdam, Bichen Wu, Zhipeng Fan, Yuchao Gu, Wenliang Zhao, Lior Shapira, Xiaohui Xie

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    An efficient model called MaskINT is introduced, which is built on non-autoregressive masked generative transformers and specializes in frame interpolation between the edited keyframes, using the structural guidance from intermediate frames.

    14
  • Point Cloud Segmentation Algorithm Based on Improved Euclidean Clustering

    Fangrui Chen, Feifei Xie, Lin Sun, Yuchao Gu, Zhipeng Zhang, Jinpeng Chen, Jinrui Zhang, Mingzhe Yi

    IEEE Access · 2024

    To address the issue of over-segmentation and under-segmentation in cases of object adhesion and stacking in unordered scenes, a method is introduced for discriminating collision points based on normal angle constraints and an adaptive search radius is employed to determine the clustering distance threshold.

    11
  • Olaf-World: Orienting Latent Actions for Video World Modeling

    Yuxin Jiang, Yuchao Gu, Ivor Wai-Hung Tsang, Mike Zheng Shou

    arXiv · 2026

    Olaf-World is presented, a pipeline that pretrains action-conditioned video world models from large-scale passive video and learns a more structured latent action space, leading to stronger zero-shot action transfer and more data-efficient adaptation to new control interfaces than state-of-the-art baselines.

    9
  • ROICtrl: Boosting Instance Control for Visual Generation

    Yuchao Gu, Yipin Zhou, Yunfan Ye, Yixin Nie, Licheng Yu, Pingchuan Ma, Kevin Qinghong Lin, Mike Zheng Shou

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2025

    This work enhances diffusion models by introducing regional instance control, where each instance is governed by a bounding box paired with a free-form caption, and proposes ROICtrl, an adapter for pretrained diffusion models that enables precise regional instance control.

    9
  • Tuning-Free Image Editing with Fidelity and Editability via Unified Latent Diffusion Model

    Qi Mao, Chen, Lan, Yuchao Gu, Mike Zheng Shou, Ming–Hsuan Yang

    arXiv · 2025

    This work introduces UnifyEdit, a tuning-free method that performs diffusion latent optimization to enable a balanced integration of fidelity and editability within a unified framework, demonstrating its superiority in achieving a robust balance between structure preservation and text alignment across various editing tasks.

    3
  • EvolveDirector: Approaching Advanced Text-to-Image Generation with Large Vision-Language Models

    Rui Jie Zhao, Hangjie Yuan, Yujie Wei, Shiwei Zhang, Yuchao Gu, Lingmin Ran, Wang Xiang, Zhangjie Wu, +3 more

    neural information processing systems · 2024

    2
  • EditTransfer++: Toward Faithful and Efficient Visual-Prompt-Guided Image Editing

    Lan Chen, Qi Mao, Yiren Song, Yuchao Gu, Siwei Ma

    arXiv · 2026

    1
  • Improved Method for 3D Point Cloud Reconstruction Based on Filtering

    Peng Xu, Yuchao Gu, Ruiju Sun, Yequn Wei, Guofeng Jing, Lei Wang, Ziqi Wang, Kaikai Qiao, +4 more

    2025 IEEE 2nd International Conference on Deep Learning and Computer Vision (DLCV) · 2025

    1
  • SolarWM: Open Data and Scalable Training for Long-Horizon Video World Models

    Junchao Huang, Guian Fang, Shengju Qian, Xianghao Kong, Zhuoran Zhao, Wei Huang, Yihua Du, Zixin Zhang, +10 more

    arXiv · 2026

    –

Publication data from OpenAlex, with missing venues and authors filled in from Crossref; citation counts are the higher of OpenAlex and Semantic Scholar, last synced 2026-10-12. One-sentence summaries under some papers are written by Semantic Scholar’s model. Citation counts may be lower than on Google Scholar, which indexes more sources.

Report an error

Wrong papers, two people merged into one, or a profile that should not be here? Tell us and we will fix or hide it.

Sign in to report