Is this you? Claim this profile to correct it, add a bio and choose the work people see first.

Claim this profile

Works154 from public data

TitleCited by
  • ESRGAN: Enhanced Super-Resolution Generative Adversarial Networks

    Xintao Wang, Ke Yu, Shixiang Wu, Jinjin Gu, Yihao Liu, Chao Dong, Yu Qiao, Chen Change Loy

    Lecture notes in computer science · 2019

    This work thoroughly study three key components of SRGAN – network architecture, adversarial loss and perceptual loss, and improves each of them to derive an Enhanced SRGAN (ESRGAN), which achieves consistently better visual quality with more realistic and natural textures than SRGAN.

    4,943
  • Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Data

    Xintao Wang, Liangbin Xie, Chao Dong, Ying Shan

    IEEE/CVF International Conference on Computer Vision Workshops (ICCVW) · 2021

    This work extends the powerful ESRGAN to a practical restoration application (namely, Real-ESRGAN), which is trained with pure synthetic data and employs a U-Net discriminator with spectral normalization to increase discriminator capability and stabilize the training dynamics.

    2,160
  • NTIRE 2017 Challenge on Single Image Super-Resolution: Methods and Results

    Radu Timofte, Eirikur Agustsson, Luc Van Gool, Shuicheng Yan, Lei Zhang, Bee Oh Lim, Sanghyun Son, Heewon Kim, +22 more

    IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · 2017

    1,955
  • EDVR: Video Restoration With Enhanced Deformable Convolutional Networks

    Xintao Wang, Kelvin C. K. Chan, Ke Yu, Chao Dong, Chen Change Loy

    IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · 2019

    This work proposes a novel Video Restoration framework with Enhanced Deformable convolutions, termed EDVR, and proposes a Temporal and Spatial Attention (TSA) fusion module, in which attention is applied both temporally and spatially, so as to emphasize important features for subsequent restoration.

    1,341
  • Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation

    Jay Zhangjie Wu, Yixiao Ge, Xintao Wang, Stan Weixian Lei, Yuchao Gu, Yufei Shi, Wynne Hsu, Ying Shan, +2 more

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2023

    This work proposes a new T2V generation setting—One-Shot Video Tuning, where only one text-video pair is presented, and introduces Tune-A-Video, which involves a tailored spatio-temporal attention mechanism and an efficient one-shot tuning strategy.

    1,235
  • Recovering Realistic Texture in Image Super-Resolution by Deep Spatial Feature Transform

    Xintao Wang, Ke Yu, Chao Dong, Chen Change Loy

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2018

    It is shown that it is possible to recover textures faithful to semantic classes in a single network conditioned on semantic segmentation probability maps through a novel Spatial Feature Transform (SFT) layer that generates affine transformation parameters for spatial-wise feature modulation.

    1,224
  • Activating More Pixels in Image Super-Resolution Transformer

    Xiangyu Chen, Xintao Wang, Jiantao Zhou, Yu Qiao, Chao Dong

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023

    A novel Hybrid Attention Transformer (HAT) is proposed, which combines both channel attention and window-based self-attention schemes, thus making use of their complementary advantages of being able to utilize global statistics and strong local fitting capability.

    1,170
  • MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editing

    Mingdeng Cao, Xintao Wang, Zhongang Qi, Ying Shan, Xiaohu Qie, Yinqiang Zheng

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2023

    MasaCtrl converts existing self-attention in diffusion models into mutual self-attention, so that it can query correlated local contents and textures from source images for consistency, and proposes a mask-guided mutual self-attention strategy.

    902
  • T2I-Adapter: Learning Adapters to Dig Out More Controllable Ability for Text-to-Image Diffusion Models

    Chong Mou, Xintao Wang, Liangbin Xie, Yanze Wu, Jian Zhang, Zhongang Qi, Ying Shan

    Proceedings of the AAAI Conference on Artificial Intelligence · 2024

    881
  • BasicVSR: The Search for Essential Components in Video Super-Resolution and Beyond

    Kelvin C. K. Chan, Xintao Wang, Ke Yu, Chao Dong, Chen Change Loy

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2021

    A succinct pipeline is shown that achieves appealing improvements in terms of speed and restoration quality in comparison to many state-of-the-art algorithms and can serve as strong baselines for future VSR approaches.

    698
  • Towards Real-World Blind Face Restoration with Generative Facial Prior

    Xintao Wang, Yu Li, Honglun Zhang, Ying Shan

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2021

    This work proposes GFP-GAN that leverages rich and diverse priors encapsulated in a pretrained face GAN for blind face restoration that achieves superior performance to prior art on both synthetic and real-world datasets.

    676
  • MotionCtrl: A Unified and Flexible Motion Controller for Video Generation

    Zhouxia Wang, Ziyang Yuan, Xintao Wang, Yaowei Li, Tianshui Chen, Menghan Xia, Ping Luo, Ying Shan

    ACM SIGGRAPH Conference Papers (SIGGRAPH) · 2024

    MotionCtrl is presented, a unified and flexible motion controller for video generation designed to effectively and independently control camera and object motion and is a relatively generalizable model that can adapt to a wide array of camera poses and trajectories once trained.

    673
  • VideoCrafter1: Open Diffusion Models for High-Quality Video Generation

    Haoxin Chen, Menghan Xia, Yingqing He, Yong Zhang, Xiaodong Cun, Shaoshu Yang, Jinbo Xing, Yaofang Liu, +4 more

    arXiv · 2023

    This model is the first open-source I2V foundation model capable of transforming a given image into a video clip while maintaining content preservation constraints, and can generate realistic and cinematic-quality videos with a resolution of $1024 \times 576.

    633
  • FateZero: Fusing Attentions for Zero-shot Text-based Video Editing

    Chenyang Qi, Xiaodong Cun, Yong Zhang, Chenyang Lei, Xintao Wang, Ying Shan, Qifeng Chen

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2023

    F FateZero, a zero-shot text-based editing method on real-world videos without per-prompt training or use-specific mask, is proposed, which is the first one to show the ability of zero-shot text-driven video style and local attribute editing from the trained text-to-image model.

    594
  • Scaling Up to Excellence: Practicing Model Scaling for Photo-Realistic Image Restoration In the Wild

    Fanghua Yu, Jinjin Gu, Zheyuan Li, Jinfan Hu, Xiangtao Kong, Xintao Wang, Jingwen He, Yu Qiao, +1 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    This work introduces SUPIR (Scaling-UP Image Restoration), a groundbreaking image restoration method that harnesses generative prior and the power of model scaling up, and develops a restoration-guided sampling method to suppress the fidelity issue encountered in generative-based restoration.

    372
  • NTIRE 2018 Challenge on Single Image Super-Resolution: Methods and Results

    Radu Timofte, Shuhang Gu, Jiqing Wu, Luc Van Gool, Lei Zhang, Shuicheng Yan, Muhammad Haris, Gregory Shakhnarovich, +22 more

    IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · 2018

    370
  • Mix-of-Show: Decentralized Low-Rank Adaptation for Multi-Concept Customization of Diffusion Models

    Yuchao Gu, Xintao Wang, Jay Zhangjie Wu, Yujun Shi, Yunpeng Chen, Zihan Fan, Wuyou Xiao, Rui Zhao, +5 more

    arXiv · 2023

    This paper proposes a new framework called Mix-of-Show, which adopts an embedding-decomposed LoRA (ED-LoRA) for single-client tuning and gradient fusion for the center node to preserve the in-domain essence of single concepts and support theoretically limitless concept fusion.

    334
  • GLEAN: Generative Latent Bank for Large-Factor Image Super-Resolution

    Kelvin C. K. Chan, Xintao Wang, Xiangyu Xu, Jinwei Gu, Chen Change Loy

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2021

    This work shows that pre-trained Generative Adversarial Networks (GANs), e.g., StyleGAN, can be used as a latent bank to improve the restoration quality of large-factor image super-resolution (SR) and shows clear improvements in terms of fidelity and texture faithfulness in comparison to existing methods.

    305
  • From Persona to Personalization: A Survey on Role-Playing Language Agents

    Jiangjie Chen, Xintao Wang, Xu, Rui, Siyu Yuan, Yikai Zhang, Wei Shi, Jian Xie, Shuang Li, +10 more

    arXiv · 2024

    A comprehensive survey of RPLAs, illustrating the evolution and recent progress in RPLAs integrating with cutting-edge LLM technologies and categorizing personas into three types: 1) Demographic Persona, which leverages statistical stereotypes; 2) Character Persona, focused on well-established figures; and 3) Individualized Persona, customized through ongoing user interactions for personalized services.

    291
  • DragonDiffusion: Enabling Drag-style Manipulation on Diffusion Models

    Chong Mou, Xintao Wang, Jiechong Song, Ying Shan, Jian Zhang

    arXiv · 2023

    A novel image editing method, DragonDiffusion, enabling Drag-style manipulation on Diffusion models, that can transform the editing signals into gradients via feature correspondence loss to modify the intermediate representation of the diffusion model.

    241
  • Making LLaMA SEE and Draw with SEED Tokenizer

    Yuying Ge, Sijie Zhao, Ziyun Zeng, Yixiao Ge, Li, Chen, Xintao Wang, Ying Shan

    arXiv · 2023

    SEED is introduced, an elaborate image tokenizer that empowers LLMs with the ability to SEE and Draw at the same time, and with SEED tokens, LLM is able to perform scalable multimodal autoregression under its original training recipe, i.e., next-word prediction.

    227
  • VFHQ: A High-Quality Dataset and Benchmark for Video Face Super-Resolution

    Liangbin Xie, Xintao Wang, Honglun Zhang, Chao Dong, Ying Shan

    IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · 2022

    An automatic and scalable pipeline to collect a high-quality video face dataset (VFHQ), which contains over 16, 000 high-fidelity clips of diverse interview scenarios, and shows that the temporal information plays a pivotal role in eliminating video consistency issues as well as further improving visual performance.

    216
  • SmartEdit: Exploring Complex Instruction-Based Image Editing with Multimodal Large Language Models

    Yuzhou Huang, Liangbin Xie, Xintao Wang, Ziyang Yuan, Xiaodong Cun, Yixiao Ge, Jiantao Zhou, Chao Dong, +3 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    A Bidirectional Interaction Module (BIM) is proposed that enables comprehensive bidirectional information interactions between the input image and the MLLM output and demonstrates that a small amount of complex instruction editing data can effectively stimulate SmartEdit’ s editing capabilities for more complex instructions.

    213
  • Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Models

    Jiale Xu, Xintao Wang, Weihao Cheng, Yan‐Pei Cao, Ying Shan, Xiaohu Qie, Shenghua Gao

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023

    This paper makes the first attempt to introduce explicit 3D shape priors into the CLIP-guided 3D optimization process, and proposes to jointly optimize a learnable text prompt and fine-tune the text-to-image diffusion model for rendering-style image generation.

    209
  • FreeNoise: Tuning-Free Longer Video Diffusion via Noise Rescheduling

    Haonan Qiu, Menghan Xia, Yong Zhang, Yingqing He, Xintao Wang, Ying Shan, Ziwei Liu

    arXiv · 2023

    This work proposes FreeNoise, a tuning-free and time-efficient paradigm to enhance the generative capabilities of pretrained video diffusion models while preserving content consistency, and designs a novel motion injection method to support the generation of videos conditioned on multiple text prompts.

    205

Show all 154 works

Publication data from OpenAlex, with missing venues and authors filled in from Crossref; citation counts are the higher of OpenAlex and Semantic Scholar, last synced 2026-10-12. One-sentence summaries under some papers are written by Semantic Scholar’s model. Citation counts may be lower than on Google Scholar, which indexes more sources.

Report an error

Wrong papers, two people merged into one, or a profile that should not be here? Tell us and we will fix or hide it.

Sign in to report