Is this you? Claim this profile to correct it, add a bio and choose the work people see first.

Claim this profile

Works151 from public data

TitleCited by
  • Interpreting the Latent Space of GANs for Semantic Face Editing

    Yujun Shen, Jinjin Gu, Xiaoou Tang, Bolei Zhou

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2020

    This work proposes a novel framework, called InterFaceGAN, for semantic face editing by interpreting the latent semantics learned by GANs, and finds that the latent code of well-trained generative models actually learns a disentangled representation after linear transformations.

    1,275
  • In-Domain GAN Inversion for Real Image Editing

    Jiapeng Zhu, Yujun Shen, Deli Zhao, Bolei Zhou

    Lecture notes in computer science · 2020

    An in-domain GAN inversion approach, which not only faithfully reconstructs the input image but also ensures the inverted code to be semantically meaningful for editing, which achieves satisfying real image reconstruction and facilitates various image editing tasks, significantly outperforming start-of-the-arts.

    697
  • Closed-Form Factorization of Latent Semantics in GANs

    Yujun Shen, Bolei Zhou

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2021

    This work examines the internal representation learned by GANs to reveal the underlying variation factors in an unsupervised manner and proposes a closedform factorization algorithm for latent semantic discovery by directly decomposing the pre-trained weights.

    664
  • AnyDoor: Zero-shot Object-level Image Customization

    Xi Chen, Lianghua Huang, Liu Yu, Yujun Shen, Deli Zhao, Hengshuang Zhao

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    This work presents AnyDoor, a diffusion-based image generator with the power to teleport target objects to new scenes at user-specified locations with desired shapes, and proposes to borrow knowledge from video datasets, which can observe various forms of a single object, leading to stronger model generalizability and robustness.

    539
  • Semi-Supervised Semantic Segmentation Using Unreliable Pseudo-Labels

    Yuchao Wang, Haochen Wang, Yujun Shen, Jingjing Fei, Wei Li, Guoqiang Jin, Liwei Wu, Rui Zhao, +1 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    It is argued that every pixel matters to the model training, even its prediction is ambiguous, and an effective pipeline is developed to make sufficient use of unlabeled data to separate reliable and unreliable pixels via the entropy of predictions.

    536
  • Notice of Removal: VideoFusion: Decomposed Diffusion Models for High-Quality Video Generation

    Zhengxiong Luo, Dayou Chen, Yingya Zhang, Yan Huang, Liang Wang, Yujun Shen, Deli Zhao, Jingren Zhou, +1 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023

    This work presents a decomposed diffusion process via resolving the per-frame noise into a base noise that is shared among all frames and a residual noise that varies along the time axis, which surpasses both GAN-based and diffusion-based alternatives in high-quality video generation.

    442
  • Composer: Creative and Controllable Image Synthesis with Composable Conditions

    Lianghua Huang, Di Chen, Yu Liu, Yujun Shen, Deli Zhao, Jingren Zhou

    arXiv · 2023

    This work offers a new generation paradigm that allows flexible control of the output image, such as spatial layout and palette, while maintaining the synthesis quality and model creativity, and serves as a general framework and facilitates a wide range of classical generative tasks without retraining.

    404
  • Image Processing Using Multi-Code GAN Prior

    Jinjin Gu, Yujun Shen, Bolei Zhou

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2020

    A novel approach is proposed, called mGANprior, to incorporate the well-trained GANs as effective prior to a variety of image processing tasks, by employing multiple latent codes to generate multiple feature maps at some intermediate layer of the generator and composing them with adaptive channel importance to recover the input image.

    347
  • SpatialTracker: Tracking Any 2D Pixels in 3D Space

    Yuxi Xiao, Qianqian Wang, Shangzhan Zhang, Nan Xue, Sida Peng, Yujun Shen, Xiaowei Zhou

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    This work proposes to estimate point trajectories in 3D space to mitigate the issues caused by image projection, and achieves state-of-the-art tracking performance both qualitatively and quantitatively, particularly in challenging scenarios such as out-of-plane rotation.

    220
  • Semantic Hierarchy Emerges in Deep Generative Representations for Scene Synthesis

    Ceyuan Yang, Yujun Shen, Bolei Zhou

    International Journal of Computer Vision · 2021

    This work shows that highly-structured semantic hierarchy emerges in the deep generative representations from the state-of-the-art GANs like StyleGAN and BigGAN, trained for scene synthesis, and quantifies the causality between the layer-wise activations and the semantics occurring in the output image.

    216
  • FLARE: Feed-Forward Geometry, Appearance and Camera Estimation from Uncalibrated Sparse Views

    Shangzhan Zhang, Jianyuan Wang, Yinghao Xu, Nan Xue, Christian Rupprecht, Xiaowei Zhou, Yujun Shen, Gordon Wetzstein

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2025

    211
  • FaceID-GAN: Learning a Symmetry Three-Player GAN for Identity-Preserving Face Synthesis

    Yujun Shen, Ping Luo, Junjie Yan, Xiaogang Wang, Xiaoou Tang

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2018

    182
  • 3D-aware Image Synthesis via Learning Structural and Textural Representations

    Yinghao Xu, Sida Peng, Ceyuan Yang, Yujun Shen, Bolei Zhou

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    This work proposes a novel framework, termed as VolumeGAN, for high-fidelity 3D-aware image synthesis, through explicitly learning a structural representation and a textural representation in a Generative Adversarial Network.

    145
  • Advancing Open-source World Models

    Robbyant Team, Zelin Gao, Qiuyu Wang, Yanhong Zeng, Jiapeng Zhu, Ka Leong Cheng, Yixuan Li, Hanlin Wang, +16 more

    arXiv · 2026

    LingBot-World is presented, an open-sourced world simulator stemming from video generation that maintains high fidelity and robust dynamics in a broad spectrum of environments, including realism, scientific contexts, cartoon styles, and beyond.

    142
  • 4K4D: Real-Time 4D View Synthesis at 4K Resolution

    Zhen Xu, Sida Peng, Haotong Lin, Guangzhao He, Jiaming Sun, Yujun Shen, Hujun Bao, Xiaowei Zhou

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    4K4D, a 4D point cloud representation that supports hardware rasterization and network pre-computation to enable unprecedented rendering speed with a high rendering quality, is proposed and a novel hybrid appearance model is designed that significantly boosts the rendering quality while preserving efficiency.

    136
  • Generative Hierarchical Features from Synthesizing Images

    Yinghao Xu, Yujun Shen, Jiapeng Zhu, Ceyuan Yang, Bolei Zhou

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2021

    This work considers the pre-trained StyleGAN generator as a learned loss function and utilizes its layer-wise representation to train a novel hierarchical encoder, termed as Generative Hierarchical Feature (GH-Feat), which has strong transferability to both generative and discriminative tasks.

    126
  • Learning Temporally Consistent Video Depth from Video Diffusion Priors

    Jiahao Shao, Yuanbo Yang, H. Zhou, Youmin Zhang, Yujun Shen, Vitor Guizilini, Yue Wang, Matteo Poggi, +1 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2025

    This work reformulates depth prediction into a conditional generation problem to provide contextual information within a clip and across clips to provide cross-clip context and proposes a consistent context-aware training and inference strategy for arbitrarily long videos to provide cross-clip context.

    118
  • Cones 2: Customizable Image Synthesis with Multiple Subjects

    Zhiheng Liu, Yifei Zhang, Yujun Shen, Kecheng Zheng, Zhu, Kai, Ruili Feng, Yu Liu, Deli Zhao, +2 more

    arXiv · 2023

    This work finds that the text embedding regarding the subject token already serves as a simple yet effective representation that supports arbitrary combinations without any model tuning and proposes to employ layout, a very abstract and easy-to-obtain prior, as the spatial guidance for subject arrangement.

    114
  • SpatialTrackerV2: 3D Point Tracking Made Easy

    Yuxi Xiao, Jianyuan Wang, Nan Xue, Nikita Karaev, Makarov, Yuri, Bingyi Kang, Xing Long Zhu, Hujun Bao, +2 more

    arXiv · 2025

    SpatialTrackerV2 decomposes world-space 3D motion into scene geometry, camera ego-motion, and pixel-wise object motion, with a fully differentiable and end-to-end architecture, allowing scalable training across a wide range of datasets.

    101
  • Ranni: Taming Text-to-Image Diffusion for Accurate Instruction Following

    Yutong Feng, Biao Gong, Di Chen, Yujun Shen, Yu Liu, Jingren Zhou

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    This work introduces a semantic panel as the middleware in decoding texts to images, supporting the generator to better follow instructions, and enhances a pre-trained T2I generator regarding its textual controllability.

    95
  • GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generation

    Yinghao Xu, Zifan Shi, Yifan Wang, Hansheng Chen, Ceyuan Yang, Sida Peng, Yujun Shen, Gordon Wetzstein

    Lecture notes in computer science · 2024

    92
  • Glancing at the Patch: Anomaly Localization with Global and Local Feature Comparison

    Shenzhi Wang, Liwei Wu, Lei Cui, Yujun Shen

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2021

    84
  • DisCoScene: Spatially Disentangled Generative Radiance Fields for Controllable 3D-aware Scene Synthesis

    Yinghao Xu, Menglei Chai, Zifan Shi, Sida Peng, Ivan Skorokhodov, Aliaksandr Siarohin, Ceyuan Yang, Yujun Shen, +3 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023

    The proposed model spatially disentangles the whole scene into object-centric generative radiance fields by learning on only 2D images with the global-local discrimination, and obtains the generation fidelity and editing flexibility of individual objects while being able to efficiently compose objects and the background into a complete scene.

    83
  • Scaling Instruction-Based Video Editing with a High-Quality Synthetic Dataset

    Qingyan Bai, Qiuyu Wang, Hao Ouyang, Yue Yu, Hanlin Wang, Wen Wang, Ka Leong Cheng, Shuailei Ma, +5 more

    arXiv · 2025

    Ditto is introduced, a holistic framework that fuses the creative diversity of a leading image editor with an in-context video generator, overcoming the limited scope of existing models and resolves the prohibitive cost-quality trade-off.

    82
  • InFusion: Inpainting 3D Gaussians via Learning Depth Completion from Diffusion Prior

    Zhiheng Liu, Hao Ouyang, Qiuyu Wang, Ka Leong Cheng, Jie Xiao, Kai Zhu, Xue, Nan, Yu Liu, +2 more

    arXiv · 2024

    This work proposes to guide the point initialization with an image-conditioned depth completion model, which learns to directly restore the depth map based on the observed image, and surpasses existing alternatives with sufficiently better fidelity and efficiency under various complex scenarios.

    75
  • Deep Generative Models on 3D Representations: A Survey

    Zifan Shi, Sida Peng, Yinghao Xu, Andreas Geiger, Yiyi Liao, Yujun Shen

    arXiv · 2022

    A thorough review of the development of 3D generation, including 3D shape generation and 3D-aware image synthesis, from the perspectives of both algorithms and more importantly representations is made.

    72
  • A Recipe for Scaling up Text-to-Video Generation with Text-free Videos

    Xiang Wang, Shiwei Zhang, Hangjie Yuan, Zhiwu Qing, Biao Gong, Yingya Zhang, Yujun Shen, Changxin Gao, +1 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    A novel text-to-video generation framework, termed TF-T2V, which can directly learn with text-free videos and validate the effectiveness and generalizability of the ideology on both native text-to-video generation and compositional video synthesis paradigms.

    70
  • One-Shot Generative Domain Adaptation

    Ceyuan Yang, Yujun Shen, Zhiyi Zhang, Yinghao Xu, Jiapeng Zhu, Zhirong Wu, Bolei Zhou

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2023

    This work aims to transfer a Generative Adversarial Network pre-trained on one image domain to another domain referred to as few as just one reference image, and proposes to constrain the diversity of the latent space through truncation in the training process, alleviating the optimization difficulty.

    70
  • Cross-Model Pseudo-Labeling for Semi-Supervised Action Recognition

    Yinghao Xu, Fangyun Wei, Xiao Na Sun, Ceyuan Yang, Yujun Shen, Bo Dai, Bolei Zhou, Stephen Ching-Feng Lin

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    This work proposes a more effective pseudo-labeling scheme, called Cross-Model Pseudo-Labeling (CMPL), which introduces a lightweight auxiliary network in addition to the primary backbone, and asks them to predict pseudo-labels for each other, and observes that these two models tend to learn complementary representations from the same video clips.

    66
  • HoloCine: Holistic Generation of Cinematic Multi-Shot Long Video Narratives

    Yihao Meng, Ouyang, Hao, Yue Yu, Qiuyu Wang, Wen Wang, Ka Leong Cheng, Hanlin Wang, Yixuan Li, +4 more

    arXiv · 2025

    HoloCine is a model that generates entire scenes holistically to ensure global consistency from the first shot to the last, marking a pivotal shift from clip synthesis towards automated filmmaking, making end-to-end cinematic creation a tangible future.

    54
  • MagicQuill: An Intelligent Interactive Image Editing System

    Zichen Liu, Yue Yu, Hao Ouyang, Qiuyu Wang, Ka Leong Cheng, Wen Wang, Zhiheng Liu, Qifeng Chen, +1 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2025

    The MagicQuill system starts with a streamlined yet functionally robust interface, enabling users to articulate their ideas with just a few strokes, then monitored by a multimodal large language model (MLLM) to anticipate user intentions in real time, bypassing the need for prompt entry.

    51
  • MANF brakes TLR4 signaling by competitively binding S100A8 with S100A9 to regulate macrophage phenotypes in hepatic fibrosis

    Chao Hou, Dong Wang, Mingxia Zhao, Petek Ballar, Xinru Zhang, Qiong Mei, Wei Wang, Xiang Li, +13 more

    Acta Pharmaceutica Sinica B · 2023

    A mechanism by which MANF targets S100A8/A9-TLR4 as a “brake” on the upstream of NF-κB pathway, which exerts an impact on macrophage differentiation and shed light on hepatic fibrosis treatment is revealed.

    51
  • Balancing Logit Variation for Long-Tailed Semantic Segmentation

    Yuchao Wang, Jingjing Fei, Haochen Wang, Wei Li, Tianpeng Bao, Liwei Wu, Rui Zhao, Yujun Shen

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023

    Although with an embarrassingly simple implementation, this work introduces category-wise variation into the network predictions in the training phase such that an instance is no longer projected to a feature point, but a small region instead.

    49
  • Prometheus: 3D-Aware Latent Diffusion Models for Feed-Forward Text-to-3D Scene Generation

    Yuanbo Yang, Jiahao Shao, Xinyang Li, Yujun Shen, Andreas Geiger, Yiyi Liao

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2025

    Prometheus, a 3D-aware latent diffusion model for text-to-3D generation at both object and scene levels in seconds is introduced and an RGB-D latent space is introduced into 3D Gaussian generation to disentangle appearance and geometry information, enabling efficient feed-forward generation of 3D Gaussians with better fidelity and geometry.

    46
  • LeviTor: 3D Trajectory Oriented Image-to-Video Synthesis

    Hanlin Wang, Hao Ouyang, Qiuyu Wang, Wen Wang, Ka Leong Cheng, Qifeng Chen, Yujun Shen, Limin Wang

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2025

    This work proposes a pioneering method for 3D trajectory control in image-to-video synthesis by abstracting object masks into a few cluster points, accompanied by the depth information and the instance information, which are finally fed into a video diffusion model as the control signal.

    45
  • EnvGS: Modeling View-Dependent Appearance with Environment Gaussian

    Tao Xie, Xi Chen, Zhen Xu, Yiman Xie, Yudong Jin, Yujun Shen, Sida Peng, Hujun Bao, +1 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2025

    This work introduces EnvGS, a novel approach that employs a set of Gaussian primitives as an explicit 3D representation for capturing reflections of environments that produces significantly more detailed reflections, achieving the best rendering quality in real-time novel view synthesis.

    45
  • LipFormer: High-fidelity and Generalizable Talking Face Generation with A Pre-learned Facial Codebook

    Jiayu Wang, Kang Zhao, Shiwei Zhang, Yingya Zhang, Yujun Shen, Deli Zhao, Jingren Zhou

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023

    44
  • Benchmarking Large Vision-Language Models via Directed Scene Graph for Comprehensive Image Captioning

    Fan Lu, Wei Wu, Kecheng Zheng, Shuailei Ma, Biao Gong, Jiawei Liu, Wei Zhai, Yang Cao, +2 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2025

    A detailed caption benchmark, termed as CompreCap, to evaluate the visual context from a directed scene graph view, to assess the generated detailed captions from LVLMs on multiple levels, including the object-level coverage, the accuracy of attribute descriptions, the score of key relationships, etc.

    40
  • 3D-Aware Indoor Scene Synthesis with Depth Priors

    Zifan Shi, Yujun Shen, Jiapeng Zhu, Dit‐Yan Yeung, Qifeng Chen

    Lecture notes in computer science · 2022

    This work proposes a dual-path generator, where one path is responsible for depth generation, whose intermediate features are injected into the other path as the condition for appearance rendering, which eases the 3D-aware synthesis with explicit geometry information.

    39
  • InterFaceGAN: Interpreting the Disentangled Face Representation Learned by GANs

    Yujun Shen, Ceyuan Yang, Xiaoou Tang, Bolei Zhou

    arXiv · 2020

    39
  • MaPa: Text-driven Photorealistic Material Painting for 3D Shapes

    Shangzhan Zhang, Sida Peng, Tao Xu, Yuanbo Yang, Tianrun Chen, Nan Xue, Yujun Shen, Hujun Bao, +2 more

    ACM SIGGRAPH Conference Papers (SIGGRAPH) · 2024

    This paper decomposes a shape into a set of segments and designs a segment-controlled diffusion model to synthesize 2D images that are aligned with mesh parts to generate segment-wise procedural material graphs as the appearance representation.

    36
  • GaussianPrediction: Dynamic 3D Gaussian Prediction for Motion Extrapolation and Free View Synthesis

    Boming Zhao, Yuan Li, Ziyu Sun, Lin Zeng, Yujun Shen, Rui Ma, Yinda Zhang, Hujun Bao, +1 more

    ACM SIGGRAPH Conference Papers (SIGGRAPH) · 2024

    GaussianPrediction is a novel framework that empowers 3D Gaussian representations with dynamic scene modeling and future scenario synthesis in dynamic environments, and can forecast future states from any viewpoint, using video observations of dynamic scenes.

    36
  • Improving GAN Equilibrium by Raising Spatial Awareness

    Jianyuan Wang, Ceyuan Yang, Yinghao Xu, Yujun Shen, Hongdong Li, Bolei Zhou

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    This work aims to alleviate the issue of D dominating the competition in GANs, and proposes to align the spatial awareness of G with the attention map induced from D, effectively lessen the information gap between D and G.

    35
  • FlashFace: Human Image Personalization with High-fidelity Identity Preservation

    Shilong Zhang, Lianghua Huang, Xi Chen, Yifei Zhang, Zhi-Fan Wu, Yutong Feng, Wei Wang, Yujun Shen, +2 more

    arXiv · 2024

    This work presents FlashFace, a practical tool with which users can easily personalize their own photos on the fly by providing one or a few reference face images and a text prompt, benefiting from two subtle designs.

    34
  • Scanning Only Once: An End-to-end Framework for Fast Temporal Grounding in Long Videos

    Yulin Pan, Xiangteng He, Biao Gong, Yiliang Lv, Yujun Shen, Yuxin Peng, Deli Zhao

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2023

    This work proposes an end-to-end framework for fast temporal grounding, which is able to model an hours-long video with one-time network execution, and significantly outperforms state-of-the-arts, and achieves 14.6× / 102.8× higher efficiency respectively.

    34
  • DepthLab: From Partial to Complete

    Zhiheng Liu, Ka Leong Cheng, Qiuyu Wang, Wang, Shuzhe, Hao Ouyang, Tan, Bin, Kai Zhu, Yujun Shen, +2 more

    arXiv · 2024

    This work bridges this gap with DepthLab, a foundation depth inpainting model powered by image diffusion priors that demonstrates resilience to depth-deficient regions, and faithfully preserves scale consistency with the conditioned known depth when filling in missing values.

    33
  • Framer: Interactive Frame Interpolation

    Wen Wang, Qiuyu Wang, Kecheng Zheng, Hao Ouyang, Zhekai Chen, Gong, Biao, Hao Chen, Yujun Shen, +1 more

    arXiv · 2024

    This work proposes Framer for interactive frame interpolation, which targets producing smoothly transitioning frames between two images as per user creativity, and supports customizing the transition process by tailoring the trajectory of some selected keypoints.

    33
  • Ready-to-React: Online Reaction Policy for Two-Character Interaction Generation

    Zhi Cen, Huaijin Pi, Sida Peng, Qin Shuai, Yujun Shen, Hujun Bao, Xiaowei Zhou, Ruizhen Hu

    arXiv · 2025

    This paper proposes an online reaction policy, called Ready-to-React, to generate the next character pose based on past observed motions, and demonstrates that this approach can be controlled by sparse signals, making it well-suited for VR and other online interactive environments.

    32
  • MangaNinja: Line Art Colorization with Precise Reference Following

    Zhiheng Liu, Ka Leong Cheng, Xi Chen, Jie Xiao, Hao Ouyang, Kai Zhu, Yu Liu, Yujun Shen, +2 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2025

    This work incorporates two thoughtful designs to ensure precise character detail transcription, including a patch shuffling module to facilitate correspondence learning between the reference color image and the target line art, and a point-driven control scheme to enable fine-grained color matching.

    31
  • HeadArtist: Text-conditioned 3D Head Generation with Self Score Distillation

    Hongyu Liu, Xuan Wang, Ziyu Wan, Yujun Shen, Yibing Song, Jing Liao, Qifeng Chen

    ACM SIGGRAPH Conference Papers (SIGGRAPH) · 2024

    Experimental results show that the HeadArtist approach produces high-quality 3D head sculptures with rich geometry and photo-realistic appearance, which significantly outperforms state-of-the-art methods.

    31
  • Data-Efficient Instance Generation from Instance Discrimination

    Ceyuan Yang, Yujun Shen, Yinghao Xu, Bolei Zhou

    arXiv · 2021

    31
  • LinkGAN: Linking GAN Latents to Pixels for Controllable Image Synthesis

    Jiapeng Zhu, Ceyuan Yang, Yujun Shen, Zifan Shi, Bo Dai, Deli Zhao, Qifeng Chen

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2023

    An easy-to-use regularizer for GAN training, which helps explicitly link some axes of the latent space to a set of pixels in the synthesized image, which can improve the spatial controllability of both 2D and 3D-aware GAN models, barely sacrificing the synthesis performance.

    30
  • AniDoc: Animation Creation Made Easier

    Yihao Meng, Hao Ouyang, Hanlin Wang, Qiuyu Wang, Wen Wang, Ka Leong Cheng, Zhiheng Liu, Yujun Shen, +1 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2025

    AniDoc1 emerges as a video line art colorization tool, which automatically converts sketch sequences into colored animations following the reference character specification, yielding strong robustness to the variations between the reference character and each line art frame.

    29
  • DreamLIP: Language-Image Pre-training with Long Captions

    Kecheng Zheng, Yifei Zhang, Wei Wu, Fan Lu, Shuailei Ma, Xin Jin, Wei Chen, Yujun Shen

    Lecture notes in computer science · 2024

    26
  • High-Fidelity GAN Inversion with Padding Space

    Qingyan Bai, Yinghao Xu, Jiapeng Zhu, Weihao Xia, Yujiu Yang, Yujun Shen

    Lecture notes in computer science · 2022

    26
  • FaceFeat-GAN: a Two-Stage Approach for Identity-Preserving Face Synthesis

    Yujun Shen, Bolei Zhou, Ping Luo, Tang, Xiaoou

    arXiv · 2018

    26
  • Learning 3D-Aware Image Synthesis with Unknown Pose Distribution

    Zifan Shi, Yujun Shen, Yinghao Xu, Sida Peng, Yiyi Liao, Sheng Guo, Qifeng Chen, Dit‐Yan Yeung

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023

    This work proposes PoF3D, a pose-free generator and the pose-aware discriminator that frees generative radiance fields from the requirements of 3D pose priors, and demonstrates the feasibility of learning high-quality 3D-aware image synthesis without using 3D posing priors for the first time.

    25
  • Rectified Diffusion Guidance for Conditional Generation

    Mengfei Xia, Nan Xue, Yujun Shen, Ran Yi, Tieliang Gong, Yong‐Jin Liu

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2025

    The theory behind CFG is revisited and it is rigorously confirmed that the improper configuration of the combination coefficients brings about expectation shift of the generative distribution and a relaxation on the guidance coefficients is proposed such that denoising with ReCFG strictly aligns with the diffusion theory.

    22
  • 4D Gaussian Videos with Motion Layering

    Pinxuan Dai, Peiquan Zhang, Zheng Dong, Ke Xu, Yifan Peng, Dandan Ding, Yujun Shen, Yin Yang, +3 more

    ACM Transactions on Graphics · 2025

    This paper proposes a novel 4D Gaussian Video approach that enables the creation and streaming of photorealistic, volumetric videos for dynamic scenes over the Internet, and demonstrates that this method outperforms state-of-the-art volumetric video approaches with superior rendering quality and minimum storage overheads.

    21
  • Zero-shot Image Editing with Reference Imitation

    Mengting Chen, Yutong Feng, Mengting Chen, Yiyang Wang, Shilong Zhang, Yu Liu, Yujun Shen, Hengshuang Zhao

    neural information processing systems · 2024

    21
  • SAM-Guided Graph Cut for 3D Instance Segmentation

    Haoyu Guo, He Zhu, Sida Peng, Yuang Wang, Yujun Shen, Ruizhen Hu, Xiaowei Zhou

    Lecture notes in computer science · 2024

    21
  • Improving the Fairness of Deep Generative Models without Retraining

    Shuhan Tan, Yujun Shen, Bolei Zhou

    arXiv · 2020

    21
  • Mimir: Improving Video Diffusion Models for Precise Text Understanding

    Shuai Tan, Biao Gong, Yutong Feng, Kecheng Zheng, Dandan Zheng, Shuwei Shi, Yujun Shen, Jingdong Chen, +1 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2025

    Mimir is an end-to-end training framework featuring a carefully tailored token fuser to harmonize the outputs from text encoders and LLMs, which allows the T2V model to fully leverage learned video priors while capitalizing on the text-related capability of LLMs.

    20
  • Residual Knowledge Distillation

    Mengya Gao, Yujun Shen, Quanquan Li, Chen Change Loy

    arXiv · 2020

    20
  • Exploring Sparse MoE in GANs for Text-conditioned Image Synthesis

    Jiapeng Zhu, Ceyuan Yang, Kecheng Zheng, Yinghao Xu, Zifan Shi, Yifei Zhang, Qifeng Chen, Yujun Shen

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2025

    Aurora, a GAN-based text-to-image generator that employs a collection of experts to learn feature processing, together with a sparse router to adaptively select the most suitable expert for each feature point, closes the performance gap between GANs and industry-level diffusion models, maintaining a fast inference speed.

    19
  • Towards Smooth Video Composition

    Zhang, Qihang, Ceyuan Yang, Yujun Shen, Yinghao Xu, Bolei Zhou

    arXiv · 2022

    This work investigates modeling the temporal relations for composing video with arbitrary length, from a few frames to even infinite, using generative adversarial networks (GANs), and develops a novel B-Spline based motion representation to ensure temporal smoothness to achieve infinite-length video generation.

    19
  • Towards More Accurate Diffusion Model Acceleration with a Timestep Tuner

    Mengfei Xia, Yujun Shen, Changsong Lei, Yu Zhou, Deli Zhao, Ran Yi, Wenping Wang, Yong‐Jin Liu

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    A timestep tuner that helps find a more accurate integral direction for a particular interval at the minimum cost and can be trained efficiently and boost the inference performance of various state-of-the-art acceleration methods, especially when there are few denoising steps.

    18
  • UKnow: A Unified Knowledge Protocol with Multimodal Knowledge Graph Datasets for Reasoning and Vision-Language Pre-Training

    Biao Gong, Shuai Tan, Yutong Feng, Xiaoying Xie, Yuyuan Li, Chaochao Chen, Kecheng Zheng, Yujun Shen, +1 more

    neural information processing systems · 2024

    This work categorizes data knowledge into five unit types, namely, in-image, in-text, cross-image, cross-text, and image-text, and sets up an efficient pipeline to help construct the multimodal knowledge graph from any data collection.

    18
  • Contextual AD Narration with Interleaved Multimodal Sequence

    Hanlin Wang, Tong Zhan, Kecheng Zheng, Yujun Shen, Limin Wang

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2025

    This work proposes a simple and lightweight module that maps video features into the textual feature space and proposes a character-refinement module to provide more precise information by identifying the main characters who play more significant roles in the video context.

    17
  • Diffuman4D: 4D Consistent Human View Synthesis From Sparse-View Videos With Spatio-Temporal Diffusion Models

    Yudong Jin, Sida Peng, Xuan Wang, Tao Xie, Zhen Xu, Yifan Yang, Yujun Shen, Hujun Bao, +1 more

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2025

    This paper proposes a novel sliding iterative denoising process to enhance the spatio-temporal consistency of the 4D diffusion model, and is able to synthesize high-quality and consistent novel-view videos and significantly outperforms the existing approaches.

    17
  • NEAT: Distilling 3D Wireframes from Neural Attraction Fields

    Nan Xue, Bin Tan, Yuxi Xiao, Liang Dong, Gui-Song Xia, Tianfu Wu, Yujun Shen

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    The proposed NEAT enjoys the joint optimization of the neural fields and the global junctions from scratch, using view-dependent 2D observations without precomputed cross-view feature matching, demonstrating its superiority over state-of-the-art alternatives for 3D wireframe reconstruction.

    17
  • VideoFusion: Decomposed Diffusion Models for High-Quality Video Generation

    Zhengxiong Luo, Dayou Chen, Yingya Zhang, Huang, Yan, Liang Wang, Yujun Shen, Deli Zhao, Jingren Zhou, +1 more

    arXiv · 2023

    17
  • CompConv: A Compact Convolution Module for Efficient Feature Learning

    Chen Guang Zhang, Yinghao Xu, Yujun Shen

    IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · 2021

    This work makes a close study of the convolution operator, which is the basic unit used in CNNs, to reduce its computing load and proposes a compact convolution module, called CompConv, to facilitate efficient feature learning.

    17
  • AvatarArtist: Open-Domain 4D Avatarization

    Hongyu Liu, Xuan Wang, Ziyu Wan, Yue Ma, Jingye Chen, Yanbo Fan, Yujun Shen, Yibing Song, +1 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2025

    This work focuses on open-domain 4D avatarization, and selects parametric triplanes as the intermediate 4D representation, and proposes a practical training paradigm that takes advantage of both generative adversarial networks (GANs) and diffusion models.

    16
  • LivePhoto: Real Image Animation with Text-Guided Motion Control

    Xi Chen, Zhi‐Heng Liu, Mengting Chen, Yutong Feng, Yu Liu, Yujun Shen, Hengshuang Zhao

    Lecture notes in computer science · 2024

    16
  • Using Unreliable Pseudo-Labels for Label-Efficient Semantic Segmentation

    Haochen Wang, Yuchao Wang, Yujun Shen, Junsong Fan, Yuxi Wang, Zhaoxiang Zhang

    International Journal of Computer Vision · 2024

    This work separate reliable and unreliable pixels via the entropy of predictions, push each unreliable pixel to a category-wise queue that consists of negative keys, and manage to train the model with all candidate pixels through an effective pipeline to make sufficient use of unlabeled data.

    15
  • In-Domain GAN Inversion for Faithful Reconstruction and Editability

    Jiapeng Zhu, Yujun Shen, Yinghao Xu, Deli Zhao, Qifeng Chen, Bolei Zhou

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2024

    In-domain GAN inversion is proposed, which consists of a domain-guided encoder and a domain-regularized optimizer, to regularize the inverted code in the native latent space of the pre-trained GAN model, to sufficiently reuse the knowledge learned by GANs for image reconstruction, facilitating a wide range of editing applications without any retraining.

    14
  • Regularized Mask Tuning: Uncovering Hidden Knowledge in Pre-trained Vision-Language Models

    Kecheng Zheng, Wei Wu, Ruili Feng, Kai Zhu, Jiawei Liu, Deli Zhao, Zheng-Jun Zha, Wei Chen, +1 more

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2023

    This work designs a new type of tuning method, termed as regularized mask tuning, which masks the network parameters through a learnable selection, and is synergistic with most existing parameter-efficient tuning methods and can boost the performance on top of them.

    14
  • Dimensionality-Varying Diffusion Process

    Han Zhang, Ruili Feng, Zhantao Yang, Lianghua Huang, Yu Liu, Yifei Zhang, Yujun Shen, Deli Zhao, +2 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023

    This work makes a theoretical generalization of the forward diffusion process via signal decomposition that facilitates high-resolution image synthesis and improves FID of diffusion model trained on FFHQ at $1024\times 1024$ resolution from 52.40 to 10.46.

    14
  • Region-Based Semantic Factorization in GANs

    Jiapeng Zhu, Yujun Shen, Yinghao Xu, Deli Zhao, Qifeng Chen

    arXiv · 2022

    14
  • Pulling Target to Source: A New Perspective on Domain Adaptive Semantic Segmentation

    Haochen Wang, Yujun Shen, Jingjing Fei, Wei Li, Liwei Wu, Yuxi Wang, Zhaoxiang Zhang

    International Journal of Computer Vision · 2024

    This work proposes T2S-DA, which encourages the model to learn similar cross-domain features and shows that T2S-DA is quite qualified for the domain generalization task, verifying its domain-invariant property.

    13
  • Reprogramming tumor-associated macrophages and inhibiting tumor neovascularization by targeting MANF–HSF1–HSP70-1 pathway: An effective treatment for hepatocellular carcinoma

    Dan Han, Qiannan Ma, Petek Ballar, Chunyang Zhang, Min Dai, Xiaoyuan Luo, Jiong Yan Gu, Chuansheng Wei, +15 more

    Acta Pharmaceutica Sinica B · 2024

    This study analyzed differential genes in normal macrophages and TAMs and found that loss of MANF in TAMs accompanied by high levels of downstream genes negatively regulated by MANF promoted HCC progression in HCC patients and mice HCC model, especially tumor neovascularization.

    12
  • GLeaD: Improving GANs with A Generator-Leading Task

    Qingyan Bai, Ceyuan Yang, Yinghao Xu, Xihui Liu, Yujiu Yang, Yujun Shen

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023

    This work proposes a new paradigm for adversarial training, which makes G assign a task to D as well, and expects D to extract representative features that can be adequately decoded by G to reconstruct the input.

    12
  • MANF Alleviates Sevoflurane-Induced Cognitive Impairment in Neonatal Mice by Modulating Microglial Activation and Polarization

    Jie Gao, Huiping Zhang, Leiying Zhou, Jiaqi Liu, Enba Zhuo, Yujun Shen, Xuesheng Liu, Qiying Shen

    Molecular Neurobiology · 2023

    It is demonstrated that MANF ameliorated neurotoxicity induced by the sevoflurane anesthesia in young mice, and such protective effect was associated with inhibition of microglia activation and neuroinflammation.

    12
  • CCM: Adding Conditional Controls to Text-to-Image Consistency Models

    Jie Xiao, Zhu, Kai, Han Zhang, Zhiheng Liu, Yujun Shen, Yu Liu, Xueyang Fu, Zheng-Jun Zha

    arXiv · 2023

    This technical report considers alternative strategies for adding ControlNet-like conditional control to CMs and presents three significant findings.

    11
  • Edicho: Consistent Image Editing in the Wild

    Qingyan Bai, Hao Ouyang, Yinghao Xu, Qiuyu Wang, Ceyuan Yang, Ka Leong Cheng, Yujun Shen, Qifeng Chen

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2025

    Edicho steps in with a training-free solution based on diffusion models, featuring a fundamental design principle of using explicit image correspondence to direct editing, and enjoys a plug-and-play nature and is compatible to most diffusion-based editing methods, such as ControlNet and BrushNet.

    10
  • Interspatial Attention for Efficient 4D Human Video Generation

    Ruizhi Shao, Yinghao Xu, Yujun Shen, Ceyuan Yang, Yang Zheng, Changan Chen, Yebin Liu, Gordon Wetzstein

    ACM Transactions on Graphics · 2025

    This paper introduces a new interspatial attention (ISA) mechanism as a scalable building block for modern diffusion transformer (DiT)-based video generation models and achieves state-of-the-art performance for 4D human video synthesis.

    9
  • MANF serves as a novel hepatocyte factor to promote liver regeneration after 2/3 partial hepatectomy via doubly targeting Wnt/β-catenin signaling

    Yanyan Liang, Qiong Mei, Enguang He, Petek Ballar, Chuansheng Wei, Yue Wang, Yue Dong, Jie Zhou, +12 more

    Cell Death and Disease · 2024

    This study confirms that MANF may serve as a novel hepatocyte factor that is closely linked to the activation of the Wnt/β-catenin pathway via intracellular and extracellular targets.

    9
  • SMaRt: Improving GANs with Score Matching Regularity

    Mengfei Xia, Yujun Shen, Ceyuan Yang, Ran Yi, Wenping Wang, Yong‐Jin Liu

    arXiv · 2023

    This work revisit the mathematical foundations of GANs, and theoretically reveal that the native adversarial loss for GAN training is insufficient to fix the problem of subsets with positive Lebesgue measure of the generated data manifold lying out of the real data manifold, and finds that score matching serves as a promising solution to this issue.

    9
  • UIKA: Fast Universal Head Avatar from Pose-Free Images

    Zijian Wu, Boyao Zhou, Liangxiao Hu, Hongyu Liu, Yuan Sun, Xuan Wang, Xun Cao, Yujun Shen, +1 more

    arXiv · 2026

    UIKA, a feed-forward animatable Gaussian head model from an arbitrary number of pose-free inputs, including a single image, multi-view captures, and smartphone-captured videos is presented, which significantly outperforms existing approaches in both monocular and multi-view settings.

    8
  • Learning Visual Generative Priors without Text

    Shuailei Ma, Kecheng Zheng, Ying Wei, Wei Wu, Fan Lu, Yifei Zhang, Chen-Wei Xie, Biao Gong, +2 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2025

    This work develops a pure vision-based training framework, Lumos, and confirms the feasibility and the scalability of learning I2I models, and finds that, as an upstream task of T2I, the I2I model serves as a more foundational visual prior and achieves on-par or better performance than existing T2I models using only 1/10 text-image pairs for fine-tuning.

    8
  • TagAlign: Improving Vision-Language Alignment with Multi-Tag Classification

    Qinying Liu, Wu, Wei, Kecheng Zheng, Tong Zhan, Liu, Jiawei, Yu Liu, Wei Chen, Zilei Wang, +1 more

    arXiv · 2023

    This work proposes an embarrassingly simple approach to better align image and text features with no need of additional data formats other than image-text pairs and indicates that attribute supervision makes vision-language models accurately localize attribute-specified objects.

    8
  • An Embarrassingly Simple Approach for Knowledge Distillation

    Mengya Gao, Yujun Shen, Quanquan Li, Yan, Junjie, Wan, Liang, Dahua Lin, Chen Change Loy, Tang, Xiaoou

    arXiv · 2018

    8
  • DiffDoctor: Diagnosing Image Diffusion Models Before Treating

    Yiyang Wang, Xi Chen, Xiaogang Xu, Sihui Ji, Yu Liu, Yujun Shen, Hengshuang Zhao

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2025

    DiffDoctor is proposed, a twostage pipeline to assist image diffusion models in generating fewer artifacts by developing a robust artifact detector and an efficient human-in-the-loop annotation process, incorporating a carefully designed class-balance strategy.

    7
  • ScaleLSD: Scalable Deep Line Segment Detection Streamlined

    Zeran Ke, Bin Tan, Xianwei Zheng, Yujun Shen, Tianfu Wu, Nan Xue

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2025

    This paper studies the problem of Line Segment Detection (LSD) for the characterization of line geometry in images and proposes a domain-agnostic robust LSD model that works well for any natural images, observed to be the first deep approach that outperforms the pioneered non-deep LSD in all aspects.

    7
  • BerfScene: Bev-conditioned Equivariant Radiance Fields for Infinite 3D Scene Generation

    Qihang Zhang, Yinghao Xu, Yujun Shen, Bo Dai, Bolei Zhou, Ceyuan Yang

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    A practical and efficient 3D representation that incorporates an equivariant radiance field with the guidance of a bird's-eye view (BEV) map is proposed that allows for large-scale, even infinite-scale, 3D scenes via synthesizing local scenes and then stitching them with smooth consistency.

    7
  • Benchmarking and Analyzing 3D-aware Image Synthesis with a Modularized Codebase

    Qiuyu Wang, Zifan Shi, Kecheng Zheng, Yinghao Xu, Sida Peng, Yujun Shen

    arXiv · 2023

    A well-structured codebase is built, dubbed Carver, through modularizing the generation process, which allows researchers to develop and replace each module independently, and hence offers an opportunity to fairly compare various approaches and recognize their contributions from the module perspective.

    7
  • AnyDoor: Zero-Shot Image Customization With Region-to-Region Reference

    Xi Chen, Lianghua Huang, Liu Yu, Yujun Shen, Deli Zhao, Hengshuang Zhao

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2025

    6
  • Airflow field simulation model building and application for aerobic compost using CFD

    Qiongyi Cheng, Haibo Meng, Haibin Zhou, Yujun Shen, Hongsheng Cheng, Jingtao Ding, Shihao Zhao, Shance Hou

    International journal of agricultural and biological engineering · 2021

    6
  • 6
  • CoDance: An Unbind-Rebind Paradigm for Robust Multi-Subject Animation

    Shuai Tan, Gong, Biao, Ke Ma, Yutong Feng, Qiyuan Zhang, Yan Wang, Yujun Shen, Hengshuang Zhao

    arXiv · 2026

    CoDance is proposed, a novel Unbind-Rebind framework that enables the animation of arbitrary subject counts, types, and spatial configurations conditioned on a single, potentially misaligned pose sequence and achieves SOTA performance.

    5
  • MagicQuillV2: Precise and Interactive Image Editing with Layered Visual Cues

    Zichen Liu, Yue Yu, Hao Ouyang, Qiuyu Wang, Shuailei Ma, Ka Leong Cheng, Wen Wang, Qingyan Bai, +6 more

    arXiv · 2025

    5
  • ZeroDexGrasp: Zero-Shot Task-Oriented Dexterous Grasp Synthesis with Prompt-Based Multi-Stage Semantic Reasoning

    Juntao Jian, Yi-Lin Wei, Chengjie Mou, Yuhao Lin, Xing Zhu, Yujun Shen, Wei‐Shi Zheng, Ruizhen Hu

    arXiv · 2025

    Experimental results demonstrate that ZeroDexGrasp enables high-quality zero-shot dexterous grasping on diverse unseen object categories and complex task requirements, advancing toward more generalizable and intelligent robotic grasping.

    5
  • Learning Naturally Aggregated Appearance for Efficient 3D Editing

    Ka Leong Cheng, Qiuyu Wang, Zifan Shi, Kecheng Zheng, Yinghao Xu, Hao Ouyang, Qifeng Chen, Yujun Shen

    International Conference on 3D Vision (3DV) · 2025

    This work proposes to learn the color field as an explicit 2D appearance aggregation, also called canonical image, with which users can easily customize their 3D editing via 2D image processing, and complement the canonical image with a projection field that maps 3D points onto 2D pixels for texture query.

    4
  • Exploring Guided Sampling of Conditional GANs

    Yifei Zhang, Mengfei Xia, Yujun Shen, Jiapeng Zhu, Ceyuan Yang, Kecheng Zheng, Lianghua Huang, Yu Liu, +1 more

    Lecture notes in computer science · 2024

    4
  • Feature Matters: A Stage-by-Stage Approach for Knowledge Transfer.

    Mengya Gao, Yujun Shen, Quanquan Li, Chen Change Loy, Xiaoou Tang

    arXiv · 2018

    It is argued that feature is the most important knowledge from teacher, and sufficient for student to achieve appealing performance by just learning similar features as teacher without any processing, and presented an efficient learning strategy, which is to make student mimic features of teacher stage by stage.

    4
  • Feature Matters: A Stage-by-Stage Approach for Task Independent Knowledge Transfer

    Mengya Gao, Yujun Shen, Quanquan Li, Liang Wan, Xiaoou Tang

    2018

    4
  • ReTracker: Exploring Image Matching for Robust Online Any Point Tracking

    Dongli Tan, Xingyi He, Sida Peng, Yiqing Gong, Xing Zhu, Jiaming Sun, Ruizhen Hu, Yujun Shen, +2 more

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2025

    3
  • UrbanGen: Urban Generation with Compositional and Controllable Neural Fields

    Yuanbo Yang, Yujun Shen, Yue Wang, Andreas Geiger, Yiyi Liao

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2025

    The systematic study shows that UrbanGen outperforms state-of-the-art generative radiance field baselines in terms of image fidelity and geometry accuracy for urban scene generation and brings a new set of controllability features, including large camera movements, stuff editing, and city style control.

    3
  • Spatial Steerability of GANs via Self-Supervision from Discriminator

    Jianyuan Wang, Lalit Bhagat, Ceyuan Yang, Yinghao Xu, Yujun Shen, Hongdong Li, Bolei Zhou

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2024

    This work designs randomly sampled Gaussian heatmaps to be encoded into the intermediate layers of generative models as spatial inductive bias, and incorporates DragGAN into the framework, which facilitates fine-grained manipulation within a reasonable time and supports a coarse-to-fine editing process.

    3
  • GenDeF: Learning Generative Deformation Field for Video Generation

    Wen Wang, Kecheng Zheng, Qiuyu Wang, Hao Chen, Zifan Shi, Ceyuan Yang, Yujun Shen, Chunhua Shen

    arXiv · 2023

    This work proposes to render a video by warping one static image with a generative deformation field (GenDeF), alleviating the difficulty in producing a video and thereby resulting in better visual quality.

    3
  • ViM: Vision Middleware for Unified Downstream Transferring

    Yutong Feng, Biao Gong, Jianwen Jiang, Yiliang Lv, Yujun Shen, Deli Zhao, Jingren Zhou

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2023

    Vision Middleware is presented, a new learning paradigm that targets unified transferring from a single foundation model to a variety of downstream tasks and can include as many midstream tasks as possible, narrowing the task gap between upstream and downstream.

    3
  • Lipschitz Singularities in Diffusion Models

    Zhantao Yang, Feng, Ruili, Han Zhang, Yujun Shen, Zhu, Kai, Lianghua Huang, Yifei Zhang, Yu Liu, +3 more

    arXiv · 2023

    A novel approach is proposed, dubbed E-TSDM, which eliminates the Lipschitz singularity of the diffusion model near zero, and yields a substantial improvement in performance, e.g., on the high-resolution FFHQ dataset.

    3
  • GH-Feat: Learning Versatile Generative Hierarchical Features From GANs

    Yinghao Xu, Yujun Shen, Jiapeng Zhu, Ceyuan Yang, Bolei Zhou

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2022

    This work investigates that a generative feature learned from image synthesis exhibits great potentials in solving a wide range of computer vision tasks, including both generative ones and more importantly discriminative ones, and develops GH-Feat, a hierarchical visual feature with multi-level semantics.

    3
  • Kinetic Model for Rapid Convective Drying of Cut Strips Based on Shrinkage Property Analysis

    XU Bingyang, Zhu Wenkui, Pan Guangle, Yujun Shen, Li Bin, YU Chuanfang

    Tobacco Science & Technology · 2014

    3
  • Efficient Object Reconstruction with Differentiable Area Light Shading

    Yaoan Gao, Jiamin Xu, James Tompkin, Qi Wang, Zheng Dong, Hujun Bao, Yujun Shen, Huamin Wang, +2 more

    SIGGRAPH Asia Conference Papers · 2025

    This work proposes an inverse rendering method that uses active area lighting: as this provides a wider range of lighting angles per photo than point lighting, material reconstruction can be more accurate for the same number of photos, and improves material reconstruction, particularly for material roughness.

    2
  • Interacted Planes Reveal 3D Line Mapping

    Zeran Ke, Bin Tan, Gui-Song Xia, Yujun Shen, Nan Xue

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2026

    LiP-Map pioneers the integration of planar topology into 3D line mapping, not by imposing pairwise coplanarity constraints but by explicitly constructing interactions between plane and line primitives, thus offering a principled route toward structured reconstruction in man-made environments.

    1
  • PhysRVG: Physics-Aware Unified Reinforcement Learning for Video Generative Models

    Qiyuan Zhang, Biao Gong, Shuai Tan, Zheng Zhang, Yujun Shen, Xing Zhu, Yuyuan Li, Kelu Yao, +2 more

    Lecture notes in computer science · 2026

    1
  • ScenDi: 3D-to-2D Scene Diffusion Cascades for Urban Generation

    Hanlei Guo, Jiahao Shao, Xinya Chen, Xiyang Tan, Miao, Sheng, Yujun Shen, Yiyi Liao

    arXiv · 2026

    ScenDi, a method for urban scene generation that integrates both 3D and 2D diffusion models that generates desired scenes based on input conditions and successfully adheres to accurate camera trajectories is proposed.

    1
  • NeuMesh++: Toward Versatile and Efficient Volumetric Editing With Disentangled Neural Mesh-Based Implicit Field

    Chong Bao, Yuan Li, Bangbang Yang, Yujun Shen, Hujun Bao, Zhaopeng Cui, Yinda Zhang, Guofeng Zhang

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2025

    A novel mesh-based representation by encoding the neural radiance field with disentangled geometry, texture, and semantic codes on mesh vertices is presented, which empowers a set of efficient and comprehensive editing functionalities, including mesh-guided geometry editing, designated texture editing with texture swapping, filling and painting operations, and semantic-guided editing.

    1
  • DW-VIO: Deep Weighted Visual-Inertial Odometry

    Guyuan Chen, Xiyue Guo, Xiaokun Pan, Yujun Shen, Guofeng Zhang, Hujun Bao, Zhaopeng Cui

    IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · 2025

    1
  • PLANA3R: Zero-shot Metric Planar 3D Reconstruction via Feed-forward Planar Splatting

    Changkun Liu, Bin Tan, Zeran Ke, Shangzhan Zhang, Jiachen Liu, Ming Qian, Nan Xue, Yujun Shen, +1 more

    neural information processing systems · 2025

    1
  • HeadArtist-VL: Vision / Language Guided 3D Head Generation with Self Score Distillation

    Hongyu Liu, Xuan Wang, Ziyu Wan, Yujun Shen, Yibing Song, Jing Liao, Qifeng Chen

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2025

    In the experiments, the HeadArtist-VL produces high-quality 3D head sculptures with rich geometry and photo-realistic appearance, which significantly outperforms state-of-the-art methods.

    1
  • LoTLIP: Improving Language-Image Pre-training for Long Text Understanding

    Wei Wu, Kecheng Zheng, Shuailei Ma, Fan Lu, Yuxin Guo, Yifei Zhang, Wei Chen, Qingpei Guo, +2 more

    neural information processing systems · 2024

    1
  • Real-Time 3D-Aware Portrait Editing from a Single Image

    Qingyan Bai, Zifan Shi, Yinghao Xu, Hao Ouyang, Qiuyu Wang, Ceyuan Yang, Xuan Wang, Gordon Wetzstein, +2 more

    Lecture notes in computer science · 2024

    1
  • Vehicle Detection Based on Improved YOLOV5s in Complex Weather

    Yusen Ma, Ye Tian, Ning Hao, Xinan Zhang, Yujun Shen

    Mechanisms and machine science · 2024

    1
  • Learning 3D-Aware GANs from Unposed Images with Template Feature Field

    Xinya Chen, Hanlei Guo, Yanrui Bin, Shangzhan Zhang, Yuanbo Yang, Yue Wang, Yujun Shen, Yiyi Liao

    Lecture notes in computer science · 2024

    1
  • Human Target Detection Model in Dense Traffic Scenes Based on Attention Mechanism

    Zheng Ren, Yingqiu Li, Yujun Shen, Yanxin Xu

    International Conference on Image, Vision and Computing (ICIVC) · 2023

    1
  • Interpreting Class Conditional GANs with Channel Awareness

    Yingqing He, Zhiyi Zhang, Jiapeng Zhu, Yujun Shen, Qifeng Chen

    arXiv · 2022

    Channel awareness is proposed, which quantitatively characterizes how a single channel contributes to the final synthesis of multiple classes in the class conditional generator, and shows promising potential in segmenting the synthesized image and evaluating the category-wise synthesis performance.

    1
  • Low-Rank Subspaces in GANs

    Jiapeng Zhu, Ruili Feng, Yujun Shen, Deli Zhao, Zheng-Jun Zha, Jingren Zhou, Qifeng Chen

    arXiv · 2021

    1
  • Design of moistening system in reordering section in strip redryer

    Yongsheng Dai, Yujun Shen, Xia Fei, Peng Liming

    Tobacco Science & Technology · 2018

    1
  • Application of Principal Components Analysis and Cluster Analysis in Evaluation of Blending Module

    Su Yong, Qiang Liu, Peng Li-Ming, Dai Yong-Sheng, Wen De-Xun, Zhixia Sun, Yujun Shen

    Tobacco Science & Technology · 2004

    The results showed that the multivariate analysis overcome the shortcomings of traditional physical, chemical and sensory index tests which failed to comprehensively evaluate and classify between numerous tobacco samples.

    1
  • Orientation Matters: Making 3D Generative Models Orientation-Aligned

    Yichong Lu, Yuzhuo Tian, Zijin Jiang, Yikun Zhao, Yuanbo Yang, Hao Ouyang, Haoji Hu, Huimin Yu, +2 more

    neural information processing systems · 2025

    –
  • Study on the evaluation method of cigarette astringency in the simulated oral environment

    Xiaofei Song, Shanhua Qian, Hui Li, Yujun Shen, Da Bian, Kai Shan, Jing-quan Shi

    Journal of Texture Studies · 2024

    The study concluded that coefficient of friction was a more reliable measure for assessing the extent of astringency in cigarettes than the total phenol content and pH of MS, offering new insights into astringency evaluation and development of high-grade cigarettes.

    –
  • Data from A Large-Scale, Exome-Wide Association Study of Han Chinese Women Identifies Three Novel Loci Predisposing to Breast Cancer

    Bo Zhang, Men-Yun Chen, Yujun Shen, Xian-Bo Zhuo, Ping Gao, Fusheng Zhou, Bo Liang, Jun Zu, +22 more

    2023

    –
  • Supplementary figure S1-S19 from A Large-Scale, Exome-Wide Association Study of Han Chinese Women Identifies Three Novel Loci Predisposing to Breast Cancer

    Bo Zhang, Men-Yun Chen, Yujun Shen, Xian-Bo Zhuo, Ping Gao, Fusheng Zhou, Bo Liang, Jun Zu, +22 more

    2023

    –
  • Table S8 from A Large-Scale, Exome-Wide Association Study of Han Chinese Women Identifies Three Novel Loci Predisposing to Breast Cancer

    Bo Zhang, Men-Yun Chen, Yujun Shen, Xian-Bo Zhuo, Ping Gao, Fusheng Zhou, Bo Liang, Jun Zu, +22 more

    2023

    –
  • A Novel Chinese Address Segmentation Method with Self-growth Feature

    Yong Zhang, Yingqiu Li, Fengkun Li, Yujun Shen, Yanxin Xu

    Advances in Engineering Technology Research · 2023

    This work proposes a novel CAS method or model that starts from scratch, without relying on any pre-installed knowledge about Chinese addresses, and dynamically evolves and grows its knowledge library by leveraging contextual information and comparing addresses during the process of dividing them into address elements.

    –
  • Table S7 from A Large-Scale, Exome-Wide Association Study of Han Chinese Women Identifies Three Novel Loci Predisposing to Breast Cancer

    Bo Zhang, Men-Yun Chen, Yujun Shen, Xian-Bo Zhuo, Ping Gao, Fusheng Zhou, Bo Liang, Jun Zu, +22 more

    2023

    –
  • Intravoxel incoherent motion diffusion-weighted imaging for monitoring the anti-angiogenesis efficacy in a C6 glioma rat model

    Weishu Hou, Xiaohu Li, Hongli Pan, Man Xu, Sixing Bi, Yujun Shen, Yong Zhang, Yinfeng Qian, +1 more

    Proceedings on CD-ROM - International Society for Magnetic Resonance in Medicine. Scientific Meeting and Exhibition/Proceedings of the International Society for Magnetic Resonance in Medicine, Scientific Meeting and Exhibition · 2023

    Investigation of the feasibility of intravoxel incoherent motion diffusion-weighted imaging in evaluating early effects of antiangiogenic therapy in a C6 glioma rat model showed significantly decreased D* values and increased ADC and D values corresponding to histological staining in Bev treated tumors.

    –
  • Table S4-S6 from A Large-Scale, Exome-Wide Association Study of Han Chinese Women Identifies Three Novel Loci Predisposing to Breast Cancer

    Bo Zhang, Men-Yun Chen, Yujun Shen, Xian-Bo Zhuo, Ping Gao, Fusheng Zhou, Bo Liang, Jun Zu, +22 more

    2023

    –
  • A Machine Learning Based Risk Identification Method for Illegal Pig Slaughtering

    Jiajun Miao, Yujun Shen, Yan Zhang, Lingjie Liu, Ye Tian, Yu Zhao, Chunyan Zhou

    International Conference on Intelligent Communication and Networking (ICN) · 2023

    –
  • Table S1 from A Large-Scale, Exome-Wide Association Study of Han Chinese Women Identifies Three Novel Loci Predisposing to Breast Cancer

    Bo Zhang, Men-Yun Chen, Yujun Shen, Xian-Bo Zhuo, Ping Gao, Fusheng Zhou, Bo Liang, Jun Zu, +22 more

    2023

    –
  • Neural Dependencies Emerging from Learning Massive Categories

    Ruili Feng, Kecheng Zheng, Kai Zhu, Yujun Shen, Jian Zhao, Yukun Huang, Deli Zhao, Jingren Zhou, +2 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023

    It is demonstrated that identifying neural dependencies is equivalent to solving the Covariance Lasso (CovLasso) regression problem proposed in this paper, and the potential of neural dependencies in understanding internal data correlations, generalizing models to unseen categories, and improving model robustness with a dependency-derived regularizer is shown.

    –
  • Table S2-S3 from A Large-Scale, Exome-Wide Association Study of Han Chinese Women Identifies Three Novel Loci Predisposing to Breast Cancer

    Bo Zhang, Men-Yun Chen, Yujun Shen, Xian-Bo Zhuo, Ping Gao, Fusheng Zhou, Bo Liang, Jun Zu, +22 more

    2023

    –
  • –
  • Research Progress of Nursing Safety Management of Pre-hospital Care

    Yujun Shen

    Guide of China Medicine · 2013

    This article reviewed the implementation of domestic hospital nursing safety and specific management in pre-hospital care in recent years, and stated current situation of nursing safety management inPre- hospital care and its practical application prospect.

    –
  • Integrated Intelligent Control Equipment for Sewage Sludge Aerobic Fermentation

    Chuang Ma, Gao Ding, Hongtao Liu, Guodi Zheng, Jun Chen, LI Xue-yi, Huang Chaowen, Yujun Shen, +4 more

    China Water & Wastewater · 2012

    –
  • Determination of Tobacco Leaf Adhesion with Texture Analyzer

    Yuhai Zhang, Xinmin Wang, Guodong Deng, Bing Wang, Xiaoping Liu, Yujun Shen, Xu Da-Yong

    Tobacco Science & Technology · 2011

    –
  • Statistical Technique in Quality Management of Military Products and Application of SPSS Software

    Yujun Shen

    Fire Control and Command Control · 2006

    The paper introduces the simple and practical SPSS software into quality management of military products so as to simplify the difficulty of application of statistical technique.

    –
  • Recognition of Cigarette Blend Make-up Based on NIR Spectrum

    Xiaoping Liu, Bin Li, YU Chuanfang, Yujun Shen, Bing Wang

    Tobacco Science & Technology · 2006

    –

Publication data from OpenAlex; citation counts are the higher of OpenAlex and Semantic Scholar, last synced 2026-10-15. One-sentence summaries under some papers are written by Semantic Scholar’s model. Citation counts may be lower than on Google Scholar, which indexes more sources.

Report an error

Wrong papers, two people merged into one, or a profile that should not be here? Tell us and we will fix or hide it.

Sign in to report