Is this you? Claim this profile to correct it, add a bio and choose the work people see first.
Claim this profileAcademic lineage
Possible advisorsa guess from early papers, not confirmed
- Tien‐Tsin WongSuggested from co-authorship
Is this you? Claim this profile to confirm or dismiss it.
Works66 from public data
- A Unified Framework for Street-View Panorama Stitching873
Experimental results on a large set of challenging street-view panoramic images captured form the real world illustrate that the proposed system is capable of creating high-quality panoramas.
- VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Models710
This work explores the training scheme of video models extended from Stable Diffusion and investigates the feasibility of leveraging low-quality videos and synthesized high-quality images to obtain a high-quality video model, resulting in a generic high-quality video model.
- MotionCtrl: A Unified and Flexible Motion Controller for Video Generation673
MotionCtrl is presented, a unified and flexible motion controller for video generation designed to effectively and independently control camera and object motion and is a relatively generalizable model that can adapt to a wide array of camera poses and trajectories once trained.
- VideoCrafter1: Open Diffusion Models for High-Quality Video Generation633
This model is the first open-source I2V foundation model capable of transforming a given image into a video clip while maintaining content preservation constraints, and can generate realistic and cinematic-quality videos with a resolution of $1024 \times 576.
- CodeTalker: Speech-Driven 3D Facial Animation with Discrete Motion Prior286
This paper proposes to cast speech-driven facial animation as a code query task in a finite proxy space of the learned codebook, which effectively promotes the vividness of the generated motions by reducing the cross-modal mapping uncertainty.
- FreeNoise: Tuning-Free Longer Video Diffusion via Noise Rescheduling205
This work proposes FreeNoise, a tuning-free and time-efficient paradigm to enhance the generative capabilities of pretrained video diffusion models while preserving content consistency, and designs a novel motion injection method to support the generation of videos conditioned on multiple text prompts.
- 197
- 188
- Make-Your-Video: Customized Video Generation Using Textual and Structural Guidance166
This paper explores customized video generation by utilizing text as context description and motion structure (e.g., frame-wise depth) as concrete guidance as concrete guidance in joint-conditional video generation using a Latent Diffusion Model.
- ScaleCrafter: Tuning-free Higher-Resolution Visual Generation with Diffusion Models150
This work investigates the capability of generating images from pre-trained diffusion models at much higher resolutions than the training image sizes and proposes the dispersed convolution and noise-damped classifier-free guidance, which can enable ultra-high-resolution image generation.
- 113
- Animate-A-Story: Storytelling with Retrieval-Augmented Video Generation106
This work develops a framework comprised of two functional modules, which provides video candidates with desired scene or motion context described by query texts, and generates plot-aligned videos under the guidance of motion structure and text prompts.
- SynCamMaster: Synchronizing Multi-Camera Video Generation from Diverse Viewpoints104
This work proposes a plug-and-play module that enhances a pre-trained text-to-video model for multi-camera video generation, ensuring consistent content across different viewpoints, and introduces a multi-view synchronization module to maintain appearance and geometry consistency across these viewpoints.
- ToonCrafter: Generative Cartoon Interpolation86
A novel approach that transcends traditional correspondence-based cartoon video interpolation, paving the way for generative interpolation, and designs a toon rectification learning strategy that seamlessly adapts live-action video priors to the cartoon domain, resolving the domain gap and content leakage issues.
- Interactive Story Visualization with Multiple Characters84
A system for generic interactive story visualization, capable of handling multiple novel characters and supporting the editing of layout and local structure is proposed, developed by leveraging the prior knowledge of large language and T2I models, trained on massive corpora.
- 3DTrajMaster: Mastering 3D Trajectory for Multi-Entity Motion in Video Generation76
3DTrajMaster is introduced, a robust controller that regulates multi-entity dynamics in 3D space, given user-desired 6DoF pose (location and rotation) sequences of entities and sets a new state-of-the-art in both accuracy and generalization for controlling multi-entity 3D motions.
- 64
- FreeTraj: Tuning-Free Trajectory Control in Video Diffusion Models61
A tuning-free framework to achieve trajectory-controllable video generation, by imposing guidance on both noise construction and attention computation, and proposes FreeTraj, a tuning-free approach that enables trajectory control by modifying noise sampling and attention mechanisms.
- 60
- Invertible grayscale57
This paper proposes to learn and embed the color-encoding scheme via a convolutional neural network (CNN) and encode the original color information into the synthesized grayscale, in a way that users cannot recognize any anomalies.
- Automatic multi-image stitching for concrete bridge inspection by combining point and line features56
A newly developed vehicle-based robot inspection system that can automatically capture thousands of bottom surface images with a group of high-resolution industrial cameras, which are then stitched into a single composite image.
- CamCloneMaster: Enabling Reference-based Camera Control for Video Generation51
This work proposes CamCloneMaster, a framework that enables users to replicate camera movements from reference videos without requiring camera parameters or test-time fine-tuning, and presents the Camera Clone Dataset, a large-scale synthetic dataset designed for camera clone learning, encompassing diverse scenes, subjects, and camera movements.
- StyleCrafter: Enhancing Stylized Text-to-Video Generation with Style Adapter50
StyleCrafter is introduced, a generic method that enhances pre-trained T2V models with a style control adapter, enabling video generation in any style by providing a reference image, and designs a scale-adaptive fusion module to balance the influences of text-based content features and image-based style features.
- Disentangled Image Colorization via Global Anchors44
A novel colorization framework that disentangles color multimodality and structure consistency through global color anchors, so that both aspects could be learned effectively and achieve notable superiority over various mainstream frameworks in perceptual quality.
- Guided color consistency optimization for image mosaicking43
The histogram extreme point matching algorithm is creatively proposed which is robust to image geometrical misalignment to some extents and can achieve as good or even better results compared with the state-of-the-art approaches.
Publication data from OpenAlex, with missing venues and authors filled in from Crossref; citation counts are the higher of OpenAlex and Semantic Scholar, last synced 2026-10-13. One-sentence summaries under some papers are written by Semantic Scholar’s model. Citation counts may be lower than on Google Scholar, which indexes more sources.
Report an error
Wrong papers, two people merged into one, or a profile that should not be here? Tell us and we will fix or hide it.