Is this you? Claim this profile to correct it, add a bio and choose the work people see first.
Claim this profileWorks44 from public data
- PANet: Few-Shot Image Semantic Segmentation With Prototype Alignment1,540
This paper tackles the challenging few-shot segmentation problem from a metric learning perspective and presents PANet, a novel prototype alignment network to better utilize the information of the support set to better generalize to unseen object categories.
- MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Model426
This work introduces Magic/snimate, a diffusion-based framework that aims at enhancing temporal consistency, preserving reference image faithfully, and improving animation fidelity, and outperforms the strongest baseline on the challenging TikTok dancing dataset.
- DragDiffusion: Harnessing Diffusion Models for Interactive Point-Based Image Editing393
This work introduces two additional techniques, namely identity-preserving fine-tuning and reference-latent-control, to further preserve the identity of the original image and presents a challenging benchmark dataset called DRAGBENCH─ the first benchmark to evaluate the performance of interactive point-based image editing methods.
- 136
- 85
- MagicEdit: High-Fidelity and Temporally Coherent Video Editing83
It is found that high-fidelity and temporally coherent video-to-video translation can be achieved by explicitly disentangling the learning of content, structure and motion signals during training.
- MagicMix: Semantic Mixing with Diffusion Models82
MagicMix is presented, a simple yet effective solution based on pre-trained text-conditioned diffusion models that does not require any spatial mask or re-training, yet is able to synthesize novel objects with high fidelity.
- 82
- Body Meshes as Points74
A new method that represents multiple person instances as points in the spatial-depth space where each point is associated with one body mesh, Body Meshes as Points (BMP), to simplify the pipeline and lift both efficiency and performance.
- 67
- Global Knowledge Calibration for Fast Open-Vocabulary Segmentation64
A core idea of preserving the generalizable representation when fine-tuning on known classes is proposed, and a text diversification strategy that generates a set of synonyms for each training category is introduced, which prevents the learned representation from collapsing onto specific known category names.
- DiG: Scalable and Efficient Diffusion Models with Gated Linear Attention63
This paper aims to incorporate the sub-quadratic modeling capability of Gated Linear Attention (GLA) into the 2D diffusion backbone, and introduces Diffusion Gated Linear Attention Transformers (DiG), a simple, adoptable solution with minimal parameter overhead.
- MagicVideo-V2: Multi-Stage High-Aesthetic Video Generation63
This work introduces MagicVideo-V2 that integrates the text-to-image model, video motion generator, reference image embedding module and frame interpolation module into an end-to-end video generation pipeline that can generate an aesthetically pleasing, high-resolution video with remarkable fidelity and smoothness.
- 60
- SegRefiner: Towards Model-Agnostic Segmentation Refinement with Discrete Diffusion Process57
A model-agnostic solution called SegRefiner is proposed, which offers a novel perspective on segmentation refinement as a data generation process by interpreting segmentation refinement as a data generation process, and which outperforms previous model-agnostic refinement methods by a significant margin.
- Focus, Segment and Erase: An Efficient Network for Multi-label Brain Tumor Segmentation56
This work proposes a novel end-to-end trainable network named FSENet, which has a tumor region pooling component to restrict the prediction within the tumor region (“focus”), thus mitigating the influence of the dominant non-tumor region.
- MagicArticulate: Make Your 3D Models Articulation-Ready50
Extensive experiments demonstrate that MagicArticulate significantly outperforms existing methods across diverse object categories, achieving high-quality articulation that enables realistic animation.
- 40
- The Scalability of Simplicity: Empirical Analysis of Vision-Language Learning with a Single Transformer34
Sail is introduced, a single transformer unified multimodal large language model (MLLM) that integrates raw pixel encoding and language decoding within a singular architecture that eliminates the need for a separate vision encoder, presenting a more minimalist architecture design.
- PV3D: A 3D Generative Model for Portrait Video Generation28
Pv3D is proposed, the first generative framework that can synthesize multi-view consistent portrait videos with high-quality appearance and geometry and is able to support many downstream applications such as animating static portraits and view-consistent video motion editing.
- MagicAvatar: Multimodal Avatar Generation and Animation24
The flexibility of MagicAvatar is demonstrated through various applications, including text-guided and video-guided avatar generation, as well as multimodal avatar animation, which enables the animation of the provided human identity according to the specific motion derived from the first stage.
- ClassDiffusion: More Aligned Personalization Tuning with Explicit Class Guidance22
ClassDiffusion is presented, a technique that leverages a **semantic preservation loss** to explicitly regulate the concept space when learning a new concept and effectively improves the compositional abilities of fine-tuning models.
- AvatarStudio: High-Fidelity and Animatable 3D Avatar Creation from Text21
Av AvatarStudio is proposed, a generative model that yields explicit textured 3D meshes for animatable human avatars and incorporates articulation modeling into the explicit mesh representation to support high-resolution rendering and avatar animation.
- MagicProp: Diffusion-based Video Editing via Motion-aware Appearance Propagation19
Overall, MagicProp combines the flexibility of image-editing techniques with the superior temporal consistency of autoregressive modeling, enabling flexible editing of object types and aesthetic styles in arbitrary regions of input videos while maintaining good temporal consistency across frames.
- AdjointDPM: Adjoint Sensitivity Method for Gradient Backpropagation of Diffusion Probabilistic Models13
A novel method AdjointDPM is proposed, which first generates new samples from diffusion models by solving the corresponding probability-flow ODEs and uses the adjoint sensitivity method to backpropagate the gradients of the loss to the models' parameters by solving another augmented ODE.
- 12
- 10
- Towards Accurate Guided Diffusion Sampling through Symplectic Adjoint Method10
Symplectic Adjoint Guidance (SAG) is proposed, which calculates the gradient guidance in two inner stages and generates images with higher qualities compared to the baselines in both guided image and video generation tasks.
- 8
- Slim Scissors: Segmenting Thin Object from Synthetic Background8
Slim Scissors is developed, which enables quick extraction of elon-gated thin parts by simply brushing some coarse scribbles and is model-agnostic and seamlessly applicable to existing state-of-the-art interactive segmentation models.
- 8
- High Quality Human Image Animation using Regional Supervision and Motion Blur Condition7
This work first leverage regional supervision for detailed regions to enhance face and hand faithfulness and model the motion blur explicitly to further improve the appearance quality, and explores novel training strategies for high-resolution human animation to improve the overall fidelity.
- Delving Deeper into Data Scaling in Masked Image Modeling7
The study reveals that MIM can be viewed as an effective method to improve the model capacity when the scale of the training data is relatively small and MIM pre- training is data-agnostic under most scenarios, which means that the strategy of sampling pre-training data is non-critical.
- Empowering Visual Creativity: A Vision-Language Assistant to Image Editing Recommendations6
This paper introduces Creativity-Vision Language Assistant(Creativity-VLA), a multimodal framework designed specifically for edit-instruction generation that aims to automatically generate diverse creative editing instructions from an input image and a simple prompt representing the users' under-specified editing purpose.
- Associating Spatially-Consistent Grouping with Text-supervised Semantic Segmentation4
This work investigates performing semantic segmentation solely through the training on image-sentence pairs by adapting a text-supervised model from image-level to region-level recognition with two core designs and adopts a contextually aware masking strategy to enable simultaneous recognition of all grouped regions.
- 2
- SODAR: Exploring Locally Aggregated Learning of Mask Representations for Instance Segmentation2
A novel learning-based aggregation method that improves upon SOLO by leveraging the rich neighboring information while maintaining the architectural efficiency, and is named SODAR, which significantly improves the instance segmentation performance.
- 1
- 1
- –
- GPA: Learning GUI Process Automation from Demonstrations–
GPA is a lightweight but general vision-based Robotic Process Automation, which enables fast and stable process replay with only a single demo, and delivers the adaptability, robustness, and security required for enterprise workflows.
- –
- –
- –
Publication data from OpenAlex; citation counts are the higher of OpenAlex and Semantic Scholar, last synced 2026-10-12. One-sentence summaries under some papers are written by Semantic Scholar’s model. Citation counts may be lower than on Google Scholar, which indexes more sources.
Report an error
Wrong papers, two people merged into one, or a profile that should not be here? Tell us and we will fix or hide it.