Is this you? Claim this profile to correct it, add a bio and choose the work people see first.

Claim this profile

Works137 from public data

TitleCited by
  • Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generators

    Levon Khachatryan, Andranik Movsisyan, Vahram Tadevosyan, Roberto D. Henschel, Zhangyang Wang, Shant Navasardyan, Humphrey Shi

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2023

    This paper proposes a low-cost approach (without any training or optimization) by leveraging the power of existing text-to-image synthesis methods, making them suitable for the video domain, and introduces a new task, zero-shot text-to-video generation.

    896
  • OneFormer: One Transformer to Rule Universal Image Segmentation

    Jitesh Jain, Jiachen Li, Mang Tik Chiu, Ali Hassani, Nikita Orlov, Humphrey Shi

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023

    This work proposes OneFormer, a universal image segmentation framework that unifies segmentation with a multi-task train-once design that outperforms specialized Mask2Former models across all three segmentation tasks on ADE20k, Cityscapes, and COCO.

    653
  • Neighborhood Attention Transformer

    Ali Hassani, Steven Walton, Jiachen Li, Shen Li, Humphrey Shi

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023

    NA is a pixel-wise operation, localizing self attention to the nearest neighboring pixels, and therefore enjoys a linear time and space complexity compared to the quadratic complexity of SA, and is the first efficient and scalable sliding window attention mechanism for vision.

    540
  • CCNet: Criss-Cross Attention for Semantic Segmentation

    Zilong Huang, Xinggang Wang, Yunchao Wei, Lichao Huang, Humphrey Shi, Wenyu Liu, Thomas S. Huang

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2020

    520
  • Forget-Me-Not: Learning to Forget in Text-to-Image Diffusion Models

    Gong Zhang, Kai Wang, Xingqian Xu, Zhangyang Wang, Humphrey Shi

    IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · 2024

    The Forget-Me-Not method is proposed, a model-centric and efficient solution designed to remove identities, objects, or styles from a well-configured text-to-image model in as little as 30 seconds, without significantly impairing its ability to generate other content.

    369
  • More Control for Free! Image Synthesis with Semantic Diffusion Guidance

    Xihui Liu, Dong Huk Park, Samaneh Azadi, Gong Zhang, Arman Chopikyan, Yuxiao Hu, Humphrey Shi, Anna Rohrbach, +1 more

    IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · 2023

    This work investigates fine-grained, continuous control of the denoising diffusion probabilistic model class, and introduces a novel unified framework for semantic diffusion guidance, which allows either language or image guidance, or both.

    354
  • Versatile Diffusion: Text, Images and Variations All in One Diffusion Model

    Xingqian Xu, Zhangyang Wang, Eric Zhang, Kai Wang, Humphrey Shi

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2023

    This work expands the existing single-flow diffusion pipeline into a multi-task multimodal network, dubbed Versatile Diffusion (VD), that handles multiple flows of text-to-image, image- to-text, and variations in one unified model.

    295
  • Escaping the Big Data Paradigm with Compact Transformers

    Hassani, Ali, Steven Walton, Nikhil Shah, Abulikemu Abuduweili, Jiachen Li, Humphrey Shi

    arXiv · 2021

    287
  • StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Text

    Roberto D. Henschel, Levon Khachatryan, Hayk Poghosyan, Daniil Hayrapetyan, Vahram Tadevosyan, Zhangyang Wang, Shant Navasardyan, Humphrey Shi

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2025

    Experiments show that StreamingT2V produces more motion, while competing methods suffer from video stagnation when applied naively in an autoregressive fashion, surpassing competitors in both consistency and motion.

    273
  • AlignSeg: Feature-Aligned Segmentation Networks

    Zilong Huang, Yunchao Wei, Xinggang Wang, Humphrey Shi, Wenyu Liu, Thomas S. Huang

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2021

    This paper proposes Feature-Aligned Segmentation Networks (AlignSeg), a feature aggregation network that adopts a simple learnable interpolation strategy to learn transformation offsets of pixels that can effectively relieve the feature misalignment issue caused by multi-resolution feature aggregation.

    199
  • VideoINR: Learning Video Implicit Neural Representation for Continuous Space-Time Super-Resolution

    Zeyuan Chen, Yinbo Chen, Jingwen Liu, Xingqian Xu, Vidit Goel, Zhangyang Wang, Humphrey Shi, Xiaolong Wang

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    This work proposes Video Implicit Neural Representation (VideoINR), and shows its applications for Space-Time Video Super-Resolution, and shows that VideoINR achieves competitive performances with state-of-the-art STVSR methods on common up-sampling scales and significantly outperforms prior works on continuous and out- of-training-distribution scales.

    179
  • Cosmos 3: Omnimodal World Models for Physical AI

    NVIDIA, Niket Agarwal, Aditi, Niket Agarwal, Arslan Ali, Jon Allen, Martin Antolini, Adeline Aubame, +22 more

    arXiv · 2026

    This report introduces Cosmos 3, a family of omnimodal world models designed to jointly process and generate language, image, video, audio, and action sequences within a unified mixture-of-transformers architecture and demonstrates omnimodal world models as scalable, general-purpose backbones for embodied agents.

    150
  • Pyramid Attention Network for Image Restoration

    Yiqun Mei, Yuchen Fan, Yulun Zhang, Jiahui Yu, Yuqian Zhou, Ding Liu, Yun Fu, Thomas S. Huang, +1 more

    International Journal of Computer Vision · 2023

    A novel Pyramid Attention module for image restoration, which captures long-range feature correspondences from a multi-scale feature pyramid, and is designed to be able to borrow clean signals from their “clean” correspondences at the coarser levels.

    142
  • SinNeRF: Training Neural Radiance Fields on Complex Scenes from a Single Image

    Dejia Xu, Yifan Jiang, Peihao Wang, Zhiwen Fan, Humphrey Shi, Zhangyang Wang

    Lecture notes in computer science · 2022

    141
  • SeMask: Semantically Masked Transformers for Semantic Segmentation

    Jitesh Jain, Anu T. Singh, Nikita Orlov, Zilong Huang, Jiachen Li, Steven Walton, Humphrey Shi

    IEEE/CVF International Conference on Computer Vision Workshops (ICCVW) · 2023

    This paper argues that incorporating semantic information of the image into pretrained hierarchical transformer-based backbones while finetuning improves the performance considerably and proposes SeMask, a simple and effective framework that incorporates semantic information into the encoder with the help of a semantic attention operation.

    132
  • Deep learning-based automated image segmentation for concrete petrographic analysis

    Yu Jin Song, Zilong Huang, Chuanyue Shen, Humphrey Shi, David A. Lange

    Cement and Concrete Research · 2020

    The experimental results showed that CNN outperforms the color-based segmentation by a considerable margin, and has comparable accuracy to human experts, and the segmentation time is reduced to mere seconds.

    120
  • Adaptive Consistency Regularization for Semi-Supervised Transfer Learning

    Abulikemu Abuduweili, Xingjian Li, Humphrey Shi, Chengzhong Xu, Dejing Dou

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2021

    This work considers semi-supervised learning and transfer learning jointly, leading to a more practical and competitive paradigm that can utilize both powerful pre-trained models from source domain as well as labeled/unlabeled data in the target domain.

    115
  • Towards Layer-wise Image Vectorization

    Xu Ma, Yuqian Zhou, Xingqian Xu, Bin Sun, Valerii Filev, Nikita Orlov, Yun Fu, Humphrey Shi

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    This work proposes Layer-wise Image Vectorization, namely LIVE, to convert raster images to SVGs and simultaneously maintain its image topology, and demonstrates that LIVE presents more plausible vectorized forms than prior works and can be generalized to new images.

    114
  • ConvMLP: Hierarchical Convolutional MLPs for Vision

    Jiachen Li, Ali Hassani, Steven Walton, Humphrey Shi

    IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · 2023

    Experiments on object detection and semantic segmentation show that visual representation learned by ConvMLP can be seamlessly transferred to downstream tasks and achieve competitive results with fewer parameters.

    102
  • OpenBias: Open-Set Bias Detection in Text-to-Image Generative Models

    Moreno D’Incà, Elia Peruzzo, Massimiliano Mancini, Dejia Xu, Vidit Goe, Xingqian Xu, Zhangyang Wang, Humphrey Shi, +1 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    This paper presents OpenBias, a new pipeline that identifies and quantifies the severity of biases agnostically, without access to any precompiled set, and demonstrates that OpenBias agrees with current closed-set bias detection methods and human judgement.

    97
  • Prompt-Free Diffusion: Taking “Text” Out of Text-to-Image Diffusion Models

    Xingqian Xu, Jiayi Guo, Zhangyang Wang, Gao Ming Huang, Irfan A. Essa, Humphrey Shi

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    The proposed frame-work, Prompt-Free Diffusion, relies on only visual inputs to generate new images and outperform prior exemplar-based image synthesis approaches, and is naturally extensible to other downstream applications such as anime figure generation and virtual try-on, with promising quality.

    92
  • HD-Painter: High-Resolution and Prompt-Faithful Text-Guided Image Inpainting with Diffusion Models

    Hayk Manukyan, Andranik Sargsyan, Barsegh Atanyan, Zhangyang Wang, Shant Navasardyan, Humphrey Shi

    arXiv · 2023

    The Prompt-Aware Introverted Attention layer enhancing self-attention scores by prompt information resulting in better text aligned generations is designed and the Reweighting Attention Score Guidance mechanism seamlessly integrating a post-hoc sampling strategy into the general form of DDIM is introduced.

    87
  • Rethinking Text Segmentation: A Novel Dataset and A Text-Specific Refinement Approach

    Xingqian Xu, Zhifei Zhang, Zhaowen Wang, Brian L. Price, Zhonghao Wang, Humphrey Shi

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2021

    This work proposes TextSeg, a large-scale fine-annotated text dataset with six types of annotations, and introduces Text Refinement Network (TexRNet), a novel text segmentation approach that adapts to the unique properties of text, e.g. non-convex boundary, diverse texture, etc., which often impose burdens on traditional segmentation models.

    86
  • Keys to Better Image Inpainting: Structure and Texture Go Hand in Hand

    Jitesh Jain, Yuqian Zhou, Ning Yu, Humphrey Shi

    IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · 2023

    A novel inpainting network combining the advantages of the two designs achieves a remarkable visual quality to match state-of-the-art performance in both structure generation and repeating texture synthesis using a single network.

    83
  • CompFeat: Comprehensive Feature Aggregation for Video Instance Segmentation

    Yang Lie Fu, Linjie Yang, Ding Liu, Thomas S. Huang, Humphrey Shi

    Proceedings of the AAAI Conference on Artificial Intelligence · 2021

    This work proposes a novel comprehensive feature aggregation approach (CompFeat) to refine features at both frame-level and object-level with temporal and spatial context information to eliminate ambiguities introduced by only using single-frame features.

    80

Show all 137 works

Publication data from OpenAlex, with missing venues and authors filled in from Crossref; citation counts are the higher of OpenAlex and Semantic Scholar, last synced 2026-10-13. One-sentence summaries under some papers are written by Semantic Scholar’s model. Citation counts may be lower than on Google Scholar, which indexes more sources.

Report an error

Wrong papers, two people merged into one, or a profile that should not be here? Tell us and we will fix or hide it.

Sign in to report