Is this you? Claim this profile to correct it, add a bio and choose the work people see first.

Claim this profile

Works240 from public data

TitleCited by
  • VITON: An Image-Based Virtual Try-on Network

    Xintong Han, Zuxuan Wu, Zhe Wu, Ruichi Yu, Larry Steven Davis

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2018

    An image-based VIirtual Try-On Network (VITON) without using 3D information in any form is presented, which seamlessly transfers a desired clothing item onto the corresponding region of a person using a coarse-to-fine strategy.

    787
  • BlockDrop: Dynamic Inference Paths in Residual Networks

    Zuxuan Wu, Tushar Nagarajan, Abhishek Kumar, Steven J. Rennie, Larry Steven Davis, Kristen Grauman, Rogério Feris

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2018

    BlockDrop, an approach that learns to dynamically choose which layers of a deep network to execute during inference so as to best reduce total computation without degrading prediction accuracy, is introduced.

    554
  • Modeling Spatial-Temporal Clues in a Hybrid Deep Learning Framework for Video Classification

    Zuxuan Wu, Xi Wang, Yu–Gang Jiang, Hao Ye, Xiangyang Xue

    ACM International Conference on Multimedia (ACM MM) · 2015

    This work proposes a hybrid deep learning framework for video classification, which is able to model static spatial information, short-term motion, as well as long-term temporal clues in the videos, and achieves very competitive performance on two popular and challenging benchmarks.

    479
  • M2TR: Multi-modal Multi-scale Transformers for Deepfake Detection

    Junke Wang, Zuxuan Wu, Wenhao Ouyang, Xintong Han, Jingjing Chen, Yu–Gang Jiang, Ser-Nam Li

    International Conference on Multimedia Retrieval · 2022

    A Multi-modal Multi-scale TRansformer (M2TR), which operates on patches of different sizes to detect local inconsistencies in images at different spatial levels, and learns to detect forgery artifacts in the frequency domain to complement RGB information through a carefully designed cross modality fusion block.

    436
  • Exploiting Feature and Class Relationships in Video Categorization with Regularized Deep Neural Networks

    Yu–Gang Jiang, Zuxuan Wu, Jun Wang, Xiangyang Xue, Shih‐Fu Chang

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2017

    Through arming the DNN with better capability of harnessing both the feature and the class relationships, the proposed regularized DNN (rDNN) is more suitable for modeling video semantics.

    385
  • AdaViT: Adaptive Vision Transformers for Efficient Image Recognition

    Lingchen Meng, Hengduo Li, Bor-Chun Chen, Shiyi Lan, Zuxuan Wu, Yu–Gang Jiang, Ser-Nam Lim

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    AdaViT is introduced, an adaptive computation framework that learns to derive usage policies on which patches, self-attention heads and transformer blocks to use throughout the backbone on a per-input basis, aiming to improve inference efficiency of vision transformers with a minimal drop of accuracy for image recognition.

    355
  • Automatic Spatially-Aware Fashion Concept Discovery

    Xintong Han, Zuxuan Wu, Phoenix X. Huang, Xiao Zhang, Menglong Zhu, Yuan Li, Yang Sheng Zhao, Larry Steven Davis

    IEEE International Conference on Computer Vision (ICCV) · 2017

    This paper proposes an automatic spatially-aware concept discovery approach using weakly labeled image-text data from shopping websites, and decomposes the visual-semantic embedding space into multiple concept-specific subspaces to facilitate structured browsing and attribute-feedback product retrieval.

    341
  • Making an Invisibility Cloak: Real World Adversarial Attacks on Object Detectors

    Zuxuan Wu, Ser-Nam Lim, Larry Steven Davis, Tom Goldstein

    Lecture notes in computer science · 2020

    A systematic study of adversarial attacks on state-of-the-art object detection frameworks, and a detailed study of physical world attacks using printed posters and wearable clothes, to quantify the performance of such attacks with different metrics.

    334
  • A Survey on Video Diffusion Models

    Zhen Xing, Qijun Feng, Haoran Chen, Qi Dai, Han Hu, Hang Xu, Zuxuan Wu, Yu–Gang Jiang

    ACM Computing Surveys · 2024

    This article presents a comprehensive review of video diffusion models in the AIGC era, and presents an overview of research on diffusion models in the video domain, categorizing the work into three key areas: video generation, video editing, and other video understanding tasks.

    318
  • BEVT: BERT Pretraining of Video Transformers

    Rui Wang, Dongdong Chen, Zuxuan Wu, Yinpeng Chen, Xiyang Dai, Mengchen Liu, Yu–Gang Jiang, Luowei Zhou, +1 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    BEVT is introduced which decouples video representation learning into spatial representation learning and temporal dynamics learning and achieves state-of-the-art performance on three challenging video benchmarks where BEVT achieves very promising results.

    279
  • DCAN: Dual Channel-Wise Alignment Networks for Unsupervised Scene Adaptation

    Zuxuan Wu, Xintong Han, Yen-Liang Lin, Mustafa Gökhan Uzunbaş, Tom Goldstein, Ser Nam Lim, Larry Steven Davis

    Lecture notes in computer science · 2018

    Dual Channel-wise Alignment Networks (DCAN) are presented, a simple yet effective approach to reduce domain shift at both pixel-level and feature-level in deep neural networks for semantic segmentation.

    276
  • AdaFrame: Adaptive Frame Selection for Fast Video Recognition

    Zuxuan Wu, Caiming Xiong, Chih‐Yao Ma, Richard Socher, Larry Steven Davis

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2019

    It is qualitatively demonstrate learned frame usage can indicate the difficulty of making classification decisions; easier samples need fewer frames while harder ones require more, both at instance-level within the same class and at class-level among different categories.

    272
  • ObjectFormer for Image Manipulation Detection and Localization

    Junke Wang, Zuxuan Wu, Jingjing Chen, Xintong Han, Abhinav Shrivastava, Ser-Nam Lim, Yu–Gang Jiang

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    This paper proposes ObjectFormer, a method to detect and localize image manipulations that outperforms state-of-the-art tampering detection and localization methods, and uses a set of learnable object prototypes as mid-level representations to model the object-level consistencies among different regions.

    240
  • Cross-Domain Contrastive Learning for Unsupervised Domain Adaptation

    Rui Wang, Zuxuan Wu, Zejia Weng, Jingjing Chen, Guo-Jun Qi, Yu–Gang Jiang

    IEEE Transactions on Multimedia · 2022

    This work builds upon contrastive self-supervised learning to align features so as to reduce the domain discrepancy between training and testing sets, and introduces a simple yet effective framework CDCL, for domain alignment.

    238
  • The Regretful Agent: Heuristic-Aided Navigation Through Progress Estimation

    Chih‐Yao Ma, Zuxuan Wu, Ghassan AlRegib, Caiming Xiong, Zsolt Kira

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2019

    This paper proposes to use a progress monitor developed in prior work as a learnable heuristic for search, and proposes two modules incorporated into an end-to-end architecture that significantly outperforms current state-of-the-art methods using greedy action selection.

    208
  • Multi-Stream Multi-Class Fusion of Deep Networks for Video Classification

    Zuxuan Wu, Yu–Gang Jiang, Xi Wang, Hao Ye, Xiangyang Xue

    ACM International Conference on Multimedia (ACM MM) · 2016

    A multi-stream framework that is able to exploit multimodal features that are more comprehensive than those previously attempted and produces significantly better results than the state of the arts on two popular benchmarks, 92.2% on UCF-101 (without using audio) and 84.9% on Columbia Consumer Videos.

    188
  • Secrets of RLHF in Large Language Models Part II: Reward Modeling

    Binghai Wang, Rui Zheng, Lu Chen, Yan Liu, Shihan Dou, Caishuang Huang, Wei Shen, Senjie Jin, +19 more

    arXiv · 2024

    This report introduces contrastive learning to enhance the ability of reward models to distinguish between chosen and rejected responses, thereby improving model generalization and employs meta-learning to enable the reward model to maintain the ability to differentiate subtle differences in out-of-distribution samples.

    179
  • Towards Transferable Adversarial Attacks on Vision Transformers

    Zhipeng Wei, Jingjing Chen, Micah Goldblum, Zuxuan Wu, Tom Goldstein, Yu–Gang Jiang

    Proceedings of the AAAI Conference on Artificial Intelligence · 2022

    A dual attack framework is introduced, which contains a Pay No Attention (PNA) attack and a PatchOut attack, to improve the transferability of adversarial samples across different ViTs, and it is shown that skipping the gradients of attention during backpropagation can generate adversarial examples with high transferability.

    175
  • M3DETR: Multi-representation, Multi-scale, Mutual-relation 3D Object Detection with Transformers

    Tianrui Guan, Jun Wang, Shiyi Lan, Rohan Chandra, Zuxuan Wu, Larry Steven Davis, Dinesh Manocha

    IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · 2022

    M3DETR is the first approach that unifies multiple point cloud representations, feature scales, as well as models mutual relationships between point clouds simultaneously using transformers, and ranks 1st on Waymo Open Dataset with single frame point cloud input.

    174
  • Self-Monitoring Navigation Agent via Auxiliary Progress Estimation

    Chih‐Yao Ma, Jiasen Lu, Zuxuan Wu, Ghassan AlRegib, Zsolt Kira, Richard Socher, Caiming Xiong

    arXiv · 2019

    165
  • Llama Scope: Extracting Millions of Features from Llama-3.1-8B with Sparse Autoencoders

    Zhengfu He, Wentao Shu, Ge, Xuyang, Lingjie Chen, Junxuan Wang, Yunhua Zhou, Liu, Frances, Qipeng Guo, +4 more

    arXiv · 2024

    A suite of 256 SAEs, trained on each layer and sublayer of the Llama-3.1-8B-Base model, with 32K and 128K features are introduced and modifications to a state-of-the-art SAE variant, Top-K SAEs, are evaluated across multiple dimensions.

    160
  • Exploring Inter-feature and Inter-class Relationships with Deep Neural Networks for Video Classification

    Zuxuan Wu, Yu–Gang Jiang, Jun Wang, Jian Pu, Xiangyang Xue

    ACM International Conference on Multimedia (ACM MM) · 2014

    A novel unified framework that jointly learns feature relationships and exploits the class relationships for improved video classification performance is proposed and demonstrates that the proposed framework exhibits superior performance over several state-of-the-art approaches.

    154
  • DiffusionAD: Norm-Guided One-Step Denoising Diffusion for Anomaly Detection

    Hui Zhang, Zheng Wang, Dan Zeng, Zuxuan Wu, Yu–Gang Jiang

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2025

    DiffusionAD, a novel anomaly detection pipeline comprising a reconstruction sub-network and a segmentation sub-network, is introduced and a norm-guided paradigm is proposed to integrate the benefits of multiple noise scales, enhancing the fidelity of reconstructions.

    142
  • SVFormer: Semi-supervised Video Transformer for Action Recognition

    Zhen Xing, Qi Dai, Hu Han, Jingjing Chen, Zuxuan Wu, Yu–Gang Jiang

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023

    SVFormer is introduced, which adopts a steady pseudo-labeling framework (i.e., EMA-Teacher) to cope with unlabeled video samples, and a novel augmentation strategy, Tube Token-Mix, tailored for video data where video clips are mixed via a mask with consistent masked tokens over the temporal axis.

    142
  • Masked Video Distillation: Rethinking Masked Feature Modeling for Self-supervised Video Representation Learning

    Rui Wang, Dongdong Chen, Zuxuan Wu, Yinpeng Chen, Xiyang Dai, Mengchen Liu, Yuan Lü, Yu–Gang Jiang

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023

    This paper proposes masked video distillation (MVD), a simple yet effective two-stage masked feature modeling framework for video representation learning that demonstrates that video transformers pre-trained with spatial-temporal co-teaching outperform models distilled with a single teacher on a multitude of video datasets.

    135

Show all 240 works

Publication data from OpenAlex; citation counts are the higher of OpenAlex and Semantic Scholar, last synced 2026-10-13. One-sentence summaries under some papers are written by Semantic Scholar’s model. Citation counts may be lower than on Google Scholar, which indexes more sources.

Report an error

Wrong papers, two people merged into one, or a profile that should not be here? Tell us and we will fix or hide it.

Sign in to report