Mike Zheng Shou · National University of Singapore

Is this you? Claim this profile to correct it, add a bio and choose the work people see first.

Works246 from public data

TitleCited by

Ego4D: Around the World in 3,000 Hours of Egocentric Video
K. Grauman, Andrew Westbury, Eugene Byrne, Zachary Chavis, Antonino Furnari, Rohit Girdhar, Jackson Hamburger, Hao Jiang, +22 more
IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022
2,124
Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation
Jay Zhangjie Wu, Yixiao Ge, Xintao Wang, Stan Weixian Lei, Yuchao Gu, Yu-Fei Shi, W. Hsu, Shan Ying, +2 more
IEEE/CVF International Conference on Computer Vision (ICCV) · 2023
1,235
Show-o: One Single Transformer to Unify Multimodal Understanding and Generation
Jinheng Xie, Weijia Mao, Ze-Chen Bai, David Junhao Zhang, Weihao Wang, Kevin Qinghong Lin, Yu-Chao Gu, Zhijie Chen, +2 more
arXiv · 2024
792
Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectives
K. Grauman, Andrew Westbury, L. Torresani, Kris Kitani, Jitendra Malik, Triantafyllos Afouras, K. Ashutosh, Vijay Baiyya, +22 more
International Journal of Computer Vision · 2025
640
Hallucination of Multimodal Large Language Models: A Survey
Ze-Chen Bai, Pichao Wang, Tianjun Xiao, Tong He, Zongbo Han, Zheng Zhang, M. Shou
arXiv · 2024
466
MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Model
Zhong-Cong Xu, Jianfeng Zhang, J. Liew, Han-Shu Yan, Jia-Wei Liu, Chen-Xu Zhang, Jiashi Feng, M. Shou
IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024
426
Channel Augmented Joint Learning for Visible-Infrared Recognition
Mang Ye, Weijian Ruan, Bo Du, M. Shou
IEEE/CVF International Conference on Computer Vision (ICCV) · 2021
375
Show-1: Marrying Pixel and Latent Diffusion Models for Text-to-Video Generation
David Junhao Zhang, Jay Zhangjie Wu, Jia-Wei Liu, Rui Zhao, L. Ran, Yu-Chao Gu, Di-Fei Gao, M. Shou
International Journal of Computer Vision · 2024
372
BoxDiff: Text-to-Image Synthesis with Training-Free Box-Constrained Diffusion
Jin-Heng Xie, Yue-Xiang Li, Ya-Wen Huang, Haozhe Liu, Wentian Zhang, Yefeng Zheng, M. Shou
IEEE/CVF International Conference on Computer Vision (ICCV) · 2023
354
Mix-of-Show: Decentralized Low-Rank Adaptation for Multi-Concept Customization of Diffusion Models
Yuchao Gu, Xintao Wang, Jay Zhangjie Wu, Yujun Shi, Yunpeng Chen, Zihan Fan, Wu-You Xiao, Rui Zhao, +5 more
arXiv · 2023
334
Egocentric Video-Language Pretraining
Kevin Lin, Alex Wang, Mattia Soldan, Michael Wray, Rui Yan, Eric Z. Xu, Di-Fei Gao, Rong-Cheng Tu, +8 more
arXiv · 2022
306
VideoLLM-online: Online Video Large Language Model for Streaming Video
Joya Chen, Zhao-Yang Lv, Shiwei Wu, Kevin Qinghong Lin, Chenan Song, Di-Fei Gao, Jia-Wei Liu, Ziteng Gao, +2 more
IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024
280
ShowUI: One Vision-Language-Action Model for GUI Visual Agent
Kevin Qinghong Lin, Linjie Li, Di-Fei Gao, Zhengyuan Yang, Shiwei Wu, Ze-Chen Bai, Stan Weixian Lei, Lijuan Wang, +1 more
IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2025
278
UniVTG: Towards Unified Video-Language Temporal Grounding
Kevin Lin, Pengchuan Zhang, Joya Chen, Shraman Pramanick, Di-Fei Gao, Alex Wang, Rui Yan, M. Shou
IEEE/CVF International Conference on Computer Vision (ICCV) · 2023
274
Is Someone Speaking?
Ruijie Tao, Ze-Xu Pan, Rohan Kumar Das, Xin-Yuan Qian, M. Shou, Haizhou Li
ACM International Conference on Multimedia (ACM MM) · 2021
272
All in One: Exploring Unified Video-Language Pre-Training
Jin-Peng Wang, Yixiao Ge, Rui Yan, Yu-Ying Ge, Kevin Qinghong Lin, Satoshi Tsutsui, Xudong Lin, Guanyu Cai, +4 more
IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023
258
DiffuMask: Synthesizing Images with Pixel-level Annotations for Semantic Segmentation Using Diffusion Models
Weijia Wu, Yuzhong Zhao, M. Shou, Hong Zhou, Chunhua Shen
IEEE/CVF International Conference on Computer Vision (ICCV) · 2023
220
Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Models
Jay Zhangjie Wu, Yuxuan Zhang, Haithem Turki, Xuan-Chi Ren, Jun Gao, M. Shou, Sanja Fidler, Zan Gojcic, +1 more
IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2025
193
DatasetDM: Synthesizing Data with Perception Annotations Using Diffusion Models
Wei Wu, Yuzhong Zhao, Hao Chen, Yuchao Gu, Rui Zhao, Yefei He, Hong Zhou, M. Shou, +1 more
arXiv · 2023
193
Actor-Context-Actor Relation Network for Spatio-Temporal Action Localization
Junting Pan, Siyu Chen, M. Shou, Yu Liu, Jing Shao, Hongsheng Li
IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2021
184
EgoVLPv2: Egocentric Video-Language Pre-training with Fusion in the Backbone
Shraman Pramanick, Yale Song, Sayan Nag, Kevin Lin, Hardik Shah, M. Shou, Ramalingam Chellappa, Pengchuan Zhang
IEEE/CVF International Conference on Computer Vision (ICCV) · 2023
183
DeVRF: Fast Deformable Voxel Radiance Fields for Dynamic Scenes
Yan-Pei Cao, J. Keppo, Jia-Wei Liu, Weijia Mao, Xiaohu Qie, Shan Ying, M. Shou, David Junhao Zhang, +1 more
arXiv · 2022
151
Unified Transformer Tracker for Object Tracking
Fan Ma, M. Shou, Linchao Zhu, Haoqi Fan, Yi-Lei Xu, Yi Yang, Zhicheng Yan
IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022
127
Long-Context Autoregressive Video Modeling with Next-Frame Prediction
Yu-Chao Gu, Weijia Mao, M. Shou
arXiv · 2025
126
AssistGPT: A General Multi-modal Assistant that can Plan, Execute, Inspect, and Learn
Di-Fei Gao, Lei Ji, Luowei Zhou, Kevin Lin, Joya Chen, Zihan Fan, M. Shou
arXiv · 2023
122
Generic Event Boundary Detection: A Benchmark for Event Segmentation
M. Shou, Stan Weixian Lei, Weiyao Wang, Deepti Ghadiyaram, Matt Feiszli
IEEE/CVF International Conference on Computer Vision (ICCV) · 2021
104
MIST : Multi-modal Iterative Spatial-Temporal Transformer for Long-form Video Question Answering
Di-Fei Gao, Luowei Zhou, Lei Ji, Linchao Zhu, Yezhou Yang, M. Shou
IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023
103
On Pursuit of Designing Multi-modal Transformer for Video Grounding
Meng Cao, Long Chen, M. Shou, Can Zhang, Yue-Xian Zou
Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2021
103
Object-aware Video-language Pre-training for Retrieval
Alex Wang, Yixiao Ge, Guanyu Cai, Rui Yan, Xudong Lin, Shan Ying, Xiaohu Qie, M. Shou
IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022
92
VideoSwap: Customized Video Subject Swapping with Interactive Semantic Point Correspondence
Yu-Chao Gu, Yipin Zhou, Bichen Wu, Licheng Yu, Jia-Wei Liu, Rui Zhao, Jay Zhangjie Wu, David Junhao Zhang, +2 more
IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024
81
ReCapture: Generative Video Camera Controls for User-Provided Videos using Masked Video Fine-Tuning
David Junhao Zhang, Roni Paiss, Shiran Zada, Nikhil Karnad, David E. Jacobs, Y. Pritch, Inbar Mosseri, M. Shou, +2 more
IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2025
80
VLA-Touch: Enhancing Vision-Language-Action Models with Dual-Level Tactile Feedback
Jian-Xin Bi, K. Ma, Ce Hao, M. Shou, Harold Soh
arXiv · 2025
70
AVA-AVD: Audio-visual Speaker Diarization in the Wild
Eric Z. Xu, Zeyang Song, Satoshi Tsutsui, C. Feng, Mang Ye, M. Shou
ACM International Conference on Multimedia (ACM MM) · 2022
70
CVPR 2023 Text Guided Video Editing Competition
Jay Zhangjie Wu, Xiuyu Li, Di-Fei Gao, Zhen Dong, Jinbin Bai, Aishani Singh, Xiaoyu Xiang, You Li, +12 more
arXiv · 2023
66
The Dawn of GUI Agent: A Preliminary Case Study with Claude 3.5 Computer Use
Si-Yuan Hu, Ming-Yu Ouyang, Di-Fei Gao, M. Shou
arXiv · 2024
65
Image Watermarks are Removable Using Controllable Regeneration from Clean Noise
Yepeng Liu, Yiren Song, Hai Ci, Yu Zhang, Hao-Fan Wang, M. Shou, Yuheng Bu
arXiv · 2024
63
Towards A Better Metric for Text-to-Video Generation
Jay Zhangjie Wu, Guian Fang, Haoning Wu, Xintao Wang, Yixiao Ge, Xiaodong Cun, David Junhao Zhang, Jia-Wei Liu, +6 more
arXiv · 2024
61
Affordance Grounding from Demonstration Video to Target Image
Joya Chen, Di-Fei Gao, Kevin Lin, M. Shou
IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023
56
Making Vision Transformers Efficient from A Token Sparsification View
Shuning Chang, Pichao Wang, Ming Lin, Fan Wang, David Junhao Zhang, Rong Jin, M. Shou
IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023
56
WMAdapter: Adding WaterMark Control to Latent Diffusion Models
Hai Ci, Yiren Song, Pei Yang, Jinheng Xie, M. Shou
arXiv · 2024
53
STPrivacy: Spatio-Temporal Privacy-Preserving Action Recognition
Ming Li, Xiang-Yu Xu, Hehe Fan, Pan Zhou, Jun Liu, Jia-Wei Liu, Jiahe Li, J. Keppo, +2 more
IEEE/CVF International Conference on Computer Vision (ICCV) · 2023
53
World Action Models: The Next Frontier in Embodied AI
Siyin Wang, Junhao Shi, Zhao-Yang Fu, Xinzhe He, Fei Liu, Chenchen Yang, Yi-Kang Zhou, Zhaoye Fei, +6 more
arXiv · 2026
52
Paragraph-to-Image Generation with Information-Enriched Diffusion Model
Weijia Wu, Zhuang Li, Ye-Fei He, M. Shou, Chun-Hua Shen, Lele Cheng, Yan Li, Ting-Ting Gao, +2 more
International Journal of Computer Vision · 2025
51
Moonshot: Towards Controllable Video Generation and Editing with Multimodal Conditions
David Junhao Zhang, Dongxu Li, Hung Le, M. Shou, Caiming Xiong, Doyen Sahoo
arXiv · 2024
51
Position-Guided Text Prompt for Vision-Language Pre-Training
Jinpeng Wang, Pan Zhou, M. Shou, Shuicheng Yan
IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023
50
LayerTracer: Cognitive-Aligned Layered SVG Synthesis via Diffusion Transformer
Yiren Song, Dan-Qing Chen, M. Shou
IEEE/CVF International Conference on Computer Vision (ICCV) · 2025
49
Can Simple Averaging Defeat Modern Watermarks?
Pei Yang, Hai Ci, Yiren Song, M. Shou
neural information processing systems · 2024
49
ASSISTGUI: Task-Oriented Desktop Graphical User Interface Automation
Di-Fei Gao, Lei Ji, Ze-Chen Bai, Ming-Yu Ouyang, Peiran Li, Dongxing Mao, Qinchen Wu, Wei-Chen Zhang, +5 more
arXiv · 2023
49
MakeAnything: Harnessing Diffusion Transformers for Multi-Domain Procedural Sequence Generation
Yiren Song, Cheng Liu, M. Shou
arXiv · 2025
46
VIT-LENS: Towards Omni-modal Representations
Wei-Xian Lei, Yi-Xiao Ge, Kun Yi, Jianfeng Zhang, Di-Fei Gao, Dylan Sun, Yu-Ying Ge, Shan Ying, +1 more
IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024
46
MovieBench: A Hierarchical Movie Level Dataset for Long Video Generation
Weijia Wu, Ming-Yu Liu, Ze-Yu Zhu, Xi Xia, Hao Feng, Wen Wang, Kevin Qinghong Lin, Chun-Hua Shen, +1 more
IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2025
44
ProcessPainter: Learn Painting Process from Sequence Data
Yiren Song, Shijie Huang, Chen Yao, Xiaojun Ye, Hai Ci, Jia-Ming Liu, Yuxuan Zhang, M. Shou
arXiv · 2024
42
MotionDirector: Motion Customization of Text-to-Video Diffusion Models
Lecture notes in computer science · 2024
42
Continual Learning for Image Segmentation With Dynamic Query
Weijia Wu, Yuzhong Zhao, Zhuang Li, Lianlei Shan, Hong Zhou, M. Shou
IEEE Transactions on Circuits and Systems for Video Technology · 2023
40
HOSNeRF: Dynamic Human-Object-Scene Neural Radiance Fields from a Single Video
Jia-Wei Liu, Yan-Pei Cao, Tianyu Yang, Zhong-Cong Xu, J. Keppo, Shan Ying, Xiaohu Qie, M. Shou
IEEE/CVF International Conference on Computer Vision (ICCV) · 2023
38
MorphMLP: An Efficient MLP-Like Backbone for Spatial-Temporal Representation Learning
David Junhao Zhang, Kun-Chang Li, Ya-Li Wang, Yuxiang Chen, Shashwat Chandra, Y. Qiao, Luoqi Liu, M. Shou
Lecture notes in computer science · 2022
38
Rethinking the Objectives of Vector-Quantized Tokenizers for Image Synthesis
Yuchao Gu, Xintao Wang, Yixiao Ge, Shan Ying, Xiaohu Qie, M. Shou
IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024
37
Too Large; Data Reduction for Vision-Language Pre-Training
Alex Wang, Kevin Lin, David Junhao Zhang, Stan Weixian Lei, M. Shou
IEEE/CVF International Conference on Computer Vision (ICCV) · 2023
37
Kiwi-Edit: Versatile Video Editing via Instruction and Reference Guidance
Yiqi Lin, Guo-Qiang Liang, Ziyun Zeng, Ze-Chen Bai, Yan-Zhe Chen, M. Shou
arXiv · 2026
36
World-VLA-Loop: Closed-Loop Learning of Video World Model and VLA Policy
Xiaokang Liu, Ze-Chen Bai, Hai Ci, K. Ma, M. Shou
arXiv · 2026
36
RingID: Rethinking Tree-Ring Watermarking for Enhanced Multi-key Identification
Lecture notes in computer science · 2024
33
AssistGUI: Task-Oriented PC Graphical User Interface Automation
Di-Fei Gao, Lei Ji, Ze-Chen Bai, Ming-Yu Ouyang, Peiran Li, Donzxing Mao, Qinchen Wu, Wei-Chen Zhang, +5 more
IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024
32
Symbolic Replay: Scene Graph as Prompt for Continual Learning on VQA Task
Proceedings of the AAAI Conference on Artificial Intelligence · 2023
32
SCT: A Simple Baseline for Parameter-Efficient Fine-Tuning via Salient Channels
Henry Hengyuan Zhao, Pichao Wang, Yuyang Zhao, Hao Luo, F. Wang, M. Shou
International Journal of Computer Vision · 2023
32
One Token to Seg Them All: Language Instructed Reasoning Segmentation in Videos
neural information processing systems · 2024
30
Video-Text Pre-training with Learned Regions for Retrieval
Rui Yan, M. Shou, Yixiao Ge, Alex Wang, Xudong Lin, Guanyu Cai, Jin-Hui Tang
Proceedings of the AAAI Conference on Artificial Intelligence · 2023
30
GEB+: A Benchmark for Generic Event Boundary Captioning, Grounding and Retrieval
Yuxuan Wang, Di-Fei Gao, Licheng Yu, Wei-Xian Lei, Matt Feiszli, M. Shou
Lecture notes in computer science · 2022
30
Paper2Video: Automatic Video Generation from Scientific Papers
Ze-Yu Zhu, Kevin Qinghong Lin, M. Shou
arXiv · 2025
29
MAG-Edit: Localized Image Editing in Complex Scenarios via Mask-Based Attention-Adjusted Guidance
Qi Mao, Lan Chen, Yu-Chao Gu, Zhen Fang, M. Shou
ACM International Conference on Multimedia (ACM MM) · 2024
29
Exocentric-to-Egocentric Video Generation
Jia-Wei Liu, Weijia Mao, Zhong-Cong Xu, Jussi Keppo, M. Shou
neural information processing systems · 2024
28
DynVideo-E: Harnessing Dynamic NeRF for Large-Scale Motion- and View-Change Human-Centric Video Editing
Jia-Wei Liu, Yanpei Cao, Jay Zhangjie Wu, Weijia Mao, Yu-Chao Gu, Rui Zhao, J. Keppo, Shan Ying, +1 more
IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024
28
DragAnything: Motion Control for Anything Using Entity Representation
Lecture notes in computer science · 2024
28
Towards Fast Adaptation of Pretrained Contrastive Models for Multi-channel Video-Language Retrieval
Xudong Lin, Simran Tiwari, Shiyuan Huang, Man-Ling Li, M. Shou, Heng Ji, Shih-Fu Chang
IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023
28
PV3D: A 3D Generative Model for Portrait Video Generation
Eric Xu, Jianfeng Zhang, J. Liew, Wen-Qing Zhang, Song Bai, Jiashi Feng, M. Shou
arXiv · 2022
28
PhotoDoodle: Learning Artistic Image Editing from Few-Shot Pairwise Data
Shijie Huang, Yiren Song, Yuxuan Zhang, Hailong Guo, Xueying Wang, M. Shou, Jia-Ming Liu
arXiv · 2025
27
Code2Video: A Code-centric Paradigm for Educational Video Generation
Yan-Zhe Chen, Kevin Qinghong Lin, M. Shou
arXiv · 2025
26
Label-Efficient Online Continual Object Detection in Streaming Video
Jay Zhangjie Wu, David Junhao Zhang, W. Hsu, Mengmi Zhang, M. Shou
IEEE/CVF International Conference on Computer Vision (ICCV) · 2023
26
IDProtector: An Adversarial Noise Encoder to Protect Against ID-Preserving Image Generation
Yiren Song, Pei Yang, Hai Ci, M. Shou
IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2025
25
XAGen: 3D Expressive Human Avatars Generation
Zhong-Cong Xu, Jianfeng Zhang, J. Liew, Jiashi Feng, M. Shou
arXiv · 2023
24
GroundNLQ @ Ego4D Natural Language Queries Challenge 2023
Zhijian Hou, Lei Ji, Di-Fei Gao, Wan-Jun Zhong, Kun Yan, C. Li, Wing-Kwong Chan, C. Ngo, +2 more
arXiv · 2023
24
X-Adapter: Adding Universal Compatibility of Plugins for Upgraded Diffusion Model
L. Ran, Xiaodong Cun, Jia-Wei Liu, Rui Zhao, Song Zijie, Xintao Wang, J. Keppo, M. Shou
arXiv · 2023
24
Deep Motion Prior for Weakly-Supervised Temporal Action Localization
Meng Cao, Can Zhang, Long Chen, M. Shou, Yue-Xian Zou
IEEE Transactions on Image Processing · 2022
24
UniRL: Self-Improving Unified Multimodal Models via Supervised and Reinforcement Learning
Weijia Mao, Zhenheng Yang, M. Shou
arXiv · 2025
23
MLLMs-Augmented Visual-Language Representation Learning
Yanqing Liu, Kai Wang, Wenqi Shao, Ping Luo, Yu Qiao, M. Shou, Kai-Peng Zhang, Yang You
arXiv · 2023
23
COSMO: COntrastive Streamlined MultimOdal Model with Interleaved Pre-Training
Alex Jinpeng Wang, Linjie Li, K. Lin, Jianfeng Wang, K. Lin, Zhengyuan Yang, Lijuan Wang, M. Shou
arXiv · 2024
22
Dataset Condensation via Generative Model
David Junhao Zhang, Heng Wang, Chuhui Xue, Rui Yan, Wen-Qing Zhang, Song Bai, M. Shou
arXiv · 2023
21
GazeVQA: A Video Question Answering Dataset for Multiview Eye-Gaze Task-Oriented Collaborations
Muhammet Ilaslan, Chenan Song, Joya Chen, Di-Fei Gao, Wei-Xian Lei, Qianli Xu, Joo Lim, M. Shou
Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2023
21
EVOLVE-VLA: Test-Time Training from Environment Feedback for Vision-Language-Action Models
Ze-Chen Bai, Chen Gao, M. Shou
arXiv · 2025
20
DiffSim: Taming Diffusion Models for Evaluating Visual Similarity
Yiren Song, Xiaokang Liu, M. Shou
IEEE/CVF International Conference on Computer Vision (ICCV) · 2025
20
SparseFormer: Sparse Visual Recognition via Limited Latent Tokens
Ziteng Gao, Zhan Tong, Limin Wang, M. Shou
arXiv · 2023
20
Object-centric Learning with Cyclic Walks between Parts and Whole
Ziyu Wang, M. Shou, Mengmi Zhang
arXiv · 2023
19
DR-FER: Discriminative and Robust Representation Learning for Facial Expression Recognition
Ming Li, Hua-Zhu Fu, Shengfeng He, Hehe Fan, Jun Liu, Jussi Keppo, M. Shou
IEEE Transactions on Multimedia · 2023
19
Enhancing Visual Grounding in Vision-Language Pre-Training With Position-Guided Text Prompts
Alex Jinpeng Wang, Pan Zhou, M. Shou, Shui-Cheng Yan
IEEE Transactions on Pattern Analysis and Machine Intelligence · 2023
19
CONE: An Efficient COarse-to-fiNE Alignment Framework for Long Video Temporal Grounding
Annual Meeting of the Association for Computational Linguistics (ACL) · 2023
18
Personalized Vision via Visual In-Context Learning
Yuxin Jiang, Yu-Chao Gu, Yi-Ren Song, I. Tsang, M. Shou
arXiv · 2025
17
AssistQ: Affordance-Centric Question-Driven Task Completion for Egocentric Assistant
Lecture notes in computer science · 2022
17
The Metaverse Data Deluge: What Can We Do About It?
B. Ooi, Gang Chen, M. Shou, K. Tan, A. Tung, X. Xiao, James Wei Luen Yip, Bing-Xue Zhang, +1 more
Proceedings - International Conference on Data Engineering · 2023
16
Show-o2: Improved Native Unified Multimodal Models
neural information processing systems · 2025
15
X-Humanoid: Robotize Human Videos to Generate Humanoid Videos at Scale
Pei Yang, Hai Ci, Yiren Song, M. Shou
arXiv · 2025
15
Spiking-Leaf: A Learnable Auditory Front-End for Spiking Neural Networks
Zeyang Song, Ji-Bin Wu, Malu Zhang, M. Shou, Haizhou Li
IEEE International Conference on Acoustics Speech and Signal Processing · 2024
15
Ego4D: Around the World in 3,600 Hours of Egocentric Video
Kristen Grauman, Andrew Westbury, Eugene Byrne, Vincent Cartillier, Zachary Chavis, Antonino Furnari, Rohit Girdhar, Jackson Hamburger, +22 more
IEEE Transactions on Pattern Analysis and Machine Intelligence · 2024
15
Unsupervised Open-Vocabulary Object Localization in Videos
Ke Fan, Ze-Chen Bai, Tianjun Xiao, Dominik Zietlow, Max Horn, Zixu Zhao, Carl-Johann Simon-Gabriel, M. Shou, +6 more
IEEE/CVF International Conference on Computer Vision (ICCV) · 2023
15
From Token to Word: OCR Token Evolution via Contrastive Learning and Semantic Matching for Text-VQA
Zan-Xia Jin, M. Shou, Fang Zhou, Satoshi Tsutsui, Jingyan Qin, Xu-Cheng Yin
ACM International Conference on Multimedia (ACM MM) · 2022
15
DD-Ranking: Rethinking the Evaluation of Dataset Distillation
Ze-Kai Li, Xin-Hao Zhong, Samir Khaki, Zhiyuan Liang, Yuhao Zhou, Ming-Jia Shi, Zi-Qiao Wang, Xuan-Lei Zhao, +22 more
arXiv · 2025
14
SAM-I2V: Upgrading SAM to Support Promptable Video Segmentation with Less than 0.2% Training Cost
Haiyang Mei, Pengyu Zhang, M. Shou
IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2025
14
Steganalysis on Digital Watermarking: Is Your Defense Truly Impervious?
Pei Yang, Hai Ci, Yiren Song, M. Shou
arXiv · 2024
14
ProcessPainter: Learning to draw from sequence data
Yiren Song, Shijie Huang, Chen Yao, Hai Ci, Xiaojun Ye, Jia-Ming Liu, Yuxuan Zhang, M. Shou
SIGGRAPH Asia Conference Papers · 2024
14
A large cross-modal video retrieval dataset with reading comprehension
Pattern Recognition · 2024
14
Magi-Net: Meta Negative Network for Early Activity Prediction
Wen-Qian Wang, F. Chang, Junhao Zhang, Rui Yan, Chunsheng Liu, Bin Wang, M. Shou
IEEE Transactions on Image Processing · 2023
14
Agentic World Modeling: Foundations, Capabilities, Laws, and Beyond
Mengke Chu, X. Zhang, K. Lin, Ling-Dong Kong, Jize Zhang, Teng Tu, Weijian Ma, Zi-Qi Huang, +22 more
arXiv · 2026
13
Mitty: Diffusion-based Human-to-Robot Video Generation
Yi-Ren Song, Cheng Liu, Weijia Mao, M. Shou
arXiv · 2025
13
DoFIT: Domain-aware Federated Instruction Tuning with Alleviated Catastrophic Forgetting
Bin-Qian Xu, Xiang-Bo Shu, Haiyang Mei, Ze-Chen Bai, Basura Fernando, M. Shou, Jinhui Tang
neural information processing systems · 2024
13
VisorGPT: Learning Visual Prior via Generative Pre-Training
Jin-Heng Xie, Kai Ye, Yu-Dong Li, Yue-Xiang Li, Kevin Lin, Yefeng Zheng, Linlin Shen, M. Shou
arXiv · 2023
12
OmniPSD: Layered PSD Generation with Diffusion Transformer
Cheng Liu, Yi-Ren Song, Hao-Fan Wang, M. Shou
arXiv · 2025
11
MoonShot: Towards Controllable Video Generation and Editing with Motion-Aware Multimodal Conditions
David Junhao Zhang, Dongxu Li, Hung Le, M. Shou, Caiming Xiong, Doyen Sahoo
International Journal of Computer Vision · 2025
11
Apprenticeship-Inspired Elegance: Synergistic Knowledge Distillation Empowers Spiking Neural Networks for Efficient Single-Eye Emotion Recognition
Yang Wang, Haiyang Mei, Qirui Bao, Ziqi Wei, Mike Zheng Shou, Haizhou Li, Bo Dong, Xin Yang
Proceedings of the Thirty-ThirdInternational Joint Conference on Artificial Intelligence · 2024
11
VideoLLM-MoD: Efficient Video-Language Streaming with Mixture-of-Depths Vision Computation
neural information processing systems · 2024
11
Multi-Modal Generative Embedding Model
Fei-Peng Ma, Hong-Wei Xue, Guang-Ting Wang, Yizhou Zhou, Feng-Yun Rao, Shi-Lin Yan, Yueyi Zhang, Si-Ying Wu, +2 more
arXiv · 2024
11
Skip \n: A Simple Method to Reduce Hallucination in Large Vision-Language Models
Zongbo Han, Ze-Chen Bai, Haiyang Mei, Qianli Xu, Chang-Qing Zhang, M. Shou
arXiv · 2024
11
Factorized Visual Tokenization and Generation
Ze-Chen Bai, Jianxiong Gao, Ziteng Gao, Pichao Wang, Zheng Zhang, Tong He, M. Shou
arXiv · 2024
11
Learning to Learn: How to Continuously Teach Humans and Machines
Parantak Singh, You Li, Ankur Sikarwar, Wei-Xian Lei, Di-Fei Gao, Morgan B. Talbot, Ying Sun, M. Shou, +2 more
IEEE/CVF International Conference on Computer Vision (ICCV) · 2023
11
Mover: Mask and Recovery based Facial Part Consistency Aware Method for Deepfake Video Detection
Juan Hu, Xin Liao, Di-Fei Gao, Satoshi Tsutsui, Qian Wang, Zheng Qin, M. Shou
arXiv · 2023
11
ICDAR 2023 Competition on Video Text Reading for Dense and Small Text
Wei Wu, Yuzhong Zhao, Zhuang Li, Jiahong Li, M. Shou, U. Pal, Dimosthenis Karatzas, Xiang Bai
Lecture notes in computer science · 2023
11
The Image as Its Own Reward: Reinforcement Learning with Adversarial Reward for Image Generation
Weijia Mao, Hao Chen, Zhenheng Yang, M. Shou
arXiv · 2025
10
VLog: Video-Language Models by Generative Retrieval of Narration Vocabulary
Kevin Qinghong Lin, Mike Zheng Shou
IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2025
10
GUI Action Narrator: Where and When Did That Action Take Place?
Qinchen Wu, Di-Fei Gao, Kevin Qinghong Lin, Zhuoyu Wu, Xiangwu Guo, Peiran Li, Wei-Chen Zhang, Hengxu Wang, +1 more
arXiv · 2024
10
DSText V2: A Comprehensive Video Text Spotting Dataset for Dense and Small Text
Weijia Wu, Yuzhong Zhao, Zhuangzi Li, Jiahong Li, M. Shou, U. Pal, Dimosthenis Karatzas, Xiang Bai
arXiv · 2023
10
TaCA: Upgrading Your Visual Foundation Model with Task-agnostic Compatible Adapter
Bin-Jie Zhang, Yixiao Ge, Xu-Yuan Xu, Shan Ying, M. Shou
arXiv · 2023
10
ColonNeRF: High-Fidelity Neural Reconstruction of Long Colonoscopy
Yu-Fei Shi, Beijia Lu, Jia-Wei Liu, Ming Li, M. Shou
arXiv · 2023
10
AssistSR: Task-oriented Video Segment Retrieval for Personal AI Assistant
Weixian Lei, Difei Gao, Yuxuan Wang, Dongxing Mao, Zihan Liang, Lingmin Ran, Mike Zheng Shou
Findings of the Association for Computational Linguistics: EMNLP 2022 · 2022
10
MachaGrasp: Morphology-Aware Cross-Embodiment Dexterous Hand Articulation Generation for Grasping
Heng Zhang, K. Ma, Mike Zheng Shou, Wei-Si Lin, Yan Wu
Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · 2026
9
VISTA: Triplet-Supervised Video Style Transfer with Diffusion Transformers
Yiren Song, Wangzi Yao, Hao-Fan Wang, M. Shou
arXiv · 2026
9
Olaf-World: Orienting Latent Actions for Video World Modeling
Yuxin Jiang, Yu-Chao Gu, I. Tsang, M. Shou
arXiv · 2026
9
StreamingEffect: Real-Time Human-Centric Video Effect Generation
Yiren Song, Cheng Liu, Yuxin Jiang, M. Shou
arXiv · 2026
9
ROICtrl: Boosting Instance Control for Visual Generation
Yu-Chao Gu, Yipin Zhou, Yunfan Ye, Yixin Nie, Licheng Yu, Ping-Chuan Ma, Kevin Qinghong Lin, M. Shou
IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2025
9
Live: Learning Video LLM with Streaming Speech Transcription at Scale
Joya Chen, Ziyun Zeng, Yiqi Lin, Yiqi Lin, Wei Li, Ze-Jun Ma, M. Shou
IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2025
9
H2R-Grounder: A Paired-Data-Free Paradigm for Translating Human Interaction Videos into Physically Grounded Robot Videos
Hai Ci, Xiaokang Liu, Pei Yang, Yi-Ren Song, M. Shou
arXiv · 2025
9
In-Context Defense in Computer Agents: An Empirical Study
Pei Yang, Hai Ci, M. Shou
arXiv · 2025
9
Learning Long-form Video Prior via Generative Pre-Training
Jin-Heng Xie, Jia-Jun Feng, Zhaoxu Tian, Kevin Qinghong Lin, Ya-Wen Huang, Xi Xia, Nanxu Gong, Xu Zuo, +3 more
arXiv · 2024
9
Free-ATM: Exploring Unsupervised Learning on Diffusion-Generated Images with Free Attention Masks
David Junhao Zhang, Mutian Xu, Chuhui Xue, Wen-Qing Zhang, Xiaoguang Han, Song Bai, M. Shou
arXiv · 2023
9
FocusUI: Efficient UI Grounding via Position-Preserving Visual Token Selection
Ming-Yu Ouyang, Kevin Qinghong Lin, M. Shou, Hwee Tou Ng
arXiv · 2026
8
AssistPDA: An Online Video Surveillance Assistant for Video Anomaly Prediction, Detection, and Analysis
Zhiwei Yang, Chen Gao, Jing Liu, Peng Wu, Guan-Song Pang, M. Shou
arXiv · 2025
8
Balanced Image Stylization with Style Matching Score
Yuxin Jiang, Liming Jiang, Shuai Yang, Jia-Wei Liu, I. Tsang, M. Shou
IEEE/CVF International Conference on Computer Vision (ICCV) · 2025
8
L4D-Track: Language-to-4D Modeling Towards 6-DoF Tracking and Shape Reconstruction in 3D Point Cloud Stream
Jing-Tao Sun, Yaonan Wang, Ming-Tao Feng, Yulan Guo, Ajmal Mian, M. Shou
IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024
8
ShowRoom3D: Text to High-Quality 3D Room Generation Using 3D Priors
Weijia Mao, Yan-Pei Cao, Jia-Wei Liu, Zhong-Cong Xu, M. Shou
arXiv · 2023
8
Revisiting Vision Transformer from the View of Path Ensemble
Shuning Chang, Pichao Wang, Haowen Luo, Fan Wang, M. Shou
IEEE/CVF International Conference on Computer Vision (ICCV) · 2023
8
Egocentric Video-Language Pretraining @ Ego4D Challenge 2022
Kevin Lin, Alex Wang, Mattia Soldan, Michael Wray, Rui Yan, Eric Z. Xu, Di-Fei Gao, Rong-Cheng Tu, +8 more
arXiv · 2022
8
MorphMLP: A Self-Attention Free, MLP-Like Backbone for Image and Video
arXiv · 2021
8
ShowUI-Aloha: Human-Taught GUI Agent
Yi-Chun Zhang, Xiangwu Guo, Yau-Hong Goh, Jesse Hu, Zhiheng Chen, X. Wang, Di-Fei Gao, M. Shou
arXiv · 2026
7
Managing Metaverse Data Tsunami: Actionable Insights
Bing-Xue Zhang, Gang Chen, B. Ooi, M. Shou, Kian-Lee Tan, Anthony K. H. Tung, Xiao-Kui Xiao, J. Yip, +1 more
IEEE Transactions on Knowledge and Data Engineering · 2024
7
High Quality Human Image Animation using Regional Supervision and Motion Blur Condition
Zhong-Cong Xu, Chaoyue Song, Guo-Xian Song, Jianfeng Zhang, J. Liew, Hongyi Xu, You Xie, Linjie Luo, +3 more
arXiv · 2024
7
Skinned Motion Retargeting with Dense Geometric Interaction Perception
neural information processing systems · 2024
7
Revisit Parameter-Efficient Transfer Learning: A Two-Stage Paradigm
Hengyuan Zhao, Hao Luo, Yuyang Zhao, Pichao Wang, F. Wang, M. Shou
arXiv · 2023
7
Novel View Synthesis for High-fidelity Headshot Scenes
Satoshi Tsutsui, Weijia Mao, Sijing Lin, Yunyi Zhu, Murong Ma, M. Shou
arXiv · 2022
7
Factorized Learning for Temporally Grounded Video-Language Models
Wen-Zheng Zeng, Di-Fei Gao, M. Shou, Hwee Tou Ng
IEEE/CVF International Conference on Computer Vision (ICCV) · 2025
6
DoraCycle: Domain-Oriented Adaptation of Unified Generative Model in Multimodal Cycles
Rui Zhao, Weijia Mao, M. Shou
IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2025
6
X- Adapter: Universal Compatibility of Plugins for Upgraded Diffusion Model
L. Ran, Xiaodong Cun, Jia-Wei Liu, Rui Zhao, Song Zijie, Xintao Wang, Jussi Keppo, M. Shou
IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024
6
DOAD: Decoupled One Stage Action Detection Network
Shuning Chang, Pichao Wang, Fan Wang, Jiashi Feng, M. Shou
IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · 2023
6
Revitalize Region Feature for Democratizing Video-Language Pre-training of Retrieval
Guanyu Cai, Yixiao Ge, Bin-Jie Zhang, Alex Wang, Rui Yan, Xudong Lin, Shan Ying, Lianghua He, +3 more
arXiv · 2022
6
Video-Text Pre-training with Learned Regions
arXiv · 2021
6
Escaping the Diversity Trap in Robotic Manipulation via Anchor-Centric Adaptation
Yan-Zhe Chen, K. Ma, Qi Lv, Yiqi Lin, Ze-Chen Bai, Chen Gao, M. Shou
arXiv · 2026
5
UniMoD: Efficient Unified Multimodal Transformers with Mixture-of-Depths
Weijia Mao, Zhenheng Yang, M. Shou
arXiv · 2025
5
CLIMS++: Cross Language Image Matching with Automatic Context Discovery for Weakly Supervised Semantic Segmentation
Jin-Heng Xie, Songhe Deng, Xianxu Hou, Zhaochuan Luo, Linlin Shen, Ya-Wen Huang, Ye-Feng Zheng, M. Shou
International Journal of Computer Vision · 2025
5
PhysReason: A Comprehensive Benchmark towards Physics-Based Reasoning
Annual Meeting of the Association for Computational Linguistics (ACL) · 2025
5
GUI-Narrator: Detecting and Captioning Computer GUI Actions
Qinchen Wu, Di-Fei Gao, Qinghong Lin, Zhuoyu Wu, M. Shou
ACM International Conference on Multimedia (ACM MM) · 2025
5
Delocate: Detection and Localization for Deepfake Videos with Randomly-Located Tampered Traces
Juan Hu, Xin Liao, Difei Gao, Satoshi Tsutsui, Qian Wang, Zheng Qin, Mike Zheng Shou
Proceedings of the Thirty-ThirdInternational Joint Conference on Artificial Intelligence · 2024
5
AssistEditor: Multi-Agent Collaboration for GUI Workflow Automation in Video Creation
Di-Fei Gao, Si-Yuan Hu, Ze-Chen Bai, Qinghong Lin, M. Shou
ACM International Conference on Multimedia (ACM MM) · 2024
5
Diffusion Models in Robotics: A Survey
Xiaokang Liu, K. Ma, Chen Gao, M. Shou
International Journal of Computer Vision · 2026
4
OmniHumanoid: Streaming Cross-Embodiment Video Generation with Paired-Free Adaptation
Yiren Song, Xiyao Deng, Pei Yang, Yi-Han Wang, M. Shou
arXiv · 2026
4
TPDiff: Temporal Pyramid Video Diffusion Model
L. Ran, M. Shou
arXiv · 2025
4
Open-world Weakly-Supervised Object Localization
Pattern Recognition · 2025
4
ShowUI-$π$: Flow-based Generative Models as GUI Dexterous Hands
Si-Yuan Hu, Kevin Qinghong Lin, M. Shou
arXiv · 2025
4
A Bilingual, Open World Video Text Dataset and Real-Time Video Text Spotting With Contrastive Learning
Weijia Wu, Zhuang Li, Yuan-Qiang Cai, Hong Zhou, M. Shou
IEEE Transactions on Circuits and Systems for Video Technology · 2024
4
Single-Stage Open-world Instance Segmentation with Cross-task Consistency Regularization
Xi-Zhe Xue, Dongdong Yu, Ling-Qiao Liu, Yu Liu, Satoshi Tsutsui, Ying Li, Zehuan Yuan, Ping Song, +1 more
arXiv · 2022
4
Contrastive Learning of Semantic and Visual Representations for Text Tracking
arXiv · 2021
4
ActionMap: Robot Policy Learning via Voxel Action Heatmap
Pei Yang, Hai Ci, Yan-Zhe Chen, Qi Lv, Han Cai, M. Shou
arXiv · 2026
3
Soap2Soap: Long Cinematic Video Remaking via Multi-Agent Collaboration
Yiren Song, Huilin Zhong, K. Lin, Hao-Fan Wang, M. Shou
arXiv · 2026
3
DeformGS: Scene Flow in Highly Deformable Scenes for Deformable Object Manipulation
Springer proceedings in advanced robotics · 2026
3
OpenWorldLib: A Unified Codebase and Definition of Advanced World Models
D. Team, Bo-Han Zeng, Daili Hua, Kaixin Zhu, Yi-Fan Dai, Bozhou Li, Yu-Ran Wang, Cheng-Zhuo Tong, +22 more
arXiv · 2026
3
RobotSeg: A Model and Dataset for Segmenting Robots in Image and Video
Haiyang Mei, Qi-Ming Huang, Hai Ci, M. Shou
arXiv · 2025
3
DOTA: Distributional Test-time Adaptation of Vision-Language Models
neural information processing systems · 2025
3
Tuning-Free Image Editing with Fidelity and Editability via Unified Latent Diffusion Model
Qi Mao, Lan Chen, Yu-Chao Gu, M. Shou, Ming-Hsuan Yang
arXiv · 2025
3
Diffusion-Driven Self-Supervised Learning for Shape Reconstruction and Pose Estimation
Jing-Tao Sun, Yaonan Wang, Ming-Tao Feng, Chao Ding, M. Shou, Ajmal Saeed Mian
IEEE Transactions on Pattern Analysis and Machine Intelligence · 2025
3
ControLRM: Fast and Controllable 3D Generation via Large Reconstruction Model
Hongbin Xu, Wei-Tao Chen, Zhi-Peng Zhou, Feng Xiao, Bai-Gui Sun, M. Shou, Wenxiong Kang
arXiv · 2024
3
GENIXER: Empowering Multimodal Large Language Model as a Powerful Data Generator
Lecture notes in computer science · 2024
3
Tune-an-Ellipse: CLIP Has Potential to Find what you Want
Jin-Heng Xie, Songhe Deng, Bing Li, Haozhe Liu, Ya-Wen Huang, Ye-Feng Zheng, J. Schmidhuber, Bernard Ghanem, +2 more
IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024
3
Parrot Captions Teach CLIP to Spot Text
Lecture notes in computer science · 2024
3
VideoGUI: A Benchmark for GUI Automation from Instructional Videos
neural information processing systems · 2024
3
Recap: Detecting Deepfake Video with Unpredictable Tampered Traces via Recovering Faces and Mapping Recovered Faces
Juan Hu, Xin Liao, Di-Fei Gao, Satoshi Tsutsui, Qian Wang, Zheng Qin, M. Shou
arXiv · 2023
3
Large Generative Models Meet Multimodal Video Intelligence
Mike Zheng Shou
Proceedings of the 1st Workshop on Large Generative Models Meet Multimodal Applications · 2023
3
Darwinian Model Upgrades: Model Evolving with Selective Compatibility
Proceedings of the AAAI Conference on Artificial Intelligence · 2023
3
Can I Trust You? Advancing GUI Task Automation with Action Trust Score
Haiyang Mei, Di-Fei Gao, Xiao-Peng Wei, Xin Yang, M. Shou
ACM International Conference on Multimedia (ACM MM) · 2025
2
OmniConsistency: Learning Style-Agnostic Consistency from Paired Stylization Data
neural information processing systems · 2025
2
Faster Diffusion via Temporal Attention Decomposition
arXiv · 2024
2
Bootstrapping SparseFormers from Vision Foundation Models
Ziteng Gao, Zhan Tong, K. Lin, Joya Chen, M. Shou
IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024
2
Learning Video Context as Interleaved Multimodal Sequences
Lecture notes in computer science · 2024
2
EvolveDirector: Approaching Advanced Text-to-Image Generation with Large Vision-Language Models
neural information processing systems · 2024
2
Transformer-based Open-world Instance Segmentation with Cross-task Consistency Regularization
Xi-Zhe Xue, Dong-Dong Yu, Lingqiao Liu, Yu Liu, Satoshi Tsutsui, Ying Li, Zehuan Yuan, Ping Song, +1 more
ACM International Conference on Multimedia (ACM MM) · 2023
2
Egocentric Video-Language Pretraining @ EPIC-KITCHENS-100 Multi-Instance Retrieval Challenge 2022
Kevin Lin, Alex Wang, Rui Yan, Eric Z. Xu, Rong-Cheng Tu, Yan Zhu, Wenzhe Zhao, Weijie Kong, +4 more
arXiv · 2022
2
Supervise What Survives: Geometry-Guided VLA Adaptation from Synthetic Robot Videos
Dan-Ze Chen, Yan-Zhe Chen, Qi-Ming Huang, Zhi-Jun Cao, Chen Gao, M. Shou
arXiv · 2026
1
UENR-600K: A Large-Scale Physically Grounded Dataset for Nighttime Video Deraining
Pei Yang, Hai Ci, Beibei Lin, Yiren Song, M. Shou
arXiv · 2026
1
Sparkle: Realizing Lively Instruction-Guided Video Background Replacement via Decoupled Guidance
Ziyun Zeng, Yiqi Lin, Guo-Qiang Liang, M. Shou
arXiv · 2026
1
Exploring a Unified Vision-Centric Contrastive Alternatives on Multi-Modal Web Documents
Yiqi Lin, Alex Jinpeng Wang, Linjie Li, Zhengyuan Yang, M. Shou
arXiv · 2025
1
SAM-I2V++: Efficiently Upgrading SAM for Promptable Video Segmentation
Haiyang Mei, Pengyu Zhang, M. Shou
IEEE Transactions on Pattern Analysis and Machine Intelligence · 2025
1
Reinforcement Learning for Large Model: A Survey
arXiv · 2025
1
VG-TVP: Multimodal Procedural Planning via Visually Grounded Text-Video Prompting
Proceedings of the AAAI Conference on Artificial Intelligence · 2025
1
Leveraging Visual Tokens for Extended Text Contexts in Multi-Modal Learning
Linjie Li, Min Li, Yiqi Lin, Yiqi Lin, M. Shou, Alex Jinpeng Wang, Lijuan Wang
neural information processing systems · 2024
1
Visual Perception by Large Language Model’s Weights
Fei-Peng Ma, Feng-Yun Rao, M. Shou, Xiaoyan Sun, Guang-Ting Wang, Si-Ying Wu, Hong-Wei Xue, Shi-Lin Yan, +2 more
neural information processing systems · 2024
1
AssistGPT: Towards Multi-modal Agent for Human-Centric AI Assistant
Difei Gao, Siyuan Hu, Qinghong Lin, Mike Zheng Shou
Proceedings of the 5th International Workshop on Human-centric Multimedia Analysis · 2024
1
AssistSR: Affordance-centric Question-driven Video Segment Retrieval
arXiv · 2021
1
A Collaborative Multi-Modality Interaction for VLA-based End-to-End Autonomous Driving
arXiv · 2026
–
Parallelized Autoregressive Decoding for Omni-Modal Dense Video Captioning
Lecture notes in computer science · 2026
–
OptMark: Robust Multi-bit Diffusion Watermarking via Inference Time Optimization
Proceedings of the AAAI Conference on Artificial Intelligence · 2026
–
P-Flow: Prompting Visual Effects Generation
Rui Zhao, M. Shou
arXiv · 2026
–
A Survey on Foundations and Frontiers of Multimodal Agentic Frameworks: Techniques and Applications
arXiv · 2026
–
Hermite Curves as Trajectory Priors for Vision-Language-Action Models
arXiv · 2026
–
Where Success Breaks: Failure-Boundary Learning for Robust Vision-Language-Action Models
arXiv · 2026
–
ReGRPO: Reflection-Augmented Policy Optimization for Tool-Using Agents
Lecture notes in computer science · 2026
–
GameWorld: Towards Standardized and Verifiable Evaluation of Multimodal Game Agents
Lecture notes in computer science · 2026
–
SWEET: Sparse World Modeling with Image Editing for Embodied Task Execution
Yiren Song, Yi-Han Wang, Xiyao Deng, Zhuo Yan, M. Shou
arXiv · 2026
–
PAI-Actor: Cinematic Multi-Character Replacement in Dynamic Scenes
arXiv · 2026
–
Learning Long-form Movie Prior via Large Language Models
Jin-Heng Xie, Jia-Jun Feng, M. Shou
IEEE Transactions on Pattern Analysis and Machine Intelligence · 2026
–
Demo2Tutorial: From Human Experience to Multimodal Software Tutorials
Ze-Chen Bai, Zhiheng Chen, Yiqi Lin, Kevin Qinghong Lin, Di-Fei Gao, Xiangwu Guo, X. Wang, M. Shou
arXiv · 2026
–
FedIGA: Improving Global Model Aggregation for Federated Self-Supervised Skeletal Action Recognition
Bin-Qian Xu, Xiang-Bo Shu, Chun-Mei Feng, Basura Fernando, M. Shou
IEEE Transactions on Multimedia · 2026
–
Show-Harness: Just a VLM Agent Can Play Robots
arXiv · 2026
–
SolarWM: Open Data and Scalable Training for Long-Horizon Video World Models
arXiv · 2026
–
Semantic-Contact Fields for Category-Level Generalizable Tactile Tool Manipulation
K. Ma, Heng Zhang, Weisi Lin, M. Shou, Yan Wu
arXiv · 2026
–
AnyFlow: Any-Step Video Diffusion Model with On-Policy Flow Map Distillation
Lecture notes in computer science · 2026
–
PAI-Studio: Cinematic Video Background Replacement with Camera-Aware Motion
Lecture notes in computer science · 2026
–
Reinforcement Learning for Multimodal Foundation Models: A Survey
Weijia Wu, Chen Gao, Joya Chen, Qinghong Lin, Qing-Wei Meng, Yi-Ming Zhang, Yuke Qiu, Hong Zhou, +1 more
ACM Computing Surveys · 2026
–
MANGO-Grasp: Mahalanobis Fields over Geometry-Oriented 3D Gaussians for Cross-Embodiment Dexterous Grasping
arXiv · 2026
–
Dream.exe: Can Video Generation Models Dream Executable Robot Manipulation?
Rui Zhao, Kai Yang, Jifeng Zhu, Si-Yang Chen, Ziqian Wang, Wei-Jia Wu, K. Lin, Heng Wang, +1 more
arXiv · 2026
–
PaperDoctor: Evidence-Grounded and Actionable Feedback for Scientific Papers in Progress
arXiv · 2026
–
WorldWander: Bridging Egocentric and Exocentric Worlds in Video Generation
Lecture notes in computer science · 2026
–
StreamTTT: Reconciling Real-Time Perception and Long-Term Memory in Streaming VLMs
arXiv · 2026
–
Language-4D Cross-Boosting for Generalized Zero-Shot 6DoF Tracking and 3D Reconstruction
Jing-Tao Sun, Yaonan Wang, Jia-Wen Zhao, Yi-Ke Zhang, Min Liu, M. Shou
IEEE Transactions on Pattern Analysis and Machine Intelligence · 2026
–
InterFeedback: Unveiling Interactive Intelligence of Large Multimodal Models with Human Feedback
Henry Hengyuan Zhao, Wenqi Pei, Yifei Tao, Haiyang Mei, Mike Zheng Shou
Findings of the Association for Computational Linguistics: EMNLP 2025 · 2025
–
macOSWorld: A Multilingual Interactive Benchmark for GUI Agents
neural information processing systems · 2025
–
CoFFT: Chain of Foresight-Focus Thought for Visual Language Models
neural information processing systems · 2025
–
LiveCC: Learning Video LLM with Streaming Speech Transcription at Scale
arXiv · 2025
–
Bridging Information Asymmetry in Text-video Retrieval: A Data-centric Approach
arXiv · 2024
–
Free-ATM: Harnessing Free Attention Masks for Representation Learning on Diffusion-Generated Images
David Junhao Zhang, Mutian Xu, Jay Zhangjie Wu, Chuhui Xue, Wenqing Zhang, Xiao-Guang Han, Song Bai, M. Shou
Lecture notes in computer science · 2024
–
Multimodal Video Understanding and Generation
Mike Zheng Shou
Proceedings of the 2nd Workshop on Large Generative Models Meet Multimodal Applications · 2024
–
Bring Your Own Character: A Holistic Solution for Automatic Facial Animation Generation of Customized Characters
arXiv · 2024
–
ViT-Lens: Initiating Omni-Modal Exploration through 3D Insights
arXiv · 2023
–
History of Low-Power Computer Vision Challenge
Chapman & Hall/CRC eBooks · 2022
–

Publication data from OpenAlex, with missing venues and authors filled in from Crossref; citation counts are the higher of OpenAlex and Semantic Scholar; position from the scholar’s ORCID record, last synced 2026-10-10. Citation counts may be lower than on Google Scholar, which indexes more sources.

Report an error

Wrong papers, two people merged into one, or a profile that should not be here? Tell us and we will fix or hide it. You will be asked to sign in.