Is this you? Claim this profile to correct it, add a bio and choose the work people see first.

Claim this profile

Academic lineage

Possible advisorsa guess from early papers, not confirmed

  • Ping Luo

    Possible advisor · last author on 6 of their early first-author papers, 2020–2023

    Suggested from co-authorship

Is this you? Claim this profile to confirm or dismiss it.

Works42 from public data

TitleCited by
  • ByteTrack: Multi-object Tracking by Associating Every Detection Box

    Yifu Zhang, Peize Sun, Yi Jiang, Dongdong Yu, Fucheng Weng, Zehuan Yuan, Ping Luo, Wenyu Liu, +1 more

    Lecture notes in computer science · 2022

    A simple, effective and generic association method, tracking by associating almost every detection box instead of only the high score ones, named ByteTrack, which achieves state-of-the-art performance on MOT20, HiEve and BDD100K tracking benchmarks.

    2,841
  • Sparse R-CNN: End-to-End Object Detection with Learnable Proposals

    Peize Sun, Rufeng Zhang, Yi Jiang, Tao Kong, Chenfeng Xu, Wei Zhan, Masayoshi Tomizuka, Lei Li, +3 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2021

    Sparse R-CNN demonstrates accuracy, run-time and training convergence performance on par with the well-established detector baselines on the challenging COCO dataset, e.g., achieving 45.0 AP in standard 3× training schedule and running at 22 fps using ResNet-50 FPN model.

    1,564
  • SAM 3: Segment Anything with Concepts

    Nicolas Carion, Laura Gustafson, Yuan-Ting Hu, Shoubhik Debnath, Ronghang Hu, Dídac Surís, Chaitanya K. Ryali, Kalyan Vasudev Alwala, +22 more

    arXiv · 2025

    The Segment Anything Model (SAM) 3 is presented, a unified model that detects, segments, and tracks objects in images and videos based on concept prompts, which are either short noun phrases or image exemplars, or a combination of both.

    1,205
  • Autoregressive Model Beats Diffusion: Llama for Scalable Image Generation

    Peize Sun, Yi Jiang, Shoufa Chen, Shilong Zhang, Bingyue Peng, Ping Luo, Zehuan Yuan

    arXiv · 2024

    LlamaGen is introduced, a new family of image generation models that apply original ``next-token prediction'' paradigm of large language models to visual generation domain, an affirmative answer to whether vanilla autoregressive models can achieve state-of-the-art image generation performance if scaling properly.

    833
  • DiffusionDet: Diffusion Model for Object Detection

    Shoufa Chen, Peize Sun, Yibing Song, Ping Luo

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2023

    The extensive experiments show that DiffusionDet achieves favorable performance compared to previous well-established detectors, and possesses an appealing property of flexibility, which enables the dynamic number of boxes and iterative evaluation.

    811
  • PolarMask: Single Shot Instance Segmentation With Polar Representation

    Enze Xie, Peize Sun, Xiaoge Song, Wenhai Wang, Xuebo Liu, Ding Liang, Chunhua Shen, Ping Luo

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2020

    This paper introduces an anchor-box free and single shot instance segmentation method, which is conceptually simple, fully convolutional and can be used by easily embedding it into most off-the-shelf detection methods.

    641
  • DanceTrack: Multi-Object Tracking in Uniform Appearance and Diverse Motion

    Peize Sun, Jinkun Cao, Yi Jiang, Zehuan Yuan, Song Bai, Kris Kitani, Ping Luo

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    A large-scale dataset for multi-human tracking, where humans have sim-ilar appearance, diverse motion and extreme articulation, and is named “DanceTrack”, which is expected to provide a better platform to develop more MOT algorithms that rely less on visual discrimination and depend more on motion analysis.

    467
  • DetCo: Unsupervised Contrastive Learning for Object Detection

    Enze Xie, Jian Ding, Wenhai Wang, Xiaohang Zhan, Hang Xu, Peize Sun, Zhenguo Li, Ping Luo

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2021

    Extensive experiments demonstrate that DetCo not only outperforms recent methods on a series of 2D and 3D instance-level detection tasks, but also competitive on image classification.

    379
  • TransTrack: Multiple Object Tracking with Transformer

    Peize Sun, Jinkun Cao, Yi Jiang, Rufeng Zhang, Enze Xie, Zehuan Yuan, Changhu Wang, Ping Luo

    arXiv · 2020

    345
  • Language as Queries for Referring Video Object Segmentation

    Jiannan Wu, Yi Jiang, Peize Sun, Zehuan Yuan, Ping Luo

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    This work proposes a simple and unified framework built upon Transformer, termed ReferFormer, which views the language as queries and directly attends to the most relevant regions in the video frames, and significantly outperforms the previous methods by a large margin.

    282
  • Semantic-SAM: Segment and Recognize Anything at Any Granularity

    Feng Li, Hao Zhang, Peize Sun, Xueyan Zou, Shilong Liu, Jianwei Yang, Chunyuan Li, Lei Zhang, +1 more

    arXiv · 2023

    Semantic-SAM, a universal image segmentation model to enable segment and recognize anything at any desired granularity, is introduced, representing the first attempt to jointly train a model on SA-1B, generic, and part segmentation datasets.

    272
  • A deep-learning-based approach for fast and robust steel surface defects classification

    Guizhong Fu, Peize Sun, Wenbin Zhu, Jiangxin Yang, Yanlong Cao, Yanlong Cao, Michael Ying Yang, Yanpeng Cao, +1 more

    Optics and Lasers in Engineering · 2019

    A compact yet effective convolutional neural network model, which emphasizes the training of low-level features and incorporates multiple receptive fields, to achieve fast and accurate steel surface defect classification and adopts the pre-trained SqueezeNet as the backbone architecture.

    267
  • Towards Grand Unification of Object Tracking

    Bin Yan, Yi Jiang, Peize Sun, Dong Wang, Zehuan Yuan, Ping Luo, Huchuan Lu

    Lecture notes in computer science · 2022

    148
  • Learning Object-Language Alignments for Open-Vocabulary Object Detection

    Chuang Lin, Peize Sun, Yi Jiang, Ping Luo, Lizhen Qu, Gholamreza Haffari, Zehuan Yuan, Jianfei Cai

    arXiv · 2022

    This paper proposes a novel open-vocabulary object detection framework directly learning from image-text pair data as a set matching problem between a set of image region features and aSet of word embeddings, which enables us to train an open- Vocabulary object detector on image- Text pairs in a much simple and effective way.

    144
  • Sparse R-CNN: An End-to-End Framework for Object Detection

    Peize Sun, Rufeng Zhang, Yi Fan Jiang, Tao Kong, Chenfeng Xu, Wei Zhan, Masayoshi Tomizuka, Zehuan Yuan, +1 more

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2023

    130
  • Segmenting Transparent Objects in the Wild with Transformer

    Enze Xie, Wenjia Wang, Wenhai Wang, Peize Sun, Hang Xu, Ding Liang, Ping Luo

    Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence · 2021

    A novel Transformer-based segmentation pipeline termed Trans2Seg is proposed, which significantly outperforms all the CNN-based methods, showing the proposed algorithm's potential ability to solve transparent object segmentation.

    109
  • Domain-Invariant Disentangled Network for Generalizable Object Detection

    Chuang Lin, Zehuan Yuan, Sicheng Zhao, Peize Sun, Changhu Wang, Jianfei Cai

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2021

    100
  • Going Denser with Open-Vocabulary Part Segmentation

    Peize Sun, Shoufa Chen, Chenchen Zhu, Fanyi Xiao, Ping Luo, Saining Xie, Zhicheng Yan

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2023

    A detector with the ability to predict both open-vocabulary objects and their part segmentation and a detector that generalizes to a wide range of part segmentation datasets while achieving better performance than dataset-specific training is proposed.

    99
  • GPT4RoI: Instruction Tuning Large Language Model on Region-of-Interest

    Shilong Zhang, Peize Sun, Shoufa Chen, Min Xiao, Wenqi Shao, Wenwei Zhang, Yu Liu, Kai Chen, +1 more

    Lecture notes in computer science · 2025

    84
  • Goku: Flow Based Video Generative Foundation Models

    Shoufa Chen, Chongjian Ge, Yuqi Zhang, Yida Zhang, Fengda Zhu, Hao Yang, Hongxiang Hao, Hui Wu, +14 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2025

    The foundational elements enabling high-quality visual generation, including the data curation pipeline, model architecture design, flow formulation, and advanced infrastructure for efficient and robust large-scale training are detailed.

    82
  • Segment and Recognize Anything at Any Granularity

    Feng Li, Hao Zhang, Peize Sun, Xueyan Zou, Shilong Liu, Chunyuan Li, Jianwei Yang, Lei Zhang, +1 more

    Lecture notes in computer science · 2024

    This work introduces Semantic-SAM, an augmented image segmentation foundation for segmenting and recognizing anything at desired granularities, and is the first attempt to jointly train a model on SA-1B, instance-level, and part-level segmentation datasets.

    81
  • Watch Only Once: An End-to-End Video Action Detection Framework

    Shoufa Chen, Peize Sun, Enze Xie, Chongjian Ge, Jiannan Wu, Lan Ma, Jiajun Shen, Ping Luo

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2021

    75
  • RoboCodeX: Multimodal Code Generation for Robotic Behavior Synthesis

    Yao Mu, Junting Chen, Qinglong Zhang, Shoufa Chen, Qiaojun Yu, Chongjian Ge, Runjian Chen, Zhixuan Liang, +11 more

    arXiv · 2024

    A tree-structured multimodal code generation framework for generalized robotic behavior synthesis, termed RoboCodeX, which decomposes high-level human instructions into multiple object-centric manipulation units consisting of physical preferences such as affordance and safety constraints, and applies code generation to introduce generalization ability across various robotics platforms.

    66
  • ControlAR: Controllable Image Generation with Autoregressive Models

    Li, Zongming, Tianheng Cheng, Shoufa Chen, Peize Sun, Haocheng Shen, Longjin Ran, Xiaoxin Chen, Wenyu Liu, +1 more

    arXiv · 2024

    ControlAR is introduced, an efficient and effective framework for integrating spatial controls into autoregressive image generation models and surpasses previous state-of-the-art controllable diffusion models, e.g., ControlNet++.

    55
  • ByteTrackV2: 2D and 3D Multi-Object Tracking by Associating Every Detection Box

    Yifu Zhang, Xinggang Wang, Xiaoqing Ye, Wei Zhang, Jincheng Lu, Xiao Yan Tan, Errui Ding, Peize Sun, +1 more

    arXiv · 2023

    A complementary motion prediction strategy that incorporates the detected velocities with a Kalman filter to address the problem of abrupt motion and short-term disappearing is proposed.

    51
  • TextSR: Content-Aware Text Super-Resolution Guided by Recognition

    Wenjia Wang, Enze Xie, Peize Sun, Wenhai Wang, Tian, Lixun, Chunhua Shen, Ping Luo

    arXiv · 2019

    47
  • OneNet: Towards End-to-End One-Stage Object Detection.

    Peize Sun, Yi Jiang, Enze Xie, Zehuan Yuan, Changhu Wang, Ping Luo

    arXiv · 2020

    This paper discovers that the lack of classification cost between sample and ground-truth in label assignment is the main obstacle for one-stage detectors to remove Non-maximum Suppression (NMS) and reach end-to-end.

    33
  • Prompt-A-Video: Prompt your Video Diffusion Model via Preference-Aligned LLM

    Yatai Ji, Jiacheng Zhang, Jie Ying Wu, Shilong Zhang, Shoufa Chen, Chongjian Ge, Peize Sun, Weifeng Chen, +4 more

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2025

    This work introduces an LLMbased prompt adaptation framework, termed as Prompt-A-Video, which excels in crafting Video-Centric, LaborFree and Preference-Aligned prompts tailored to specific video diffusion model, and validate the effectiveness of Prompt-A-Video across diverse generation models.

    25
  • Segmenting Transparent Object in the Wild with Transformer

    Enze Xie, Wenjia Wang, Wenhai Wang, Peize Sun, Hang Xu, Ding Liang, Ping Luo

    arXiv · 2021

    24
  • Token-Shuffle: Towards High-Resolution Image Generation with Autoregressive Models

    Xu Ma, Peize Sun, Haoyu Ma, Hao Tang, Chih‐Yao Ma, Jialiang Wang, Kunpeng Li, Xiaoliang Dai, +17 more

    arXiv · 2025

    Token-Shuffle is presented, a novel yet simple method that reduces the number of image tokens in Transformer that enables MLLMs to support extremely high-resolution image synthesis in a unified next-token prediction way while maintaining efficient training and inference.

    21
  • Toward Guidance-Free AR Visual Generation via Condition Contrastive Alignment

    Huayu Chen, Hang Su, Peize Sun, Jun Zhu

    arXiv · 2024

    Experimental results show that CCA can significantly enhance the guidance-free performance of all tested models with just one epoch of fine-tuning on the pretraining dataset, on par with guided sampling methods, and largely removes the need for guided sampling in AR visual generation and cuts the sampling cost by half.

    16
  • Objects in Semantic Topology

    Shuo Yang, Peize Sun, Yi Jiang, Xiaobo Xia, Ruiheng Zhang, Zehuan Yuan, Changhu Wang, Ping Luo, +1 more

    arXiv · 2021

    15
  • Perception Encoder: The best visual embeddings are not at the output of the network

    Daniel Bolya, Po-Yao Huang, Peize Sun, Jang Hyun Cho, Andrea Madotto, Chen Wei, Tengyu Ma, Jiale Zhi, +10 more

    neural information processing systems · 2025

    14
  • Trans2Seg: Transparent Object Segmentation with Transformer

    Enze Xie, Wenjia Wang, Wenhai Wang, Peize Sun, Hang Xu, Ding Liang, Ping Luo

    arXiv · 2021

    12
  • IDA-VLM: Towards Movie Understanding via ID-Aware Large Vision-Language Model

    Yatai Ji, Shilong Zhang, Jie Wu, Peize Sun, Weifeng Chen, Xuefeng Xiao, Sidi Yang, Yujiu Yang, +1 more

    arXiv · 2024

    The research introduces a novel benchmark MM-ID, to examine LVLMs on instance IDs memory and recognition across four dimensions: matching, location, question-answering, and captioning, and highlights the limitations of existing LVLMs in recognizing and associating instance identities with ID reference.

    11
  • OmniGen-AR: AutoRegressive Any-to-Image Generation

    Junke Wang, Xun Wang, Qiushan Guo, Peize Sun, Weilin Huang, Zuxuan Wu, Yu–Gang Jiang

    neural information processing systems · 2025

    This work presents OmniGen-AR, a unified autoregressive framework for Any-to-Image generation that supports a broad spectrum of conditional inputs within a single model, and introduces Disentangled Causal Attention (DCA), which separates the full-sequence causal mask into condition causal attention and content causal attention.

    7
  • PerceptionLM: Open-Access Data and Models for Detailed Visual Understanding

    Jang Hyun Cho, Andrea Madotto, Effrosyni Mavroudi, Triantafyllos Afouras, Tushar Nagarajan, Muhammad Maaz, Yale Song, Tengyu Ma, +21 more

    neural information processing systems · 2025

    7
  • Enhancing Your Trained DETRs with Box Refinement

    Yiqun Chen, Qiang Chen, Peize Sun, Shoufa Chen, Jingdong Wang, Jian Cheng

    arXiv · 2023

    6
  • Double Anchor R-CNN for Human Detection in a Crowd

    Kevin Zhang, Feng Xiong, Peize Sun, Li Hu, Boxun Li, Gang Yu

    arXiv · 2019

    6
  • Towards High-Quality Temporal Action Detection with Sparse Proposals

    Jiannan Wu, Peize Sun, Shoufa Chen, Jiewen Yang, Zihao Qi, Lan Ma, Ping Luo

    arXiv · 2021

    5
  • FlashVideo: Flowing Fidelity to Detail for Efficient High-Resolution Video Generation

    Shilong Zhang, Wenbo Li, Shoufa Chen, Chongjian Ge, Peize Sun, Yifu Zhang, Yi Jiang, Zehuan Yuan, +2 more

    Proceedings of the AAAI Conference on Artificial Intelligence · 2026

    1
  • What Makes for End-to-End Object Detection?

    Peize Sun, Yi Jiang, Enze Xie, Wenqi Shao, Zehuan Yuan, Changhu Wang, Ping Luo

    arXiv · 2020

    1

Publication data from OpenAlex, with missing venues and authors filled in from Crossref; citation counts are the higher of OpenAlex and Semantic Scholar, last synced 2026-10-14. One-sentence summaries under some papers are written by Semantic Scholar’s model. Citation counts may be lower than on Google Scholar, which indexes more sources.

Report an error

Wrong papers, two people merged into one, or a profile that should not be here? Tell us and we will fix or hide it.

Sign in to report