Is this you? Claim this profile to correct it, add a bio and choose the work people see first.

Claim this profile

Works135 from public data

TitleCited by
  • Deformable Convolutional Networks

    Jifeng Dai, Haozhi Qi, Yuwen Xiong, Yi Li, Guodong Zhang, Han Hu, Yichen Wei

    IEEE International Conference on Computer Vision (ICCV) · 2017

    This work introduces two new modules to enhance the transformation modeling capability of CNNs, namely, deformable convolution and deformable RoI pooling, based on the idea of augmenting the spatial sampling locations in the modules with additional offsets and learning the offsets from the target tasks, without additional supervision.

    7,141
  • R-FCN: Object Detection via Region-based Fully Convolutional Networks

    Jifeng Dai, Yi Li, Kaiming He, Jian Zhong Sun

    arXiv · 2016

    3,149
  • Deformable ConvNets V2: More Deformable, Better Results

    Xizhou Zhu, Han Hu, Stephen Ching-Feng Lin, Jifeng Dai

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2019

    This work presents a reformulation of Deformable Convolutional Networks that improves its ability to focus on pertinent image regions, through increased modeling power and stronger training, and guides network training via a proposed feature mimicking scheme that helps the network to learn features that reflect the object focus and classification power of R-CNN features.

    2,748
  • InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Models

    Jinguo Zhu, Weiyun Wang, Zhe Sage Chen, Zhaoyang Liu, Ye, Shenglong, Gu, Lixin, Hao Tian, Yuchen Duan, +22 more

    arXiv · 2025

    InternVL3 incorporates variable visual position encoding (V2PE) to support extended multimodal contexts, employs advanced post-training techniques such as supervised fine-tuning (SFT) and mixed preference optimization (MPO), and adopts test-time scaling strategies alongside an optimized training infrastructure.

    1,936
  • VL-BERT: Pre-training of Generic Visual-Linguistic Representations

    Weijie Su, Xizhou Zhu, Yue Cao, Bin Li, Lewei Lu, Furu Wei, Jifeng Dai

    International Conference on Learning Representations · 2020

    A new pre-trainable generic representation for visual-linguistic tasks, called Visual-Linguistic BERT (VL-BERT), which adopts the simple yet powerful Transformer model as the backbone, and extends it to take both visual and linguistic embedded features as input.

    1,860
  • Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling

    Zhe Sage Chen, Weiyun Wang, Yue Qin Cao, Yangzhou Liu, Zhangwei Gao, Erfei Cui, Jinguo Zhu, Ye, Shenglong, +22 more

    arXiv · 2024

    This work explores the relationship between model scaling and performance, systematically exploring the performance trends in vision encoders, language models, dataset sizes, and test-time configurations and hopes this model contributes to the open-source community by setting new standards for developing and applying multimodal AI systems.

    1,813
  • Deformable DETR: Deformable Transformers for End-to-End Object Detection

    Xizhou Zhu, Su, Weijie, Lewei Lu, Bin Li, Xiaogang Wang, Jifeng Dai

    arXiv · 2020

    1,776
  • Planning-oriented Autonomous Driving

    Yihan Hu, Jiazhi Yang, Li Chen, Keyu Li, Chonghao Sima, Xizhou Zhu, Siqi Chai, Senyao Du, +8 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023

    This work introduces Unified Autonomous Driving (UniAD), a comprehensive framework up-to-date that incorporates full-stack driving tasks in one network and is exquisitely devised to leverage advantages of each module, and provide complementary feature abstractions for agent interaction from a global perspective.

    1,690
  • Relation Networks for Object Detection

    Han Hu, Jiayuan Gu, Zheng Zhang, Jifeng Dai, Yichen Wei

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2018

    An object relation module is proposed that processes a set of objects simultaneously through interaction between their appearance feature and geometry, thus allowing modeling of their relations, which gives rise to the first fully end-to-end object detector.

    1,464
  • BEVFormer: Learning Bird’s-Eye-View Representation from Multi-camera Images via Spatiotemporal Transformers

    Zhiqi Li, Wenhai Wang, Hongyang Li, Enze Xie, Chonghao Sima, Tong Lü, Yu Qiao, Jifeng Dai

    Lecture notes in computer science · 2022

    1,344
  • How far are we to GPT-4V? Closing the gap to commercial multimodal models with open-source suites

    Zhe Chen, Weiyun Wang, Weiyun Wang, Hao Tian, Shenglong Ye, Zhangwei Gao, Erfei Cui, Wenwen Tong, +22 more

    Science China Information Sciences · 2024

    InternVL 1.5, an open-source multimodal large language model (MLLM) to bridge the capability gap between open-source and proprietary commercial models in multimodal understanding, shows competitive performance, achieving state-of-the-art results in 8 of 18 multimodal benchmarks.

    1,306
  • Instance-Aware Semantic Segmentation via Multi-task Network Cascades

    Jifeng Dai, Kaiming He, Jian Sun

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2016

    This paper presents Multitask Network Cascades for instance-aware semantic segmentation, which consists of three networks, respectively differentiating instances, estimating masks, and categorizing objects, and develops an algorithm for the nontrivial end-to-end training of this causal, cascaded structure.

    1,279
  • InternImage: Exploring Large-Scale Vision Foundation Models with Deformable Convolutions

    Wenhai Wang, Jifeng Dai, Zhe Chen, Zhenhang Huang, Zhiqi Li, Xizhou Zhu, Xiaowei Hu, Tong Lü, +4 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023

    This work presents a new large-scale CNN-based foundation model, termed InternImage, which can obtain the gain from increasing parameters and training data like ViTs, and reduces the strict inductive bias of traditional CNNs and makes it possible to learn stronger and more robust patterns with large- scale parameters from massive datalike ViTs.

    1,217
  • ScribbleSup: Scribble-Supervised Convolutional Networks for Semantic Segmentation

    Di Lin, Jifeng Dai, Jiaya Jia, Kaiming He, Jian Sun

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2016

    This paper proposes to use scribbles to annotate images, and develops an algorithm to train convolutional networks for semantic segmentation supervised by scribbles, which shows excellent results on the PASCALCONTEXT dataset thanks to extra inexpensive scribble annotations.

    1,154
  • BoxSup: Exploiting Bounding Boxes to Supervise Convolutional Networks for Semantic Segmentation

    Jifeng Dai, Kaiming He, Jian Sun

    IEEE International Conference on Computer Vision (ICCV) · 2015

    This paper proposes a method that achieves competitive accuracy but only requires easily obtained bounding box annotations, and yields state-of-the-art results on PASCAL VOC 2012 and PASCal-CONTEXT.

    1,125
  • Fully Convolutional Instance-Aware Semantic Segmentation

    Yi Li, Haozhi Qi, Jifeng Dai, Xiangyang Ji, Yichen Wei

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2017

    The first fully convolutional end-to-end solution for instance-aware semantic segmentation task, which achieves state-of-the-art performance in both accuracy and efficiency, wins the COCO 2016 segmentation competition by a large margin.

    1,071
  • Vision Transformer Adapter for Dense Predictions

    Zhe Chen, Yuchen Duan, Wenhai Wang, Junjun He, Tong Lu, Jifeng Dai, Yu Qiao

    arXiv · 2022

    The ViT-Adapter is proposed, which allows plain ViT to achieve comparable performance to vision-specific transformers and facilitate future research and is verified on multiple dense prediction tasks, including object detection, instance segmentation, and semantic segmentation.

    938
  • Flow-Guided Feature Aggregation for Video Object Detection

    Xizhou Zhu, Yujie Wang, Jifeng Dai, Lu Yuan, Yichen Wei

    IEEE International Conference on Computer Vision (ICCV) · 2017

    This work presents flow-guided feature aggregation, an accurate and end-to-end learning framework for video object detection that improves the per-frame features by aggregation of nearby features along the motion paths, and thus improves the video recognition accuracy.

    727
  • MMDetection: Open MMLab Detection Toolbox and Benchmark

    Kai Chen, Jiaqi Wang, Jiangmiao Pang, Yuhang Cao, Yu Xiong, Xiaoxiao Li, Shuyang Sun, Wansen Feng, +17 more

    arXiv · 2019

    668
  • Deep Feature Flow for Video Recognition

    Xizhou Zhu, Yuwen Xiong, Jifeng Dai, Lu Yuan, Yichen Wei

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2017

    Deep feature flow is presented, a fast and accurate framework for video recognition that runs the expensive convolutional sub-network only on sparse key frames and propagates their deep feature maps to other frames via a flow field and achieves significant speedup as flow computation is relatively fast.

    668
  • Exploring Cross-Image Pixel Contrast for Semantic Segmentation

    Wenguan Wang, Tianfei Zhou, Fisher Yu, Jifeng Dai, Ender Konukoğlu, Luc Van Gool

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2021

    This work raises a pixel-wise metric learning paradigm for semantic segmentation, by explicitly exploring the structures of labeled pixels, which were rarely explored before, and hopes this work will encourage the community to rethink the current de facto training paradigm in semantic segmentsation.

    596
  • An Empirical Study of Spatial Attention Mechanisms in Deep Networks

    Xizhou Zhu, Dazhi Cheng, Zheng Zhang, Stephen Ching-Feng Lin, Jifeng Dai

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2019

    An empirical study that ablates various spatial attention elements within a generalized attention formulation, encompassing the dominant Transformer attention as well as the prevalent deformable convolution and dynamic convolution modules, yields significant findings about spatial attention in deep networks, some of which run counter to conventional understanding.

    596
  • BEVFormer: Learning Bird’s-Eye-View Representation From LiDAR-Camera via Spatiotemporal Transformers

    Zhiqi Li, Wenhai Wang, Hongyang Li, Enze Xie, Chonghao Sima, Tong Lü, Yu Qiao, Jifeng Dai

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2024

    This work presents a new framework termed BEVFormer, which learns unified BEV representations from multi-modality data with spatiotemporal transformers to support multiple autonomous driving perception tasks, achieving outstanding results across these tasks.

    593
  • BEVFormer v2: Adapting Modern Image Backbones to Bird's-Eye-View Recognition via Perspective Supervision

    Chenyu Yang, Yuntao Chen, Hao Tian, Chenxin Tao, Xizhou Zhu, Zhaoxiang Zhang, Gao Ming Huang, Hongyang Li, +4 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023

    A novel bird's-eye-view (BEV) detector with perspective supervision, which converges faster and bet-suits modern image backbones and achieves new SoTA results on the large-scale nuScenes dataset.

    490
  • EmbodiedGPT: Vision-Language Pre-Training via Embodied Chain of Thought

    Yao Mu, Qinglong Zhang, Mengkang Hu, Wenhai Wang, Mingyu Ding, Jun Jin, Bin Wang, Jifeng Dai, +2 more

    arXiv · 2023

    This work introduces EmbodiedGPT, an end-to-end multi-modal foundation model for embodied AI, empowering embodied agents with multi- modal understanding and execution capabilities, and significantly enhances the success rate of the embodied control task by extracting more effective features.

    459

Show all 135 works

Publication data from OpenAlex; citation counts are the higher of OpenAlex and Semantic Scholar, last synced 2026-10-13. One-sentence summaries under some papers are written by Semantic Scholar’s model. Citation counts may be lower than on Google Scholar, which indexes more sources.

Report an error

Wrong papers, two people merged into one, or a profile that should not be here? Tell us and we will fix or hide it.

Sign in to report