Is this you? Claim this profile to correct it, add a bio and choose the work people see first.

Claim this profile

Works335 from public data

TitleCited by
  • Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutions

    Wenhai Wang, Enze Xie, Xiang Li, Deng-Ping Fan, Kaitao Song, Ding Liang, Tong Lü, Ping Luo, +1 more

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2021

    The Pyramid Vision Transformer (PVT) is introduced, which overcomes the difficulties of porting Transformer to various dense prediction tasks and is validated through extensive experiments, showing that it boosts the performance of many downstream tasks, including object detection, instance and semantic segmentation.

    5,324
  • Intern VL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Tasks

    Zhe Chen, Jiannan Wu, Wenhai Wang, Weijie Su, Guo Chen, Sen Xing, Muyan Zhong, Qinglong Zhang, +7 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    A large-scale vision-language foun-dation model (Intern VL), which scales up the vision foun-dation model to 6 billion parameters and progressively aligns it with the LLM, using web-scale image-text data from various sources is designed.

    3,476
  • PVT v2: Improved baselines with pyramid vision transformer

    Wenhai Wang, Enze Xie, Xiang Li, Deng-Ping Fan, Kaitao Song, Ding Liang, Tong Lü, Ping Luo, +1 more

    Computational Visual Media · 2022

    This work improves the original Pyramid Vision Transformer (PVT v1) by adding three designs: a linear complexity attention layer, an overlapping patch embedding, and a convolutional feed-forward network to reduce the computational complexity of PVT v1 to linearity and provide significant improvements on fundamental vision tasks.

    2,673
  • InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Models

    Jinguo Zhu, Weiyun Wang, Zhe Sage Chen, Zhaoyang Liu, Ye, Shenglong, Gu, Lixin, Hao Tian, Yuchen Duan, +22 more

    arXiv · 2025

    InternVL3 incorporates variable visual position encoding (V2PE) to support extended multimodal contexts, employs advanced post-training techniques such as supervised fine-tuning (SFT) and mixed preference optimization (MPO), and adopts test-time scaling strategies alongside an optimized training infrastructure.

    1,936
  • Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling

    Zhe Sage Chen, Weiyun Wang, Yue Qin Cao, Yangzhou Liu, Zhangwei Gao, Erfei Cui, Jinguo Zhu, Ye, Shenglong, +22 more

    arXiv · 2024

    This work explores the relationship between model scaling and performance, systematically exploring the performance trends in vision encoders, language models, dataset sizes, and test-time configurations and hopes this model contributes to the open-source community by setting new standards for developing and applying multimodal AI systems.

    1,813
  • BEVFormer: Learning Bird’s-Eye-View Representation from Multi-camera Images via Spatiotemporal Transformers

    Zhiqi Li, Wenhai Wang, Hongyang Li, Enze Xie, Chonghao Sima, Tong Lü, Yu Qiao, Jifeng Dai

    Lecture notes in computer science · 2022

    1,348
  • InternImage: Exploring Large-Scale Vision Foundation Models with Deformable Convolutions

    Wenhai Wang, Jifeng Dai, Zhe Chen, Zhenhang Huang, Zhiqi Li, Xizhou Zhu, Xiaowei Hu, Tong Lü, +4 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023

    This work presents a new large-scale CNN-based foundation model, termed InternImage, which can obtain the gain from increasing parameters and training data like ViTs, and reduces the strict inductive bias of traditional CNNs and makes it possible to learn stronger and more robust patterns with large- scale parameters from massive datalike ViTs.

    1,217
  • Shape Robust Text Detection With Progressive Scale Expansion Network

    Wenhai Wang, Enze Xie, Xiang Li, Wenbo Hou, Tong Lü, Gang Yu, Shuai Shao

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2019

    A novel Progressive Scale Expansion Network (PSENet) is proposed, which can precisely detect text instances with arbitrary shapes and is effective to split the close text instances, making it easier to use segmentation-based methods to detect arbitrary-shaped text instances.

    860
  • Efficient and Accurate Arbitrary-Shaped Text Detection With Pixel Aggregation Network

    Wenhai Wang, Enze Xie, Xiaoge Song, Yuhang Zang, Wenjia Wang, Tong Lü, Gang Yu, Chunhua Shen

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2019

    This paper proposes an efficient and accurate arbitrary-shaped text detector, termed Pixel Aggregation Network (PAN), which is equipped with a low computational-cost segmentation head and a learnable post-processing.

    632
  • BEVFormer: Learning Bird’s-Eye-View Representation From LiDAR-Camera via Spatiotemporal Transformers

    Zhiqi Li, Wenhai Wang, Hongyang Li, Enze Xie, Chonghao Sima, Tong Lü, Yu Qiao, Jifeng Dai

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2024

    This work presents a new framework termed BEVFormer, which learns unified BEV representations from multi-modality data with spatiotemporal transformers to support multiple autonomous driving perception tasks, achieving outstanding results across these tasks.

    593
  • TAM: Temporal Adaptive Module for Video Recognition

    Zhaoyang Liu, Limin Wang, Wayne Wu, Chen Qian, Tong Lü

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2021

    A new temporal adaptive module (TAM) to generate video-specific temporal kernels based on its own feature map that outperforms other temporal modeling methods consistently, and achieves the state-of-the-art performance under the similar complexity.

    388
  • Is Ego Status All You Need for Open-Loop End-to-End Autonomous Driving?

    Zhiqi Li, Zhiding Yu, Shiyi Lan, Jiahan Li, Jan Kautz, Tong Lü, José M. Álvarez

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    This paper conducts thorough analyses and introduces a new metric to evaluate whether the predicted trajectories adhere to the road, and proposes a simple baseline able to achieve competitive results without relying on perception annotations.

    296
  • TEINet: Towards an Efficient Architecture for Video Recognition

    Zhaoyang Liu, Donghao Luo, Yabiao Wang, Limin Wang, Ying Yu Tai, Chengjie Wang, Jilin Li, Feiyue Huang, +1 more

    Proceedings of the AAAI Conference on Artificial Intelligence · 2020

    The proposed TEINet can achieve a good recognition accuracy on these datasets but still preserve a high efficiency, and is able to capture temporal structure flexibly and effectively, but also efficient for model inference.

    275
  • Efficient Deformable ConvNets: Rethinking Dynamic and Sparse Operator for Vision Applications

    Yuwen Xiong, Zhiqi Li, Yuntao Chen, Feng Wang, Xizhou Zhu, Jiapeng Luo, Wenhai Wang, Tong Lü, +5 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    The advancements in speed and efficiency of DCNv4, combined with its robust performance across diverse vision tasks, show its potential as a foundational building block for future vision models.

    267
  • DDP: Diffusion Model for Dense Visual Prediction

    Yuanfeng Ji, Zhe Chen, Enze Xie, Lanqing Hong, Xihui Liu, Zhaoqiang Liu, Tong Lü, Zhenguo Li, +1 more

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2023

    The method, called DDP, efficiently extends the denoising diffusion process into the modern perception pipeline and shows attractive properties such as dynamic inference and uncertainty awareness, in contrast to previous single-step discriminative methods.

    254
  • GridFormer: Residual Dense Transformer with Grid Structure for Image Restoration in Adverse Weather Conditions

    Tao Wang, Kaihao Zhang, Ziqian Shao, Wenhan Luo, Björn Stenger, Tong Lü, Tae‐Kyun Kim, Wei Liu, +1 more

    International Journal of Computer Vision · 2024

    The GridFormer framework achieves state-of-the-art results on five diverse image restoration tasks in adverse weather conditions, including image deraining, dehazing, deraining & dehazing, desnowing, and multi-weather restoration.

    240
  • Panoptic SegFormer: Delving Deeper into Panoptic Segmentation with Transformers

    Zhiqi Li, Wenhai Wang, Enze Xie, Zhiding Yu, Anima Anandkumar, José Manuel Álvarez, Ping Luo, Tong Lü

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    This work presents Panoptic SegFormer, a general framework for panoptic segmentation with transformers, which contains three innovative components: an efficient deeply-supervised mask decoder, a query decoupling strategy, and an improved postprocessing method.

    199
  • Adaptive Graph Convolution for Point Cloud Analysis

    Haoran Zhou, Yidan Feng, Mingsheng Fang, Mingqiang Wei, Jing Qin, Tong Lü

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2021

    Compared with using a fixed/isotropic kernel, AdaptConv improves the flexibility of point cloud convolutions, effectively and precisely capturing the diverse relations between points from different semantic parts.

    185
  • SeedFormer: Patch Seeds Based Point Cloud Completion with Upsample Transformer

    Haoran Zhou, Yun Cao, Wenqing Chu, Jun‐Wei Zhu, Tong Lü, Ying Yu Tai, Chengjie Wang

    Lecture notes in computer science · 2022

    179
  • PAN++: Towards Efficient and Accurate End-to-End Spotting of Arbitrarily-Shaped Text

    Wenhai Wang, Enze Xie, Xiang Li, Xuebo Liu, Ding Liang, Zhibo Yang, Tong Lü, Chunhua Shen

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2021

    An end-to-end text spotting framework, termed PAN++, which can efficiently detect and recognize text of arbitrary shapes in natural scenes, based on the kernel representation that reformulates a text line as a text kernel surrounded by peripheral pixels.

    177
  • FB-BEV: BEV Representation from Forward-Backward View Transformations

    Zhiqi Li, Zhiding Yu, Wenhai Wang, Anima Anandkumar, Tong Lü, José Manuel Álvarez

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2023

    This work proposes a novel forward-backward view transformation module that compensates for the deficiencies in both existing methods, allowing them to enhance each other to obtain higher quality BEV representations mutually.

    171
  • Vision-RWKV: Efficient and Scalable Visual Perception with RWKV-Like Architectures

    Yuchen Duan, Wei‐Yun Wang, Zhe Chen, Xizhou Zhu, Lewei Lu, Tong Lü, Yu Qiao, Hongsheng Li, +2 more

    arXiv · 2024

    Vision-RWKV (VRWKV), a model adapted from the RWKV model used in the NLP field with necessary modifications for vision tasks, surpasses ViT's performance in image classification and has significantly faster speeds and lower memory usage processing high-resolution inputs.

    166
  • Temporal Action Localization by Structured Maximal Sums

    Zehuan Yuan, Jonathan Stroud, Tong Lü, Jia Hao Deng

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2017

    This work addresses the problem of temporal action localization in videos by posing action localization as a structured prediction over arbitrary-length temporal windows, where each window is scored as the sum of frame-wise classification scores.

    155
  • Mini-InternVL: a flexible-transfer pocket multi-modal model with 5% parameters and 90% performance

    Zhangwei Gao, Zhe Chen, Erfei Cui, Yiming Ren, Weiyun Wang, Weiyun Wang, Jinguo Zhu, Hao Tian, +9 more

    Visual Intelligence · 2024

    This work introduces Mini-InternVL, a series of MLLMs with parameters ranging from 1 billion to 4 billion, which achieves 90% of the performance with only 5% of the parameters, which makes these models more accessible and applicable in various real-world scenarios.

    139
  • VideoLLM: Modeling Video Sequence with Large Language Models

    Chen Guo, Yin-Dong Zheng, Jiahao Wang, Jilan Xu, Yifei Huang, Junting Pan, Yi Wang, Yali Wang, +3 more

    arXiv · 2023

    This work proposes a novel framework called VideoLLM that leverages the sequence reasoning capabilities of pre-trained LLMs from natural language processing (NLP) for video sequence understanding and demonstrates that the understanding and Reasoning capabilities of LLMs can be effectively transferred to video understanding tasks.

    134

Show all 335 works

Publication data from OpenAlex, with missing venues and authors filled in from Crossref; citation counts are the higher of OpenAlex and Semantic Scholar, last synced 2026-10-14. One-sentence summaries under some papers are written by Semantic Scholar’s model. Citation counts may be lower than on Google Scholar, which indexes more sources.

Report an error

Wrong papers, two people merged into one, or a profile that should not be here? Tell us and we will fix or hide it.

Sign in to report