Is this you? Claim this profile to correct it, add a bio and choose the work people see first.

Claim this profile

Academic lineage

Possible advisorsa guess from early papers, not confirmed

  • Qi Tian

    Possible advisor · last author on 8 of their early first-author papers, 2016–2018

    Suggested from co-authorship
  • Longin Jan Latecki

    Possible advisor · last author on 6 of their early first-author papers, 2016–2019

    Suggested from co-authorship

Is this you? Claim this profile to confirm or dismiss it.

Works140 from public data

TitleCited by
  • CenterNet: Keypoint Triplets for Object Detection

    Kaiwen Duan, Song Bai, Lingxi Xie, Honggang Qi, Qingming Huang, Qi Chuan Tian

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2019

    This paper presents an efficient solution that explores the visual patterns within individual cropped regions with minimal costs, and builds the framework upon a representative one-stage keypoint-based detector named CornerNet, which improves both precision and recall.

    3,591
  • CenterNet: Object Detection with Keypoint Triplets

    Kaiwen Duan, Song Bai, Lingxi Xie, Honggang Qi, Qingming Huang, Qi Chuan Tian

    arXiv · 2019

    This paper presents an efficient solution that explores the visual patterns within individual cropped regions with minimal costs, and builds the framework upon a representative one-stage keypoint-based detector named CornerNet, which improves both precision and recall.

    3,563
  • Improving Transferability of Adversarial Examples With Input Diversity

    Cihang Xie, Zhishuai Zhang, Yuyin Zhou, Song Bai, Jianyu Wang, Zhou Ren, Alan Yuille

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2019

    This work proposes to improve the transferability of adversarial examples by creating diverse input patterns by applying random transformations to the input images at each iteration, and shows that the proposed attack method can generate adversarialExamples that transfer much better to different networks than existing baselines.

    1,524
  • Hypergraph convolution and hypergraph attention

    Song Bai, Feihu Zhang, Philip H. S. Torr

    Pattern Recognition · 2020

    This work introduces two end-to-end trainable operators to the family of graph neural networks, i.e., hypergraph convolution and hypergraph attention, which define the basic formulation of performing convolution on a hypergraph and further enhances the capacity of representation learning by leveraging an attention module.

    952
  • Asymmetric Non-Local Neural Networks for Semantic Segmentation

    Zhen Zhu, Meng Xu, Song Bai, Tengteng Huang, Xiang Bai

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2019

    Asymmetric Pyramid Non- local Block (APNB) and Asymmetric Fusion Non-local Block (AFNB) are presented, which has two prominent components: APNB leverages a pyramid sampling module into the non-local block to largely reduce the computation and memory consumption without sacrificing the performance.

    712
  • DanceTrack: Multi-Object Tracking in Uniform Appearance and Diverse Motion

    Peize Sun, Jinkun Cao, Yi Jiang, Zehuan Yuan, Song Bai, Kris Kitani, Ping Luo

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    A large-scale dataset for multi-human tracking, where humans have sim-ilar appearance, diverse motion and extreme articulation, and is named “DanceTrack”, which is expected to provide a better platform to develop more MOT algorithms that rely less on visual discrimination and depend more on motion analysis.

    467
  • Is synthetic data from generative models ready for image recognition?

    Ruifei He, Sun, Shuyang, Xin Feng Yu, Chuhui Xue, Wenqing Zhang, Philip H.S. Torr, Song Bai, Xiaojuan Qi

    arXiv · 2022

    This work extensively study whether and how synthetic images generated from state-of-the-art text-to-image generation models can be used for image recognition tasks, and focuses on two perspectives: synthetic data for improving classification models in data-scarce settings (i.e. zero-shot and few-shot), and syntheticData for large-scale model pre-training for transfer learning.

    443
  • DeepPano: Deep Panoramic Representation for 3-D Shape Recognition

    Baoguang Shi, Song Bai, Zhichao Zhou, Xiang Bai

    IEEE Signal Processing Letters · 2015

    440
  • PCL: Proposal Cluster Learning for Weakly Supervised Object Detection

    Peng Tang, Xinggang Wang, Song Bai, Wei Shen, Xiang Bai, Wenyu Liu, Alan Yuille

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2018

    This paper first shows that instances can be assigned object or background labels directly based on proposal clusters for instance classifier refinement, and then shows that treating each cluster as a small new bag yields fewer ambiguities than the directly assigning label method.

    422
  • DragDiffusion: Harnessing Diffusion Models for Interactive Point-Based Image Editing

    Yujun Shi, Chuhui Xue, Jun Hao Liew, Jiachun Pan, Hanshu Yan, Wenqing Zhang, Vincent Y. F. Tan, Song Bai

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    This work introduces two additional techniques, namely identity-preserving fine-tuning and reference-latent-control, to further preserve the identity of the original image and presents a challenging benchmark dataset called DRAGBENCH─ the first benchmark to evaluate the performance of interactive point-based image editing methods.

    393
  • Triplet-Center Loss for Multi-view 3D Object Retrieval

    Xinwei He, Yang Zhou, Zhichao Zhou, Song Bai, Xiang Bai

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2018

    This paper study variants of deep metric learning losses for 3D object retrieval, which did not receive enough attention from this area, and proposes a novel loss named triplet-center loss, which can further enhance the discriminative power of the features.

    385
  • SRFormer: Permuted Self-Attention for Single Image Super-Resolution

    Yupeng Zhou, Zhen Li, Chunle Guo, Song Bai, Ming‐Ming Cheng, Qibin Hou

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2023

    373
  • Scalable Person Re-identification on Supervised Smoothed Manifold

    Song Bai, Xiang Bai, Qi Tian

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2017

    An unconventional manifold-preserving algorithm is proposed, which can make best use of supervision from training data, whose label information is given as pairwise constraints, scale up to large repositories with low on-line time complexity, and be plunged into most existing algorithms, serving as a generic postprocessing procedure to further boost the identification accuracies.

    342
  • End-to-End Temporal Action Detection With Transformer

    Xiaolong Liu, Qimeng Wang, Yao Hu, Xu Tang, Shiwei Zhang, Song Bai, Xiang Bai

    IEEE Transactions on Image Processing · 2022

    TadTR is an end-to-end Transformer-based method for temporal action detection that achieves state-of-the-art performance on THUMOS14 and HACS Segments, and requires lower computation cost than previous detectors, while preserving remarkable performance.

    341
  • MOSE: A New Dataset for Video Object Segmentation in Complex Scenes

    Henghui Ding, Chang Liu, Shuting He, Xudong Jiang, Philip H. S. Torr, Song Bai

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2023

    The experiments show that current VOS algorithms cannot well perceive objects in complex scenes, and there are unresolved challenges under complex scenes and more efforts are desired to explore these challenges in the future.

    307
  • GIFT: A Real-Time and Scalable 3D Shape Search Engine

    Song Bai, Xiang Bai, Zhichao Zhou, Zhaoxiang Zhang, Longin Jan Latecki

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2016

    The proposed 3D shape search engine, which combines GPU acceleration and Inverted File (Twice), is named as GIFT, which outperforms the state-of-the-art methods significantly in retrieval accuracy on various shape benchmarks and competitions.

    298
  • PLA: Language-Driven Open-Vocabulary 3D Scene Understanding

    Runyu Ding, Jihan Yang, Chuhui Xue, Wenqing Zhang, Song Bai, Xiaojuan Qi

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023

    This work proposes to distill knowledge encoded in pretrained vision-language (VL) foundation models through captioning multi-view images from 3D, which allows explicitly associating 3D and semantic-rich captions in open-vocabulary captions.

    240
  • Occluded Video Instance Segmentation: A Benchmark

    Jiyang Qi, Yan Gao, Yao Guang Hu, Xinggang Wang, Xiaoyu Liu, Xiang Bai, Serge Belongie, Alan Yuille, +2 more

    International Journal of Computer Vision · 2022

    A simple plug-and-play module that performs temporal feature calibration to complement missing object cues caused by occlusion is presented, and a remarkable AP improvement on the OVIS dataset is obtained.

    229
  • Prior-Aware Neural Network for Partially-Supervised Multi-Organ Segmentation

    Yuyin Zhou, Zhe Li, Song Bai, Xinlei Chen, Mei Han, Chong Wang, Elliot K. Fishman, Alan Yuille

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2019

    PaNN achieves state-of-the-art performance on the MICCAI2015 challenge ``Multi-Atlas Labeling Beyond the Cranial Vault'', a competition on organ segmentation in the abdomen, and is reformulated as a min-max form and optimized via the stochastic primal-dual gradient algorithm.

    204
  • XingGAN for Person Image Generation

    Hao Tang, Song Bai, Li Zhang, Philip H. S. Torr, Nicu Sebe

    Lecture notes in computer science · 2020

    A novel Generative Adversarial Network (XingGAN or CrossingGAN) for person image generation tasks, i.e., translating the pose of a given person to a desired one to mutually improve each other is proposed.

    197
  • SwiftNet: Real-time Video Object Segmentation

    Haochen Wang, Xiaolong Jiang, Haibing Ren, Yao Guang Hu, Song Bai

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2021

    This work presents SwiftNet for real-time semisupervised video object segmentation (one-shot VOS), which reports 77.8% $\mathcal{J}\& \mathcal {F}$ and 70 FPS on DAVIS 2017 validation dataset, leading all present solutions in overall accuracy and speed performance.

    190
  • Deep Learning Representation using Autoencoder for 3D Shape Retrieval

    Zhuotun Zhu, Xinggang Wang, Song Bai, Cong Yao, Xiang Bai

    Neurocomputing · 2016

    This work projects 3D shapes into 2D space and uses autoencoder for feature learning on the 2D images and shows the proposed deep learning feature is complementary to conventional local image descriptors, which can obtain the state-of-the-art performance on 3D shape retrieval benchmarks.

    187
  • Learning Transferable Adversarial Examples via Ghost Networks

    Yingwei Li, Song Bai, Yuyin Zhou, Cihang Xie, Zhishuai Zhang, Alan Yuille

    Proceedings of the AAAI Conference on Artificial Intelligence · 2020

    Ghost Networks is proposed to improve the transferability of adversarial examples by reproducing the NeurIPS 2017 adversarial competition, and outperforms the No.1 attack submission by a large margin, demonstrating its effectiveness and efficiency.

    171
  • Learning Attraction Field Representation for Robust Line Segment Detection

    Nan Xue, Song Bai, Fudong Wang, Gui-Song Xia, Tianfu Wu, Liangpei Zhang

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2019

    A region-partition based attraction field dual representation for line segment maps, which poses the problem of line segment detection (LSD) as the region coloring problem and harnesses the best practices developed in ConvNets based semantic segmentation methods such as the encoder-decoder architecture and the a-trous convolution.

    169
  • Symmetry-Constrained Rectification Network for Scene Text Recognition

    Mingkun Yang, Yushuo Guan, Minghui Liao, Xin James He, Kaigui Bian, Song Bai, Cong Yao, Xiang Bai

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2019

    A Symmetry-constrained Rectification Network (ScRN) based on local attributes of text instances, such as center line, scale and orientation, which enables ScRN to generate better rectification results than existing methods and thus lead to higher recognition accuracy.

    166
  • Semi-Supervised 3D Abdominal Multi-Organ Segmentation Via Deep Multi-Planar Co-Training

    Yuyin Zhou, Yan Wang, Peng Tang, Song Bai, Wei Shen, Elliot K. Fishman, Alan Yuille

    IEEE Winter Conference on Applications of Computer Vision · 2019

    Deep Multi-Planar Co-Training is proposed, whose contributions can be divided into two folds: 1) the deep model is learned in a co-training style which can mine consensus information from multiple planes like the sagittal, coronal, and axial planes; 2) Multi-planar fusion is applied to generate more reliable pseudo-labels, which alleviates the errors occurring in the pseudo-Labels and thus can help to train better segmentation networks.

    166
  • SeqFormer: Sequential Transformer for Video Instance Segmentation

    Junfeng Wu, Yi Jiang, Song Bai, Wenqing Zhang, Xiang Bai

    Lecture notes in computer science · 2022

    This work presents SeqFormer, a model that locates an instance in each frame and aggregates temporal information to learn a powerful representation of a video-level instance, which is used to predict the mask sequences on each frame dynamically.

    163
  • Sparse Contextual Activation for Efficient Visual Re-Ranking

    Song Bai, Xiang Bai

    IEEE Transactions on Image Processing · 2016

    161
  • Learn to Scale: Generating Multipolar Normalized Density Maps for Crowd Counting

    Chenfeng Xu, Kai Qiu, Jianlong Fu, Song Bai, Yongchao Xu, Xiang Bai

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2019

    First, a patch-level density map is extracted by a density estimation model and further grouped into several density levels which are determined over full datasets, which can significantly condense the density distribution into several clusters, and enable that the density variance can be learned by a single model.

    157
  • Hard-Aware Point-to-Set Deep Metric for Person Re-identification

    Rui Yu, Zhiyong Dou, Song Bai, Zhaoxiang Zhang, Yongchao Xu, Xiang Bai

    Lecture notes in computer science · 2018

    In addition to person re-ID, the proposed Hard-Aware Point-to-Set (HAP2S) loss with a soft hard-mining scheme applies to generic deep metric learning benchmarks including CUB-200-2011 and Cars196, and achieves state-of-the-art results.

    156
  • Holistically-Attracted Wireframe Parsing

    Nan Xue, Tianfu Wu, Song Bai, Fudong Wang, Gui-Song Xia, Liangpei Zhang, Philip H. S. Torr

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2020

    This paper presents a fast and parsimonious parsing method to accurately and robustly detect a vectorized wireframe in an input image with a single forward pass, and is thus called Holistically-Attracted Wireframe Parser (HAWP).

    143
  • Deep learning for predicting COVID-19 malignant progression

    Cong Fang, Song Bai, Qianlan Chen, Yu Zhou, Liming Xia, Lixin Qin, Shi Gong, Xudong Xie, +7 more

    Medical Image Analysis · 2021

    142
  • TransMix: Attend to Mix for Vision Transformers

    Jie-Neng Chen, Shuyang Sun, He Ju, Philip H.S. Torr, Alan Yuille, Song Bai

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    TransMix is proposed, which mixes labels based on the attention maps of Vision Transformers, which can consistently improve various ViT-based models at scales on ImageNet classification.

    140
  • AutoScale: Learning to Scale for Crowd Counting

    Chenfeng Xu, Dingkang Liang, Yongchao Xu, Song Bai, Wei Zhan, Xiang Bai, Masayoshi Tomizuka

    International Journal of Computer Vision · 2022

    A simple and effective Learning to Scale (L2S) module, which automatically scales dense regions into reasonable closeness levels (reflecting image-plane distance between neighboring people), and introduces a customized dynamic cross-entropy loss, significantly improving the localization-based model optimization.

    137
  • Anchor-Free Person Search

    Yichao Yan, Jinpeng Li, Jie Qin, Song Bai, Shengcai Liao, Li Liu, Fan Zhu, Ling Shao

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2021

    This work presents the Feature-Aligned Person Search Network (AlignPS), the first anchor-free framework to efficiently tackle this challenging task, and proposes an aligned feature aggregation module to generate more discriminative and robust feature embeddings by following a "re-id first" principle.

    133
  • Anchor Diffusion for Unsupervised Video Object Segmentation

    Zhao Yang, Qiang Wang, Luca Bertinetto, Song Bai, Weiming Hu, Philip H. S. Torr

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2019

    Inspired by the non-local operators, a technique to establish dense correspondences between pixel embeddings of a reference "anchor" frame and the current one is introduced, which allows the learning of pairwise dependencies at arbitrarily long distances without conditioning on intermediate frames.

    128
  • General Object Foundation Model for Images and Videos at Scale

    Junfeng Wu, Yi Jiang, Qihao Liu, Zehuan Yuan, Xiang Bai, Song Bai

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    GLEE is presented, an object-level foundation model for locating and identifying objects in images and videos, capable of being integrated into Large Language Models, serving as a foun-dational model to provide universal object-level information for multimodal tasks.

    120
  • Corner Proposal Network for Anchor-Free, Two-Stage Object Detection

    Kaiwen Duan, Lingxi Xie, Honggang Qi, Song Bai, Qingming Huang, Qi Chuan Tian

    Lecture notes in computer science · 2020

    A novel anchor-free, two-stage framework which first extracts a number of object proposals by finding potential corner keypoint combinations and then assigns a class label to each proposal by a standalone classification stage is proposed, which is competitive among state-of-the-art object detection methods.

    118
  • CenterNet++ for Object Detection

    Kaiwen Duan, Song Bai, Lingxi Xie, Honggang Qi, Qingming Huang, Qi Chuan Tian

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2023

    It is demonstrated that bottom-up approaches show competitive performance compared with top-down approaches and have higher recall rates and a real-time CenterNet model, an anchor-free detector that achieves a good trade-off between accuracy and speed.

    112
  • In Defense of Online Models for Video Instance Segmentation

    Junfeng Wu, Qihao Liu, Yi Jiang, Song Bai, Alan Yuille, Xiang Bai

    Lecture notes in computer science · 2022

    110
  • Re-Ranking via Metric Fusion for Object Retrieval and Person Re-Identification

    Song Bai, Peng Tang, Philip H. S. Torr, Longin Jan Latecki

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2019

    105
  • Multi-shot Temporal Event Localization: a Benchmark

    Xiaolong Liu, Yao Guang Hu, Song Bai, Fei Ding, Xiang Bai, Philip H. S. Torr

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2021

    This paper proposes a new and challenging task called multi-shot temporal event localization, and accordingly, collects a large-scale dataset called MUlti-Shot EventS (MUSES), which has 31,477 event instances for a total of 716 video hours.

    102
  • Predicting COVID-19 Malignant Progression with AI Techniques

    Xiang Bai, Cong Fang, Yu Zhou, Song Bai, Zaiyi Liu, Liming Xia, Qianlan Chen, Yongchao Xu, +10 more

    SSRN Electronic Journal · 2020

    98
  • Ensemble Diffusion for Retrieval

    Song Bai, Zhichao Zhou, Jingdong Wang, Xiang Bai, Longin Jan Latecki, Qi Tian

    IEEE International Conference on Computer Vision (ICCV) · 2017

    98
  • Divide and Fuse: A Re-ranking Approach for Person Re-identification

    Rui Yu, Zhichao Zhou, Song Bai, Xiang Bai

    British Machine Vision Conference (BMVC) · 2017

    A "Divide and use" re- ranking framework for person re-ID that exploits the diversity from different parts of a high-dimensional feature vector for fusion-based re-ranking, while no other features are accessible.

    96
  • GIFT: Towards Scalable 3D Shape Retrieval

    Song Bai, Xiang Bai, Zhichao Zhou, Zhaoxiang Zhang, Qi Tian, Longin Jan Latecki

    IEEE Transactions on Multimedia · 2017

    94
  • Dual Attention GANs for Semantic Image Synthesis

    Hao Tang, Song Bai, Nicu Sebe

    ACM International Conference on Multimedia (ACM MM) · 2020

    A novel Dual Attention GAN (DAGAN) is proposed to synthesize photo-realistic and semantically-consistent images with fine details from the input layouts without imposing extra training overhead or modifying the network architectures of existing methods.

    92
  • Regularized Diffusion Process on Bidirectional Context for Object Retrieval

    Song Bai, Xiang Bai, Qi Tian, Longin Jan Latecki

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2018

    92
  • Towards Understanding and Mitigating Dimensional Collapse in Heterogeneous Federated Learning

    Yujun Shi, Jian Liang, Wenqing Zhang, Vincent Y. F. Tan, Song Bai

    arXiv · 2022

    This work proposes {\sc FedDecorr], a novel method that can effectively mitigate dimensional collapse in federated learning that applies a regularization term during local training that encourages different dimensions of representations to be uncorrelated.

    89
  • Mimicking the Oracle: An Initial Phase Decorrelation Approach for Class Incremental Learning

    Yujun Shi, Kuangqi Zhou, Jian Liang, Zihang Jiang, Jiashi Feng, Philip H. S. Torr, Song Bai, Vincent Y. F. Tan

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    Class-wise Decorrelation (CwD) is proposed that regularizes representations of each class to scatter more uniformly, thus mimicking the model jointly trained with all classes (i.e., the oracle model), and is simple to implement and easy to plug into existing methods.

    89
  • Advancing COVID-19 diagnosis with privacy-preserving collaboration in artificial intelligence

    Xiang Bai, Hanchen Wang, Liya Ma, Yongchao Xu, Jiefeng Gan, Ziwei Fan, Fan Yang, Ke Ma, +22 more

    Nature Machine Intelligence · 2021

    A privacy-preserving AI framework for CT-based COVID-19 diagnosis is presented and demonstrated on data from 23 hospitals in China and the United Kingdom, showing that the federated learning framework model considerably outperformed all of the local models.

    82
  • 3D Shape Matching via Two Layer Coding

    Xiang Bai, Song Bai, Zhuotun Zhu, Longin Jan Latecki

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2015

    81
  • An Empirical Study of End-to-End Temporal Action Detection

    Xiaolong Liu, Song Bai, Xiang Bai

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    A mid-resolution baseline detector is built, which achieves the state-of-the-art performance of end-to-end temporal action detection methods while running more than 4×faster.

    77
  • Adversarial Metric Attack and Defense for Person Re-Identification

    Song Bai, Yingwei Li, Yuyin Zhou, Qizhu Li, Philip H. S. Torr

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2020

    77
  • MOSEv2: A More Challenging Dataset for Video Object Segmentation in Complex Scenes

    Henghui Ding, Kaining Ying, Chang Liu, Shuting He, Xudong Jiang, Yu–Gang Jiang, Philip H. S. Torr, Song Bai

    arXiv · 2025

    This work presents MOSEv2, a significantly more challenging dataset designed to further advance VOS methods under real-world conditions, and benchmark 20 representative VOS methods under 5 different settings, highlighting that current VOS methods still fall short under real-world complexities.

    74
  • Liquid: Language Models are Scalable and Unified Multi-Modal Generators

    Junfeng Wu, Yi Jiang, Chuofan Ma, Yuliang Liu, Hengshuang Zhao, Zehuan Yuan, Song Bai, Xiang Bai

    International Journal of Computer Vision · 2026

    71
  • Regularized Diffusion Process for Visual Retrieval

    Song Bai, Xiang Bai, Qi Tian, Longin Jan Latecki

    Proceedings of the AAAI Conference on Artificial Intelligence · 2017

    A new variant o diffusion process, which also operates on a tensor product graph is proposed, defined in three equivalent formulations (regularization framework, iterative framework and limit framework, respectively), which theoretically explain how this kind of diffusion process can better reveal the intrinsic relationship between objects.

    70
  • View N-Gram Network for 3D Object Retrieval

    Xinwei He, Tengteng Huang, Song Bai, Xiang Bai

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2019

    Inspired by n-gram models in natural language processing, VNN divides the view sequence into a set of visual n- grams, which involve overlapping consecutive view sub-sequences, which helps to learn a discriminative global embedding for each 3D object.

    68
  • Learning to Holistically Detect Bridges From Large-Size VHR Remote Sensing Imagery

    Yansheng Li, Junwei Luo, Yongjun Zhang, Yihua Tan, Jin-Gang Yu, Song Bai

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2024

    This paper proposes a large-scale dataset named GLH-Bridge comprising 6,000 VHR RSIs sampled from diverse geographic locations across the globe and presents an efficient network for holistic bridge detection (HBD-Net) in large-size RSIs.

    65
  • Importance-Aware Semantic Segmentation in Self-Driving with Discrete Wasserstein Training

    Xiaofeng Liu, Yuzhuo Han, Song Bai, Yi Ge, Tianxing Wang, Xu Han, Site Li, Jane You, +1 more

    Proceedings of the AAAI Conference on Artificial Intelligence · 2020

    This paper proposes to incorporate the importance-aware inter-class correlation in a Wasserstein training framework by configuring its ground distance matrix by extending the ground metric to a linear, convex or concave increasing function w.r.t. pre-defined ground distance.

    65
  • Bipartite Graph Reasoning GANs for Person Image Generation

    Hao Tang, Song Bai, Philip H. S. Torr, Nicu Sebe

    British Machine Vision Conference (BMVC) · 2020

    A novel Bipartite Graph Reasoning GAN (BiGraphGAN) block aims to reason the crossing long-range relations between the source pose and the target pose in a bipartite graph, which mitigates some challenges caused by pose deformation.

    62
  • Large-Scale 3D Shape Retrieval from ShapeNet Core55

    Manolis Savva, Fisher Yu, Hao Su, Masaki Aono, Chen, Baoquan, Cohen-Or, Daniel, Weihong Deng, Hang Su, +13 more

    Eurographics · 2016

    This track aims to provide a benchmark to evaluate large-scale shape retrieval based on the ShapeNet dataset, using ShapeNet Core55, which provides more than 50 thousands models over 55 common categories in total for training and evaluating several algorithms.

    61
  • Regional Homogeneity: Towards Learning Transferable Universal Adversarial Perturbations Against Defenses

    Yingwei Li, Song Bai, Cihang Xie, Zhenyu Liao, Xiaohui Shen, Alan Yuille

    Lecture notes in computer science · 2020

    It is shown that a simple universal perturbation can fool a series of state-of-the-art defenses, and it is verified that regionally homogeneous perturbations can well transfer across different vision tasks.

    59
  • Holistically-Attracted Wireframe Parsing: From Supervised to Self-Supervised Learning

    Nan Xue, Tianfu Wu, Song Bai, Fudong Wang, Gui-Song Xia, Liangpei Zhang, Philip H. S. Torr

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2023

    58
  • Instance Segmentation of LiDAR Point Clouds

    Feihu Zhang, Chenye Guan, Jin Fang, Song Bai, Ruigang Yang, Philip H. S. Torr, Victor Adrian Prisacariu

    Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · 2020

    58
  • Lowis3D: Language-Driven Open-World Instance-Level 3D Scene Understanding

    Runyu Ding, Jihan Yang, Chuhui Xue, Wenqing Zhang, Song Bai, Xiaojuan Qi

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2024

    To tackle the localization challenge for novel classes in the open-world setting, this work develops debiased instance localization, which significantly improves the generalization capabilities of instance grouping and, thus, the ability to accurately locate novel objects.

    57
  • Neural Architecture Search for Lightweight Non-Local Networks

    Yingwei Li, Xiaojie Jin, Jieru Mei, Xiaochen Lian, Linjie Yang, Cihang Xie, Qihang Yu, Yuyin Zhou, +2 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2020

    This work proposes a Lightweight Non-Local (LightNL) block by squeezing the transformation operations and incorporating compact features, and proposes an efficient neural architecture search algorithm to learn an optimal configuration of LightNL blocks in an end-to-end manner.

    55
  • Knowledge Distillation as Efficient Pre-training: Faster Convergence, Higher Data-efficiency, and Better Transferability

    Ruifei He, Shuyang Sun, Jihan Yang, Song Bai, Xiaojuan Qi

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    This work investigates an alternative strategy for pre-training, namely Knowledge Distillation as Efficient Pre-training (KDEP), aiming to efficiently transfer the learned feature representation from existing pre-trained models to new student models for future downstream tasks.

    53
  • PlaneTR: Structure-Guided Transformers for 3D Plane Recovery

    Bin Tan, Nan Xue, Song Bai, Tianfu Wu, Gui-Song Xia

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2021

    A neural network built upon Transformers, namely PlaneTR, to simultaneously detect and reconstruct planes from a single image and achieves state-of-the-art performance on the ScanNet and NYUv2 datasets.

    52
  • Language Matters: A Weakly Supervised Vision-Language Pre-training Approach for Scene Text Detection and Spotting

    Chuhui Xue, Wenqing Zhang, Hao Yu, Shijian Lu, Philip H. S. Torr, Song Bai

    Lecture notes in computer science · 2022

    A weakly supervised pre-training method, oCLIP, which can acquire effective scene text representations by jointly learning and aligning visual and textual information and outperforms existing pre- training techniques consistently across multiple public datasets.

    51
  • Fourier Document Restoration for Robust Document Dewarping and Recognition

    Chuhui Xue, Zichen Tian, Fangneng Zhan, Shijian Lu, Song Bai

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    FDRNet is presented, a Fourier Document Restoration Network that can restore documents with different distortions and improve document recognition in a reliable and simpler manner and outperforms the state-of-the-art by large margins on both dewarping and text recognition tasks.

    44
  • Beyond diffusion process: Neighbor set similarity for fast re-ranking

    Xiang Bai, Song Bai, Xinggang Wang

    Information Sciences · 2015

    A simple yet effective method called Neighbor Set Similarity (NSS) is proposed, which is superior to both traditional pairwise similarity and diffusion process, and suggests that NSS is more suitable for large scale image retrieval than diffusion process.

    44
  • Learning Regional Attraction for Line Segment Detection

    Nan Xue, Song Bai, Fudong Wang, Gui-Song Xia, Tianfu Wu, Liangpei Zhang, Philip H. S. Torr

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2019

    The problem of line segment detection (LSD) as a problem of region coloring is posed, and an end-to-end framework to learn attraction field maps for raw input images, followed by a squeeze module to detect line segments is developed.

    39
  • Understanding and Mitigating Dimensional Collapse in Federated Learning

    Yujun Shi, Jian Liang, Wenqing Zhang, Chuhui Xue, Vincent Y. F. Tan, Song Bai

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2023

    35
  • Smooth Neighborhood Structure Mining on Multiple Affinity Graphs with Applications to Context-Sensitive Similarity

    Song Bai, Shaoyan Sun, Xiang Bai, Zhaoxiang Zhang, Qi Tian

    Lecture notes in computer science · 2016

    A new algorithm called Smooth Neighborhood (SN) is proposed that mines the neighborhood structure to satisfy the manifold assumption and is adjusted to tackle multiple affinity graphs by imposing a weight learning paradigm.

    34
  • Explicit Occlusion Reasoning for Multi-person 3D Human Pose Estimation

    Qihao Liu, Yi Zhang, Song Bai, Alan Yuille

    Lecture notes in computer science · 2022

    28
  • PV3D: A 3D Generative Model for Portrait Video Generation

    Zhongcong Xu, Jianfeng Zhang, Jun Hao Liew, Wenqing Zhang, Song Bai, Jiashi Feng, Mike Zheng Shou

    arXiv · 2022

    Pv3D is proposed, the first generative framework that can synthesize multi-view consistent portrait videos with high-quality appearance and geometry and is able to support many downstream applications such as animating static portraits and view-consistent video motion editing.

    28
  • Automatic Ensemble Diffusion for 3D Shape and Image Retrieval

    Song Bai, Zhichao Zhou, Jingdong Wang, Xiang Bai, Longin Jan Latecki, Qi Chuan Tian

    IEEE Transactions on Image Processing · 2018

    28
  • SHREC'18 track: 2D image-based 3D scene retrieval

    Hameed Abdul-Rashid, Juefei Yuan, Bo Li, Yijuan Lu, Song Bai, Xiang Bai, Ngoc Minh Bui, Minh N. Do, +18 more

    3DOR@Eurographics · 2018

    28
  • 2D Image-Based 3D Scene Retrieval

    Hameed Abdul-Rashid, Juefei Yuan, Bo Li, Yijuan Lu, Song Bai, Xiang Bai, Ngoc-Minh Bui, Minh N. Do, +18 more

    Eurographics · 2018

    28
  • Neural shape codes for 3D model retrieval

    Song Bai, Xiang Bai, Wenyu Liu, Fabio Roli

    Pattern Recognition Letters · 2015

    This work proposes a practical and effective way for applying Convolutional Neural Network to 3D model retrieval, by training the network with the depth projections of3D model.

    28
  • Image-to-Character-to-Word Transformers for Accurate Scene Text Recognition

    Chuhui Xue, Jiaxing Huang, Wenqing Zhang, Shijian Lu, Changhu Wang, Song Bai

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2023

    The proposed I2C2W outperforms the state-of-the-art by large margins for challenging scene text dataset with various curvature and perspective distortions and achieves very competitive recognition performance over multiple normal scene text datasets.

    27
  • An Improved Multi-View Convolutional Neural Network for 3D Object Retrieval

    Xinwei He, Song Bai, Jiajia Chu, Xiang Bai

    IEEE Transactions on Image Processing · 2020

    27
  • Wasserstein Loss With Alternative Reinforcement Learning for Severity-Aware Semantic Segmentation

    Xiaofeng Liu, Yunhong Lu, Xiongchang Liu, Song Bai, Site Li, Jane You

    IEEE Transactions on Intelligent Transportation Systems · 2020

    26
  • Location-Sensitive Visual Recognition with Cross-IOU Loss

    Kaiwen Duan, Lingxi Xie, Honggang Qi, Song Bai, Qingming Huang, Qi Chuan Tian

    arXiv · 2021

    25
  • DIRECT-3D: Learning Direct Text-to-3D Generation on Massive Noisy 3D Data

    Qihao Liu, Yi Zhang, Song Bai, Adam Kortylewski, Alan Yuilie

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    DIRECT-3D is a diffusion-based 3D generative model for creating high-quality 3D assets from text prompts that achieves state-of-the-art performance in both single-class generation and text-to-3D generation and can serve as a useful 3D geometric prior of objects.

    23
  • Supervised Phenotype Discovery From Multimodal Brain Imaging

    Weikang Gong, Song Bai, Ying‐Qiu Zheng, Stephen M. Smith, Christian F. Beckmann

    IEEE Transactions on Medical Imaging · 2022

    22
  • Multidimensional Scaling on Multiple Input Distance Matrices

    Song Bai, Xiang Bai, Longin Jan Latecki, Qi Tian

    Proceedings of the AAAI Conference on Artificial Intelligence · 2017

    This paper proposes a new algorithm called Multi-View Multidimensional Scaling (MVMDS) by considering each input distance matrix as one view, which can learn the weights of views automatically by exploring the consensus information and complementary nature of views.

    22
  • Dataset Condensation via Generative Model

    David Junhao Zhang, Heng Wang, Chuhui Xue, Rui Yan, Wenqing Zhang, Song Bai, Mike Zheng Shou

    arXiv · 2023

    This work proposes to condense the dataset into another format, a generative model, and is the first to successfully conduct condensation on ImageNet-1k.

    21
  • Timeexpert: an Expert-Guided Video Llm for Video Temporal Grounding

    Zuhao Yang, Yingchen Yu, Yunqing Zhao, Shijian Lu, Song Bai

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2025

    TimeExpert is introduced, a Mixture-of-Experts (MoE)-based Video-LLM that effectively decomposes VTG tasks by dynamically routing task-specific tokens to specialized experts, with increased computational efficiency.

    19
  • Feature context learning for human parsing

    Tengteng Huang, Yongchao Xu, Song Bai, Yongpan Wang, Xiang Bai

    Science China Information Sciences · 2019

    This paper proposes an end-to-end trainable, highly flexible and generic module called feature context module (FCM), which explores the correlation of adjacent pixels and aggregates the contextual information embedded in the real topology of the human body.

    19
  • Metric Attack and Defense for Person Re-identification

    Song Bai, Yingwei Li, Yuyin Zhou, Qizhu Li, Philip H. S. Torr

    arXiv · 2019

    This work proposes Adversarial Metric Attack, a parallel methodology to adversarial classification attacks, and presents an early attempt of training a metric-preserving network, thereby defending the metric against adversarial attacks.

    17
  • Semi-Supervised Multi-Organ Segmentation via Deep Multi-Planar Co-Training

    Yuyin Zhou, Yan Wang, Peng Tang, Song Bai, Wei Shen, Elliot K. Fishman, Alan Yuille

    arXiv · 2018

    17
  • Multiple Stage Residual Model for Image Classification and Vector Compression

    Song Bai, Xiang Bai, Wenyu Liu

    IEEE Transactions on Multimedia · 2016

    17
  • Visual Parser: Representing Part-whole Hierarchies with Transformers

    Shuyang Sun, Xiaoyu Yue, Song Bai, Philip H. S. Torr

    arXiv · 2021

    16
  • Discovering Failure Modes of Text-guided Diffusion Models via Adversarial Search

    Qihao Liu, Adam Kortylewski, Yutong Bai, Song Bai, Alan Yuille

    arXiv · 2023

    This work proposes SAGE, an adversarial attack on TDMs that uses image classifiers as surrogate loss functions, to search over the discrete prompt space and the high-dimensional latent space of TDMs to automatically discover unexpected behaviors and failure cases in the image generation.

    14
  • 2D Scene Sketch-Based 3D Scene Retrieval

    Juefei Yuan, Bo Li, Yijuan Lu, Song Bai, Xiang Bai, Ngoc-Minh Bui, Minh N. Do, Trong-Le Do, +17 more

    Eurographics · 2018

    The objective of this track is to evaluate the performance of different 2D scene sketch-based 3D scene retrieval algorithms using a 2D sketch query dataset and a 3D Warehouse model dataset and suggest several future research directions to tackle this research problem.

    14
  • Debiasing Text-to-Image Diffusion Models

    Ruifei He, Chuhui Xue, Haoru Tan, Wenqing Zhang, Yingchen Yu, Song Bai, Xiaojuan Qi

    Proceedings of the 1st ACM Multimedia Workshop on Multi-modal Misinformation Governance in the Era of Foundation Models · 2024

    This work formalizes the problem setting and uses the text descriptions of bias groups to establish an unsafe direction for guiding the diffusion process, and proposes an iterative distribution alignment (IDA) method, which shows efficiency and fast convergence in resolving the social bias in TTI diffusion models.

    13
  • Patch-based Separable Transformer for Visual Recognition

    Shuyang Sun, Xiaoyu Yue, Hengshuang Zhao, Philip H.S. Torr, Song Bai

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2022

    12
  • Learn to Interpret Atari Agents

    Yang, Zhao, Song Bai, Li Zhang, Philip H. S. Torr

    arXiv · 2018

    12
  • Improving context-sensitive similarity via smooth neighborhood for object retrieval

    Song Bai, Shaoyan Sun, Xiang Bai, Zhaoxiang Zhang, Qi Tian

    Pattern Recognition · 2018

    A new algorithm called Smooth Neighborhood (SN) is proposed that mines the neighborhood structure to satisfy the manifold assumption and can yield state-of-the-art performances on shape retrieval, image retrieval and 3D model retrieval.

    12
  • Training convolutional neural network from multi-domain contour images for 3D shape retrieval

    Zongxiao Zhu, Cong Rao, Song Bai, Longin Jan Latecki

    Pattern Recognition Letters · 2017

    This work takes 2D sketches and edge maps of 2D views of 3D models as a unified domain to train the Convolutional Neural Network (CNN), and shows that the CNN can successfully learn the object structure from different types of clues.

    12
  • Multiple Stage Residual Model for Accurate Image Classification

    Song Bai, Xinggang Wang, Cong Yao, Xiang Bai

    Lecture notes in computer science · 2015

    This paper proposes an effective and efficient model, which is called Multiple Stage Residual Model (MSRM), to make full use of the residual vector to generate a multiple stage code.

    12
  • Text4Seg++: Advancing Image Segmentation via Generative Language Modeling

    Mengcheng Lan, Chaofeng Chen, Jiaxing Xu, Zongrui Li, Yiping Ke, Xudong Jiang, Yingchen Yu, Yunqing Zhao, +1 more

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2026

    A novel text-as-mask paradigm that casts image segmentation as a text generation problem, eliminating the need for additional decoders and significantly simplifying the segmentation process is proposed, highlighting the effectiveness, scalability, and generalizability of text-driven image segmentation within the MLLM framework.

    11
  • LATFormer: Locality-Aware Point-View Fusion Transformer for 3D shape recognition

    Xinwei He, Silin Cheng, Dingkang Liang, Song Bai, Xi Wang, Yingying Zhu

    Pattern Recognition · 2024

    This work proposes a novel Locality-Aware Point-View Fusion Transformer (LATFormer) for 3D shape retrieval and classification and utilizes the LAF module to fuse the multi-scale features of the two modalities both bidirectionally and hierarchically to obtain more informative features.

    11
  • A comparison of methods for 3D scene shape retrieval

    Juefei Yuan, Hameed Abdul-Rashid, Bo Li, Yijuan Lu, Tobias Schreck, Song Bai, Xiang Bai, Ngoc-Minh Bui, +22 more

    Computer Vision and Image Understanding · 2020

    A comprehensive comparison of all the above methods and an additional new retrieval methods are performed by evaluating them on the two benchmarks to solicit state-of-the-art approaches.

    11
  • Progress and Prospects in 3D Generative AI: A Technical Overview including 3D human

    Song Bai, Jie Li

    arXiv · 2024

    The AI generated object models in 3D, followed by the generated 3D human models, and finally, the generated 3D human motions are discussed, culminating in a conclusive summary and a vision for the future.

    10
  • Free-ATM: Exploring Unsupervised Learning on Diffusion-Generated Images with Free Attention Masks

    David Junhao Zhang, Mutian Xu, Chuhui Xue, Wenqing Zhang, Xiaoguang Han, Song Bai, Mike Zheng Shou

    arXiv · 2023

    This work uncovers that diffusion models' cross-attention layers inherently provide annotation-free attention masks aligned with corresponding text inputs on generated images that can close the performance gap between unsupervised pretraining on synthetic data and real-world scenarios.

    9
  • InstMove: Instance Motion for Object-centric Video Segmentation

    Qihao Liu, Junfeng Wu, Yi Jiang, Xiang Bai, Alan Yuille, Song Bai

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023

    InstMove, which stands for Instance Motion for Object-centric Video Segmentation, mainly relies on instance-level motion information that is free from image feature embeddings, and features physical interpretations, making it more accurate and robust toward occlusion and fast-moving objects.

    9
  • LUMix: Improving Mixup by Better Modelling Label Uncertainty

    Shuyang Sun, Jie-Neng Chen, Ruifei He, Alan Yuille, Philip H.S. Torr, Song Bai

    arXiv · 2022

    This paper proposes LUMix, which models such uncertainty by adding label perturbation during training and can be universally applied to any deep networks, with minimal computational cost.

    8
  • Contextual Text Block Detection Towards Scene Text Understanding

    Chuhui Xue, Jiaxing Huang, Wenqing Zhang, Shijian Lu, Changhu Wang, Song Bai

    Lecture notes in computer science · 2022

    8
  • Adversarial Metric Attack for Person Re-identification.

    Song Bai, Yingwei Li, Yuyin Zhou, Qizhu Li, Philip H. S. Torr

    arXiv · 2019

    This work proposes Adversarial Metric Attack, a parallel methodology to adversarial classification attacks, which can effectively generate adversarial examples for re-ID, and expects that this work can facilitate the development of robust feature learning with the experimental conclusions.

    8
  • Author Correction: Advancing COVID-19 diagnosis with privacy-preserving collaboration in artificial intelligence

    Xiang Bai, Hanchen Wang, Liya Ma, Yongchao Xu, Jiefeng Gan, Ziwei Fan, Fan Yang, Ke Ma, +22 more

    Nature Machine Intelligence · 2022

    7
  • Reinforced Wasserstein Training for Severity-Aware Semantic Segmentation in Autonomous Driving

    Xiaofeng Liu, Yimeng Zhang, Xiongchang Liu, Song Bai, Site Li, Jane You

    arXiv · 2020

    7
  • GraphHP: A Hybrid Platform for Iterative Graph Processing

    Qun Chen, Song Bai, Zhanhuai Li, Gou, Zhiying, Bo Suo, Pan, Wei

    arXiv · 2017

    7
  • PVUW 2025 Challenge Report: Advances in Pixel-Level Understanding of Complex Videos in the Wild

    Henghui Ding, Chang Liu, Nikhila Ravi, Shuting He, Yunchao Wei, Song Bai, Philip H. S. Torr, Kehuan Song, +22 more

    IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · 2025

    6
  • Describe, Adapt and Combine: Empowering CLIP Encoders for Open-Set 3D Object Retrieval

    Zhichuan Wang, Yang Zhou, Zhe Liu, Rui Yu, Song Bai, Yi Wang, Xinwei He, Xiang Bai

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2025

    A simple yet effective framework named Describe, Adapt and Combine (DAC) is presented, which innovatively synergizes a CLIP model with a multi-modal large language model (MLLM) to learn generalized 3D representations, where the MLLM is used for dual purposes.

    6
  • Disaggregation Distillation for Person Search

    Yizhen Jia, Rong Quan, Haiyan Chen, Jiamei Liu, Yichao Yan, Song Bai, Jie Qin

    IEEE Transactions on Multimedia · 2024

    6
  • Deep Interactive Video Inpainting: An Invisibility Cloak for Harry Potter

    Cheng Chen, Jiayin Cai, Yao Guang Hu, Xu Tang, Xinggang Wang, Chun Yuan, Xiang Bai, Song Bai

    ACM International Conference on Multimedia (ACM MM) · 2021

    This is the first deep learning-based interactive video inpainting framework that only uses a free form of user input as guidance (i.e. scribbles) instead of mask annotations, which has academic, entertainment, and commercial value.

    6
  • AutoScale: Learning to Scale for Crowd Counting and Localization

    Chenfeng Xu, Dingkang Liang, Yongchao Xu, Song Bai, Wei Zhan, Xiang Bai, Masayoshi Tomizuka

    arXiv · 2019

    6
  • SHREC'18 Track: 2D Scene Sketch-Based 3D Scene Retrieval

    Juefei Yuan, Bo Li, Yijuan Lu, Song Bai, Xiang Bai, Ngoc Minh Bui, Minh N. Do, Trong Le Do, +17 more

    Aquila Digital Community (University of Southern Mississippi) · 2018

    6
  • YouMVOS: An Actor-centric Multi-shot Video Object Segmentation Dataset

    Donglai Wei, Siddhant Kharbanda, Sarthak Arora, Roshan Roy, Nishant Jain, Akash Palrecha, Tanav Shah, Shray Mathur, +10 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    5
  • Co-spectral for robust shape clustering

    Song Bai, Zhiyong Liu, Xiang Bai

    Pattern Recognition Letters · 2016

    A similarity fusion framework based on spectral analysis is proposed, which can automatically make use of the complementarity of various shape similarities based on a co-training framework and outperforms the state-of-the-art algorithms by a large margin.

    5
  • PartGLEE: A Foundation Model for Recognizing and Parsing Any Objects

    Junyi Li, Junfeng Wu, Wenzhe Zhao, Song Bai, Xiang Bai

    Lecture notes in computer science · 2024

    4
  • Occluded Video Instance Segmentation: Dataset and ICCV 2021 Challenge

    Jiyang Qi, Yan Gao, Yao Guang Hu, Xinggang Wang, Xiaoyu Liu, Xiang Bai, Serge Belongie, Alan Yuille, +2 more

    arXiv · 2021

    4
  • Aggregating contour fragments for shape classification

    Song Bai, Xinggang Wang, Xiang Bai

    Proceedings - International Conference on Image Processing · 2014

    4
  • I2C2W: Image-to-Character-to-Word Transformers for Accurate Scene Text Recognition

    Chuhui Xue, Huang, Jiaxing, Wenqing Zhang, Shijian Lu, Changhu Wang, Song Bai

    arXiv · 2021

    2
  • PVUW 2024 Challenge on Complex Video Understanding: Methods and Results

    Henghui Ding, Chang Liu, Yunchao Wei, Nikhila Ravi, Shuting He, Song Bai, Philip H. S. Torr, Deshui Miao, +22 more

    Lecture notes in computer science · 2025

    1
  • Runner-Up Solution to ECCV 2022 Challenge on Out of Vocabulary Scene Text Understanding: Cropped Word Recognition

    Zhangzi Zhu, Hao Yu, Wenqing Zhang, Chuhui Xue, Song Bai

    arXiv · 2022

    This report presents the 2nd place solution to ECCV 2022 challenge on Out-of-Vocabulary Scene Text Understanding (OOV-ST) : Cropped Word Recognition, which achieves a word accuracy of 59.45\% when considering out- of-vocabulary words only.

    1
  • LATFormer: Locality-Aware Point-View Fusion Transformer for 3D Shape Recognition

    Xinwei He, Silin Cheng, Dingkang Liang, Song Bai, Xi Wang, Yingying Zhu

    arXiv · 2021

    1
  • CAP-Net: Correspondence-Aware Point-view Fusion Network for 3D Shape Analysis.

    Xinwei He, Silin Cheng, Song Bai, Xiang Bai

    arXiv · 2021

    1
  • FedOCR: Communication-Efficient Federated Learning for Scene Text Recognition

    Wenqing Zhang, Yang Qiu, Song Bai, Rui Zhang, Xiaolin K. Wei, Xiang Bai

    arXiv · 2020

    1
  • MIS '24: 1st ACM Multimedia Workshop on Multi-modal Misinformation Governance in the Era of Foundation Models

    Shaojing Fan, Zheng Wang, Rui Shao, Song Bai, Hongyuan Zhu, Liqiang Nie, Shin’ichi Satoh

    Proceedings of the 1st ACM Multimedia Workshop on Multi-modal Misinformation Governance in the Era of Foundation Models · 2024

    This workshop brings together researchers and practitioners to discuss key topics in multi-modal misinformation governance, including new datasets, evaluation techniques, ethical considerations, methodological progress, case studies, and future research directions.

    –
  • Free-ATM: Harnessing Free Attention Masks for Representation Learning on Diffusion-Generated Images

    David Junhao Zhang, Mutian Xu, Jay Zhangjie Wu, Chuhui Xue, Wenqing Zhang, Xiaoguang Han, Song Bai, Mike Zheng Shou

    Lecture notes in computer science · 2024

    –
  • Guest Editorial: Introduction to the Special Section on Graphs in Vision and Pattern Analysis

    Song Bai, Philip H. S. Torr, Ranjay Krishna, Li Fei-Fei, Abhinav Gupta, Song‐Chun Zhu

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2023

    –
  • The Runner-up Solution for YouTube-VIS Long Video Challenge 2022

    Junfeng Wu, Yi Jiang, Qihao Liu, Xiang Bai, Song Bai

    arXiv · 2022

    This technical report describes the 2nd-place solution for the ECCV 2022 YouTube-VIS Long Video Challenge, which adopts the previously proposed online video instance segmentation method IDOL and uses pseudo labels to help contrastive learning.

    –
  • 1st Place Solution to ECCV 2022 Challenge on Out of Vocabulary Scene Text Understanding: End-to-End Recognition of Out of Vocabulary Words

    Zhangzi Zhu, Chuhui Xue, Hao Yu, Wenqing Zhang, Song Bai

    arXiv · 2022

    This report describes the solution to the Out of Vocabulary Scene Text Understanding (OOV-ST) Challenge, which aims to extract out-of-vocabulary words from natural scene images, and achieves 1st in end-to-end OOV word recognition track of OOV Challenge in ECCV2022 TiE Workshop.

    –
  • Contextual Text Detection

    Chuhui Xue, Jiaxing Huang, Wenqing Zhang, Shijian Lu, Song Bai, Changhu Wang

    2021

    –
  • Object Propagation via Inter-Frame Attentions for Temporally Stable Video Instance Segmentation

    Anirudh Srinivasan Chakravarthy, Won-Dong Jang, Zudi Lin, Donglai Wei, Song Bai, Hanspeter Pfister

    arXiv · 2021

    –
  • 教師付き平滑多様体上でのスケーラブルな人物再同定【Powered by NICT】

    Song Bai, Bai Xiang, Tian Qi

    IEEE Conference Proceedings · 2017

    –

Publication data from OpenAlex, with missing venues and authors filled in from Crossref; citation counts are the higher of OpenAlex and Semantic Scholar, last synced 2026-10-12. One-sentence summaries under some papers are written by Semantic Scholar’s model. Citation counts may be lower than on Google Scholar, which indexes more sources.

Report an error

Wrong papers, two people merged into one, or a profile that should not be here? Tell us and we will fix or hide it.

Sign in to report