Is this you? Claim this profile to correct it, add a bio and choose the work people see first.

Claim this profile

Academic lineage

Possible advisorsa guess from early papers, not confirmed

  • Shuicheng Yan

    Possible advisor · last author on 3 of their early first-author papers, 2015–2017

    Suggested from co-authorship
  • Wei Liu

    Possible advisor · last author on 3 of their early first-author papers, 2017–2019

    Suggested from co-authorship

Is this you? Claim this profile to confirm or dismiss it.

Works94 from public data

TitleCited by
  • Revisiting Dilated Convolution: A Simple Approach for Weakly- and Semi-Supervised Semantic Segmentation

    Yunchao Wei, Huaxin Xiao, Honghui Shi, Zequn Jie, Jiashi Feng, Thomas S. Huang

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2018

    It is found that varying dilation rates can effectively enlarge the receptive fields of convolutional kernels and more importantly transfer the surrounding discriminative information to non-discriminative object regions, promoting the emergence of these regions in the object localization maps.

    627
  • A Sufficient Condition for Convergences of Adam and RMSProp

    Fangyu Zou, Li Shen, Zequn Jie, Weizhong Zhang, Wei Liu

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2019

    An alternative easy-to-check sufficient condition is introduced, which merely depends on the parameters of the base learning rate and combinations of historical second-order moments, to guarantee the global convergence of generic Adam/RMSProp for solving large-scale non-convex stochastic optimization.

    470
  • Evaluation of Combined Artificial Intelligence and Radiologist Assessment to Interpret Screening Mammograms

    Thomas Schaffter, Diana S.M. Buist, Christoph I. Lee, Yaroslav V. Nikulin, Dezső Ribli, Yuanfang Guan, William E. Lotter, Zequn Jie, +22 more

    JAMA Network Open · 2020

    This diagnostic accuracy study evaluates whether artificial intelligence can overcome human mammography interpretation limits with a rigorous, unbiased evaluation of machine learning algorithms.

    409
  • Central Similarity Quantization for Efficient Image and Video Retrieval

    Li Yuan, Tao Wang, Xiaopeng Zhang, Francis EH Tay, Zequn Jie, Wei Liu, Jiashi Feng

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2020

    The Central Similarity Quantization (CSQ) is proposed, a new similarity metric with which the hash codes of similar data pairs are encouraged to approach a common center and those for dissimilar pairs to converge to different centers, to improve hash learning efficiency and retrieval accuracy.

    392
  • Temporally Grounding Natural Sentence in Video

    Jingyuan Chen, Xinpeng Chen, Lin Ma, Zequn Jie, Tat‐Seng Chua

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2018

    An effective and efficient method that grounds (i.e., localizes) natural sentences in long, untrimmed video sequences using a novel Temporal GroundNet to temporally capture the evolving fine-grained frame-by-word interactions between video and sentence.

    345
  • PromptDet: Towards Open-Vocabulary Detection Using Uncurated Images

    Chengjian Feng, Yujie Zhong, Zequn Jie, Xiangxiang Chu, Haibing Ren, Xiaolin K. Wei, Weidi Xie, Lin Ma

    Lecture notes in computer science · 2022

    The goal of this work is to establish a scalable pipeline for expanding an object detector towards novel/unseen categories, using zero manual annotations, and the proposed detector, termed as PromptDet, shows superior performance over existing approaches with fewer additional training images andzero manual annotations whatsoever.

    245
  • Joint Task-Recursive Learning for Semantic Segmentation and Depth Estimation

    Zhenyu Zhang, Zhen Cui, Chunyan Xu, Zequn Jie, Xiang Li, Jian Jun Yang

    Lecture notes in computer science · 2018

    A novel joint Task-Recursive Learning (TRL) framework for the closing-loop semantic segmentation and monocular depth estimation tasks and propagate previous learning experiences on both tasks into the next network evolution by explicitly concatenating previous responses.

    237
  • Deep Self-Taught Learning for Weakly Supervised Object Localization

    Zequn Jie, Yunchao Wei, Xiaojie Jin, Jiashi Feng, Wei Liu

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2017

    A deep self-taught learning approach is proposed, which makes the detector learn the object-level features reliable for acquiring tight positive samples and afterwards re-train itself based on them, which progressively improves its detection ability and localizes more informative positive samples.

    207
  • NMS by Representative Region: Towards Crowded Pedestrian Detection by Proposal Pairing

    Xin Huang, Zheng Ge, Zequn Jie, Osamu Yoshie

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2020

    A novel Representative Region NMS (R2NMS) approach leveraging the less occluded visible parts, effectively removing the redundant boxes without bringing in many false positives is proposed.

    197
  • Multi-View Image Generation from a Single-View

    Bo Zhao, Xiao Ying Wu, Zhi-Qi Cheng, Hao Liu, Zequn Jie, Jiashi Feng

    ACM International Conference on Multimedia (ACM MM) · 2018

    This paper proposes a novel image generation model termed VariGANs, which combines the merits of the variational inference and the Generative Adversarial Networks (GANs), and generates the target image in a coarse-to-fine manner instead of a single pass which suffers from severe artifacts.

    193
  • Video-Based Person Re-Identification With Accumulative Motion Context

    Hao Liu, Zequn Jie, Karlekar Jayashree, Meibin Qi, Jianguo Jiang, Shuicheng Yan, Jiashi Feng

    IEEE Transactions on Circuits and Systems for Video Technology · 2017

    The experimental results demonstrate that the proposed AMOC network outperforms state-of-the-arts for video-based re-identification significantly and confirm the advantage of exploiting long-range motion context forVideo-based person re-Identification, validating the motivation evidently.

    181
  • Policy Optimization with Demonstrations

    Bingyi Kang, Zequn Jie, Jiashi Feng

    International Conference on Machine Learning · 2018

    It is shown that POfD induces implicit dynamic reward shaping and brings provable benefits for policy improvement, and can be combined with policy gradient methods to produce state-of-the-art results, as demonstrated experimentally on a range of popular benchmark sparse-reward tasks.

    180
  • Neural Person Search Machines

    Hao Liu, Jiashi Feng, Zequn Jie, Karlekar Jayashree, Bo Zhao, Meibin Qi, Jianguo Jiang, Shuicheng Yan

    IEEE International Conference on Computer Vision (ICCV) · 2017

    Evaluations on two benchmark datasets have demonstrated that the Neural Person Search Machines (NPSM) developed can outperform current state-of-the-arts in both mAP and top-1 evaluation protocols.

    171
  • MSMDFusion: Fusing LiDAR and Camera at Multiple Scales with Multi-Depth Seeds for 3D Object Detection

    Yang Jiao, Zequn Jie, Shaoxiang Chen, Jingjing Chen, Lin Ma, Yu–Gang Jiang

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023

    A novel framework with better utilization of the depth information and fine-grained cross-modal interaction between LiDAR and camera is proposed, which consists of two important components and achieves state-of-the-art results on both 3D object detection and tracking tasks without using test-time-augmentation and ensemble techniques.

    152
  • CASNet: A Cross-Attention Siamese Network for Video Salient Object Detection

    Yuzhu Ji, Haijun Zhang, Zequn Jie, Lin Ma, Q. M. Jonathan Wu

    IEEE Transactions on Neural Networks and Learning Systems · 2020

    119
  • Video Scene Parsing with Predictive Feature Learning

    Xiaojie Jin, Xin Li, Huaxin Xiao, Xiaohui Shen, Zhe Lin, Jimei Yang, Yunpeng Chen, Jian Dong, +4 more

    IEEE International Conference on Computer Vision (ICCV) · 2017

    It is experimentally proved that the learned predictive features in the model are able to significantly enhance the video parsing performance by combining with the standard image parsing network.

    117
  • MTL-NAS: Task-Agnostic Neural Architecture Search Towards General-Purpose Multi-Task Learning

    Yuan Gao, Haoping Bai, Zequn Jie, Jiayi Ma, Kui Jia, Wei Liu

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2020

    A novel single-shot gradient-based search algorithm that closes the performance gap between the searched architectures and the final evaluation architecture and achieves a single model, which can be directly used for evaluation without (re-)training from scratch.

    113
  • LLaVA-MoLE: Sparse Mixture of LoRA Experts for Mitigating Data Conflicts in Instruction Finetuning MLLMs

    Shaoxiang Chen, Zequn Jie, Lin Ma

    arXiv · 2024

    Extensive experiments proved that LLaVA-MoLE effectively mitigates the data conflict issue when mixing multiple distinct instruction datasets with various configurations, and achieves consistent performance gains over the strong plain-LoRA baselines.

    107
  • Localizing Natural Language in Videos

    Jingyuan Chen, Lin Ma, Xinpeng Chen, Zequn Jie, Jiebo Luo

    Proceedings of the AAAI Conference on Artificial Intelligence · 2019

    A localizing network (LNet), working in an end-to-end fashion, to tackle the NLVL task, which first match the natural sentence and video sequence by cross-gated attended recurrent networks to exploit their fine-grained interactions and generate a sentence-aware video representation.

    107
  • Geometry-Aware Distillation for Indoor Semantic Segmentation

    Jianbo Jiao, Yunchao Wei, Zequn Jie, Honghui Shi, Rynson W. H. Lau, Thomas S. Huang

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2019

    100
  • Learning to segment with image-level annotations

    Yunchao Wei, Xiaodan Liang, Yunpeng Chen, Zequn Jie, Yanhui Xiao, Yao Zhao, Shuicheng Yan

    Pattern Recognition · 2016

    This paper explores a more challenging problem by learning to segment under image-level annotations by incorporating the hypotheses-aware classification and cross-image contextual refinement in a supervised manner, and proposes two network training strategies for achieving good segmentation performance.

    99
  • Left-Right Comparative Recurrent Model for Stereo Matching

    Zequn Jie, Pengfei Wang, Yonggen Ling, Bo Zhao, Yunchao Wei, Jiashi Feng, Wei Liu

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2018

    A novel left- right comparative recurrent model to perform left-right consistency checking jointly with disparity estimation and a soft attention mechanism is introduced, which employs the learned error maps for better guiding the model to selectively focus on refining the unreliable regions at the next recurrent step.

    89
  • Modular Generative Adversarial Networks

    Bo Zhao, Bo Chang, Zequn Jie, Leonid Sigal

    Lecture notes in computer science · 2018

    ModularGAN consists of several reusable and composable modules that carry on different functions that can be trained simultaneously, leveraging data from all domains, and then combined to construct specific GAN networks at test time, according to the specific image translation task.

    82
  • TimeMarker: A Versatile Video-LLM for Long and Short Video Understanding with Superior Temporal Localization Ability

    Shimin Chen, Lan, Xiaohan, Yitian Yuan, Zequn Jie, Lin Ma

    arXiv · 2024

    TimeMarker is introduced, a versatile Video-LLM designed for high-quality dialogue based on video content, emphasizing temporal localization, and achieves state-of-the-art performance across multiple benchmarks, excelling in both short and long video categories.

    81
  • Tree-Structured Reinforcement Learning for Sequential Object Localization

    Zequn Jie, Xiaodan Liang, Jiashi Feng, Xiaojie Jin, Wen Feng Lu, Shuicheng Yan

    arXiv · 2017

    71
  • Predicting Scene Parsing and Motion Dynamics in the Future

    Xiaojie Jin, Huaxin Xiao, Xiaohui Shen, Shuicheng Yan, Zhe Lin, Yunpeng Chen, Zequn Jie, Jiashi Feng, +1 more

    arXiv · 2017

    62
  • FoveaNet: Perspective-Aware Urban Scene Parsing

    Xin Yue Li, Zequn Jie, Wei Wang, Changsong Liu, Jimei Yang, Xiaohui Shen, Zhe Lin, Qiang Chen, +2 more

    IEEE International Conference on Computer Vision (ICCV) · 2017

    This work proposes a new FoveaNet model to fully exploit the perspective geometry of scene images and address the common failures of generic parsing models, and introduces a new dense CRFs model that takes the Perspective geometry as a prior potential.

    61
  • Reversible Recursive Instance-Level Object Segmentation

    Xiaodan Liang, Yunchao Wei, Xiaohui Shen, Zequn Jie, Jiashi Feng, Liang Lin, Shuicheng Yan

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2016

    This work proposes a novel Reversible Recursive Instance-level Object Segmentation (R2-IOS) framework that consists of a reversible proposal refinement sub-network that predicts bounding box offsets for refining the object proposal locations, and an instance-level segmentation sub- network that generates the foreground mask of the dominant object instance in each proposal.

    61
  • UniToken: Harmonizing Multimodal Understanding and Generation Through Unified Visual Encoding

    Yang Jiao, Haibo Qiu, Zequn Jie, Shaoxiang Chen, Jingjing Chen, Lin Ma, Yu–Gang Jiang

    IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · 2025

    55
  • InstaGen: Enhancing Object Detection by Training on Synthetic Dataset

    Chengjian Feng, Yujie Zhong, Zequn Jie, Weidi Xie, Lin Ma

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    This enhanced version of diffusion model, termed as InstaGen, can serve as a data synthe-sizer, to enhance object detectors by training on its generated samples, demonstrating superior performance over existing state-of-the-art methods in open-vocabulary and data-sparse scenarios.

    50
  • Learning Object-Wise Semantic Representation for Detection in Remote Sensing Imagery

    Chengzheng Li, Chunyan Xu, Zhen Cui, Dan Wang, Zequn Jie, Tong Zhang, Jian Yang

    CVPR Workshops · 2019

    An enhanced feature pyramid network is first designed to better extract hierarchical discriminative visual features to suppress background clutter as well as better estimate proposals, and specifically introduces a semantic segmentation module to guide horizontal proposals detection.

    49
  • Learning with rethinking: Recurrently improving convolutional neural networks through feedback

    Xin Shane Li, Zequn Jie, Jiashi Feng, Changsong Liu, Shuicheng Yan

    Pattern Recognition · 2018

    By adding a feedback layer and producing the emphasis vector, the model is able to recurrently boost the performance based on previous prediction, and can be employed to boost any pre-trained models.

    42
  • Weighted AdaGrad with Unified Momentum

    Fangyu Zou, Li Shen, Zequn Jie, Ju Sun, Wei Liu

    arXiv · 2018

    AdaUSM is proposed, which has the main characteristics that it incorporates a unified momentum scheme which covers both the heavy ball momentum and the Nesterov accelerated gradient momentum, and adopts a novel weighted adaptive learning rate that can unify the learning rates of AdaGrad, AccAdaGrad, Adam, and RMSProp.

    42
  • A Unified Analysis of AdaGrad With Weighted Aggregation and Momentum Acceleration

    Li Shen, Congliang Chen, Fangyu Zou, Zequn Jie, Ju Sun, Wei Liu

    IEEE Transactions on Neural Networks and Learning Systems · 2023

    40
  • PS-RCNN: Detecting Secondary Human Instances in a Crowd via Primary Object Suppression

    Zheng Ge, Zequn Jie, Xin Huang, Rong Xu, Osamu Yoshie

    IEEE International Conference on Multimedia and Expo (ICME) · 2020

    This work introduces a variant of two-stage detectors called PS-RCNN, which significantly improves recall and AP on CrowdHuman and Widerperson, and introduces a High Resolution RoI Align module to retain as much of fine-grained features of visible parts of the heavily occluded humans as possible.

    40
  • AlignSAM: Aligning Segment Anything Model to Open Context via Reinforcement Learning

    Duojun Huang, Xinyu Xiong, Jie Ma, Jichang Li, Zequn Jie, Lin Ma, Guanbin Li

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    A novel framework, termed AlignSAM, designed for automatic prompting for aligning SAM to an open context through reinforcement learning, which enables the generality of the SAM model across diverse downstream tasks while keeping its parameters frozen.

    39
  • Matten: Video Generation with Mamba-Attention

    Gao, Yu, Jiancheng Huang, Xiaopeng Sun, Zequn Jie, Yujie Zhong, Lin Ma

    arXiv · 2024

    This paper introduces Matten, a cutting-edge latent diffusion model with Mamba-Attention architecture for video generation that has competitive performance with the current Transformer-based and GAN-based models in benchmark performance, achieving superior FVD scores and efficiency.

    38
  • OV-DINO: Unified Open-Vocabulary Detection with Language-Aware Selective Fusion

    Hao Wang, Pengzhen Ren, Zequn Jie, Dong, Xiao, Chengjian Feng, Yinlong Qian, Lin Ma, Dongmei Jiang, +3 more

    arXiv · 2024

    A novel unified open-vocabulary detection method called OV-DINO is proposed, which is pre-trained on diverse large-scale datasets with language-aware selective fusion in a unified framework, and a Unified Data Integration pipeline is introduced to enable end-to-end training and eliminate noise from pseudo-label generation by unifying different data sources into detection-centric data format.

    38
  • Weakly Supervised Semantic Segmentation Via Progressive Patch Learning

    Jinlong Li, Zequn Jie, Xu Wang, Yu Zhou, Xiaolin K. Wei, Lin Ma

    IEEE Transactions on Multimedia · 2022

    A novel “Progressive Patch Learning” approach is proposed to improve the local details extraction of the classification, producing the CAM better covering the whole object rather than only the most discriminative regions as in CAMs obtained in conventional classification models.

    37
  • RoboTron-Drive: All-in-One Large Multimodal Model for Autonomous Driving

    Zhijian Huang, Chengjian Feng, Feng Yan, Baihui Xiao, Zequn Jie, Yujie Zhong, Xiaodan Liang, Lin Ma

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2025

    This work proposes RoboTron-Drive, a general large multimodal model designed to process diverse data inputs, such as images and multi-view videos, while performing a broad spectrum of AD tasks, including perception, prediction, and planning.

    36
  • ARMANI: Part-level Garment-Text Alignment for Unified Cross-Modal Fashion Design

    Xujie Zhang, Yu Sha, Michael Kampffmeyer, Zhenyu Xie, Zequn Jie, Chengwen Huang, Jianqing Peng, Xiaodan Liang

    ACM International Conference on Multimedia (ACM MM) · 2022

    This work argues that simply aligning texture and garment information is not sufficient to capture the semantics of the visual information and therefore proposes MaskCLIP, a unified cross-modal fashion designer with part-level garment-text alignment that outperforms existing state-of-the-art cross- modal image synthesis approaches.

    36
  • Investigating Compositional Challenges in Vision-Language Models for Visual Grounding

    Yunan Zeng, Yan Huang, Jinjin Zhang, Zequn Jie, Zhenhua Chai, Liang Wang

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    35
  • MORE: Multi-Order RElation Mining for Dense Captioning in 3D Scenes

    Yang Jiao, Shaoxiang Chen, Zequn Jie, Jingjing Chen, Lin Ma, Yu–Gang Jiang

    Lecture notes in computer science · 2022

    34
  • Bidirectional image-sentence retrieval by local and global deep matching

    Lin Ma, Wenhao Jiang, Zequn Jie, Xu Wang

    Neurocomputing · 2019

    The proposed local and global deep matching model outperforms the state-of-the-art bidirectional retrieval approaches on the Flickr8K, Flickr30K, and MSCOCO datasets and the image and sentence representations exploited in local andglobal levels are demonstrated to play synergic and complementary roles for biddirectional image-sentence retrieval.

    33
  • Expansion and Shrinkage of Localization for Weakly-Supervised Semantic Segmentation

    Jinlong Li, Zequn Jie, Xu Wang, Xiaolin Wei, Lin Ma

    neural information processing systems · 2022

    32
  • Multi-Path Feedback Recurrent Neural Networks for Scene Parsing

    Xiaojie Jin, Yunpeng Chen, Zequn Jie, Jiashi Feng, Shuicheng Yan

    Proceedings of the AAAI Conference on Artificial Intelligence · 2017

    This paper considers the scene parsing problem and proposes a novel Multi-Path Feedback recurrent neural network (MPF-RNN), which can enhance the capability of RNNs in modeling long-range context information at multiple levels and better distinguish pixels that are easy to confuse.

    32
  • AeDet: Azimuth-Invariant Multi-View 3D Object Detection

    Chengjian Feng, Zequn Jie, Yujie Zhong, Xiangxiang Chu, Lin Ma

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023

    A camera-decoupled virtual depth is introduced to unify the depth prediction for the images with different camera intrinsic parameters and the resultant detector is dubbed Azimith-equivariant Detector (AeDet), topping the recent multi-view 3D object detectors such as PETRv2 and BEVDepth by a large margin.

    31
  • Two-stage Visual Cues Enhancement Network for Referring Image Segmentation

    Yang Jiao, Zequn Jie, Weixin Luo, Jingjing Chen, Yu–Gang Jiang, Xiaolin K. Wei, Lin Ma

    ACM International Conference on Multimedia (ACM MM) · 2021

    Through the two-stage enhancement, the proposed TV-Net enjoys better performances in learning fine-grained matching behaviors between the natural language expression and image, especially when the visual information of the referent is inadequate, thus produces better segmentation results.

    31
  • Matching Image and Sentence with Multi-faceted Representations

    Lin Ma, Wenhao Jiang, Zequn Jie, Yu–Gang Jiang, Wei Liu

    IEEE Transactions on Circuits and Systems for Video Technology · 2019

    30
  • Curriculum Multi-Negative Augmentation for Debiased Video Grounding

    Xiaohan Lan, Yitian Yuan, Hong Chen, Xin Wang, Zequn Jie, Lin Ma, Zhi Wang, Wenwu Zhu

    Proceedings of the AAAI Conference on Artificial Intelligence · 2023

    This work proposes multiple negative augmentations in a hierarchical way, including cross-video augmentations from clip-/video-level, and self-shuffled augmentations with masks, to discourage the standard VG model's behavior of exploiting such temporal annotation biases and improve the model generalization ability.

    29
  • Anytime Recognition with Routing Convolutional Networks

    Zequn Jie, Peng Sun, Xin Shane Li, Jiashi Feng, Wei Liu

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2019

    29
  • Delving deep into the imbalance of positive proposals in two-stage object detection

    Zheng Ge, Zequn Jie, Xin Huang, Chengzheng Li, Osamu Yoshie

    Neurocomputing · 2020

    This work incorporates an R-CNN Gradient Annealing (RGA) strategy to enhance the impact of positive proposals in the early training stage and a set of Parallel R- CNN Modules (PRM) with different positive/negative sampling ratios during training on one same backbone to tackle imbalance issues.

    23
  • Joint Task-Recursive Learning for RGB-D Scene Understanding

    Zhenyu Zhang, Zhen Cui, Chunyan Xu, Zequn Jie, Xiang Li, Jian Jun Yang

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2019

    23
  • Multi-Path Feedback Recurrent Neural Network for Scene Parsing

    Xiaojie Jin, Yunpeng Chen, Jiashi Feng, Zequn Jie, Shuicheng Yan

    arXiv · 2016

    23
  • Multi View Action Recognition for Distracted Driver Behavior Localization

    Wei Zhou, Yinlong Qian, Zequn Jie, Lin Ma

    IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · 2023

    22
  • Object Proposal Generation With Fully Convolutional Networks

    Zequn Jie, Wen Feng Lu, Siavash Sakhavi, Yunchao Wei, Eng Hock Tay, Shuicheng Yan

    IEEE Transactions on Circuits and Systems for Video Technology · 2016

    22
  • Modeling Varying Camera-IMU Time Offset in Optimization-Based Visual-Inertial Odometry

    Yonggen Ling, Linchao Bao, Zequn Jie, Fengming Zhu, Ziyang Li, Shanmin Tang, Yongsheng Liu, Wei Liu, +1 more

    Lecture notes in computer science · 2018

    This work proposes a nonlinear optimization-based monocular visual inertial odometry (VIO) with varying camera-IMU time offset modeled as an unknown variable that is able to handle the rolling-shutter effects and imperfect sensor synchronization in a unified way.

    21
  • Weakly supervised semantic segmentation via self-supervised destruction learning

    Jinlong Li, Zequn Jie, Xu Wang, Yu Zhou, Lin Ma, Jianmin Jiang

    Neurocomputing · 2023

    19
  • Real-Time Referring Expression Comprehension by Single-Stage Grounding Network

    Xinpeng Chen, Lin Ma, Jingyuan Chen, Zequn Jie, Wei Liu, Jiebo Luo

    arXiv · 2018

    18
  • CLIP-GS: Unifying Vision-Language Representation with 3D Gaussian Splatting

    Siyu Jiao, Haoye Dong, Yuyang Yin, Zequn Jie, Yinlong Qian, Yao Zhao, Humphrey Shi, Yunchao Wei

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2025

    This paper introduces the GS Tokenizer to generate serialized gaussian tokens, which are then processed through transformer layers pre-initialized with weights from point cloud models, resulting in the 3DGS embeddings, and introduces an image voting loss to guide the directionality and convergence of gradient optimization.

    14
  • Making Large Language Models Better Planners with Reasoning-Decision Alignment

    Zhijian Huang, Tao Tang, Shaoxiang Chen, Sihao Lin, Zequn Jie, Lin Ma, Guangrun Wang, Xiaodan Liang

    Lecture notes in computer science · 2024

    14
  • Learnable Central Similarity Quantization for Efficient Image and Video Retrieval

    Li Yuan, Tao Wang, Xiaopeng Zhang, Francis E. H. Tay, Zequn Jie, Yonghong Tian, Wei Liu, Jiashi Feng

    IEEE Transactions on Neural Networks and Learning Systems · 2023

    14
  • A Pyramid Fusion MLP for Dense Prediction

    Qiuyu Huang, Zequn Jie, Lin Ma, Li Shen, Shenqi Lai

    IEEE Transactions on Image Processing · 2025

    13
  • Instance-Aware Multi-Camera 3D Object Detection with Structural Priors Mining and Self-Boosting Learning

    Yang Jiao, Zequn Jie, Shaoxiang Chen, Lechao Cheng, Jingjing Chen, Lin Ma, Yu–Gang Jiang

    Proceedings of the AAAI Conference on Artificial Intelligence · 2024

    13
  • Robust Scene Classification with Cross-Level LLC Coding on CNN Features

    Zequn Jie, Shuicheng Yan

    Lecture notes in computer science · 2015

    This framework first fine-tunes multi-level CNNs in a cascaded way, then extracts multi- level CNN features to learn a cross-level universal codebook, and finally performs locality-constrained linear coding (LLC) and max-pooling on the patches of all levels to form the final representation.

    13
  • Photo to Family Tree: Deep Kinship Understanding for Nuclear Family Photos

    Mengyin Wang, Jiashi Feng, Xiangbo Shu, Zequn Jie, Jinhui Tang

    Proceedings of the Joint Workshop of the 4th Workshop on Affective Social Multimedia Computing and first Multi-Modal Affective Computing of Large-Scale Multimedia Data · 2018

    This paper extends kinship recognition from two persons to a nuclear family consisting of multiple persons and proposes a novel Deep Kinship Recognition (DKR) framework, which gains superior performance on both Group-Face dataset and TSKinFace dataset, compared with state-of-the-arts.

    11
  • Suspected Objects Matter: Rethinking Model's Prediction for One-stage Visual Grounding

    Yang Jiao, Zequn Jie, Jingjing Chen, Lin Ma, Yu-Gang Jiang

    ACM International Conference on Multimedia (ACM MM) · 2023

    A Suspected Object Transformation mechanism (SOT), which can be seamlessly integrated into existing CNN and Transformer-based one-stage visual grounders to encourage the target object selection among the suspected ones.

    10
  • Fewer Tokens and Fewer Videos: Extending Video Understanding Abilities in Large Vision-Language Models

    Shimin Chen, Yitian Yuan, Shaoxiang Chen, Zequn Jie, Lin Ma

    arXiv · 2024

    This paper presents a cost-effective video-LVLM that enhances model architecture, introduces innovative training strategies, and identifies the most effective types of video instruction data, and delve into the influence of video instruction data in limited-resource settings.

    8
  • VidCompress: Memory-Enhanced Temporal Compression for Video Understanding in Large Language Models

    Xiaohan Lan, Yuan, Yitian, Zequn Jie, Lin Ma

    arXiv · 2024

    Experiments on several VideoQA datasets and comprehensive benchmarks demonstrate that VidCompress efficiently models complex temporal-spatial relations and significantly outperforms existing Video-LLMs.

    8
  • MT-Net Submission to the Waymo 3D Detection Leaderboard

    Shaoxiang Chen, Zequn Jie, Xiaolin K. Wei, Lin Ma

    arXiv · 2022

    This work designs a 2D backbone to utilize multi-scale features for better detecting objects with various sizes, together with an optimal transport-based target assignment strategy, which dynamically assigns richer supervision signals to the detection candidates.

    8
  • Image-level to Pixel-wise Labeling: From Theory to Practice

    Tiezhu Sun, Wei Zhang, Zhijie Wang, Lin Ma, Zequn Jie

    International Joint Conference on Artificial Intelligence · 2018

    Theoretically, the effects of image-level labels on pixel-wise segmentation from the perspective of information theory are analyzed and discussed, and in practice, an end-to-end segmentation model is built by fusing the image- level andpixel-wise labeling networks.

    8
  • Multiple Object Tracking Challenge Technical Report for Team MT_IoT

    Yan, Feng, Zhiheng Li, Weixin Luo, Zequn Jie, Liang, Fan, Xiaolin Wei, Lin Ma

    arXiv · 2022

    An improved human detector is designed and associated most of detection is associated most of detection to guarantee the integrity of the motion trajectory and a location-wise matching matrix is proposed to obtain more accurate trace matching.

    5
  • Central Similarity Hashing via Hadamard matrix.

    Yuan Li, Tao Wang, Xiaopeng Zhang, Zequn Jie, Francis E. H. Tay, Jiashi Feng

    arXiv · 2019

    A new hash center network (HCN) that learns hashing functions by optimizing the central similarity w.r.t.\ these hash centers is devised and can be applied for both image and video hashing.

    5
  • X-SAM: From Segment Anything to Any Segmentation

    Hao Wang, Limeng Qiao, Zequn Jie, Zhijian Huang, Chengjian Feng, Qingfang Zheng, Lin Ma, Xiangyuan Lan, +1 more

    Proceedings of the AAAI Conference on Artificial Intelligence · 2026

    4
  • Weakly-Supervised 3D Visual Grounding Based on Visual Language Alignment

    Xiaoxu Xu, Yitian Yuan, Qiudan Zhang, Wenhui Wu, Zequn Jie, Lin Ma, Xu Wang

    IEEE Transactions on Multimedia · 2025

    This work proposes 3D-VLA, a weakly supervised approach for 3D visual grounding based on Visual Language Alignment, which exploits the superior ability of current large-scale vision-language models on aligning the semantics between texts and 2D images, as well as the naturally existing correspondences between 2D images and 3D point clouds.

    4
  • MindBench: A Comprehensive Benchmark for Mind Map Structure Recognition and Analysis

    Lei Chen, Feng Yan, Yujie Zhong, Shaoxiang Chen, Zequn Jie, Lin Ma

    arXiv · 2024

    The new benchmark named MindBench is introduced, which not only includes meticulously constructed bilingual authentic or synthetic images, detailed annotations, evaluation metrics and baseline models, but also specifically designs five types of structured understanding and parsing tasks.

    4
  • Lumen: Unleashing Versatile Vision-Centric Capabilities of Large Multimodal Models

    Yang Jiao, Shaoxiang Chen, Zequn Jie, Jingjing Chen, Lin Ma, Yu–Gang Jiang

    neural information processing systems · 2024

    4
  • UniDiff: Advancing Vision-Language Models with Generative and Discriminative Learning

    Xiao ming Dong, Runhui Huang, Wei, Xiaoyong, Zequn Jie, Jianxing Yu, Jian Yin, Xiaodan Liang

    arXiv · 2023

    UniDiff is a unified multi-modal model that integrates image-text contrastive learning (ITC), text-conditioned image synthesis learning (IS), and reciprocal semantic consistency modeling (RSC) and effectively learns aligned semantics and mitigates the issue of semantic collapse during fine-tuning on small datasets.

    3
  • 3D Weakly Supervised Semantic Segmentation with 2D Vision-Language Guidance

    Xiaoxu Xu, Yitian Yuan, Jinlong Li, Qiudan Zhang, Zequn Jie, Lin Ma, Hao Tang, Nicu Sebe, +1 more

    Lecture notes in computer science · 2024

    2
  • Orthogonal Projection Subspace to Aggregate Online Prior-knowledge for Continual Test-time Adaptation

    Jinlong Li, Dong Yang Zhao, Qi Zang, Zequn Jie, Lin Ma, Nicu Sebe

    arXiv · 2025

    A novel pipeline, Orthogonal Projection Subspace to aggregate online Prior-knowledge, dubbed OoPk is proposed, which first project a tuning subspace orthogonally which allows the model to adapt to new domains while preserving the knowledge integrity of the pre-trained source model to alleviate catastrophic forgetting.

    1
  • FlexVAR: Flexible Visual Autoregressive Modeling without Residual Prediction

    Siyu Jiao, Gengwei Zhang, Yinlong Qian, Jiancheng Huang, Yao Zhao, Humphrey Shi, Lin Ma, Yunchao Wei, +1 more

    neural information processing systems · 2025

    1
  • Enhancing Robustness of Vision-Language Models through Orthogonality Learning and Self-Regularization

    Jinlong Li, Zhao, Dong, Zequn Jie, Elisa Ricci, Lin Ma, Nicu Sebe

    arXiv · 2024

    An orthogonal finetuning method for efficiently updating pretrained weights which enhances robustness and generalization, while a cross-regularization strategy is further exploited to maintain the stability in terms of zero-shot generalization of VLMs, dubbed OrthCR.

    1
  • MRStyle: A Unified Framework for Color Style Transfer with Multi-Modality Reference

    Jiancheng Huang, Yu Gao, Zequn Jie, Yujie Zhong, Xintong Han, Lin Ma

    arXiv · 2024

    The proposed MRStyle framework is a comprehensive framework that enables color style transfer using multi-modality reference, including image and text, and outperforms the state-of-the-art in both qualitative and quantitative evaluations.

    1
  • Accurate On-Road Vehicle Detection with Deep Fully Convolutional Networks

    Zequn Jie, Wen Feng Lu, Eng Hock Tay

    Lecture notes in computer science · 2016

    This paper presents a framework utilizing fully convolutional networks (FCN) to produce bounding boxes with high confidence to contain a vehicle, and bounding box location refinement with SVM to further improve localization accuracy.

    1
  • Vorch-Omni: Multi-Task Orchestration of Sight and Sound

    Vorch Team, Xiaoyu Chen, Yang Ding, Cong Han, Menglin Han, Yuxin Hong, Jiebo Hou, Zequn Jie, +20 more

    arXiv · 2026

    –
  • Video-MOPD: Multi-Teacher On-Policy Distillation for Video Understanding

    Zhenxin Qin, Peng Shi, Cong Han, Yinlong Qian, Zequn Jie, Lin Ma

    arXiv · 2026

    –
  • M4V: Multimodal Mamba for Efficient Text-to-Video Generation

    Jiancheng Huang, Gengwei Zhang, Zequn Jie, Siyu Jiao, Qian, Yinlong, Chen, Ling, Yunchao Wei, Lin Ma

    arXiv · 2025

    –
  • Cross-Modal Attention Calibration for LVLM Hallucination Mitigation

    Jiaming Li, Jiacheng Zhang, Zequn Jie, Lin Ma, Guanbin Li

    arXiv · 2025

    –
  • Enhancing Video-Language Alignment Via Mining Entity Knowledge

    Cong Wang, Xiao Dong, Jiaxi Gu, Youpeng Wen, Runhui Hunag, Jianhua Han, Hang Xu, Zequn Jie, +3 more

    SSRN Electronic Journal · 2024

    –
  • RecFormer: Recurrent Multi-modal Transformer with History-Aware Contrastive Learning for Visual Dialog

    Liucun Lu, Jinghui Qin, Zequn Jie, Lin Ma, Liang Lin, Xiaodan Liang

    Lecture notes in computer science · 2023

    –
  • Suspected Object Matters: Rethinking Model's Prediction for One-stage Visual Grounding

    Yang Jiao, Zequn Jie, Jingjing Chen, Lin Ma, Yu–Gang Jiang

    arXiv · 2022

    –
  • Delving into the Imbalance of Positive Proposals in Two-stage Object Detection

    Zheng Ge, Zequn Jie, Xin Huang, Chengzheng Li, Osamu Yoshie

    arXiv · 2020

    –
  • Li Yuan, Tao Wang, Xiaopeng Zhang, Francis EH Tay, Zequn Jie, Wei Liu, Jiashi Feng

    Yuan Li, Tao Wang, Xiaopeng Zhang, Zequn Jie, Francis EH Tay, Jiashi Feng

    arXiv · 2019

    –
  • Central Similarity Hashing for Efficient Image and Video Retrieval

    Yuan Li, Tao Wang, Xiaopeng Zhang, Zequn Jie, Francis EH Tay, Jiashi Feng

    arXiv · 2019

    The Central Similarity Hashing (CSH) is proposed, a new similarity metric with which the hash codes for similar data pairs are encouraged to approach a common center and those for dissimilar pairs to converge to different centers to improve hash learning efficiency and retrieval accuracy.

    –

Publication data from OpenAlex, with missing venues and authors filled in from Crossref; citation counts are the higher of OpenAlex and Semantic Scholar, last synced 2026-10-14. One-sentence summaries under some papers are written by Semantic Scholar’s model. Citation counts may be lower than on Google Scholar, which indexes more sources.

Report an error

Wrong papers, two people merged into one, or a profile that should not be here? Tell us and we will fix or hide it.

Sign in to report