Is this you? Claim this profile to correct it, add a bio and choose the work people see first.

Claim this profile

Academic lineage

Possible advisorsa guess from early papers, not confirmed

  • Rongrong Ji

    Possible advisor · last author on 4 of their early first-author papers, 2021–2023

    Suggested from co-authorship

Is this you? Claim this profile to confirm or dismiss it.

Works138 from public data

TitleCited by
  • MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework

    Sirui Hong, Zhuge, Mingchen, Chen, Jiaqi, Xiawu Zheng, Yuheng Cheng, Ceyao Zhang, Jinlin Wang, Zili Wang, +7 more

    arXiv · 2023

    MetaGPT is introduced, an innovative framework that incorporates efficient human workflows as a meta programming approach into LLM-based multi-agent collaboration and leverages the assembly line paradigm to assign diverse roles to various agents, thereby establishing a framework that can effectively and cohesively deconstruct complex multi- agent collaborative problems.

    2,626
  • Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis

    Chaoyou Fu, Yuhan Dai, Yongdong Luo, Lei Li, Shuhuai Ren, Renrui Zhang, Zihan Wang, Chenyu Zhou, +13 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2025

    Video-MME is introduced, the first-ever full-spectrum, Multi-Modal Evaluation benchmark of MLLMs in Video analysis, and it is revealed that Gemini 1.5 Pro is the best-performing commercial model, significantly outperforming the open-source models with an average accuracy of 75%, compared to 71.9% for GPT-4o.

    1,687
  • VITA: Towards Open-Source Interactive Omni Multimodal LLM

    Chaoyou Fu, Haojia Lin, Zuwei Long, Yunhang Shen, Dai, Yuhang, Zhao Meng, Zhang, Yi-Fan, Dong, Shaoqi, +11 more

    arXiv · 2024

    VITA, the first-ever open-source Multimodal Large Language Model (MLLM) adept at simultaneous processing and analysis of Video, Image, Text, and Audio modalities, and meanwhile has an advanced multimodal interactive experience is introduced.

    204
  • MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Models

    Chaoyou Fu, Peixian Chen, Yunhang Shen, Yulei Qin, Mengdan Zhang, Lin Xu, Jinrui Yang, Xiawu Zheng, +6 more

    neural information processing systems · 2025

    143
  • Feast Your Eyes: Mixture-of-Resolution Adaptation for Multimodal Large Language Models

    Gen Luo, Yiyi Zhou, Yuxin Zhang, Xiawu Zheng, Xiaoshuai Sun, Rongrong Ji

    arXiv · 2024

    This work proposes a novel and efficient method for MLLMs, termed Mixture-of-Resolution Adaptation (MRA), which adopts two visual pathways for images with different resolutions, where high-resolution visual information is embedded into the low-resolution pathway via the novel mixture-of-resolution adapters (MR-Adapters).

    120
  • Meta Architecture for Point Cloud Analysis

    Haojia Lin, Xiawu Zheng, Lijiang Li, Fei Chao, Shanshan Wang, Yan Wang, Yonghong Tian, Rongrong Ji

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023

    This paper takes the initiative to explore and propose a unified framework called PointMeta, to which the popular 3D point cloud analysis approaches could fit, and shows very strong performance in efficiency and effectiveness through extensive experiments on challenging benchmarks, and verifies the necessity and benefits of high-level interpretation, contrast, and comparison like PointMeta.

    115
  • Multinomial Distribution Learning for Effective Neural Architecture Search

    Xiawu Zheng, Rongrong Ji, Lang Tang, Baochang Zhang, Jianzhuang Liu, Qi Chuan Tian

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2019

    A Multinomial Distribution Learning for extremely effective NAS is proposed, which considers the search space as a joint multinomial distribution, and the optimal network structure is obtained by the operations with the most likely probability in this distribution.

    115
  • FastVGGT: Training-Free Acceleration of Visual Geometry Transformer

    You Shen, Zhipeng Zhang, Yansong Qu, Xiawu Zheng, Ji, Jiayi, Shengchuan Zhang, Liujuan Cao

    arXiv · 2025

    This work proposes FastVGGT, which, for the first time, leverages token merging in the 3D domain through a training-free mechanism for accelerating VGGT, and devise a unique token partitioning strategy tailored to 3D architectures and tasks.

    108
  • PAMS: Quantized Super-Resolution via Parameterized Max Scale

    Huixia Li, Chenqian Yan, Shaohui Lin, Xiawu Zheng, Baochang Zhang, Fan Yang, Rongrong Ji

    Lecture notes in computer science · 2020

    A new quantization scheme termed PArameterized Max Scale (PAMS), which applies the trainable truncated parameter to explore the upper bound of the quantization range adaptively and a structured knowledge transfer (SKT) loss is introduced to fine-tune the quantized network.

    104
  • AutoDiffusion: Training-Free Optimization of Time Steps and Architectures for Automated Diffusion Model Acceleration

    Lijiang Li, Huixia Li, Xiawu Zheng, Jie Wu, Xuefeng Xiao, Rui Wang, Min Jing Zheng, Xin Pan, +2 more

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2023

    This work designs a unified search space that consists of all possible time steps and various architectures and introduces a two stage evolutionary algorithm to find the optimal solution in the designed search space.

    94
  • Data-Efficient Image Quality Assessment with Attention-Panel Decoder

    Guanyi Qin, Runze Hu, Yutao Liu, Xiawu Zheng, Haotian Liu, Xiu Li, Yan Zhang

    Proceedings of the AAAI Conference on Artificial Intelligence · 2023

    94
  • Towards Optimal Fine Grained Retrieval via Decorrelated Centralized Loss with Normalize-Scale Layer

    Xiawu Zheng, Rongrong Ji, Xiaoshuai Sun, Baochang Zhang, Yongjian Wu, Feiyue Huang

    Proceedings of the AAAI Conference on Artificial Intelligence · 2019

    A novel metric learning scheme, termed Normalize-Scale Layer and Decorrelated Global Centralized Ranking Loss, which achieves extremely efficient and discriminative learning, i.e., 5× speedup over triplet loss and 12% recall boost on CARS196.

    77
  • Cantor: Inspiring Multimodal Chain-of-Thought of MLLM

    Timin Gao, Peixian Chen, Mengdan Zhang, Chaoyou Fu, Yunhang Shen, Yan Zhang, Shengchuan Zhang, Xiawu Zheng, +3 more

    ACM International Conference on Multimedia (ACM MM) · 2024

    It is argued that converging visual context acquisition and logical reasoning is pivotal for tackling visual reasoning tasks and an innovative multimodal CoT framework, termed Cantor, characterized by a perception-decision architecture is proposed, demonstrating the efficacy of the proposed framework.

    74
  • AffineQuant: Affine Transformation Quantization for Large Language Models

    Yuexiao Ma, Huixia Li, Xiawu Zheng, Ling, Feng, Xuefeng Xiao, Rui Wang, Shilei Wen, Fei Chao, +1 more

    arXiv · 2024

    This paper advocates for the direct optimization using equivalent Affine transformations in PTQ (AffineQuant) using the corresponding inverse matrix to ensure equivalence between the pre- and post-quantization outputs of PTQ, thereby maintaining its efficiency and generalization capabilities.

    72
  • OMPQ: Orthogonal Mixed Precision Quantization

    Yuexiao Ma, Taisong Jin, Xiawu Zheng, Yan Wang, Huixia Li, Yongjian Wu, Guannan Jiang, Wei Zhang, +1 more

    Proceedings of the AAAI Conference on Artificial Intelligence · 2023

    This work proposes to optimize a proxy metric of network orthogonality that can be efficiently solved with linear programming, which proves to be highly correlated with quantized model accuracy and bit-width and achieves high accuracy without compromise on quantization accuracy.

    72
  • Training-free Transformer Architecture Search

    Qinqin Zhou, Kekai Sheng, Xiawu Zheng, Ke Li, Xing Sun, Yonghong Tian, Jie Chen, Rongrong Ji

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    Experimental results demonstrate that the TF- TAS achieves a competitive performance against the state-of-the-art manually or automatically design ViT architectures, and it promotes the searching efficiency in ViT search space greatly.

    68
  • Centralized Ranking Loss with Weakly Supervised Localization for Fine-Grained Object Retrieval

    Xiawu Zheng, Rongrong Ji, Xiaoshuai Sun, Yongjian Wu, Feiyue Huang, Yanhua Yang

    International Joint Conference on Artificial Intelligence · 2018

    A novel centralized ranking loss (CRL) is introduced, which achieves a very efficient (1,000times training speedup comparing to the triplet loss) and discriminative feature learning by a ?

    63
  • Video-MME-v2: Towards the Next Stage in Benchmarks for Comprehensive Video Understanding

    Chaoyou Fu, Haozhi Yuan, Yuhao Dong, Yi-Fan Zhang, Yunhang Shen, Xiaoxing Hu, Xueying Li, Jinsen Su, +11 more

    arXiv · 2026

    This work introduces Video-MME-v2, a comprehensive benchmark designed to rigorously evaluate the robustness and faithfulness of video understanding, and designs a progressive tri-level hierarchy that incrementally increases the complexity of video comprehension.

    53
  • MIGO-NAS: Towards Fast and Generalizable Neural Architecture Search

    Xiawu Zheng, Rongrong Ji, Yuhang Chen, Qiang Wang, Baochang Zhang, Jie Chen, Qixiang Ye, Feiyue Huang, +1 more

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2021

    48
  • Knowledge Prompt-tuning for Sequential Recommendation

    Jianyang Zhai, Xiawu Zheng, Chang‐Dong Wang, Hui Li, Yonghong Tian

    ACM International Conference on Multimedia (ACM MM) · 2023

    This work introduces an external knowledge base and proposes Knowledge Prompt-tuning for Sequential Recommendation (KP4SR), which improves NDCG@5 and HR@5 by 40.65% and 36.65%, and proposes a knowledge tree mask, which restores the data structure in a mask matrix form, thus mitigating the noise problem.

    46
  • Solving the Catastrophic Forgetting Problem in Generalized Category Discovery

    Xinzi Cao, Xiawu Zheng, Guanhong Wang, Weijiang Yu, Yunhang Shen, Ke Li, Yutong Lu, Yonghong Tian

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    This work designs a novel learning approach, LegoGCD, which is seamlessly integrated into previous methods to enhance the discrimination of novel classes while maintaining performance on previously encountered known classes and effectively addresses the known category forgetting issue across all datasets.

    43
  • Long-VITA: Scaling Large Multi-modal Models to 1 Million Tokens with Leading Short-Context Accuracy

    Shen, Yunhang, Chaoyou Fu, Dong, Shaoqi, Wang, Xiong, Zhang, Yi-Fan, Peixian Chen, Mengdan Zhang, Haoyu Cao, +9 more

    arXiv · 2025

    An effective multi-modal training schema that starts with large language models and proceeds through vision-language alignment, general knowledge learning, and two sequential stages of long-sequence fine-tuning to serve as a competitive baseline and offer valuable insights for the open-source community in advancing long-context multi-modal understanding.

    40
  • An Information Theory-Inspired Strategy for Automated Network Pruning

    Xiawu Zheng, Yuexiao Ma, Teng Xi, Gang Zhang, Errui Ding, Yuchao Li, Jie Chen, Yonghong Tian, +1 more

    International Journal of Computer Vision · 2025

    This paper introduces a new theorem to illustrate that the hidden representation should compress information with each other to achieve a better generalization, and provides rigorous proof to reveal that optimizing the normalized HSIC simultaneously minimizes the mutual information between different layers.

    36
  • Data Interpreter: An LLM Agent for Data Science

    Sirui Hong, Yizhang Lin, Bang Liu, Bangbang Liu, Binhao Wu, Ceyao Zhang, Danyang Li, Jiaqi Chen, +20 more

    Findings of the Association for Computational Linguistics: ACL 2025 · 2025

    36
  • UI-AGILE: Advancing GUI Agents with Effective Reinforcement Learning and Precise Inference-Time Grounding

    Lian, Shuquan, Yuhang Wu, Jia Ma, Yifan Ding, Zihan Song, Bingqi Chen, Xiawu Zheng, Yongjie Li, +1 more

    arXiv · 2025

    UI-AGILE is introduced, a suite of improvements to the Reinforcement Fine-Tuning process to balance planning with speed and grounding accuracy, and a cropping-based resampling strategy to mitigate the sparse reward problem and improve learning on complex tasks.

    34
  • Automatic Network Pruning via Hilbert-Schmidt Independence Criterion Lasso under Information Bottleneck Principle

    Song Guo, Lei Zhang, Xiawu Zheng, Yan Wang, Yuchao Li, Fei Chao, Chenglin Wu, Shengchuan Zhang, +1 more

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2023

    33
  • Rethinking Performance Estimation in Neural Architecture Search

    Xiawu Zheng, Rongrong Ji, Qiang Wang, Qixiang Ye, Zhenguo Li, Yonghong Tian, Qi Chuan Tian

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2020

    This paper provides a novel yet systematic rethinking of PE in a resource constrained regime, termed budgeted PE (BPE), which precisely and effectively estimates the performance of an architecture sampled from an architecture space.

    32
  • DDPNAS: Efficient Neural Architecture Search via Dynamic Distribution Pruning

    Xiawu Zheng, Chenyi Yang, Shaokun Zhang, Yan Wang, Baochang Zhang, Yongjian Wu, Yunsheng Wu, Ling Shao, +1 more

    International Journal of Computer Vision · 2023

    This paper proposes an efficient and unified NAS framework termed DDPNAS via dynamic distribution pruning, facilitating a theoretical bound on accuracy and efficiency and directly obtains the optimal neural architectures on given constraints, practical for on-device models across diverse search spaces and constraints.

    30
  • Multimodal Quantitative Language for Generative Recommendation

    Jianyang Zhai, Zi-Feng Mai, Chang‐Dong Wang, Feidiao Yang, Xiawu Zheng, Hui Li, Yonghong Tian

    arXiv · 2025

    This work proposes a novel approach called Multimodal Quantitative Language for Generative Recommendation (MQL4GRec), which aims to transform items from different domains and modalities into a unified language, which can serve as a bridge for transferring recommendation knowledge.

    29
  • Binarized Neural Architecture Search

    Hanlin Chen, Li’an Zhuo, Baochang Zhang, Xiawu Zheng, Jianzhuang Liu, David Doermann, Rongrong Ji

    Proceedings of the AAAI Conference on Artificial Intelligence · 2020

    This work introduces channel sampling and operation space reduction into a differentiable NAS to significantly reduce the cost of searching and achieves a performance comparable to NAS on both CIFAR and ImageNet databases.

    29
  • Motion-aware Latent Diffusion Models for Video Frame Interpolation

    Zhilin Huang, Yijie Yu, Ling Yang, Chujun Qin, Bing Zheng, Xiawu Zheng, Zikun Zhou, Yaowei Wang, +1 more

    ACM International Conference on Multimedia (ACM MM) · 2024

    A novel diffusion framework, Motion-Aware latent Diffusion models (MADiff), which is specifically designed for the VFI task and achieves state-of-the-art performance significantly outperforming existing approaches, especially under challenging scenarios involving dynamic textures with complex motion.

    28
  • Solving Oscillation Problem in Post-Training Quantization Through a Theoretical Perspective

    Yuexiao Ma, Huixia Li, Xiawu Zheng, Xuefeng Xiao, Rui Wang, Shilei Wen, Xin Pan, Fei Chao, +1 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023

    This paper first formulate the oscillation in PTQ and prove the problem is caused by the difference in module capacity, and then tries to solve this problem by introducing a principled and generalized frame-work theoretically.

    28
  • A Unified Framework for Soft Threshold Pruning

    Yanqi Chen, Zhengyu Ma, Wei Fang, Xiawu Zheng, Zhaofei Yu, Yonghong Tian

    arXiv · 2023

    This work reformulates soft threshold pruning as an implicit optimization problem solved using the Iterative Shrinkage-Thresholding Algorithm (ISTA), a classic method from the fields of sparse recovery and compressed sensing, and derives a family of pruning methods, including sparsify-during-training, early pruning, and pruning at initialization.

    28
  • Training-Free Transformer Architecture Search With Zero-Cost Proxy Guided Evolution

    Qinqin Zhou, Kekai Sheng, Xiawu Zheng, Ke Li, Yonghong Tian, Jie Chen, Rongrong Ji

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2024

    27
  • Flow caching for autoregressive video generation

    Yuexiao Ma, Xuzhe Zheng, Jing Xu, Xiwei Xu, Feng Ling, Xiawu Zheng, Huafeng Kuang, Huixia Li, +4 more

    arXiv · 2026

    FlowCache is presented, the first caching framework specifically designed for autoregressive video generation, which introduces a chunkwise caching strategy that dynamically adapts to the unique denoising characteristics of each chunk, complemented by a joint importance-redundancy optimized KV cache compression mechanism that maintains fixed memory bounds while preserving generation quality.

    26
  • Discover and Align Taxonomic Context Priors for Open-world Semi-Supervised Learning

    Yu Wang, Zhun Zhong, Pengchong Qiao, Xuxin Cheng, Xiawu Zheng, Chang Liu, Nicu Sebe, Rongrong Ji, +1 more

    neural information processing systems · 2023

    25
  • Neural Architecture Search with Representation Mutual Information

    Xiawu Zheng, Xiang Fei, Lei Zhang, Chenglin Wu, Fei Chao, Jianzhuang Liu, Wei Zeng, Yonghong Tian, +1 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    24
  • You only compress once: Towards effective and elastic BERT compression via exploit–explore stochastic nature gradient

    Shaokun Zhang, Xiawu Zheng, Guilin Li, Chenyi Yang, Yuchao Li, Yan Wang, Fei Chao, Mengdi Wang, +2 more

    Neurocomputing · 2024

    A novel approach, YOCO-BERT, to achieve compress once and deploy everywhere and proposes a novel stochastic nature gradient optimization method to guide the generation of optimal candidate architecture which could keep a balanced trade-off between explorations and exploitation.

    23
  • Event-Diffusion: Event-Based Image Reconstruction and Restoration with Diffusion Models

    Quanmin Liang, Xiawu Zheng, Kai Huang, Yan Zhang, Jie Chen, Yonghong Tian

    ACM International Conference on Multimedia (ACM MM) · 2023

    It is argued that the key to event-based image reconstruction is to enhance the edge information of objects and restore the artifacts in the reconstructed images, and a new framework which incorporate it into the reconstruction pipeline to obtain high-quality results which effectively remove artifacts and blur in reconstructed images.

    23
  • Binarized Neural Architecture Search for Efficient Object Recognition

    Hanlin Chen, Li’an Zhuo, Baochang Zhang, Xiawu Zheng, Jianzhuang Liu, Rongrong Ji, David Doermann, Guodong Guo

    International Journal of Computer Vision · 2020

    Binarized neural architecture search (BNAS), with a search space of binarized convolutions, is introduced to produce extremely compressed models to reduce huge computational cost on embedded devices for edge computing.

    23
  • Uncovering the Over-Smoothing Challenge in Image Super-Resolution: Entropy-Based Quantification and Contrastive Optimization

    Tianshuo Xu, Lijiang Li, Peng Mi, Xiawu Zheng, Fei Chao, Rongrong Ji, Yonghong Tian, Qiang Shen

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2024

    This paper proposes an explicit solution to the center-oriented optimization (COO) problem, called Detail Enhanced Contrastive Loss (DECLoss), which utilizes the clustering property of contrastive learning to directly reduce the variance of the potential high-resolution distribution and thereby decrease the entropy.

    21
  • Aggregating Global and Local Visual Representation for Vehicle Re-IDentification

    Xianming Lin, Run Li, Xiawu Zheng, Pai Peng, Yongjian Wu, Feiyue Huang, Rongrong Ji

    IEEE Transactions on Multimedia · 2020

    20
  • Determining Layer-wise Sparsity for Large Language Models Through a Theoretical Perspective

    Huang, Weizhong, Yuxin Zhang, Xiawu Zheng, Chao, Fei, Rongrong Ji

    arXiv · 2025

    This paper identifies a critical issue of construction error explosion in existing LLMs sparsification methods and derives a simple yet effective approach to layer-wise sparsity allocation that mitigates this issue, and uses a monotonically increasing arithmetic progression to identify optimal layer-wise sparsity rates.

    19
  • GraCo: Granularity-Controllable Interactive Segmentation

    Y. Zhao, Kehan Li, Zesen Cheng, Pengchong Qiao, Xiawu Zheng, Rongrong Ji, Chang Liu, Yuan Li, +1 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    An any-granularity mask generator is designed that exploits the semantic property of the pre-trained IS model to automatically gen-erate abundant mask-granularity pairs without requiring additional manual annotation and a granularity-controllable learning strategy that efficiently imparts the granularity controllability to the IS model is proposed.

    19
  • Semi-Supervised Blind Image Quality Assessment through Knowledge Distillation and Incremental Learning

    Wensheng Pan, Timin Gao, Yan Zhang, Xiawu Zheng, Yunhang Shen, Ke Li, Runze Hu, Yutao Liu, +1 more

    Proceedings of the AAAI Conference on Artificial Intelligence · 2024

    A unified framework that combines semi-supervised and incremental learning to address the issue of catastrophic forgetting in Blind Image Quality Assessment and demonstrates its potential to tackle the challenges in real-world production processes.

    18
  • Dynamic Distribution Pruning for Efficient Network Architecture Search

    Xiawu Zheng, Rongrong Ji, Lang Tang, Yan Wan, Baochang Zhang, Yongjian Wu, Yunsheng Wu, Ling Shao

    arXiv · 2019

    A dynamic distribution pruning method towards extremely efficient NAS, which samples architectures from a joint categorical distribution, and the optimal neural architecture is obtained when there is only one structure remained.

    18
  • Dynamic Low-Rank Sparse Adaptation for Large Language Models

    Huang, Weizhong, Yuxin Zhang, Xiawu Zheng, Liu, Yang, Lin, Jing, Yiwu Yao, Rongrong Ji

    arXiv · 2025

    17
  • Bilateral Event Mining and Complementary for Event Stream Super-Resolution

    Zhilin Huang, Quanmin Liang, Yijie Yu, Chujun Qin, Xiawu Zheng, Kai Huang, Zikun Zhou, Wenming Yang

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    This paper proposes a bilateral event mining and complementary network (BMCNet) to fully leverage the potential of each event and capture the shared information to complement each other simultaneously and proposes a bilateral information exchange (BIE) module to facilitate the exchange of information between two streams.

    16
  • Evolving Fully Automated Machine Learning via Life-Long Knowledge Anchors

    Xiawu Zheng, Yang Zhang, Sirui Hong, Huixia Li, Lang Tang, Youcheng Xiong, Jin Zhou, Yan Wang, +4 more

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2021

    16
  • Binding-Adaptive Diffusion Models for Structure-Based Drug Design

    Zhilin Huang, Ling Qiang Yang, Zaixi Zhang, Xiangxin Zhou, Yu Bao, Xiawu Zheng, Yuwei Yang, Yu Wang, +1 more

    Proceedings of the AAAI Conference on Artificial Intelligence · 2024

    14
  • Multi-branch Collaborative Learning Network for 3D Visual Grounding

    Zhipeng Qian, Yiwei Ma, Zhekai Lin, Jiayi Ji, Xiawu Zheng, Xiaoshuai Sun, Rongrong Ji

    Lecture notes in computer science · 2024

    13
  • Out-of-Distributed Semantic Pruning for Robust Semi-Supervised Learning

    Yu Wang, Pengchong Qiao, Chang Liu, Guoli Song, Xiawu Zheng, Jie Chen

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023

    A unified framework termed OOD Semantic Pruning (OSP), which aims at pruning OOD semantics out from in-distribution (ID) features by designing a soft orthogonality regularization, which first transforms each ID feature by suppressing its semantic component that is collinear with paired OOD sample.

    13
  • Wavelet-based Frame Selection by Detecting Semantic Boundary for Long Video Understanding

    Wang Chen, Yuhui Zeng, Yongdong Luo, Tianyu Xie, Luojun Lin, Jiayi Ji, Yan Zhang, Xiawu Zheng

    arXiv · 2026

    Wavelet-based Frame Selection by Detecting Semantic Boundary by Detecting Semantic Boundary (WFS-SB) is introduced, a training-free framework that presents a new perspective on effective video understanding that significantly boosts LVLM performance.

    12
  • SocialOmni: Benchmarking Audio-Visual Social Interactivity in Omni Models

    Tianyu Xie, Jinfa Huang, Yuexiao Ma, Rongfang Luo, Yan Yang, Qingchuan Ma, Wang Chen, Yuhui Zeng, +6 more

    arXiv · 2026

    SocialOmni is introduced, an offline diagnostic benchmark that separates three turn-level decisions: identifying who is speaking, deciding when a designated participant should enter at an annotated query time, and determining how that participant should continue the dialogue.

    12
  • Discovering Important Experts for Mixture-of-Experts Models Pruning Through a Theoretical Perspective

    Weizhong Huang, Yuxin Zhang, Xiawu Zheng, Fei Chao, Rongrong Ji, Liujuan Cao

    neural information processing systems · 2025

    Shapley-MoE, an efficient pruning method for MoE models inspired by cooperative game theory, is proposed by quantifying each expert’s contribution via Shapley value, and two novel methods to improve sampling accuracy and efficiency are proposed.

    12
  • Distilling Spatially-Heterogeneous Distortion Perception for Blind Image Quality Assessment

    Xudong Li, Wenjie Nie, Yan Zhang, Runze Hu, Ke Li, Xiawu Zheng, Liujuan Cao

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2025

    12
  • 深度神经网络结构搜索综述

    Lang Tang, Huixia Li, Chenqian Yan, Xiawu Zheng, Rongrong Ji

    Journal of Image and Graphics · 2021

    12
  • VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interaction

    Chaoyou Fu, Haojia Lin, Xiong Wang, Yifan Zhang, Yunhang Shen, Xiaoyu Liu, Haoyu Cao, Zuwei Long, +8 more

    neural information processing systems · 2025

    11
  • An Information Theory-inspired Strategy for Automatic Network Pruning

    Xiawu Zheng, Yuexiao Ma, Teng Xi, Gang Zhang, Errui Ding, Li, Yuchao, Jie Chen, Yonghong Tian, +1 more

    arXiv · 2021

    11
  • Video-RAG: Visually-aligned Retrieval-Augmented Long Video Comprehension

    Yongdong Luo, Xiawu Zheng, Guilin Li, Shukang Yin, Haojia Lin, Chaoyou Fu, Jinfa Huang, Jiayi Ji, +3 more

    neural information processing systems · 2025

    9
  • EC-DARTS: Inducing Equalized and Consistent Optimization into DARTS

    Qinqin Zhou, Xiawu Zheng, Liujuan Cao, Bineng Zhong, Teng Xi, Gang Zhang, Errui Ding, Mingliang Xu, +1 more

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2021

    9
  • Automated Fine-Grained Mixture-of-Experts Quantization

    Zhanhao Xie, Yuexiao Ma, Xiawu Zheng, Fei Chao, Wanchen Sui, Yong Li, Shen Li, Rongrong Ji

    Findings of the Association for Computational Linguistics: ACL 2025 · 2025

    8
  • Few-Shot Image Quality Assessment via Adaptation of Vision-Language Models

    Xudong Li, Z P Huang, Yan Zhang, Yunhang Shen, Ke Li, Xiawu Zheng, Liujuan Cao, Rongrong Ji

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2025

    The Gradient-Regulated MetaPrompt IQA Framework (GRMP-IQA), designed to efficiently adapt the visual-language pre-trained model, CLIP, to IQA tasks, achieving high accuracy even with limited data, is proposed.

    8
  • VEGA: Learning Interleaved Image-Text Comprehension in Vision-Language Large Models

    Chenyu Zhou, Mengdan Zhang, Peixian Chen, Chaoyou Fu, Yunhang Shen, Xiawu Zheng, Xing Sun, Rongrong Ji

    arXiv · 2024

    By employing a multi-task, multi-scale post-training strategy, this work sets a robust baseline for MLLMs on the IITC task, attaining an $85.8% accuracy rate in image association and a $0.508$ Rouge score, which validate the effectiveness of the dataset in improving MLLMs capabilities for nuanced image-text comprehension.

    8
  • A Unified Framework for 3D Point Cloud Visual Grounding

    Haojia Lin, Yongdong Luo, Xiawu Zheng, Lijiang Li, Fei Chao, Taisong Jin, Donghao Luo, Yan Wang, +2 more

    arXiv · 2023

    This paper proposes Superpoint Mask Branch, which serves a dual purpose and eliminates the heavy computational overhead on the high-resolution visual features for upsampling, and enables 3DRefTR to achieve both well-performing 3DRES and3DREC capacities with only a 6% additional latency compared to the original 3DREC model.

    8
  • Event-Anchored Frame Selection for Effective Long-Video Understanding

    Wang Chen, Yongdong Luo, Yuhui Zeng, Luojun Lin, Tianyu Xie, Fei Chao, Rongrong Ji, Xiawu Zheng

    arXiv · 2026

    Event-Anchored Frame Selection (EFS), a hierarchical, event-aware pipeline that partitions the video stream into visually homogeneous temporal segments, which serve as proxies for semantic events and ensures the final keyframe set jointly optimizes for event coverage, query relevance, and visual diversity.

    7
  • EBFT: Effective and Block-Wise Fine-Tuning for Sparse LLMs

    Song Guo, Wu, Fan, Zhang, Lei, Xiawu Zheng, Shengchuan Zhang, Fei Chao, Yiyu Shi, Rongrong Ji

    arXiv · 2024

    This work proposes an efficient and fast framework for fine-tuning sparse LLMs based on minimizing reconstruction error that achieves superior results on various benchmarks, and can be executed on a single 16GB GPU.

    7
  • DLIP: Distilling Language-Image Pre-training

    Huafeng Kuang, Jie Wu, Xiawu Zheng, Ming Li, Xuefeng Xiao, Rui Wang, Min Zheng, Rongrong Ji

    arXiv · 2023

    DLIP, a simple yet efficient Distilling Language-Image Pre-training framework, is presented, through which it is investigated how to distill a light VLP model, and experimental results reveal that DLIP can achieve a state-of-the-art accuracy/efficiency trade-off across diverse cross-modal tasks.

    7
  • Digest: Deeply Supervised Knowledge Transfer Network Learning for Brain Tumor Segmentation with Incomplete Multi-Modal MRI Scans

    Haoran Li, Cheng Li, Weijian Huang, Xiawu Zheng, Yan Xi, Shanshan Wang

    IEEE International Symposium on Biomedical Imaging (ISBI) · 2023

    A knowledge transfer learning frame is constructed, enabling a student model to learn modality-shared semantic information from a teacher model pretrained with the complete multi-modal MRI data, and a deeply supervised knowledge transfer loss is designed to ensure the consistency of the teacher-student structure at different decoding stages.

    7
  • Motion-Aware Caching for Efficient Autoregressive Video Generation

    Jing Xu, Yuexiao Ma, Xuzhe Zheng, Xing Wang, Shiwei Liu, Chenqian Yan, Xiawu Zheng, Rongrong Ji, +2 more

    arXiv · 2026

    MotionCache is proposed, a motion-aware cache framework that exploits inter-frame differences as a lightweight proxy for pixel-level motion characteristics and employs a coarse-to-fine strategy: an initial warm-up phase establishes semantic coherence, followed by motion-weighted cache reuse that dynamically adjusts update frequencies per token.

    6
  • Multimodal Inplace Prompt Tuning for Open-set Object Detection

    Guilin Li, Mengdan Zhang, Xiawu Zheng, Peixian Chen, Zihan Wang, Yunhang Shen, Mingchen Zhuge, Chenglin Wu, +4 more

    ACM International Conference on Multimedia (ACM MM) · 2024

    This study introduces a redundancy assessment metric to identify uniform attention patterns and incorporates multimodal inplace prompt tuning (MIPT) to enrich the text prompt with visual clues in areas with high redundancy.

    6
  • Depth-Guided Semi-Supervised Instance Segmentation

    Xin Chen, Jie Hu, Xiawu Zheng, Jianghang Lin, Liujuan Cao, Rongrong Ji

    arXiv · 2024

    This work proposes Depth Feature Fusion, which integrates features extracted from depth estimation into the SSIS process, and establishes a new benchmark for SSIS, outperforming previous methods.

    6
  • Probabilistic Modeling: Proving the Lottery Ticket Hypothesis in Spiking Neural Network

    Yao, Man, Yuhong Chou, Guangshe Zhao, Xiawu Zheng, Yonghong Tian, Bo Xu, Guoqi Li

    arXiv · 2023

    This work proposes a novel probabilistic modeling approach for spiking neurons with complicated spatio-temporal dynamics and theoretically and experimentally proves that LTH holds in Spiking Neural Networks (SNNs), and concludes that pruning directly in accordance with the weight size in existing SNNs is clearly not optimal.

    6
  • Adaptive Feature Selection for No-Reference Image Quality Assessment by Mitigating Semantic Noise Sensitivity

    Xudong Li, Timin Gao, Runze Hu, Zhang, Yan, Zhang, Shengchuan, Xiawu Zheng, Jingyuan Zheng, Yunhang Shen, +4 more

    arXiv · 2023

    A Quality-Aware Feature Matching IQA metric (QFM-IQM) is proposed that employs contrastive learning to remove harmful features from the upstream task and achieves superior performance to the state-of-the-art NR-IQA.

    6
  • AlphaQ: Calibration-Free Bit Allocation for Mixture-of-Experts Quantization

    Wanqi Yang, Yuexiao Ma, Alexander Conzelmann, Xiawu Zheng, Michael W. Mahoney, T. Konstantin Rusch, Shiwei Liu

    arXiv · 2026

    AlphaQ is proposed, a calibration-free bit-allocation method for MoE quantization that draws on HT-SR theory and operationalizes this principle by measuring expert-wise spectral heavy-tailedness and solving a budget-constrained optimization problem that minimizes total quantization error under a global bit-budget constraint.

    5
  • From Objects to Events: Unlocking Complex Visual Understanding in Object Detectors Via LLM-guided Symbolic Reasoning

    Yuhui Zeng, Haoxiang Wu, WenJie Nie, Guangyao Chen, Xiawu Zheng, Yunhang Shen, Jun Peng, Yonghong Tian, +1 more

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2025

    A novel framework that expands the capability of standard object detectors beyond mere object recognition to complex event understanding through LLM-guided symbolic reasoning, bridging the semantic gap between object detection and event understanding without requiring expensive taskspecific training.

    5
  • Aligning Instance Brownian Bridge with Texts for Open-Vocabulary Video Instance Segmentation

    Zesen Cheng, Kehan Li, Li Hao, Peng Jin, Xiawu Zheng, Chang Liu, Jie Chen

    Proceedings of the AAAI Conference on Artificial Intelligence · 2025

    BridgeText Alignment (BTA) is proposed to link frame-level instance representations as a Brownian Bridge to link frame-level instance representations as a Brownian Bridge and surpasses the SOTA (OV2Seg) by a clear margin.

    5
  • Benchmarking Abstract and Reasoning Abilities Through A Theoretical Perspective

    Qingchuan Ma, Yuhang Wu, Xiawu Zheng, Rongrong Ji

    arXiv · 2025

    This paper designs a benchmark: systematic symbol remapping in rule-based tasks, which forces models to demonstrate genuine pattern recognition beyond superficial token matching, and introduces two novel complementary metrics: \(\scoreGamma\) measures basic reasoning accuracy and \(\scoreDelta\) quantifies a model's reliance on specific symbols rather than underlying patterns.

    5
  • Multi-Modal Prompt Learning on Blind Image Quality Assessment

    Pan, Wensheng, Timin Gao, Yan Zhang, Runze Hu, Xiawu Zheng, Enwei Zhang, Yuting Gao, Yutao Liu, +5 more

    arXiv · 2024

    This paper introduces an innovative multi-modal prompt-based methodology for IQA that employs carefully crafted prompts that synergistically mine incremental semantic information from both visual and linguistic data.

    5
  • ARLP: Automatic multi-agent transformer reinforcement learning pruner for one-shot neural network pruning

    Bowen Guo, Xiang Chang, Fei Chao, Xiawu Zheng, Chih‐Min Lin, Yanjie Chen, Changjing Shang, Qiang Shen

    Knowledge-Based Systems · 2024

    5
  • CDP

    Tianshuo Xu, Yuhang Wu, Xiawu Zheng, Teng Xi, Gang Zhang, Errui Ding, Fei Chao, Rongrong Ji

    ACM International Conference on Multimedia (ACM MM) · 2021

    5
  • Mix-Ecom: Towards Mixed-Type E-Commerce Dialogues with Complex Domain Rules

    Chenyu Zhou, Xiaoming Shi, Qiu, Hui, Xiawu Zheng, Haitao Leng, Jiang, Yankai, Shaoguo Liu, Gao, Tingting, +1 more

    arXiv · 2025

    This work introduces a novel corpus, termed Mix-ECom, which is constructed based on real-world customer-service dialogues with post-processing to remove user privacy and add CoT process and proposes a dynamic framework to further improve the performance.

    4
  • Instance Brownian Bridge as Texts for Open-vocabulary Video Instance Segmentation

    Zesen Cheng, Li, Kehan, Hao Li, Peng Jin, Chang Liu, Xiawu Zheng, Rongrong Ji, Jie Chen

    arXiv · 2024

    This work builds a frozen video segmentor to generate frame-level instance queries, and design Temporal Instance Resampler (TIR) to generate queries with temporal context from frame queries to link frame-level instance representations as a Brownian Bridge to model instance dynamics and align bridge-level instance representation to class texts.

    4
  • On Evolving Attention Towards Domain Adaptation

    Kekai Sheng, Ke Li, Xiawu Zheng, Jian Liang, Weiming Dong, Feiyue Huang, Rongrong Ji, Xing Sun

    arXiv · 2021

    4
  • ALLGCD: Leveraging All Unlabeled Data for Generalized Category Discovery

    Xinzi Cao, Ke Chen, Feidiao Yang, Xiawu Zheng, Yonghong Tian, Yutong Lu

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2025

    3
  • Textual Grounding for Open-Vocabulary Visual Information Extraction in Layout-Diversified Documents

    Mengjun Cheng, Chengquan Zhang, Chang Liu, Yuke Li, Bohan Li, Kun Yao, Xiawu Zheng, Rongrong Ji, +1 more

    Lecture notes in computer science · 2024

    3
  • Adaptive Fuzzy Positive Learning for Annotation-Scarce Semantic Segmentation

    Pengchong Qiao, Yu Wang, Chang Liu, Lei Shang, Baigui Sun, Zhennan Wang, Xiawu Zheng, Rongrong Ji, +1 more

    International Journal of Computer Vision · 2024

    Adaptive Fuzzy Positive Learning (A-FPL) is proposed for correctly learning unlabeled data in a plug-and-play fashion, targeting adaptively encouraging fuzzy positive predictions and suppressing highly probable negatives.

    3
  • RepAn: Enhanced Annealing through Re-parameterization

    Xiang Fei, Xiawu Zheng, Yan Wang, Fei Chao, Chenglin Wu, Liujuan Cao

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    3
  • LocLoc: Low-level Cues and Local-area Guides for Weakly Supervised Object Localization

    Xinzi Cao, Xiawu Zheng, Yunhang Shen, Ke Li, Jie Chen, Yutong Lu, Yonghong Tian

    ACM International Conference on Multimedia (ACM MM) · 2023

    This paper introduces a GrabCut-Enhanced Generator to learn global semantic representations for localization based on graph cuts to enhance low-level information based on long-range dependencies captured by the transformer and designs a Local Feature Digging Module (LFDM) that utilizes low- level cues to guide the learning route of local feature representations for accurate classification.

    3
  • Iterative Data Refinement for Self-Supervised Learning MR Image Reconstruction

    Xue Liu, Juan Zou, Tao Sun, Ruoyou Wu, Xiawu Zheng, Cheng Li, Shanshan Wang

    IEEE International Symposium on Biomedical Imaging (ISBI) · 2023

    3
  • SpecEyes: Accelerating Agentic Multimodal LLMs via Speculative Perception and Planning

    Haoyu Huang, Jinfa Huang, Zhongwei Wan, Xiawu Zheng, Rongrong Ji, Jiebo Luo

    arXiv · 2026

    This work proposes SpecEyes, an agentic-level speculative acceleration framework that breaks this sequential bottleneck in agentic multimodal large language models and introduces a cognitive gating mechanism based on answer separability, which quantifies the model's confidence for self-verification without requiring oracle labels.

    2
  • OmniView-Space: Reinforcing Spatial Reasoning via Multi-Perspective Spatial Mapping

    Xudong Li, Mengdan Zhang, Peixian Chen, Jiaxi Tan, Z Zhangqin Huang, Jiawei Zheng, Yan Zhang, Xiawu Zheng, +2 more

    arXiv · 2026

    OmniView-Space is a framework designed to maintain spatial consistency through multimodal egocentric evidence and achieves state-of-the-art performance on single- and multi-image spatial reasoning benchmarks, while reducing reliance on external geometry pipelines.

    2
  • WaveZip: Wavelet-Driven Space-Time Decoupling for Video Token Condensation

    Yuhui Zeng, Wang Chen, Jinfa Huang, Tianyu Xie, Yongdong Luo, Jiayi Ji, Xiawu Zheng, jiebo Luo

    arXiv · 2026

    WaveZip is proposed, a joint signal-frequency-domain framework for efficient video inference that requires no task-specific training and can be seamlessly integrated into off-the-shelf LVLMs to boost inference efficiency.

    2
  • QuoTA: Query-oriented Token Assignment via CoT Query Decouple for Long Video Comprehension

    Yongdong Luo, Wang Chen, Weizhong Huang, Shukang Yin, Haojia Lin, Jinfa Huang, Chaoyou Fu, Jiayi Ji, +2 more

    Proceedings of the AAAI Conference on Artificial Intelligence · 2026

    QuoTA strategically allocates frame-level importance scores based on query relevance, enabling one-time visual token assignment before cross-modal interactions in decoder layers, and decouple the query through Chain-of-Thoughts reasoning to facilitate more precise LVLM-based frame importance scoring.

    2
  • Towards Efficient Automatic Self-Pruning of Large Language Models

    Huang, Weizhong, Yuxin Zhang, Xiawu Zheng, Chao, Fei, Rongrong Ji

    arXiv · 2025

    This work introduces an end-to-end automatic self-pruning framework for LLMs, which efficiently search layer-wise pruning rates and leverages LLMs to autonomously execute the entire evolutionary search process to search for pruning rate configurations.

    2
  • Dynamic Clustering Convolutional Neural Network

    Tanzhe Li, Baochang Zhang, Jiayi Lyu, Xiawu Zheng, Guodong Guo, Taisong Jin

    Proceedings of the AAAI Conference on Artificial Intelligence · 2025

    The extensive experiments demonstrate that the proposed DCCNeXt outperforms the mainstream Convolutional Neural Networks (CNNs), Vision Transformers (ViTs), Vision Multi-layer Perceptrons (MLPs), Vision Graph Neural Networks (GNNs), and Vision Mambas.

    2
  • Watch Where You Move: Region-Aware Dynamic Aggregation and Excitation for Gait Recognition

    Binyuan Huang, Yongdong Luo, Xianda Guo, Xiawu Zheng, Zheng Dong Zhu, Jiahui Pan, Chengju Zhou

    IEEE Transactions on Multimedia · 2025

    A Region-aware Dynamic Aggregation and Excitation framework (GaitRDAE) that automatically searches for motion regions, assigns adaptive temporal scales and applies corresponding attention, and achieves state-of-the-art performance on several benchmark datasets.

    2
  • Feature Denoising Diffusion Model for Blind Image Quality Assessment

    Xudong Li, Yan Zhang, Yunhang Shen, Ke Li, Runze Hu, Xiawu Zheng, Sicheng Zhao

    Proceedings of the AAAI Conference on Artificial Intelligence · 2025

    2
  • Fast Hybrid Search for Automatic Model Compression

    Guilin Li, Lang Tang, Xiawu Zheng

    Electronics · 2024

    A hybrid search method, searching for the pruned model architecture and the pruning algorithm at the same time, which automatically finds the pruning ratio and pruning algorithm for each convolution layer, which achieves a clear improvement in performance compared to current state-of-the-art methods.

    2
  • A Novel Neighbor Aggregation Function for Medical Point Cloud Analysis

    Fan Wu, Yumeng Qian, Haozhun Zheng, Yan Zhang, Xiawu Zheng

    Lecture notes in computer science · 2023

    2
  • Less is More: Learning Reference Knowledge Using No-Reference Image Quality Assessment

    Xudong Li, Jingyuan Zheng, Xiawu Zheng, Runze Hu, Enwei Zhang, Yuting Gao, Yunhang Shen, Ke Li, +4 more

    arXiv · 2023

    2
  • Searching Lightweight Neural Network for Image Signal Processing

    Haojia Lin, Lijiang Li, Xiawu Zheng, Fei Chao, Rongrong Ji

    ACM International Conference on Multimedia (ACM MM) · 2022

    An automated search framework is proposed that derives ISP models with high image quality while satisfying the low-computation requirement and adopts the weight-sharing strategy by introducing a supernet and decouple the architecture search into two stages, supernet training and hard-aware evolutionary search.

    2
  • Iterative Data Refinement for Self-Supervised MR Image Reconstruction

    Xue Liu, Juan Zou, Xiawu Zheng, Cheng Li, Hairong Zheng, Shanshan Wang

    arXiv · 2022

    Experimental results show that without utilizing any fully sampled MRI data, the proposed self-supervised framework possesses strong capabilities in capturing image details and structures at high acceleration factors.

    2
  • Connecting the Dots: Training-Free Visual Grounding via Agentic Reasoning

    Liqin Luo, Guangyao Chen, Xiawu Zheng, Yongxing Dai, Yixiong Zou, Yonghong Tian

    Proceedings of the AAAI Conference on Artificial Intelligence · 2026

    1
  • A2RBench: An Automatic Paradigm for Formally Verifiable Abstract Reasoning Benchmark Generation

    Qingchuan Ma, Yuexiao Ma, Yongkang Xie, Tianyu Xie, Xiawu Zheng, Rongrong Ji

    arXiv · 2026

    An automated pipeline named A2RBench is introduced, encompassing generation, expansion, evaluation, and analysis, and it is proved that programmatic verification--testing whether the inverse operation perfectly reverses the forward operation (cycle consistency)--guarantees a unique solution.

    1
  • OmniScope: Modality-Decoupled Token Compression for Omnimodal Large Language Models

    Jinsen Su, Yongdong Luo, Yuexiao Ma, Yibo Hu, Meiguang Jin, Xiawu Zheng

    arXiv · 2026

    This work proposes OmniScope, a training-free token compression framework that uses the query as a shared semantic anchor while estimating relevance separately for audio and video, and suggests a simple design principle for OmniLLM inference: share the query across modalities, but not the salience estimates.

    1
  • Good Performance Estimation Strategies are All You Need in Neural Architecture Search

    Xiawu Zheng, Lei Zhang, Binghan Chen, Mingkai Wang, Fei Chao, Chenglin Wu, Shanshan Wang, Rongrong Ji, +1 more

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2025

    1
  • Distilling Structural Knowledge for Platform-Aware Semantic Segmentation

    Guilin Li, Qiang Wang, Xiawu Zheng

    Journal of Physics Conference Series · 2024

    It is found that the student network with a more similar architecture against the teacher network obtains more performance gain from distillation, and a novel Structural Distillation (SD) method is proposed which introduces the structural similarity constraints into vanilla knowledge distillation.

    1
  • Probabilistic Automated Model Compression via Representation Mutual Information Optimization

    Wenjie Nie, Shengchuan Zhang, Xiawu Zheng

    Mathematics · 2024

    This work introduces a probabilistic framework for automated model compression (Prob-AMC) that optimizes pruning, quantization, and knowledge distillation simultaneously using information theory, and achieves a superior compression ratio on CIFAR-10 and ImageNet.

    1
  • Adaptive PromptNet for Auxiliary Glioma Diagnosis Without Contrast-Enhanced MRI

    Yeqi Wang, Weijian Huang, Cheng Li, Xiawu Zheng, Yusong Lin, Shanshan Wang

    IEEE International Symposium on Biomedical Imaging (ISBI) · 2023

    An adaptive PromptNet for glioma grading utilizing only non-enhanced MRI data has been constructed, and competitive gliomas grading performance on NE-MRI data is achieved.

    1
  • –
  • HEART: Exploiting Head Heterogeneity in Sparse Attention for Video Diffusion

    Xuzhe Zheng, Yuexiao Ma, Xu, Jing, Xiawu Zheng, Rongrong Ji, Fei Chao

    arXiv · 2026

    –
  • Relaxing the Constraints: A Dual-Importance Projection Mechanism for Lifelong Model Editing

    Zhenghai Chen, Senbin Xu, Jiaxi Tan, Xinhua Wu, Yan Zhang, Xiawu Zheng, Shengchuan Zhang, Ke Li, +3 more

    Findings of the Association for Computational Linguistics: ACL 2026 · 2026

    –
  • YOLO-PEFT: Parameter-Efficient Fine-Tuning on YOLO Family

    Xu Lin, WenJie Nie, Jinlong Peng, Weifu Fu, YueXiao Ma, Xiawu Zheng, Yong Liu

    arXiv · 2026

    –
  • Q-DeepSight: Incentivizing Thinking with Images for Image Quality Assessment and Refinement

    Xudong Li, Jiaxi Tan, Ziyin Zhou, Yan Zhong, Zihao Huang, Jingyuan Zheng, Yan Zhang, Xiawu Zheng, +1 more

    arXiv · 2026

    Q-DeepSight is proposed, a think-with-image framework that achieves state-of-the-art performance across diverse benchmarks, including natural, restored, and AI-generated content and demonstrates its practical value with Perceptual-in-Generation (PiG), a training-free framework where Q-DeepSight's diagnoses guide iterative image enhancement, effectively closing the loop between assessment and refinement.

    –
  • One Ranking, Any Budget: Matryoshka Evidence-to-Context Frame Selection for Long-Video Understanding

    Wang Chen, Yu Chen, Xiang Wang, Shuai Li, Jinfa Huang, Xiawu Zheng

    arXiv · 2026

    –
  • Deep Research in Physical Sciences: A Multi-Agent Framework and Comprehensive Benchmark

    Yigeng Jiang, Tengchao Yang, Taoyong Cui, Jiaxing Wan, Yuan Wang, Weida Wang, Zhiyu Liu, Chuyi Peng, +20 more

    arXiv · 2026

    –
  • Toward Robust In-Context Segmentation via Concept Guidance

    Zhigang Chen, Xiawu Zheng, Rongrong Ji

    Lecture notes in computer science · 2026

    –
  • TimePLE: Rethinking Temporal Representation for Video Temporal Grounding

    Yuhui Zeng, Xinyu Mao, Xiaokun Liu, Xin Tao, Jinfa Huang, Jiayi Ji, Xiawu Zheng

    arXiv · 2026

    TimePLE is proposed, which reformulates VTG from endpoint prediction to interval-native grounding by predicting a single joint distribution over valid temporal intervals, and curate 90K-scale grounded samples and human-verify 3K-scale benchmark annotations.

    –
  • Symbolic-driven agentic reasoning for environmental and behavioral event detection

    Guangyao Chen, Luo L, Jun Peng, Feidiao Yang, Xiawu Zheng, Gang Shen, Yonghong Tian

    Visual Intelligence · 2026

    SDAR employs a symbolic reasoning engine to guide agentic decision making, connecting low-level visual cues with structured symbolic representations of events, and enables interpretable reasoning chains that capture causal relationships, contextual dependencies, and event categories.

    –
  • Duplex-MPE: Benchmarking Multi-Party Interaction in Full-Duplex Dialogue

    Chengqian Ma, Wenhao Feng, Weixuan Jin, Gaole Dai, Tianyu Xie, Yuexiao Ma, Zhaolu Kang, Xiangyu Zhao, +2 more

    arXiv · 2026

    –
  • UniCache: Task- and Type-Aware KV Cache Compression for Unified Multimodal Models

    Wanqi Yang, Yuexiao Ma, Mei Xie, Xiawu Zheng, Shiwei Liu

    arXiv · 2026

    –
  • Stabilizing Ultra-Low-Bit Quantization of Multimodal LLMs via Global Bit Allocation

    Guilin Li, Yuexiao Ma, Yue Zhang, Xinxiong Wu, Jiaqi Zhou, Qingheng Zhang, Yan Zhang, Fei Chao, +2 more

    Lecture notes in computer science · 2026

    –
  • : Accelerating Agentic Multimodal LLMs via Speculative Perception and Planning

    Haoyu Huang, Jinfa Huang, Zhongwei Wan, Xiawu Zheng, Rongrong Ji, Jiebo Luo

    Lecture notes in computer science · 2026

    –
  • Low Rank Quantization Adaptation for Large Language Model

    Xiwei Xu, Yuexiao Ma, Wenting Lin, Yuhang Wu, Yuxin Lin, Zelan Yang, Wanchen Sui, Shen Li, +4 more

    IEEE International Conference on Acoustics Speech and Signal Processing · 2026

    –
  • ALGOGEN: Tool-Generated Verifiable Traces for Reliable Algorithm Visualization

    Liaokunpeng, Yuexiao Ma, Yisheng Lin, Hualin Zeng, Xiawu Zheng, Rongrong Ji

    Findings of the Association for Computational Linguistics: ACL 2026 · 2026

    The results demonstrate that the decoupling paradigm effectively mitigates LLM hallucinations in complex AV tasks, providing a more reliable solution for automated generation of high-quality algorithm visualizations.

    –
  • Zooming from Context to Cue: Hierarchical Preference Optimization for Multi-Image MLLMs

    Xudong Li, Mengdan Zhang, Peixian Chen, Xiawu Zheng, Yan Zhang, Jingyuan Zheng, Yunhang Shen, Ke Li, +3 more

    neural information processing systems · 2025

    –
  • Breaking Static Barriers: Dynamic Post-Training Quantization for Diffusion Models

    Yang Xiao, Huixia Li, Lijiang Li, Xiawu Zheng, Yuexiao Ma, Feng Ling, Jie Wu, Xuefeng Xiao, +3 more

    2025 International Joint Conference on Neural Networks (IJCNN) · 2025

    –
  • Oriented-Derivative Representation for Boundary-Aware Polyp Segmentation

    Yuke Li, Mengjun Cheng, Xiawu Zheng, Rongrong Ji, Jie Chen

    IEEE Transactions on Multimedia · 2025

    –
  • Margin-Aware Prototype Debiasing for Generalized Category Discovery

    Xinzi Cao, Feidiao Yang, Xiawu Zheng, Quanmin Liang, Yutong Lu, Yonghong Tian

    IEEE Transactions on Circuits and Systems for Video Technology · 2025

    –
  • Functionally Similar Multi-Label Knowledge Distillation

    Binghan Chen, Jianlong Hu, Xiawu Zheng, Wei Lin, Fei Chao, Rongrong Ji

    IEEE International Conference on Acoustics Speech and Signal Processing · 2024

    –
  • A Hybrid Performance Estimation Strategy for Optimizing Neural Architecture Search

    Lei Zhang, Xiawu Zheng, Jiarui Wu, Xiang Chang, Nigel Joseph Copner, Chih‐Min Lin, Fei Chao, Yanjie Chen, +2 more

    Advances in intelligent systems and computing · 2024

    –
  • Rethinking 3D Dense Caption and Visual Grounding in A Unified Framework through Prompt-based Localization

    Yongdong Luo, Haojia Lin, Xiawu Zheng, Yigeng Jiang, Fei Chao, Jie Hu, Guannan Jiang, Songan Zhang, +1 more

    arXiv · 2024

    Inspired by DETR, this work proposes a unified framework, 3DGCTR, to jointly solve these two distinct but closely related tasks in an end-to-end fashion, and facilitates simultaneous multi-task training on both tasks, mutually enhancing their performance.

    –
  • Real-Time Interactive Face Beautification

    Luojun Lin, Wang Chen, Pei-Zhen Chen, Xiawu Zheng, Lianwen Jin

    SSRN Electronic Journal · 2024

    –
  • Two-Stage Deep Learning Segmentation for Tiny Brain Regions

    Yan Ren, Xiawu Zheng, Rongrong Ji, Jie Chen

    Lecture notes in computer science · 2023

    –
  • Learning Sparse Neural Networks with Identity Layers

    Mingjian Ni, Guangyao Chen, Xiawu Zheng, Peixi Peng, Li Yuan, Yonghong Tian

    Lecture notes in computer science · 2023

    –
  • GLViG: Global and Local Vision GNN May Be What You Need for Vision

    Tanzhe Li, Wei Lin, Xiawu Zheng, Taisong Jin

    Lecture notes in computer science · 2023

    –
  • 効果的なニューラルアーキテクチャ探索のための多項分布学習【JST・京大機械翻訳】

    Xiawu Zheng, Ji Rongrong, Tang Lang, Zhang Baochang, Jianzhuang Liu, Tian Qi

    IEEE Conference Proceedings · 2019

    –

Publication data from OpenAlex, with missing venues and authors filled in from Crossref; citation counts are the higher of OpenAlex and Semantic Scholar, last synced 2026-10-15. One-sentence summaries under some papers are written by Semantic Scholar’s model. Citation counts may be lower than on Google Scholar, which indexes more sources.

Report an error

Wrong papers, two people merged into one, or a profile that should not be here? Tell us and we will fix or hide it.

Sign in to report