Is this you? Claim this profile to correct it, add a bio and choose the work people see first.

Claim this profile

Academic lineage

Possible advisorsa guess from early papers, not confirmed

  • Simin Yu

    Possible advisor · last author on 3 of their early first-author papers, 2009

    Suggested from co-authorship

Is this you? Claim this profile to confirm or dismiss it.

Works164 from public data

TitleCited by
  • SphereFace: Deep Hypersphere Embedding for Face Recognition

    Weiyang Liu, Yandong Wen, Zhiding Yu, Ming Li, Bhiksha Raj, Le Song

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2017

    This paper proposes the angular softmax (A-Softmax) loss that enables convolutional neural networks (CNNs) to learn angularly discriminative features in deep face recognition (FR) problem under open-set protocol.

    3,154
  • GR00T N1: An Open Foundation Model for Generalist Humanoid Robots

    Nvidia Nvidia, :, Johan Björck, Castañeda, Fernando, Nikita Chernyadev, Xingye Da, Runyu Ding, Linxi Fan, +22 more

    arXiv · 2025

    This work introduces GR00T N1, an open foundation model for humanoid robots that outperforms the state-of-the-art imitation learning baselines on standard simulation benchmarks across multiple robot embodiments and deploys the model on the Fourier GR-1 humanoid robot for language-conditioned bimanual manipulation tasks.

    1,558
  • Unsupervised Domain Adaptation for Semantic Segmentation via Class-Balanced Self-training

    Yang Zou, Zhiding Yu, B. V. K. Vijaya Kumar, Jinsong Wang

    Lecture notes in computer science · 2018

    This paper proposes a novel UDA framework based on an iterative self-training (ST) procedure, where the problem is formulated as latent variable loss minimization, and can be solved by alternatively generating pseudo labels on target data and re-training the model with these labels.

    1,531
  • Confidence Regularized Self-Training

    Yang Zou, Zhiding Yu, Xiaofeng Liu, B. V. K. Vijaya Kumar, Jinsong Wang

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2019

    A confidence regularized self-training (CRST) framework, formulated as regularizedSelf-training, that treats pseudo-labels as continuous latent variables jointly optimized via alternating optimization and proposes two types of confidence regularization: label regularization (LR) and modelRegularization (MR).

    941
  • SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers

    Enze Xie, Wenhai Wang, Zhiding Yu, Animashree Anandkumar, José Manuel Álvarez, Ping Luo

    CaltechAUTHORS (California Institute of Technology) · 2021

    927
  • Joint Discriminative and Generative Learning for Person Re-Identification

    Zhedong Zheng, Xiaodong Yang, Zhiding Yu, Liang Zheng, Yi Ping Yang, Jan Kautz

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2019

    This paper proposes a joint learning framework that couples re-id learning and data generation end-to-end and renders significant improvement over the baseline without using generated data, leading to the state-of-the-art performance on several benchmark datasets.

    856
  • Image based Static Facial Expression Recognition with Multiple Deep Network Learning

    Zhiding Yu, Cha Zhang

    ACM International Conference on Multimodal Interaction (ICMI) · 2015

    This work reports the proposed image based static facial expression recognition method for the Emotion Recognition in the Wild Challenge (EmotiW) 2015, and presents two schemes for learning the ensemble weights of the network responses by minimizing the log likelihood loss and the hinge loss.

    605
  • VoxFormer: Sparse Voxel Transformer for Camera-Based 3D Semantic Scene Completion

    Yiming Li, Zhiding Yu, Christopher Choy, Chaowei Xiao, José Manuel Álvarez, Sanja Fidler, Chen Feng, Animashree Anandkumar

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023

    VoxFormer, a Transformer-based semantic scene completion framework that can output complete 3D volumetric semantics from only 2D images that outperforms the state of the art with a relative improvement of 20.0% in geometry and 18.1% in semantics.

    479
  • Large-Margin Softmax Loss for Convolutional Neural Networks

    Weiyang Liu, Yandong Wen, Zhiding Yu, Meng Yang

    arXiv · 2016

    408
  • CASENet: Deep Category-Aware Semantic Edge Detection

    Zhiding Yu, Chen Feng, Ming-Yu Liu, Srikumar Ramalingam

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2017

    This work proposes a novel end-to-end deep semantic edge learning architecture based on ResNet and a new skip-layer architecture where category-wise edge activations at the top convolution layer share and are fused with the same set of bottom layer features.

    300
  • Is Ego Status All You Need for Open-Loop End-to-End Autonomous Driving?

    Zhiqi Li, Zhiding Yu, Shiyi Lan, Jiahan Li, Jan Kautz, Tong Lü, José Manuel Álvarez

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    This paper conducts thorough analyses and introduces a new metric to evaluate whether the predicted trajectories adhere to the road, and proposes a simple baseline able to achieve competitive results without relying on perception annotations.

    296
  • Hydra-MDP: End-to-end Multimodal Planning with Multi-target Hydra-Distillation

    Zhenxin Li, Kailin Li, Shihao Wang, Shiyi Lan, Zhiding Yu, Yishen Ji, Zhiqi Li, Ziyue Zhu, +4 more

    arXiv · 2024

    Hydra-MDP, a novel paradigm employing multiple teachers in a teacher-student model, which features a multi-head decoder to learn diverse trajectory candidates tailored to various evaluation metrics, achieves the 1-st place in the Navsim challenge.

    288
  • Uncertainty-aware multi-view co-training for semi-supervised medical image segmentation and domain adaptation

    Yingda Xia, Dong Yang, Zhiding Yu, Fengze Liu, Jinzheng Cai, Lequan Yu, Zhuotun Zhu, Daguang Xu, +2 more

    Medical Image Analysis · 2020

    This paper proposes uncertainty-aware multi-view co-training (UMCT), a unified framework that addresses these two tasks for volumetric medical image segmentation and can even effectively handle the challenging situation where labeled source data is inaccessible.

    287
  • Understanding The Robustness in Vision Transformers

    Daquan Zhou, Zhiding Yu, Enze Xie, Chaowei Xiao, Animashree Anandkumar, Jiashi Feng, José Manuel Álvarez

    CaltechAUTHORS (California Institute of Technology) · 2022

    This paper examines the role of self-attention in learning robust representations in Vision Transformers and proposes a family of fully attentional networks (FANs) that strengthen this capability by incorporating an attentional channel processing design.

    268
  • Constructing the L2-Graph for Robust Subspace Learning and Subspace Clustering

    Xi Peng, Zhiding Yu, Yi Zhang, Huajin Tang

    IEEE Transactions on Cybernetics · 2016

    A novel method to eliminate the effects of the errors from the projection space (representation) rather than from the input space is presented and a method to construct a sparse similarity graph, called L2-graph is introduced.

    257
  • M$^2$BEV: Multi-Camera Joint 3D Detection and Segmentation with Unified Birds-Eye View Representation

    Enze Xie, Zhiding Yu, Daquan Zhou, Jonah Philion, Animashree Anandkumar, Sanja Fidler, Ping Luo, José Manuel Álvarez

    arXiv · 2022

    A unified framework that jointly performs 3D object detection and map segmentation in the Birds Eye View~(BEV) space with multi-camera image inputs, which is memory efficient, allowing significantly higher resolution images as input, with faster inference speed.

    249
  • Joint Disentangling and Adaptation for Cross-Domain Person Re-Identification

    Yang Zou, Xiaodong Yang, Zhiding Yu, B. V. K. Vijaya Kumar, Jan Kautz

    Lecture notes in computer science · 2020

    This paper proposes a joint learning framework that disentangles id-related/unrelated features and enforces adaptation to work on the id- related feature space exclusively, and outperforms the state-of-the-art methods by clear margins.

    244
  • Instance-Aware, Context-Focused, and Memory-Efficient Weakly Supervised Object Detection

    Zhongzheng Ren, Zhiding Yu, Xiaodong Yang, Ming-Yu Liu, Yong Jae Lee, Alexander Gerhard Schwing, Jan Kautz

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2020

    This work develops an instance-aware and context-focused unified framework for weakly supervised video object detection that achieves state-of-the-art results on COCO, VOC 2007, and VOC 2012 while devising a memory-efficient sequential batch back-propagation.

    231
  • FB-OCC: 3D Occupancy Prediction based on Forward-Backward View Transformation

    Zhiqi Li, Zhiding Yu, David E. Austin, Mingsheng Fang, Shiyi Lan, Jan Kautz, José Manuel Álvarez

    arXiv · 2023

    The proposed solution FB-OCC builds upon FB-BEV, a cutting-edge camera-based bird's-eye view perception design using forward-backward projection, and results in a state-of-the-art mIoU score of 54.19% on the nuScenes dataset.

    222
  • OmniDrive: A Holistic Vision-Language Dataset for Autonomous Driving with Counterfactual Reasoning

    Shihao Wang, Zhiding Yu, Xiaohui Jiang, Shiyi Lan, Min Shi, Nadine Chang, Jan Kautz, Ying Li, +1 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2025

    This work proposes OmniDrive, a holistic vision-language dataset that aligns agent models with 3D driving tasks through counter-factual reasoning, and explores two advanced OmniDrive-Agent frameworks to assess the importance of vision-language alignment versus 3D perception.

    212
  • Panoptic SegFormer: Delving Deeper into Panoptic Segmentation with Transformers

    Zhiqi Li, Wenhai Wang, Enze Xie, Zhiding Yu, Animashree Anandkumar, José Manuel Álvarez, Ping Luo, Tong Lü

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    This work presents Panoptic SegFormer, a general framework for panoptic segmentation with transformers, which contains three innovative components: an efficient deeply-supervised mask decoder, a query decoupling strategy, and an improved postprocessing method.

    199
  • FB-BEV: BEV Representation from Forward-Backward View Transformations

    Zhiqi Li, Zhiding Yu, Wenhai Wang, Animashree Anandkumar, Tong Lü, José Manuel Álvarez

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2023

    This work proposes a novel forward-backward view transformation module that compensates for the deficiencies in both existing methods, allowing them to enhance each other to obtain higher quality BEV representations mutually.

    171
  • Eagle: Exploring The Design Space for Multimodal LLMs with Mixture of Encoders

    Min Shi, Fuxiao Liu, Shihao Wang, Liao, Shijia, Subhashree Radhakrishnan, Zhao, Yilin, De-An Huang, Hongxu Yin, +8 more

    arXiv · 2024

    This study provides an extensive exploration of the design space for MLLMs using a mixture of vision encoders and resolutions, finding that simply concatenating visual tokens from a set of complementary vision encoders is as effective as more complex mixing architectures or strategies.

    164
  • Delving Deeper into Anti-Aliasing in ConvNets

    Xueyan Zou, Fanyi Xiao, Zhiding Yu, Yuheng Li, Yong Jae Lee

    International Journal of Computer Vision · 2022

    An adaptive content-aware low-pass filtering layer, which predicts separate filter weights for each spatial location and channel group of the input feature maps, which effectively adapts to the different feature frequencies to avoid aliasing while preserving useful information for recognition.

    160
  • FreeSOLO: Learning to Segment Objects without Annotations

    Xinlong Wang, Zhiding Yu, Shalini De Mello, Jan Kautz, Animashree Anandkumar, Chunhua Shen, José Manuel Álvarez

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    This work proposes a fully unsupervised learning method that learns class-agnostic instance segmentation without any annotations, and presents a novel localization-aware pre-training framework, where objects can be discovered from complicated scenes in an unsuper supervised manner.

    155
  • Cosmos 3: Omnimodal World Models for Physical AI

    NVIDIA, Niket Agarwal, Aditi, Niket Agarwal, Arslan Ali, Jon Allen, Martin Antolini, Adeline Aubame, +22 more

    arXiv · 2026

    This report introduces Cosmos 3, a family of omnimodal world models designed to jointly process and generate language, image, video, audio, and action sequences within a unified mixture-of-transformers architecture and demonstrates omnimodal world models as scalable, general-purpose backbones for embodied agents.

    150
  • FocalFormer3D : Focusing on Hard Instance for 3D Object Detection

    Yilun Chen, Zhiding Yu, Yukang Chen, Shiyi Lan, Animashree Anandkumar, Jiaya Jia, José Manuel Álvarez

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2023

    This work proposes Hard Instance Probing (HIP), a general pipeline that identifies FN in a multi-stage manner and guides the models to focus on excavating difficult instances, and instantiates this method as FocalFormer3D, a simple yet effective detector that excels at excavating difficult objects and improving prediction recall.

    133
  • An adaptive unsupervised approach toward pixel clustering and color image segmentation

    Zhiding Yu, Oscar C. Au, Ruobing Zou, Weiyu Yu, Jing Tian

    Pattern Recognition · 2009

    Compared with classical segmentation algorithms such as mean shift and normalized cut, the proposed adaptive unsupervised scheme could generate reasonably good or better image partitioning, which illustrates the method's practical value.

    124
  • DiscoBox: Weakly Supervised Instance Segmentation and Semantic Correspondence from Box Supervision

    Shiyi Lan, Zhiding Yu, Christopher Choy, Subhashree Radhakrishnan, Guilin Liu, Yuke Zhu, Larry Steven Davis, Animashree Anandkumar

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2021

    A self-ensembling framework where instance segmentation and semantic correspondence are jointly guided by a structured teacher in addition to the bounding box supervision, which shows a symbiotic relationship where the two tasks mutually benefit from each other.

    112
  • SSCBench: A Large-Scale 3D Semantic Scene Completion Benchmark for Autonomous Driving

    Yiming Li, Sihang Li, Xinhao Liu, Moonjun Gong, Kenan Li, Nuo Chen, Zijun Wang, Zhiheng Li, +6 more

    IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · 2024

    This work introduces SSCBench, a comprehensive benchmark that integrates scenes from widely used automotive datasets and has unified semantic labels across diverse datasets to simplify cross-domain generalization testing.

    107
  • Real-Time Radiance Fields for Single-Image Portrait View Synthesis

    Alex Trevithick, Matthew Chan, Michael Stengel, Eric Ryan Chan, Chao Liu, Zhiding Yu, Sameh Khamis, Manmohan Krishna Chandraker, +2 more

    ACM Transactions on Graphics · 2023

    This work presents a one-shot method to infer and render a photorealistic 3D representation from a single unposed image (e.g., face portrait) in real-time and benchmark against the state-of-the-art methods.

    100
  • Decoupled Networks

    Weiyang Liu, Zhen Liu, Zhiding Yu, Bo Dai, Rongmei Lin, Yisen Wang, James Matthew Rehg, Le Song

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2018

    A generic decoupled learning framework which models the intra-class variation and semantic difference independently and directly learn the operator from data is proposed.

    92
  • Simultaneous Edge Alignment and Learning

    Zhiding Yu, Weiyang Liu, Yang Zou, Chen Feng, Srikumar Ramalingam, B. V. K. Vijaya Kumar, Jan Kautz

    Lecture notes in computer science · 2018

    It is shown that label misalignment can cause considerably degraded edge learning quality, and a probabilistic model is formulated where edge alignment is treated as latent variable optimization, and is learned end-to-end during network training.

    90
  • Eagle 2: Building Post-Training Data Strategies from Scratch for Frontier Vision-Language Models

    Zhiqi Li, Chen, Guo, Shilong Liu, Shihao Wang, Vibashan VS, Yishen Ji, Shiyi Lan, Hao Zhang, +19 more

    arXiv · 2025

    This work addresses VLM post-training from a data-centric perspective, showing the key role of data strategy in developing frontier VLMs and leads to a family of performant VLMs named Eagle2.

    77
  • Deep Hyperspherical Learning

    Weiyang Liu, Yan‐Ming Zhang, Xingguo Li, Zhiding Yu, Bo Dai, Tuo Zhao, Le Song

    arXiv · 2017

    73
  • Partial Convolution for Padding, Inpainting, and Image Synthesis

    Guilin Liu, Ayşegül Dündar, Kevin J. Shih, Ting-Chun Wang, Fitsum A. Reda, Karan Sapra, Zhiding Yu, Xiaodong Yang, +2 more

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2022

    68
  • Partial Convolution based Padding

    Guilin Liu, Kevin J. Shih, Ting-Chun Wang, Fitsum A. Reda, Karan Sapra, Zhiding Yu, Andrew Tao, Bryan Catanzaro

    arXiv · 2018

    68
  • Learning Strict Identity Mappings in Deep Residual Networks

    Xin Yu, Zhiding Yu, Srikumar Ramalingam

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2018

    66
  • Taxonomy of Machine Learning Safety: A Survey and Primer

    Sina Mohseni, Haotao Wang, Chaowei Xiao, Zhiding Yu, Zhangyang Wang, Jay Yadawa

    ACM Computing Surveys · 2022

    The taxonomy of ML safety presents a safety-oriented categorization of ML techniques to provide guidance for improving dependability of the ML design and development and can serve as a safety checklist to aid designers in improving coverage and diversity of safety strategies employed in any given ML system.

    64
  • Test-Time Prompt Tuning for Zero-Shot Generalization in Vision-Language Models

    Manli Shu, Weili Nie, De-An Huang, Zhiding Yu, Tom Goldstein, Animashree Anandkumar, Chaowei Xiao

    neural information processing systems · 2022

    64
  • Nemotron-Research-Tool-N1: Exploring Tool-Using Language Models with Reinforced Reasoning

    Shaokun Zhang, Yi Dong, Jieyu Zhang, Jan Kautz, Bryan Catanzaro, Andrew Tao, Qingyun Wu, Zhiding Yu, +1 more

    arXiv · 2025

    This work explores rule-based reinforcement learning to enhance tool-calling in LLMs, resulting in Nemotron-Research-Tool-N1, a series of tool-calling reasoning models trained with a binary RL reward that assesses only the format validity and functional correctness of tool invocations.

    63
  • Bongard-HOI: Benchmarking Few-Shot Visual Reasoning for Human-Object Interactions

    Huaizu Jiang, Xiaojian Ma, Weili Nie, Zhiding Yu, Yuke Zhu, Animashree Anandkumar

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    Bongard-HOI, a new visual reasoning benchmark that focuses on compositional learning of humanobject interactions (HOIs) from natural images, is introduced, inspired by two desirable characteristics from the classical Bongard problems: fewshot concept learning and contextdependent reasoning.

    59
  • UFO$$^2$$: A Unified Framework Towards Omni-supervised Object Detection

    Zhongzheng Ren, Zhiding Yu, Xiaodong Yang, Ming-Yu Liu, Alexander Gerhard Schwing, Jan Kautz

    Lecture notes in computer science · 2020

    UFO$^2$ is presented, a unified object detection framework that can handle different forms of supervision simultaneously and is used to investigate budget-aware omni-supervised learning and shows that competitive performance needs no strong labels for all data.

    59
  • STORM: Token-Efficient Long Video Understanding for Multimodal LLMs

    Jindong Jiang, Xiuyu Li, Zhijian Liu, Muyang Li, Chen Guo, Zhiqi Li, De-An Huang, Guilin Liu, +8 more

    IEEE/CVF International Conference on Computer Vision Workshops (ICCVW) · 2025

    STORM (Spatiotemporal TOken Reduction for Multimodal LLMs) is introduced, a novel architecture incorporating a dedicated temporal encoder between the image encoder and the LLM, substantially reducing computational demands on the LLM without sacrificing key temporal information.

    56
  • Argus: Vision-Centric Reasoning with Grounded Chain-of-Thought

    Yunze Man, De-An Huang, Guilin Liu, Shiwei Sheng, Shilong Liu, Liang-Yan Gui, Jan Kautz, Yu-Xiong Wang, +1 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2025

    The Argus approach employs object-centric grounding as visual chain-of-thought signals, enabling more effective goal-conditioned visual attention during multimodal reasoning tasks, and reveals the effectiveness of explicit language-guided visual region-of-interest engagement in MLLMs.

    55
  • Not All Labels Are Equal: Rationalizing The Labeling Costs for Training Object Detection

    Ismail Elezi, Zhiding Yu, Animashree Anandkumar, Laura Leal-Taixé, José Manuel Álvarez

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    This work proposes a unified frame-work for active learning, that considers both the uncertainty and the robustness of the detector, ensuring that the network performs well in all classes, and leverages auto-labeling to suppress a potential distribution drift while boosting the performance of the model.

    55
  • Hydra-NeXt: Robust Closed-Loop Driving with Open-Loop Training

    Zhenxin Li, S G Wang, Shiyi Lan, Zhiding Yu, Zuxuan Wu, José Manuel Álvarez

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2025

    This paper introduces Hydra-NeXt, a novel multi-branch planning framework that unifies trajectory prediction, control prediction, and a trajectory refinement network in one model and proposes the Trajectory Refinement module to augment and refine the planning decisions by effectively adhering to kinematic constraints in closed-loop environments.

    51
  • QLIP: Text-Aligned Visual Tokenization Unifies Auto-Regressive Multimodal Understanding and Generation

    Yue Zhao, Fuzhao Xue, Scott Reed, Linxi Fan, Yuke Zhu, Jan Kautz, Zhiding Yu, Philipp Krähenbühl, +1 more

    arXiv · 2025

    It is shown that a two-stage training pipeline effectively mixes the large-batch requirements of image-language pre-training with the memory bottleneck imposed by the reconstruction objective, and it is demonstrated that QLIP enables a unified mixed-modality auto-regressive model for understanding and generation.

    50
  • X-VILA: Cross-Modality Alignment for Large Language Model

    Hanrong Ye, De-An Huang, Yao Lu, Zhiding Yu, Wei Ping, Andrew Tao, Jan Kautz, Song Han, +3 more

    arXiv · 2024

    This work introduces X-VILA, an omni-modality model designed to extend the capabilities of large language models (LLMs) by incorporating image, video, and audio modalities, and proposes a visual alignment mechanism with a visual embedding highway module that exhibits proficiency in any-to-any modality conversation.

    50
  • Centaur: Robust End-to-End Autonomous Driving with Test-Time Training

    Chonghao Sima, Kashyap Chitta, Zhiding Yu, Shiyi Lan, Ping Luo, Andreas Geiger, Hongyang Li, José Manuel Álvarez

    arXiv · 2025

    Centaur (Cluster Entropy for Test-time trAining using Uncertainty) is proposed, which updates a planner's behavior via test-time training, without relying on hand-engineered rules or cost functions, and measures and minimize the uncertainty in the planner's decisions.

    49
  • Regularizing Neural Networks via Minimizing Hyperspherical Energy

    Rongmei Lin, Weiyang Liu, Zhen Liu, Chen Feng, Zhiding Yu, James Matthew Rehg, Li Xiong, Le Song

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2020

    The compressive minimum hyperspherical energy (CoMHE) is proposed as a more effective regularization for neural networks that consistently outperforms existing regularization methods, and can be easily applied to different neural networks.

    48
  • RocketKV: Accelerating Long-Context LLM Inference via Two-Stage KV Cache Compression

    Payman Behnam, Yaosheng Fu, Ritchie Zhao, Po-An Tsai, Zhiding Yu, Alexey Tumanov

    arXiv · 2025

    A variant of RocketKV is proposed, a training-free KV cache compression strategy containing two consecutive stages that consistently outperforms other existing methods and achieves accuracy nearly on par with an oracle top-k attention scheme for multi-turn scenarios.

    47
  • Domain Adaptation for Semantic Segmentation via Class-Balanced Self-Training

    Yang Zou, Zhiding Yu, B. V. K. Vijaya Kumar, Jinsong Wang

    arXiv · 2018

    47
  • Benchmarking Robustness of 3D Point Cloud Recognition Against Common Corruptions

    J. F. Sun, Qingzhao Zhang, Bhavya Kailkhura, Zhiding Yu, Chaowei Xiao, Mao, Z. Morley

    arXiv · 2022

    46
  • Domain Stylization: A Fast Covariance Matching Framework Towards Domain Adaptation

    Ayşegül Dündar, Ming-Yu Liu, Zhiding Yu, Ting-Chun Wang, John Zedlewski, Jan Kautz

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2020

    44
  • T-Stitch: Accelerating Sampling in Pre-Trained Diffusion Models with Trajectory Stitching

    Zizheng Pan, Bohan Zhuang, De-An Huang, Weili Nie, Zhiding Yu, Chaowei Xiao, Jianfei Cai, Animashree Anandkumar

    arXiv · 2024

    This paper introduces sampling Trajectory Stitching T-Stitch, a simple yet efficient technique to improve the sampling efficiency with little or no generation degradation and can be used as a drop-in technique to not only accelerate the popular pretrained stable diffusion models but also improve the prompt alignment of stylized SD models from the public model zoo.

    43
  • End-to-end 3D Tracking with Decoupled Queries

    Yanwei Li, Zhiding Yu, Jonah Philion, Animashree Anandkumar, Sanja Fidler, Jiaya Jia, José Manuel Álvarez

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2023

    39
  • How Much More Data Do I Need? Estimating Requirements for Downstream Tasks

    Rafid Mahmood, James Lucas, David Acuna, Daiqing Li, Jonah Philion, José Manuel Álvarez, Zhiding Yu, Sania Fidler, +1 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    This work considers a broad class of computer vision tasks and systematically investigates a family of functions that generalize the power-law function to allow for better estimation of data requirements, and shows that incorporating a tuned correction factor and collecting over multiple rounds significantly improves the performance of the data estimators.

    39
  • VideoITG: Multimodal Video Understanding with Instructed Temporal Grounding

    Shihao Wang, Guo Chen, De-An Huang, Zhiqi Li, Li, Minghan, Guilin Li, José Manuel Álvarez, Lei Zhang, +1 more

    arXiv · 2025

    This work designs the VidThinker pipeline, which automates annotation by generating instruction-conditioned captions, retrieving relevant video segments, and selecting key frames to enable efficient supervision, and builds the VideoITG-40K dataset, which consistently boosts the performance on multiple multimodal video understanding benchmarks.

    36
  • PointDP: Diffusion-driven Purification against Adversarial Attacks on 3D Point Cloud Recognition

    J. F. Sun, Weili Nie, Zhiding Yu, Mao, Z. Morley, Chaowei Xiao

    arXiv · 2022

    This work extensively evaluates PointDP, a purification strategy that leverages diffusion models to defend against 3D adversarial attacks, and shows that PointDP achieves significantly better robustness than state-of-the-art purification methods under strong attacks.

    34
  • KCRC-LCD: Discriminative kernel collaborative representation with locality constrained dictionary for visual categorization

    Weiyang Liu, Zhiding Yu, Lijia Lu, Yandong Wen, Hui Li, Yuexian Zou

    Pattern Recognition · 2015

    Comprehensive experiments on widely used public datasets show that KCRC-LCD is a robust discriminative classifier with both excellent performance and good scalability, being comparable or outperforming many other state-of-the-art approaches.

    33
  • LITA: Language Instructed Temporal-Localization Assistant

    De-An Huang, Shijia Liao, Subhashree Radhakrishnan, Hongxu Yin, Pavlo A. Molchanov, Zhiding Yu, Jan Kautz

    Lecture notes in computer science · 2024

    32
  • Compressing similar image sets using low frequency template

    Chi-Ho Yeung, Oscar C. Au, Ketan Tang, Zhiding Yu, Enming Luo, Yannan Wu, Shing Fat Tu

    IEEE International Conference on Multimedia and Expo (ICME) · 2011

    31
  • Re-ViLM: Retrieval-Augmented Visual Language Model for Zero and Few-Shot Image Captioning

    Zhuolin Yang, Wei Ping, Zihan Liu, Vijay Anand Korthikanti, Weili Nie, De-An Huang, Linxi Fan, Zhiding Yu, +8 more

    Findings of the Association for Computational Linguistics: EMNLP 2023 · 2023

    29
  • Llama Nemoretriever Colembed: Top-Performing Text-Image Retrieval Model

    Mengyao Xu, Gabriel Moreira, Ronay Ak, Radek Osmulski, Yauhen Babakhin, Zhiding Yu, Benedikt Schifferer, Even Oldridge

    arXiv · 2025

    This work introduces llama-nemoretriever-colembed, a unified text-image retrieval model that delivers state-of-the-art performance across multiple benchmarks, and adopts a two-stage training strategy to enhance the model's retrieval capabilities.

    28
  • FRAG: Frame Selection Augmented Generation for Long Video and Long Document Understanding

    De-An Huang, Subhashree Radhakrishnan, Zhiding Yu, Jan Kautz

    arXiv · 2025

    This work proposes Frame Selection Augmented Generation (FRAG), where the model first selects relevant frames within the input, and then only generates the final outputs based on the selected frames.

    27
  • Fast-ThinkAct: Efficient Vision-Language-Action Reasoning via Verbalizable Latent Planning

    Chi-Pin Huang, Yunze Man, Zhiding Yu, Min-Hung Chen, Jan Kautz, Yu-Chiang Frank Wang, Fu-En Yang

    arXiv · 2026

    Fast-ThinkAct is proposed, an efficient reasoning framework that achieves compact yet performant planning through verbalizable latent reasoning that enables reasoning-enhanced policy learning that effectively connects compact reasoning to action execution.

    26
  • CoordGAN: Self-Supervised Dense Correspondences Emerge from GANs

    Jiteng Mu, Shalini De Mello, Zhiding Yu, Nuno M. Vasconcelos, Xiaolong Wang, Jan Kautz, Sifei Liu

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    Coordinate GAN (CoordGAN) is introduced, a structure-texture disentangled GAN that learns a dense correspondence map for each generated image and achieves better structure and texture disentanglement compared to existing approaches.

    26
  • Nemotron 3 Nano Omni: Efficient and Open Multimodal Intelligence

    NVIDIA, :, Amala Sanjay Deshmukh, Kateryna Chumachenko, Tuomas Rintamaki, Matthieu Le, Tyler Poon, Danial Mohseni Taheri, +22 more

    arXiv · 2026

    Nemotron 3 Nano Omni is introduced, the latest model in the Nemotron multimodal series and the first to natively support audio inputs alongside text, images, and video and incorporates innovative multimodal token-reduction techniques.

    25
  • Vision Transformers are Good Mask Auto-Labelers

    Shiyi Lan, Xitong Yang, Zhiding Yu, Zuxuan Wu, José Manuel Álvarez, Animashree Anandkumar

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023

    Qualitative results indicate that masks produced by MAL are, in some cases, even better than human annotations, and state-of-the-art box-supervised methods by significant margins.

    25
  • StreamChat: Chatting with Streaming Video

    Jihao Liu, Zhiding Yu, Shiyi Lan, Shihao Wang, Rongyao Fang, Jan Kautz, Hongsheng Li, Jose M. Alvare

    arXiv · 2024

    StreamChat is presented, a novel approach that enhances the interaction capabilities of Large Multimodal Models (LMMs) with streaming video content by innovatively updating the visual context at each decoding step, ensuring that the model utilizes up-to-date video content throughout the decoding process.

    24
  • Scaling Up RL: Unlocking Diverse Reasoning in LLMs via Prolonged Training

    Mingjie Liu, Shizhe Diao, Jian Hu, Ximing Lu, Xin Dong, Zhang, Hao, Alexander Bukharin, Shaokun Zhang, +14 more

    arXiv · 2025

    23
  • Neural Networks with Recurrent Generative Feedback

    Yujia Huang, James Gornet, Sihui Dai, Zhiding Yu, Tan M. Nguyen, Doris Ying Tsao, Animashree Anandkumar

    arXiv · 2020

    22
  • Bongard-LOGO: A New Benchmark for Human-Level Concept Learning and Reasoning

    Weili Nie, Zhiding Yu, Lei Mao, Ankit Patel, Yuke Zhu, Animashree Anandkumar

    arXiv · 2020

    21
  • CASENet: Deep Category-Aware Semantic Edge Detection

    Zhiding Yu, Chen Feng, Ming-Yu Liu, Srikumar Ramalingam

    arXiv · 2017

    21
  • ProRL Agent: Rollout-as-a-Service for RL Training of Multi-Turn LLM Agents

    Hao Zhang, Mingjie Liu, Shaokun Zhang, Songyang Han, Jian Hu, Zhenghui Jin, Yuchi Zhang, Shizhe Diao, +5 more

    arXiv · 2026

    Under the rollout-as-a-service philosophy, this work presents ProRL Agent, a scalable infrastructure that serves the full agentic rollout lifecycle through an API service and validate ProRL Agent through RL training on software engineering, math, STEM, and coding tasks.

    19
  • Contrastive Syn-to-Real Generalization

    Wuyang Chen, Zhiding Yu, Shalini De Mello, Sifei Liu, José Manuel Álvarez, Zhangyang Wang, Animashree Anandkumar

    arXiv · 2021

    19
  • Adversarially Robust 3D Point Cloud Recognition Using Self-Supervisions

    Jiachen Sun, Yulong Cao, Christopher Choy, Zhiding Yu, Animashree Anandkumar, Zhuoqing Morley Mao, Chaowei Xiao

    CaltechAUTHORS (California Institute of Technology) · 2021

    18
  • Differentially Private Video Activity Recognition

    Zelun Luo, Yuliang Zou, Yijin Yang, Zane Durante, De-An Huang, Zhiding Yu, Chaowei Xiao, Li Fei-Fei, +1 more

    IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · 2024

    This paper proposes Multi-Clip DP-SGD, a novel framework for enforcing video-level differential privacy through clip-based classification models that can enhance differentially private image classification across an array of datasets including CheXpert, ImageNet, CIFAR-10, and CIFAR-100.

    17
  • Learning Contrastive Representation for Semantic Correspondence

    Taihong Xiao, Sifei Liu, Shalini De Mello, Zhiding Yu, Jan Kautz, Ming–Hsuan Yang

    International Journal of Computer Vision · 2022

    It is shown that image-level contrastive learning is a key component to encourage the convolutional features to find correspondence between similar objects, while the performance can be further enhanced by regularizing cross-instance cycle-consistency at intermediate feature levels.

    17
  • Joint kernel dictionary and classifier learning for sparse coding via locality preserving K-SVD

    Weiyang Liu, Zhiding Yu, Meng Yang, Lijia Lu, Yuexian Zou

    IEEE International Conference on Multimedia and Expo (ICME) · 2015

    17
  • Neural Eulerian Scene Flow Fields

    Kyle Vedder, Neehar Peri, Ishan Khatri, Siyi Li, Eric Eaton, Mehmet Kocamaz, Yue Wang, Zhiding Yu, +2 more

    arXiv · 2024

    This work reframe scene flow as the task of estimating a continuous space-time ODE that describes motion for an entire observation sequence, represented with a neural prior, enabling high quality scene flow estimation via pure self-supervision on real-world data.

    16
  • Angular Visual Hardness

    Beidi Chen, Weiyang Liu, Zhiding Yu, Jan Kautz, Anshumali Shrivastava, Animesh Garg, Animashree Anandkumar

    arXiv · 2019

    16
  • ResNet Sparsifier: Learning Strict Identity Mappings in Deep Residual Networks

    Xin Yu, Zhiding Yu, Srikumar Ramalingam

    arXiv · 2018

    Epsilon-ResNet is proposed that allows us to automatically discard redundant layers, which produces responses that are smaller than a threshold epsilon, with a marginal or no loss in performance.

    16
  • Generalized transitive distance with minimum spanning random forest

    Zhiding Yu, Weiyang Liu, Wenbo Liu, Xi Peng, Zhuo Hui, B. V. K. Vijaya Kumar

    International Joint Conference on Artificial Intelligence · 2015

    16
  • Image Interpolation Using Autoregressive Model and Gauss-Seidel Optimization

    Ketan Tang, Oscar C. Au, Lu Fang, Zhiding Yu, Yuanfang Guo

    International Conference on Image and Graphics · 2011

    16
  • Prismer: A Vision-Language Model with Multi-Task Experts

    Shikun Liu, Linxi Fan, Edward Johns, Zhiding Yu, Chaowei Xiao, Animashree Anandkumar

    arXiv · 2023

    15
  • AugMax: Adversarial Composition of Random Augmentations for Robust Training

    Haotao Wang, Chaowei Xiao, Jean Kossaifi, Zhiding Yu, Animashree Anandkumar, Zhangyang Wang

    CaltechAUTHORS (California Institute of Technology) · 2021

    15
  • PhyCritic: Multimodal Critic Models for Physical AI

    Tianyi Xiong, Shihao Wang, Guilin Liu, Yi Dong, Ming Li, Heng Huang, Jan Kautz, Zhiding Yu

    arXiv · 2026

    PhyCritic is introduced, a multimodal critic model optimized for physical AI through a two-stage RLVR pipeline: a physical skill warmup stage that enhances physically oriented perception and reasoning, followed by self-referential critic finetuning, where the critic generates its own prediction as an internal reference before judging candidate responses, improving judgment stability and physical correctness.

    14
  • Nemotron ColEmbed V2: Top-Performing Late Interaction Embedding Models for Visual Document Retrieval

    Gabriel de Souza P. Moreira, Ronay Ak, Mengyao Xu, Oliver Holworthy, Benedikt Schifferer, Zhiding Yu, Yauhen Babakhin, Radek Osmulski, +4 more

    arXiv · 2026

    Nemotron ColEmbed V2 is introduced, a family of models that achieve state-of-the-art performance on the ViDoRe benchmarks and the main techniques used across data processing, training, and post-training - such as cluster-based sampling, hard-negative mining, bidirectional attention, late interaction, and model merging - are described.

    14
  • Bag of textons for image segmentation via soft clustering and convex shift

    Zhiding Yu, Ang Li, Oscar C. Au, Chunjing Xu

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2012

    14
  • MinVIS: A Minimal Video Instance Segmentation Framework Without Video-Based Training

    De-An Huang, Zhiding Yu, Animashree Anandkumar

    neural information processing systems · 2022

    13
  • Transitive Distance Clustering with K-Means Duality

    Zhiding Yu, Chunjing Xu, Deyu Meng, Zhuo Hui, Fanyi Xiao, Wenbo Liu, Jianzhuang Liu

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2014

    13
  • Improving Distant 3D Object Detection Using 2D Box Supervision

    Zetong Yang, Zhiding Yu, Christopher Choy, Renhao Wang, Animashree Anandkumar, José Manuel Álvarez

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    This work proposes LR3D, a frame-work that learns to recover the missing depth of distant ob-jects and adopts an implicit projection head to learn the generation of mapping between 2D boxes and depth using the 3D supervision on close objects.

    12
  • Semi-supervised subspace learning with L2graph

    Xi Peng, Miaolong Yuan, Zhiding Yu, Wei‐Yun Yau, Lei Zhang

    Neurocomputing · 2016

    A semi-supervised subspace learning method which is inspired by the biological observation of similar inputs having similar codes (SISC), i.e., the same collection of cortical columns of the mammal's visual cortex is always activated by the similar stimuli is proposed.

    12
  • Jointly Learning Non-negative Projection and Dictionary with Discriminative Graph Constraints for Classification

    Weiyang Liu, Zhiding Yu, Yandong Wen, Rongmei Lin, Meng Yang

    British Machine Vision Conference (BMVC) · 2016

    A framework, named joint non-negative projection and dictionary learning (JNPDL), enables interaction between the input features and the dictionaries and leads to discriminative parts-based object features while DL seeks a more suitable representation.

    12
  • On ACO-Based Fuzzy Clustering for Image Segmentation

    Zhiding Yu, Weiyu Yu, Ruobing Zou, Simin Yu

    Lecture notes in computer science · 2009

    A novel ACO-based fuzzy clustering algorithm is introduced and segmentation results indicate that the proposed approach has the potential of becoming an established clustering method for image segmentation.

    12
  • Enhancing Autonomous Driving Safety with Collision Scenario Integration

    Zi Wang, Shiyi Lan, Xinglong Sun, Nadine Chang, Zhenxin Li, Zhiding Yu, José Manuel Álvarez

    IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · 2025

    SafeFusion is proposed, a training framework to learn from collision data that integrates safety-oriented metrics during training to enable collision avoidance learning and proposes CollisionGen, a scalable data generation pipeline to generate diverse, high-quality scenarios using natural language prompts, generative models, and rule-based filtering.

    11
  • Image-Level or Object-Level? A Tale of Two Resampling Strategies for Long-Tailed Detection

    Nadine Chang, Zhiding Yu, Yu-Xiong Wang, Animashree Anandkumar, Sanja Fidler, José Manuel Álvarez

    arXiv · 2021

    11
  • A novel fifth-order hyperchaotic circuit and its research

    Simin Yu, Zhiding Yu, (1)广东工业大学自动化学院,广州 510006; (2)华南理工大学电子与信息学院,广州 510640

    Acta Physica Sinica · 2008

    Bifurcation and Lyapnuov exponent calculations demonstrate that the oscillation mechanism of the circuit evolves into chaos and hyperchaos from periodic with the change of bifurcence parameters.

    11
  • NVIDIA Nemotron Nano V2 VL

    NVIDIA, :, Amala Sanjay Deshmukh, Kateryna Chumachenko, Tuomas Rintamaki, Matthieu Le, Tyler Poon, Danial Mohseni Taheri, +22 more

    arXiv · 2025

    Nemotron Nano V2 VL is introduced, the latest model of the Nemotron vision-language series designed for strong real-world document understanding, long video comprehension, and reasoning tasks, and major enhancements in model architecture, datasets, and training recipes are introduced.

    10
  • How anti-aliasing filter affects image contrast: An analysis from majorization theory perspective

    Ketan Tang, Oscar C. Au, Lu Fang, Zhiding Yu, Yuanfang Guo

    IEEE International Conference on Multimedia and Expo (ICME) · 2011

    10
  • 10
  • Data hiding in dot diffused halftone images

    Yuanfang Guo, Oscar C. Au, Ketan Tang, Lu Fang, Zhiding Yu

    IEEE International Conference on Multimedia and Expo (ICME) · 2011

    10
  • Towards Multimodal Lifelong Understanding: A Dataset and Agentic Baseline

    Guo Chen, Lidong Lü, Yicheng Liu, Liangrui Dong, Lidong Zou, Jixin Lv, Zhenquan Li, Xinyi Mao, +12 more

    arXiv · 2026

    The Recursive Multimodal Agent (ReMA) is proposed, which employs dynamic memory management to iteratively update a recursive belief state, significantly outperforming existing methods.

    9
  • Learning Calibrated Uncertainties for Domain Shift: A Distributionally Robust Learning Approach

    Haoxuan Wang, Zhiding Yu, Yisong Yue, Animashree Anandkumar, Anqi Liu, Junchi Yan

    International Joint Conference on Artificial Intelligence · 2023

    This work proposes a framework for learning calibrated uncertainties under domain shifts, considering the case where the source (training) distribution differs from the target (test) distribution, and uses the density ratio estimator to adjust the uncertainty of prediction in the task network.

    9
  • Automated Synthetic-to-Real Generalization

    Wuyang Chen, Zhiding Yu, Wang, Zhangyang, Animashree Anandkumar

    arXiv · 2020

    9
  • What is Point Supervision Worth in Video Instance Segmentation?

    Shuaiyi Huang, De-An Huang, Zhiding Yu, Shiyi Lan, Subhashree Radhakrishnan, José Manuel Álvarez, Abhinav Shrivastava, Animashree Anandkumar

    IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · 2024

    This work reduces the human annotations to only one point for each object in a video frame during training, and obtains high-quality mask predictions close to fully supervised models.

    8
  • An iterative framework for unsupervised learning in the PLDA based speaker verification

    Wenbo Liu, Zhiding Yu, Ming Li

    The 9th International Symposium on Chinese Spoken Language Processing · 2014

    8
  • Adaptive depth map assisted matting in 3D video

    Wenxiu Sun, Oscar C. Au, Lingfeng Xu, Zhiding Yu

    IEEE International Conference on Multimedia and Expo (ICME) · 2011

    8
  • A modified fuzzy c-means algorithm with adaptive spatial information for color image segmentation

    Zhiding Yu, Ruobing Zou, Simin Yu

    2009 IEEE Symposium on Computational Intelligence for Image Processing · 2009

    8
  • Eagle 2.5: Boosting Long-Context Post-Training for Frontier Vision-Language Models

    Guo Chen, Zhiqi Li, Shihao Wang, Jindong Jiang, Yicheng Liu, Lidong Lü, De-An Huang, Wonmin Byeon, +9 more

    neural information processing systems · 2025

    7
  • Fully Attentional Networks with Self-emerging Token Labeling

    Bingyin Zhao, Zhiding Yu, Shiyi Lan, Yutao Cheng, Animashree Anandkumar, Yingjie Lao, José Manuel Álvarez

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2023

    This paper revisits the FAN models and improves their pretraining with a self-emerging token labeling (STL) framework, demonstrating significantly enhanced performance on downstream tasks such as semantic segmentation, with up to 1.7% improvement over the counterpart model.

    7
  • Structured Hough Voting for Vision-Based Highway Border Detection

    Zhiding Yu, Wende Zhang, B. V. K. Vijaya Kumar, Dan Levi

    IEEE Winter Conference on Applications of Computer Vision · 2015

    Both qualitative and quantitative evaluations show the superiority of the proposed structured Hough voting model over a number of baseline methods.

    7
  • Automatic object segmentation from large scale 3D urban point clouds through manifold embedded mode seeking

    Zhiding Yu, Chunjing Xu, Jianzhuang Liu, Oscar C. Au, Xiaoou Tang

    ACM International Conference on Multimedia (ACM MM) · 2011

    A system that can automatically segment objects in large scale 3D point clouds obtained from urban ranging images by adopting a manifold embedded mode seeking method to segment the point clouds.

    7
  • Vesta: A Generalist Embodied Reasoning Model

    Johan Björck, Zhiqi Li, Yunze Man, Jing Wang, An‐Chieh Cheng, Liu S, Shihao Wang, Zhiding Yu, +22 more

    arXiv · 2026

    Vesta is presented, a unified embodied generalist that consolidates localization, spatial reasoning, navigation, navigation, and long-horizon planning capabilities into a single foundation model and demonstrates that a generalist model can match or exceed specialists.

    6
  • LocateAnything3D: Vision-Language 3D Detection with Chain-of-Sight

    Man, Yunze, Wang, Shihao, Zhang, Guowen, Bjorck, Johan, Li, Zhiqi, Gui, Liang-Yan, Fan, Jim, Jan Kautz, +2 more

    arXiv · 2025

    This work presents LocateAnything3D, a VLM-native recipe that casts 3D detection as a next-token prediction problem, and offers a practical foundation for models to perceive in 3D.

    6
  • Practical Machine Learning Safety: A Survey and Primer

    Sina Mohseni, Haotao Wang, Zhiding Yu, Chaowei Xiao, Zhangyang Wang, Jay Yadawa

    arXiv · 2021

    6
  • Transposer: Universal Texture Synthesis Using Feature Maps as Transposed Convolution Filter

    Guilin Liu, Rohan Taori, Ting-Chun Wang, Zhiding Yu, Shiqiu Liu, Fitsum A. Reda, Karan Sapra, Andrew Tao, +1 more

    arXiv · 2020

    6
  • Stateful Token Reduction for Long-Video Hybrid VLMs

    Jiang, Jindong, Amala Sanjay Deshmukh, Kateryna Chumachenko, Karan Sapra, Zhiding Yu, Guilin Liu, Andrew Tao, Pavlo A. Molchanov, +2 more

    arXiv · 2026

    A hybrid-aware token reduction framework with a low-to-high progressive schedule and a unified query-conditioned importance score for attention and Mamba layers is proposed, which outperforms prior baselines on the same hybrid backbone and combines effectively with visual redundancy reduction methods.

    5
  • OpenVision 3: A Family of Unified Visual Encoder for Both Understanding and Generation

    Letian Zhang, Sucheng Ren, Yanqing Liu, Xianhang Li, Zeyu Wang, Yuyin Zhou, Huaxiu Yao, Zeyu Zheng, +4 more

    arXiv · 2026

    A family of advanced vision encoder that learns a single, unified visual representation that can serve both image understanding and image generation, and provides empirical evidence that generation and understanding are mutually beneficial in the architecture.

    5
  • Towards Reducing Labeling Cost in Deep Object Detection

    Ismail Elezi, Zhiding Yu, Animashree Anandkumar, Laura Leal-Taixé, José Manuel Álvarez

    arXiv · 2021

    5
  • Distributionally Robust Learning for Unsupervised Domain Adaptation

    Haoxuan Wang, Anqi Liu, Zhiding Yu, Yisong Yue, Animashree Anandkumar

    CaltechAUTHORS (California Institute of Technology) · 2021

    A distributionally robust learning method for unsupervised domain adaptation (UDA) that scales to modern computer vision benchmarks, and it is demonstrated that DRST captures shape features more effectively, and reduces the extent of distributional shift during self-training.

    5
  • Coupled Segmentation and Edge Learning via Dynamic Graph Propagation

    Zhiding Yu, Rui Huang, Wonmin Byeon, Sifei Liu, Guilin Liu, Thomas Michael Breuel, Animashree Anandkumar, Jan Kautz

    CaltechAUTHORS (California Institute of Technology) · 2021

    5
  • Learning towards Minimum Hyperspherical Energy

    Weiyang Liu, Rongmei Lin, Zhen Liu, Lixin Liu, Zhiding Yu, Bo Dai, Le Song

    arXiv · 2018

    5
  • On Order-Constrained Transitive Distance Clustering

    Zhiding Yu, Weiyang Liu, Wenbo Liu, Yingzhen Yang, Ming Li, B. V. K. Vijaya Kumar

    Proceedings of the AAAI Conference on Artificial Intelligence · 2016

    A fast approximation framework for approximating order-constrained transitive distance (OCTD) and its clustering applications is proposed, using random samplings to generate multiple diversified TD matrices and a pooling to output the final approximated OCTD matrix.

    5
  • Robust rear-view ground surface detection with hidden state conditional random field and confidence propagation

    Zhiding Yu, Wende Zhang, B. V. K. Vijaya Kumar

    Proceedings - International Conference on Image Processing · 2014

    5
  • Multi-scale analysis of color and texture for salient object detection

    Ketan Tang, Oscar C. Au, Lu Fang, Zhiding Yu, Yuanfang Guo

    Proceedings - International Conference on Image Processing · 2011

    5
  • AIDE: Agentically Improve Visual Language Model with Domain Experts

    Ming-Chang Chiu, Fuxiao Liu, Karan Sapra, Andrew Tao, Yaser Yacoob, Xuezhe Ma, Zhiding Yu, Guilin Liu

    arXiv · 2025

    AIDE (Agentic Improvement through Domain Experts), a novel framework that enables VLMs to autonomously enhance their capabilities by leveraging specialized domain expert models, provides a scalable, resource-efficient approach to continuous VLM improvement.

    4
  • Unsupervised Controllable Generation with Self-Training

    Grigorios G. Chrysos, Jean Kossaifi, Zhiding Yu, Animashree Anandkumar

    2021 International Joint Conference on Neural Networks (IJCNN) · 2021

    This work proposes an unsupervised framework to learn a distribution of latent codes that control the generator through self-training, and exhibits better disentanglement compared to other variants such as the variational autoencoder, and is able to discover semantically meaningful latent codes without any supervision.

    4
  • MULTI-KERNEL COLLABORA TIVE REPRESENTATION FOR IMAGE CLASSIFICATION

    Weiyang Liu, Zhiding Yu, Yandong Wen, Meng Yang, Yuexian Zou

    International Conference on Information Photonics · 2015

    4
  • Compressive Hyperspherical Energy Minimization.

    Rongmei Lin, Weiyang Liu, Zhen Liu, Chen Feng, Zhiding Yu, James Matthew Rehg, Li Xiong, Le Song

    arXiv · 2019

    Compressive minimum hyperspherical energy (CoMHE) is proposed as an alternative regularization for neural networks that utilizes a projection mapping to reduce the dimensionality of neurons and minimizes their hypersphericals energy.

    3
  • Texture optimization for seamless view synthesis through energy minimization

    Wenxiu Sun, Oscar C. Au, Lingfeng Xu, Yujun Li, Wei Hu, Zhiding Yu

    ACM International Conference on Multimedia (ACM MM) · 2012

    The problem is formulated as joint optimization of inter-view texture similarity and geometry preservation, which significantly differs from traditional view synthesis framework, and the image characteristics of virtual view are inherently inherited from the reference view without introducing any image prior or texture modeling technique.

    3
  • Memorize What Matters: Emergent Scene Decomposition from Multitraverse

    Yiming Li, Zehong Wang, Yue Wang, Zhiding Yu, Žan Gojčič, Marco Pavone, Chen Feng, José Manuel Álvarez

    neural information processing systems · 2024

    2
  • CASENet: Deep Category-Aware Semantic Edge Detection

    Zhiding Yu, Chen Feng, Ming-Yu Liu, Srikumar Ramalingam

    Zenodo (CERN European Organization for Nuclear Research) · 2023

    2
  • Correction to: Learning Contrastive Representation for Semantic Correspondence

    Taihong Xiao, Sifei Liu, Shalini De Mello, Zhiding Yu, Jan Kautz, Ming–Hsuan Yang

    International Journal of Computer Vision · 2022

    2
  • Image Segmentation Based on Local Ant Colony Optimization

    Ruobing Zou, Weiyu Yu, Zhiding Yu, Xiangyu Yu

    International Conference on Natural Computation (ICNC) · 2009

    2
  • GHOST: Getting to the Bottom of Hallucinations with A Multi-round Consistency Benchmark

    Vibashan VS, Nadine Chang, Jenny Schmalfuß, Vishal M. Patel, Zhiding Yu, José Manuel Álvarez

    IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · 2026

    1
  • LocateAnything: Fast and High-Quality Vision-Language Grounding with Parallel Box Decoding

    Shihao Wang, Shilong Liu, Yuanguo Kuang, Xinyu Wei, Yangzhou Liu, Zhiqi Li, Yunze Man, Chen Guo, +5 more

    Lecture notes in computer science · 2026

    1
  • Exploring Camera Encoder Designs for Autonomous Driving Perception

    Barath Lakshmanan, Joshua Chen, Shiyi Lan, Maying Shen, Zhiding Yu, José Manuel Álvarez

    arXiv · 2024

    This work starts from a standard general-purpose encoder, ConvNeXt and progressively transforms the design, resulting in an architecture optimized for AV camera encoder achieving 8.79% mAP improvement over the baseline.

    1
  • A Semantic Space is Worth 256 Language Descriptions: Make Stronger Segmentation Models with Descriptive Properties

    Junfei Xiao, Ziqi Zhou, Wenxuan Li, Shiyi Lan, Jieru Mei, Zhiding Yu, Bingchen Zhao, Alan Yuille, +2 more

    Lecture notes in computer science · 2024

    1
  • Deep Distributionally Robust Learning for Calibrated Uncertainties under Domain Shift

    Haoxuan Wang, Anqi Liu, Zhiding Yu, Junchi Yan, Yisong Yue, Animashree Anandkumar

    arXiv · 2020

    1
  • Joint recognition / segmentation with cascaded multi-level feature classification and confidence propagation

    Wenbo Liu, Zhiding Yu, Deyu Meng

    IEEE International Conference on Multimedia and Expo workshops · 2013

    1
  • 1
  • FLASHREINFORCE: CRITIC-FREE SINGLE-ROLLOUT ASYNCHRONOUS RL FOR AGENTIC LANGUAGE MODELS

    Jian Hu, Yifan Zhang, Binfeng Xu, Hao Zhang, Shaokun Zhang, Hongqing Peng, Zhiding Yu, Pavlo A. Molchanov, +2 more

    2026

    –
  • Recova: Agent-Guided Failure Recovery for Autonomous Robotic Manipulation

    Isabella Liu, An‐Chieh Cheng, Johan Björck, Zhiding Yu, Hongxu Yin, Jan Kautz, Linxi Fan, Yuke Zhu, +1 more

    arXiv · 2026

    –
  • Nemotron-H: A Family of Accurate and Efficient Hybrid Mamba-Transformer Models

    Nvidia Nvidia, :, Blakeman, Aaron, Aarti Basant, Abhinav Khattar, Adithya Renduchintala, Akhiad Bercovich, Aleksander Ficek, +22 more

    arXiv · 2025

    –
  • Test-Time Prompt Tuning for Vision-Language Models

    Manli Shu, Weili Nie, De-An Huang, Zhiding Yu, Tom Goldstein, Animashree Anandkumar, Chaowei Xiao

    Advances in computer vision and pattern recognition · 2025

    –
  • Nemotron-Research-Tool-N1: Tool-Using Language Models with Reinforced Reasoning

    Shaokun Zhang, Yi Dong, Jieyu Zhang, Jan Kautz, Bryan Catanzaro, Andrew Tao, Qingyun Wu, Zhiding Yu, +1 more

    Preprints.org · 2025

    –
  • SF3D: SlowFast Temporal 3D Object Detection

    Renhao Wang, Zhiding Yu, Shiyi Lan, Enze Xie, Ke Chen, Animashree Anandkumar, José Manuel Álvarez

    IEEE Intelligent Vehicles Symposium · 2024

    –
  • ModelNet40-C

    Jiachen Sun, Qingzhao Zhang, Bhavya Kailkhura, Zhiding Yu, Chaowei Xiao, Z. Morley Mao

    Zenodo (CERN European Organization for Nuclear Research) · 2022

    –
  • SECANT: Self-Expert Cloning for Zero-Shot Generalization of Visual Policies

    Jim Fan, Guanzhi Wang, De-An Huang, Zhiding Yu, Li Fei-Fei, Yuke Zhu, Animashree Anandkumar

    International Conference on Machine Learning · 2021

    –
  • Transferable Unsupervised Robust Representation Learning

    De-An Huang, Zhiding Yu, Animashree Anandkumar

    2021

    –
  • Panoptic SegFormer

    Zhiqi Li, Wenhai Wang, Enze Xie, Zhiding Yu, Animashree Anandkumar, José Manuel Álvarez, Tong Lü, Ping Luo

    arXiv · 2021

    –
  • ロバストな部分空間学習と部分空間クラスタリングのためのL2グラフの構築【Powered by NICT】

    Xi Peng, Zhiding Yu, Yi Zhang, Huajin Tang

    IEEE Transactions on Systems Man and Cybernetics · 2017

    –
  • –
  • L2graphによる学習半教師つき部分空間【Powered by NICT】

    Peng Xi, Yuan Miaolong, Zhiding Yu, Yau Wei Yun, Lei Zhang

    Neurocomputing · 2016

    –
  • Locality constrained transitive distance clustering on speech data

    Wenbo Liu, Zhiding Yu, Bhiksha Raj, Ming Li

    Interspeech (USB) · 2015

    The locality constrained transitive distance is proposed, a distance measure which better models speech data with arbitrarily shaped clusters and a robust top-down clustering framework on top of the distance measure to generate accurate cluster labels.

    –
  • –
  • Towards robust and efficient segmentation: An approach based on inter-region contour and intra-region content analysis

    Zhiding Yu, Oscar C. Au, Ketan Tang, Lingfeng Xu, Wenxiu Sun, Yuanfang Guo

    IEEE International Conference on Multimedia and Expo (ICME) · 2011

    –
  • Graph segmentation revisited: Detailed analysis and density learning based implementation

    Zhiding Yu, Oscar C. Au, Ketan Tang, Jiali Li, Lingfeng Xu, Xingyu Zhang

    IEEE International Conference on Multimedia and Expo (ICME) · 2010

    –
  • Color Image Segmentation Based on Ant Colony - FCM Hybrid Algorithm

    Zhiding Yu, Ruobing Zou, Weiyu Yu, Jing Tian

    ASME eBooks · 2010

    –
  • Noise-robust Binary segmentation based on Ant Colony System and Modified Fuzzy C-Means algorithm

    Zhiding Yu, Ruobing Zou, Simin Yu, Huqiong Mou

    IEEE Congress on Evolutionary Computation (CEC) · 2009

    –
  • Heuristic Search for Cluster Centroids: An Ant-Based Approach for FCM Initialization

    Zhiding Yu, Ruobing Zou, Simin Yu

    Lecture notes in computer science · 2009

    An ant-based approach to heuristic centroid searching is introduced and the partitions found using the ant initialization are better optimized than those obtained from random initializations.

    –

Publication data from OpenAlex, with missing venues and authors filled in from Crossref; citation counts are the higher of OpenAlex and Semantic Scholar, last synced 2026-10-15. One-sentence summaries under some papers are written by Semantic Scholar’s model. Citation counts may be lower than on Google Scholar, which indexes more sources.

Report an error

Wrong papers, two people merged into one, or a profile that should not be here? Tell us and we will fix or hide it.

Sign in to report