Is this you? Claim this profile to correct it, add a bio and choose the work people see first.

Claim this profile

Works126 from public data

TitleCited by
  • 3D ShapeNets: A deep representation for volumetric shapes

    Zhirong Wu, Shuran Song, Aditya Khosla, Fisher Yu, Linguang Zhang, Xiaoou Tang, Jianxiong Xiao

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2015

    6,705
  • BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learning

    Fisher Yu, Haofeng Chen, Xin Wang, Wenqi Xian, Yingying Chen, Fangchen Liu, Vashisht Madhavan, Trevor J. Darrell

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2020

    This work constructs BDD100K, the largest driving video dataset with 100K videos and 10 tasks to evaluate the exciting progress of image recognition algorithms on autonomous driving and shows that special training strategies are needed for existing models to perform such heterogeneous tasks.

    3,255
  • RePaint: Inpainting using Denoising Diffusion Probabilistic Models

    Andreas Lugmayr, Martin Danelljan, Andrés Romero, Fisher Yu, Radu Timofte, Luc Van Gool

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    This work proposes RePaint: A Denoising Diffusion Probabilistic Model (DDPM) based inpainting approach that is applicable to even extreme masks and outperforms state-of-the-art Autoregressive, and GAN approaches for at least five out of six mask distributions.

    2,341
  • ShapeNet: An Information-Rich 3D Model Repository

    Chang, Angel X., Thomas A. Funkhouser, Leonidas Guibas, Pat Hanrahan, Qixing Huang, Zimo Li, Silvio Savarese, Manolis Savva, +5 more

    arXiv · 2015

    2,329
  • Dilated Residual Networks

    Fisher Yu, Vladlen Koltun, Thomas A. Funkhouser

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2017

    It is shown that dilated residual networks (DRNs) outperform their non-dilated counterparts in image classification without increasing the models depth or complexity and the accuracy advantage of DRNs is further magnified in downstream applications such as object localization and semantic segmentation.

    1,841
  • ShapeNet: An Information-Rich 3D Model Repository

    Angel X. Chang, Thomas A. Funkhouser, Leonidas Guibas, Pat Hanrahan, Qixing Huang, Zimo Li, Silvio Savarese, Manolis Savva, +5 more

    2023

    1,623
  • Deep Layer Aggregation

    Fisher Yu, Dequan Wang, Evan Shelhamer, Trevor J. Darrell

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2018

    This work augments standard architectures with deeper aggregation to better fuse information across layers and iteratively and hierarchically merge the feature hierarchy to make networks with better accuracy and fewer parameters.

    1,568
  • Multi-Scale Context Aggregation by Dilated Convolutions

    Fisher Yu, Vladlen Koltun

    arXiv · 2015

    1,484
  • Semantic Scene Completion from a Single Depth Image

    Shuran Song, Fisher Yu, Andy Zeng, Angel X. Chang, Manolis Savva, Thomas A. Funkhouser

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2017

    The semantic scene completion network (SSCNet) is introduced, an end-to-end 3D convolutional network that takes a single depth image as input and simultaneously outputs occupancy and semantic labels for all voxels in the camera view frustum.

    1,453
  • LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loop

    Fisher Yu, Ari Seff, Yinda Zhang, Shuran Song, Funkhouser, Thomas, Jianxiong Xiao

    arXiv · 2015

    1,246
  • BDD100K: A Diverse Driving Video Database with Scalable Annotation Tooling.

    Fisher Yu, Wenqi Xian, Yingying Jennifer Chen, Fangchen Liu, Mike Liao, Vashisht Madhavan, Trevor J. Darrell

    arXiv · 2018

    The design and implementation of a scalable annotation system that can provide a comprehensive set of image labels for large-scale driving datasets, and a new driving dataset, which is an order of magnitude larger than previous efforts.

    977
  • Scaling Vision Transformers to 22 Billion Parameters

    Mostafa Dehghani, Josip Djolonga, Basil Mustafa, Piotr Padlewski, Jonathan Heek, Justin Gilmer, Steiner, Andreas, Caron, Mathilde, +22 more

    arXiv · 2023

    A recipe for highly efficient and stable training of a 22B-parameter ViT (ViT-22B) and a wide variety of experiments on the resulting model, which demonstrates the potential for "LLM-like"scaling in vision, and provides key steps towards getting there.

    961
  • End-to-End Learning of Driving Models from Large-Scale Video Datasets

    Huazhe Xu, Yang Gao, Fisher Yu, Trevor J. Darrell

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2017

    This work advocates learning a generic vehicle motion model from large scale crowd-sourced video data, and develops an end-to-end trainable architecture for learning to predict a distribution over future vehicle egomotion from instantaneous monocular camera observations and previous vehicle state.

    889
  • Few-Shot Object Detection via Feature Reweighting

    Bingyi Kang, Zhuang Liu, Xin Wang, Fisher Yu, Jiashi Feng, Trevor J. Darrell

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2019

    This work develops a few-shot object detector that can learn to detect novel objects from only a few annotated examples, using a meta feature learner and a reweighting module within a one-stage detection architecture.

    879
  • SkipNet: Learning Dynamic Routing in Convolutional Networks

    Xin Wang, Fisher Yu, Zi-Yi Dou, Trevor J. Darrell, Joseph E. Gonzalez

    Lecture notes in computer science · 2018

    This work introduces SkipNet, a modified residual network, that uses a gating network to selectively skip convolutional blocks based on the activations of the previous layer, and proposes a hybrid learning algorithm that combines supervised learning and reinforcement learning to address the challenges of non-differentiable skipping decisions.

    813
  • Segment Anything in High Quality

    Ke, Lei, Mingqiao Ye, Martin Danelljan, Yifan Liu, Yu‐Wing Tai, Chi–Keung Tang, Fisher Yu

    arXiv · 2023

    A learnable High-Quality Output Token is injected into SAM's mask decoder and is responsible for predicting the high-quality mask, which reuses and preserves the pre-trained model weights of SAM, while only introducing minimal additional parameters and computation.

    714
  • FCNs in the Wild: Pixel-level Adversarial and Constraint-based Adaptation

    Judy Hoffman, Dequan Wang, Fisher Yu, Trevor J. Darrell

    arXiv · 2016

    602
  • Exploring Cross-Image Pixel Contrast for Semantic Segmentation

    Wenguan Wang, Tianfei Zhou, Fisher Yu, Jifeng Dai, Ender Konukoğlu, Luc Van Gool

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2021

    This work raises a pixel-wise metric learning paradigm for semantic segmentation, by explicitly exploring the structures of labeled pixels, which were rarely explored before, and hopes this work will encourage the community to rethink the current de facto training paradigm in semantic segmentsation.

    596
  • Scribbler: Controlling Deep Image Synthesis with Sketch and Color

    Patsorn Sangkloy, Jingwan Lu, Fang Chen, Fisher Yu, James H. Hays

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2017

    A deep adversarial image synthesis architecture that is conditioned on sketched boundaries and sparse color strokes to generate realistic cars, bedrooms, or faces is proposed and demonstrates a sketch based image synthesis system which allows users to scribble over the sketch to indicate preferred color for objects.

    535
  • UniDepth: Universal Monocular Metric Depth Estimation

    Luigi Piccinelli, Yung-Hsu Yang, Christos Sakaridis, Mattia Segù, Siyuan Li, Luc Van Gool, Fisher Yu

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    This work proposes a new model, UniDepth, capable of reconstructing metric 3D scenes from solely single images across domains, and proposes a geometric invariance loss that promotes the invariance of camera-prompted depth features.

    523
  • Quasi-Dense Similarity Learning for Multiple Object Tracking

    Jiangmiao Pang, Linlu Qiu, Xia Li, Haofeng Chen, Qi Li, Trevor J. Darrell, Fisher Yu

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2021

    Quasi-Dense Similarity Learning is presented, which densely samples hundreds of region proposals on a pair of images for contrastive learning and which outperforms all existing methods on MOT, BDD100K, Waymo, and TAO tracking benchmarks.

    513
  • Dual Aggregation Transformer for Image Super-Resolution

    Zheng Chen, Yulun Zhang, Jinjin Gu, Linghe Kong, Xiaokang Yang, Fisher Yu

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2023

    A novel Transformer model, Dual Aggregation Transformer (DAT), is proposed, which aggregates features across spatial and channel dimensions, in the inter-block and intra-block dual manner.

    455
  • Unifying Flow, Stereo and Depth Estimation

    Haofei Xu, Jing Zhang, Jianfei Cai, Hamid Rezatofighi, Fisher Yu, Dacheng Tao, Andreas Geiger

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2023

    It is demonstrated that cross-attention enables integration of knowledge from another image via cross-view interactions, which greatly improves the quality of the extracted features and enables cross-task transfer.

    433
  • Transforming Model Prediction for Tracking

    Christoph A. Mayer, Martin Danelljan, Goutam Bhat, Matthieu Paul, Danda Pani Paudel, Fisher Yu, Luc Van Gool

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    This work trains the proposed tracker end-to-end and validate its performance by conducting comprehensive experiments on multiple tracking datasets, achieving an AUC of 68.5% on the challenging LaSOT [14] dataset.

    433
  • End-to-End Urban Driving by Imitating a Reinforcement Learning Coach

    Zhejun Zhang, Alexander Liniger, Dengxin Dai, Fisher Yu, Luc Van Gool

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2021

    A reinforcement learning expert is trained that maps bird’s-eye view images to continuous low-level actions and provides in-formative supervision signals for imitation learning agents to learn from that achieves expert-level performance.

    358
  • TextureGAN: Controlling Deep Image Synthesis with Texture Patches

    Wenqi Xian, Patsorn Sangkloy, Varun Agrawal, Amit Raj, Jingwan Lu, Fang Chen, Fisher Yu, James H. Hays

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2018

    This paper is the first to examine texture control in deep image synthesis guided by sketch, color, and texture and develops a local texture loss in addition to adversarial and content loss to train the generative network.

    302
  • Frustratingly Simple Few-Shot Object Detection

    Xin Wang, Thomas E. Huang, Trevor J. Darrell, Joseph E. Gonzalez, Fisher Yu

    arXiv · 2020

    296
  • PairedCycleGAN: Asymmetric Style Transfer for Applying and Removing Makeup

    Huiwen Chang, Jingwan Lu, Fisher Yu, Adam Finkelstein

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2018

    290
  • Hierarchical Discrete Distribution Decomposition for Match Density Estimation

    Zhichao Yin, Trevor J. Darrell, Fisher Yu

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2019

    Hierarchical Discrete Distribution Decomposition (HD^3), a framework suitable for learning probabilistic pixel correspondences in both optical flow and stereo matching, is proposed and achieves state-of-the-art results.

    276
  • SHIFT: A Synthetic Driving Dataset for Continuous Multi-Task Domain Adaptation

    Tao Sun, Mattia Segù, Janis Postels, Yuxuan Wang, Luc Van Gool, Bernt Schiele, Federico Tombari, Fisher Yu

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    This paper introduces the largest multi-task synthetic dataset for autonomous driving, SHIFT, which presents discrete and continuous shifts in cloudiness, rain and fog intensity, time of day, and vehicle and pedestrian density.

    273
  • Joint Monocular 3D Vehicle Detection and Tracking

    Hou-Ning Hu, Qi-Zhi Cai, Dequan Wang, Ji Lin, Min Sun, Philipp Krähenbühl, Trevor J. Darrell, Fisher Yu

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2019

    A novel online framework for 3D vehicle detection and tracking from monocular videos that can not only associate detections of vehicles in motion over time, but also estimate their complete 3D bounding box information from a sequence of 2D images captured on a moving platform.

    250
  • Generative Cooperative Learning for Unsupervised Video Anomaly Detection

    Muhammad Zaigham Zaheer, Arif Mahmood, Muhammad Haris Khan, Mattia Segù, Fisher Yu, Seung‐Ik Lee

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    This work proposes a novel unsupervised Generative Cooperative Learning (GCL) approach for video anomaly detection that exploits the low frequency of anomalies towards building a cross-supervision between a generator and a discriminator.

    236
  • LiDAR Snowfall Simulation for Robust 3D Object Detection

    Martin Hahner, Christos Sakaridis, Mario Bijelic, Felix Heide, Fisher Yu, Dengxin Dai, Luc Van Gool

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    This paper proposes a physically based method to simulate the effect of snowfall on real clear-weather LiDAR point clouds, and conducts an extensive evaluation using several state-of-the-art 3D object detection methods to show that this simulation consistently yields significant performance gains on the real snowy STF dataset.

    196
  • Gaussian Grouping: Segment and Edit Anything in 3D Scenes

    Mingqiao Ye, Martin Danelljan, Fisher Yu, Lei Ke

    Lecture notes in computer science · 2024

    192
  • QDTrack: Quasi-Dense Similarity Learning for Appearance-Only Multiple Object Tracking

    Tobias Fischer, T. Huang, Jiangmiao Pang, Linlu Qiu, Haofeng Chen, Trevor J. Darrell, Fisher Yu

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2023

    This paper presents Quasi-Dense Similarity Learning, which densely samples hundreds of object regions on a pair of images for contrastive learning, and combines this similarity learning with multiple existing object detectors to build QDTrack, which rivals the performance of state-of-the-art tracking methods on all benchmarks.

    173
  • Mask Transfiner for High-Quality Instance Segmentation

    Lei Ke, Martin Danelljan, Xia Li, Yu‐Wing Tai, Chi–Keung Tang, Fisher Yu

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    This paper presents Mask Transfiner, a transformer-based approach to instance segmentation that decomposes and represents the image regions as a quadtree, allowing it to predict highly accurate instance masks, at a low computational cost.

    173
  • Monocular Quasi-Dense 3D Object Tracking

    Hou-Ning Hu, Yung-Hsu Yang, Tobias Fischer, Trevor J. Darrell, Fisher Yu, Min Sun

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2022

    This work proposes a framework that can effectively associate moving objects over time and estimate their full 3D bounding box information from a sequence of 2D images captured on a moving platform and an LSTM-based object velocity learning module aggregates the long-term trajectory information for more accurate motion extrapolation.

    162
  • iDisc: Internal Discretization for Monocular Depth Estimation

    Luigi Piccinelli, Christos Sakaridis, Fisher Yu

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023

    iDisc, a new module, implements a continuous-discrete-continuous bottleneck to learn internal discretized representations without supervision, and sets the new state of the art with significant improvements on NYU-Depth v2 and KittI, outperforming all published methods on the official KITTI benchmark.

    137
  • Strategic Preys Make Acute Predators: Enhancing Camouflaged Object Detectors by Generating Camouflaged Objects

    Chunming He, Kai Li, Yachao Zhang, Yulun Zhang, Zhenhua Guo, Xiu Li, Martin Danelljan, Fisher Yu

    arXiv · 2023

    An adversarial training framework is proposed, Camouflageator, which introduces an auxiliary generator to generate more camouflaged objects that are harder for a COD method to detect and ICEG, which brings state-of-the-art COD performance.

    134
  • The Tenth Visual Object Tracking VOT2022 Challenge Results

    Matej Kristan, Aleš Leonardis, Jiřı́ Matas, Michael Felsberg, Roman Pflugfelder, Joni‐Kristian Kämäräinen, Hyung Jin Chang, Martin Danelljan, +22 more

    Lecture notes in computer science · 2023

    130
  • Segment Anything Meets Point Tracking

    Frano Rajič, Lei Ke, Yu‐Wing Tai, Chi–Keung Tang, Martin Danelljan, Fisher Yu

    IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · 2025

    This paper introduces SAM-PT, an innovative method for point-centric video segmentation, leveraging the capabilities of SAM alongside long-term point tracking, and uniquely exploits point propagation to utilize local structure information independent of object semantics.

    119
  • SAGA: Stochastic Whole-Body Grasping with Contact

    Yan Yun Wu, Jiahao Wang, Yan Zhang, Siwei Zhang, Otmar Hilliges, Fisher Yu, Siyu Tang

    Lecture notes in computer science · 2022

    The effectiveness of the SAGA method is demonstrated, which is a novel generative framework to synthesize realistic and expressive whole-body motions that approach and grasp randomly placed unseen objects.

    118
  • TAFE-Net: Task-Aware Feature Embeddings for Low Shot Learning

    Xin Wang, Fisher Yu, Ruth Wang, Trevor J. Darrell, Joseph E. Gonzalez

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2019

    This work proposes Task Aware Feature Embedding Networks (TAFE-Nets) to learn how to adapt the image representation to a new task in a meta learning fashion and shows that TAFE-Net is highly effective in generalizing to new tasks or concepts.

    116
  • Uncertainty Guided Policy for Active Robotic 3D Reconstruction Using Neural Radiance Fields

    Soomin Lee, Le Chen, Jiahao Wang, Alexander Liniger, Suryansh Kumar, Fisher Yu

    IEEE Robotics and Automation Letters · 2022

    A ray-based volumetric uncertainty estimator, which computes the entropy of the weight distribution of the color samples along each ray of the object's implicit neural representation, and shows that it is possible to infer the uncertainty of the underlying 3D geometry given a novel view with the proposed estimator.

    115
  • Deep Object-Centric Policies for Autonomous Driving

    Dequan Wang, Coline Devin, Qi-Zhi Cai, Fisher Yu, Trevor J. Darrell

    Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · 2019

    A taxonomy of “object-centric” models which leverage both object instances and end-to-end learning are described, showing that object-centric models outperform object-agnostic methods in scenes with other vehicles and pedestrians, even with an imperfect detector.

    109
  • SSCBench: A Large-Scale 3D Semantic Scene Completion Benchmark for Autonomous Driving

    Yiming Li, Sihang Li, Xinhao Liu, Moonjun Gong, Kenan Li, Nuo Chen, Zijun Wang, Zhiheng Li, +6 more

    IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · 2024

    This work introduces SSCBench, a comprehensive benchmark that integrates scenes from widely used automotive datasets and has unified semantic labels across diverse datasets to simplify cross-domain generalization testing.

    107
  • Characterizing Adversarial Examples Based on Spatial Consistency Information for Semantic Segmentation

    Chaowei Xiao, Ruizhi Deng, Bo Li, Fisher Yu, Mingyan Liu, Dawn Xiaodong Song

    Lecture notes in computer science · 2018

    It is observed that spatial consistency information can be potentially leveraged to detect adversarial examples robustly even when a strong adaptive attacker has access to the model and detection strategies.

    105
  • 3D Reconstruction from Accidental Motion

    Fisher Yu, David Gallup

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2014

    104
  • Interactive 3D Modeling with a Generative Adversarial Network

    Jerry Liu, Fisher Yu, Thomas A. Funkhouser

    International Conference on 3D Vision (3DV) · 2017

    This work proposes the idea of using a generative adversarial network (GAN) to assist users in designing real-world shapes with a simple interface to assist novice users to create 3D models characteristic of the training data by only specifying rough edits.

    96
  • Disentangling Propagation and Generation for Video Prediction

    Hang Gao, Huazhe Xu, Qi-Zhi Cai, Ruth Wang, Fisher Yu, Trevor J. Darrell

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2019

    A computational model for high-fidelity video prediction which disentangles motion-specific propagation from motion-agnostic generation and introduces a confidence-aware warping operator which gates the output of pixel predictions from a flow predictor for non-occluded regions and from a context encoder for occluded regions.

    94
  • MuRF: Multi-Baseline Radiance Fields

    Haofei Xu, Anpei Chen, Yuedong Chen, Christos Sakaridis, Yulun Zhang, Marc Pollefeys, Andreas Geiger, Fisher Yu

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    Multi-Baseline Radiance Fields (MuRF), a general feed-forward approach to solving sparse view syn-thesis under multiple different baseline settings, achieves state-of-the-art performance across multiple different baseline settings and diverse scenarios ranging from simple objects (DTU) to complex indoor and outdoor scenes.

    86
  • OVTrack: Open-Vocabulary Multiple Object Tracking

    Siyuan Li, Tobias Fischer, Lei Ke, Henghui Ding, Martin Danelljan, Fisher Yu

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023

    OVTrack is developed, an open-vocabulary tracker that is capable of tracking arbitrary object classes and its design is based on two key ingredients, leveraging vision-language models for both classification and association via knowledge distillation and a data hallucination strategy for robust appearance feature learning from denoising diffusion probabilistic models.

    86
  • TrafficBots: Towards World Models for Autonomous Driving Simulation and Motion Prediction

    Zhejun Zhang, Alexander Liniger, Dengxin Dai, Fisher Yu, Luc Van Gool

    Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · 2023

    TrafficBots is presented, a multi-agent policy built upon motion prediction and end-to-end driving, and based on TrafficBots a world model tailored for the planning module of autonomous vehicles is obtained.

    85
  • Reinforcement Learning from Imperfect Demonstrations

    Yang Gao, Huazhe, Ji Lin, Fisher Yu, Sergey Levine, Trevor J. Darrell

    arXiv · 2018

    85
  • QuantSR: Accurate Low-bit Quantization for Efficient Image Super-Resolution

    Haotong Qin, Yulun Zhang, Yifu Ding, Yifan Liu, Xianglong Liu, Martin Danelljan, Fisher Yu

    neural information processing systems · 2023

    A novel quantized image SR network, called QuantSR, is proposed, which achieves accurate and efficient SR processing under low-bit quantization and introduces the Redistribution-driven Learnable Quantizer (RLQ), and the Depth-dynamic Quantized Architecture (DQA), which allows for the trade-off between efficiency and accuracy during inference through weight sharing.

    84
  • Matching Anything by Segmenting Anything

    Siyuan Li, Lei Ke, Martin Danelljan, Luigi Piccinelli, Mattia Segù, Luc J. Van Gool, Fisher Yu

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    This work proposes MASA, a novel method for robust instance association learning, capable of matching any objects within videos across diverse domains without tracking labels, Leveraging the rich object segmentation from the Segment Anything Model (SAM).

    83
  • Deep Reparametrization of Multi-Frame Super-Resolution and Denoising

    Goutam Bhat, Martin Danelljan, Fisher Yu, Luc Van Gool, Radu Timofte

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2021

    The deep reparametrization of the maximum a posteriori formulation commonly employed in multi-frame image restoration tasks is proposed, derived by introducing a learned error metric and a latent representation of the target image, which transforms the MAP objective to a deep feature space.

    80
  • Semantic alignment of LiDAR data at city scale

    Fisher Yu, Jianxiong Xiao, Thomas A. Funkhouser

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2015

    74
  • SHREC'17 Track Large-Scale 3D Shape Retrieval From Shapenet Core55

    Manolis Savva, Fisher Yu, Hao Su, Asako Kanezaki, Takahiko Furuya, Ryutarou Ohbuchi, Zhichao Zhou, Rui Yu, +14 more

    Aquila Digital Community (University of Southern Mississippi) · 2017

    73
  • HiT-SR: Hierarchical Transformer for Efficient Image Super-Resolution

    Xiang Zhang, Yulun Zhang, Fisher Yu

    Lecture notes in computer science · 2024

    70
  • Cascade-DETR: Delving into High-Quality Universal Object Detection

    Mingqiao Ye, Lei Ke, Siyuan Li, Yu‐Wing Tai, Chi–Keung Tang, Martin Danelljan, Fisher Yu

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2023

    Cascade-DETR is introduced for high-quality universal object detection, and the Cascade Attention layer is proposed, which explicitly integrates object-centric information into the detection decoder by limiting the attention to the previous box prediction.

    69
  • Warp Consistency for Unsupervised Learning of Dense Correspondences

    Prune Truong, Martin Danelljan, Fisher Yu, Luc Van Gool

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2021

    W warp consistency loss is proposed, an unsupervised learning objective for dense correspondence regression that is effective even in settings with large appearance and view-point changes and sets a new state of the art on several challenging benchmarks, including MegaDepth, RobotCar and TSS.

    61
  • HelpingHand

    Jingwan Lu, Fisher Yu, Adam Finkelstein, Stephen DiVerdi

    ACM Transactions on Graphics · 2012

    This paper presents a data-driven approach for synthesizing the 6D hand gesture data for users of low-quality input devices and outputs a 6D trajectory that can be fed into any virtual brush stroke engine to make expressive strokes for novices or users of limited hardware.

    61
  • R3D3: Dense 3D Reconstruction of Dynamic Scenes from Multiple Cameras

    Aron Schmied, Tobias Fischer, Martin Danelljan, Marc Pollefeys, Fisher Yu

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2023

    This work proposes R3D3, a multi-camera system for dense 3D reconstruction and ego-motion estimation that integrates multi- camera feature correlation and dense bundle adjustment operators that yield robust geometric depth and pose estimates, and introduces learnable scene priors via a depth refinement network.

    58
  • BiBench: Benchmarking and Analyzing Network Binarization

    Haotong Qin, Mingyuan Zhang, Yifu Ding, Aoyu Li, Zhongang Cai, Ziwei Liu, Fisher Yu, Xianglong Liu

    arXiv · 2023

    This work presents BiBench, a rigorously designed benchmark with in-depth analysis for network binarization, and reveals that the binarized operator has a crucial impact on the performance and deployability ofbinarized networks.

    57
  • Automatic triage for a photo series

    Huiwen Chang, Fisher Yu, Jue Wang, Douglas Ashley, Adam Finkelstein

    ACM Transactions on Graphics · 2016

    A benchmark for measuring the effectiveness of algorithmic models of how people select photos is established, and several new approaches for modeling human preference based on machine learning are introduced.

    54
  • How To Not Train Your Dragon: Training-free Embodied Object Goal Navigation with Semantic Frontiers

    Junting Chen, Guohao Li, Suryansh Kumar, Bernard Ghanem, Fisher Yu

    Robotics: Science and Systems XIX · 2023

    53
  • Large-Scale 3D Shape Retrieval from ShapeNet Core55

    Manolis Savva, Fisher Yu, Hao Su, Masaki Aono, Chen, Baoquan, Cohen-Or, Daniel, Weihong Deng, Hang Su, +13 more

    Eurographics · 2016

    This track aims to provide a benchmark to evaluate large-scale shape retrieval based on the ShapeNet dataset, using ShapeNet Core55, which provides more than 50 thousands models over 55 common categories in total for training and evaluating several algorithms.

    52
  • Deep Mixture of Experts via Shallow Embedding

    Xin Wang, Fisher Yu, Lisa Dunlap, Yi-An Ma, Ruth Wang, Azalia Mirhoseini, Trevor J. Darrell, Joseph E. Gonzalez

    arXiv · 2018

    46
  • Maskomaly:Zero-Shot Mask Anomaly Segmentation

    Jan Ackermann, Christos Sakaridis, Fisher Yu

    arXiv · 2023

    A simple and practical framework for anomaly segmentation which builds upon mask-based standard semantic segmentation networks by adding a simple inference-time post-processing step which leverages the raw mask outputs of such networks.

    45
  • CC-3DT: Panoramic 3D Object Tracking via Cross-Camera Fusion

    Tobias Fischer, Yung-Hsu Yang, Suryansh Kumar, Sun, Min, Fisher Yu

    arXiv · 2022

    This paper proposes a method for panoramic 3D object tracking that associates and models object trajectories both temporally and across views, and improves the overall tracking consistency, and sets a new state-of-the-art with 12.6% improvement in average multi-object tracking accuracy (AMOTA) among all camera-based methods on the competitive NuScenes 3D tracking benchmark.

    43
  • Probabilistic Warp Consistency for Weakly-Supervised Semantic Correspondences

    Prune Truong, Martin Danelljan, Fisher Yu, Luc Van Gool

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    This work proposes Probabilistic Warp Consistency, a weakly-supervised learning objective for semantic matching that directly supervises the dense matching scores predicted by the network, encoded as a conditional probability distribution.

    43
  • MolGrapher: Graph-based Visual Recognition of Chemical Structures

    Lucas Morin, Martin Danelljan, M. Isabel Agea, Ahmed Nassar, Valéry Weber, Ingmar Meijer, Peter Staar, Fisher Yu

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2023

    This work introduces MolGrapher to recognize chemical structures visually, and proposes a synthetic data generation pipeline producing diverse and realistic results.

    42
  • Tracking Every Thing in the Wild

    Siyuan Li, Martin Danelljan, Henghui Ding, Thomas E. Huang, Fisher Yu

    Lecture notes in computer science · 2022

    42
  • 3DPPE: 3D Point Positional Encoding for Transformer-based Multi-Camera 3D Object Detection

    Changyong Shu, Jiajun Deng, Fisher Yu, Yifan Liu

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2023

    40
  • Learning Deep Sensorimotor Policies for Vision-Based Autonomous Drone Racing

    Jiawei Fu, Yunlong Song, Yan Yun Wu, Fisher Yu, Davide Scaramuzza

    IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · 2023

    This method combines feature representation learning to extract task-relevant feature representations from high-dimensional image inputs with a learning-by-cheating framework to train a deep sensorimotor policy for vision-based drone racing, eliminating the need for globally-consistent state estimation, trajectory planning, and handcrafted control design.

    39
  • S$^{3}$M-Net: Joint Learning of Semantic Segmentation and Stereo Matching for Autonomous Driving

    Zhiyuan Wu, Yi Feng, Chuang-Wei Liu, Fisher Yu, Qijun Chen, Rui Fan

    IEEE Transactions on Intelligent Vehicles · 2024

    This article introduces S3M-Net, a novel joint learning framework developed to perform semantic segmentation and stereo matching simultaneously and its superior performance compared to other state-of-the-art single-task networks.

    38
  • Robust Object Detection via Instance-Level Temporal Cycle Confusion

    Xin Wang, Thomas E. Huang, Benlin Liu, Fisher Yu, Xiaolong Wang, Joseph E. Gonzalez, Trevor J. Darrell

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2021

    This work introduces a novel self-supervised task, instance-level temporal cycle confusion (CycConf), which operates on the region features of the object detectors, and encourages the object detector to explore invariant structures across instances under various motions, which leads to improved model robustness in unseen domains at test time.

    37
  • Learning Saliency Propagation for Semi-Supervised Instance Segmentation

    Yanzhao Zhou, Xin Wang, Jianbin Jiao, Trevor J. Darrell, Fisher Yu

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2020

    37
  • The First Visual Object Tracking Segmentation VOTS2023 Challenge Results

    Matej Kristan, Jiřı́ Matas, Martin Danelljan, Michael Felsberg, Hyung Jin Chang, Luka Čehovin Zajc, Alan Lukežič, Ondřej Drbohlav, +22 more

    IEEE/CVF International Conference on Computer Vision Workshops (ICCVW) · 2023

    35
  • Bitcoin-Enhanced Proof-of-Stake Security: Possibilities and Impossibilities

    Ertem Nusret Tas, David N. C. Tse, Fangyu Gai, Sreeram Kannan, Mohammad Ali Maddah-Ali, Fisher Yu

    Proceedings - IEEE Symposium on Security and Privacy/Proceedings of the ... IEEE Symposium on Security and Privacy · 2023

    The experimental results show that this delay can be reduced from weeks in existing PoS chains to less than 5 hours using Babylon, at a transaction cost of less than 10K USD per annum for posting the checkpoints onto Bitcoin.

    35
  • Prototypical Cross-Attention Networks for Multiple Object Tracking and Segmentation

    Lei Ke, Xia Li, Martin Danelljan, Yu‐Wing Tai, Chi–Keung Tang, Fisher Yu

    Repository for Publications and Research Data (ETH Zurich) · 2021

    35
  • Mask-Free Video Instance Segmentation

    Lei Ke, Martin Danelljan, Henghui Ding, Yu‐Wing Tai, Chi–Keung Tang, Fisher Yu

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023

    This work proposes MaskFreeVIS, achieving highly competitive VIS performance, while only using bounding box annotations for the object state, by introducing the Temporal KNN-patch Loss (TK-Loss), providing strong mask supervision without any labels.

    32
  • BiMatting: Efficient Video Matting via Binarization

    Haotong Qin, Lei Ke, Xudong Ma, Martin Danelljan, Yu-Wing Tai, Chi-Keung Tang, Xianglong Liu, Fisher Yu

    neural information processing systems · 2023

    BiMatting is proposed, an accurate and efficient video matting model using binarization that outperforms other binarized video matting models, including state-of-the-art (SOTA) binarization methods, by a significant margin and performs comparably to the full-precision counterpart in visual quality.

    28
  • IDK Cascades: Fast Deep Learning by Learning not to Overthink

    Xin Wang, Yujia Luo, Daniel Crankshaw, Alexey Tumanov, Fisher Yu, Joseph E. Gonzalez

    arXiv · 2017

    26
  • Video OWL-ViT: Temporally-consistent open-world localization in video

    Georg Heigold, Daniel Keysers, Matthias Minderer, Mario Lučić, Alexey A. Gritsenko, Fisher Yu, Alex Bewley, Thomas Kipf

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2023

    This work presents an architecture and a training recipe that adapts pretrained open-world image models to localization in videos and demonstrates that open-world capabilities, learned from large-scale image-text pretraining, can be transferred successfully to open-world localization across diverse videos.

    24
  • Condition-Invariant Semantic Segmentation

    Christos Sakaridis, David Brüggemann, Fisher Yu, Luc Van Gool

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2025

    This work proposes to leverage stylization in performing feature-level adaptation by aligning the internal network features extracted by the encoder of the network from the original and the stylized view of each input image with a novel feature invariance loss.

    22
  • PatCID: an open-access dataset of chemical structures in patent documents

    Lucas Morin, Valéry Weber, Gerhard Ingmar Meijer, Fisher Yu, Peter Staar

    Nature Communications · 2024

    Leveraging state-of-the-art methods of document understanding, PatCID high-quality data outperforms currently available automatically-generated patent-databases and even competes with proprietary manually-created patent-databases.

    22
  • DARTH: Holistic Test-time Adaptation for Multiple Object Tracking

    Mattia Segù, Bernt Schiele, Fisher Yu

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2023

    This paper proposes a detection consistency formulation to adapt object detection in a self-supervised fashion, while adapting the instance appearance representations via the authors' novel patch contrastive loss.

    21
  • Video Mask Transfiner for High-Quality Video Instance Segmentation

    Lei Ke, Henghui Ding, Martin Danelljan, Yu‐Wing Tai, Chi–Keung Tang, Fisher Yu

    Lecture notes in computer science · 2022

    21
  • Spatio-Temporal Action Detection Under Large Motion

    Gurkirt Singh, Vasileios Choutas, Suman Saha, Fisher Yu, Luc Van Gool

    IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · 2023

    This work finds that track-aware feature aggregation consistently achieves a large improvement in action detection performance, especially for actions under large motion compared to cuboid-aware baseline, and reports state-of-the-art on the large-scale MultiSports dataset.

    20
  • ICGNet: A Unified Approach for Instance-Centric Grasping

    René Zurbrügg, Yifan Liu, Francis Engelmann, S. Kumar, Marco Hutter, Vaishakh Patil, Fisher Yu

    Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · 2024

    An end-to-end architecture for object-centric grasping that uses pointcloud data from a single arbitrary viewing direction as an input and generates an instance-centric representation for each partially observed object in the scene, used for object reconstruction and grasp detection in cluttered table-top scenes.

    18
  • Normalizing Flow as a Flexible Fidelity Objective for Photo-Realistic Super-resolution

    Andreas Lugmayr, Martin Danelljan, Fisher Yu, Luc Van Gool, Radu Timofte

    IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · 2022

    This work revisiting the L1 loss and showing that it corresponds to a one-layer conditional flow is shown to outperform state-of-the-art methods for photo-realistic super-resolution and demonstrate that the flexibility of deeper flows leads to better visual quality and consistency when combined with adversarial losses.

    16
  • Semantic Predictive Control for Explainable and Efficient Policy Learning

    Xinlei Pan, Xiangyu Chen, Qi-Zhi Cai, John Canny, Fisher Yu

    Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · 2019

    16
  • Normalization Perturbation: A Simple Domain Generalization Method for Real-World Domain Shifts

    Qi Fan, Mattia Segù, Yu‐Wing Tai, Fisher Yu, Chi–Keung Tang, Bernt Schiele, Dengxin Dai

    arXiv · 2022

    This work proposes to perturb the channel statistics of source domain features to synthesize various latent styles, so that the trained deep model can perceive diverse potential domains and generalizes well even without observations of target domain data in training.

    15
  • Pangu Ultra MoE: How to Train Your Big MoE on Ascend NPUs

    Yehui Tang, Yichun Yin, Yaoyuan Wang, Hang Zhou, Yu Cheng Pan, Wei Guo, Ziyang Zhang, Miao Rang, +22 more

    arXiv · 2025

    Extensive experiments indicate that the recipe uncovered can lead to efficient training of large-scale sparse language models with MoE, and the Ascend system is capable of harnessing all the training stages of the state-of-the-art language models.

    14
  • Distilling ODE Solvers of Diffusion Models into Smaller Steps

    Sanghwan Kim, Hao Tang, Fisher Yu

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    Distilled-ODE solvers (D-ODE solvers) are introduced, a straightforward distillation approach grounded in ODE solver formulations that seamlessly integrates the strengths of both learning-free and learning-based sampling.

    12
  • Video Task Decathlon: Unifying Image and Video Tasks in Autonomous Driving

    Thomas E. Huang, Yifan Liu, Luc Van Gool, Fisher Yu

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2023

    This work designs a Curriculum training, Pseudo-labeling, and Fine-tuning scheme to successfully train VTDNet on all tasks and mitigate performance loss, and develops a unified network, VTDNet, that uses a single structure and a single set of weights for all ten tasks.

    12
  • Dense Prediction with Attentive Feature Aggregation

    Yung-Hsu Yang, Thomas E. Huang, Min Sun, Samuel Rota Bulò, Peter Kontschieder, Fisher Yu

    IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · 2023

    Attentive Feature Aggregation is introduced to fuse different network layers with more expressive non-linear operations and improves the performance of the Deep Layer Aggregation model by nearly 6% mIoU on Cityscapes.

    10
  • TACS: Taxonomy Adaptive Cross-Domain Semantic Segmentation

    Rui Gong, Martin Danelljan, Dengxin Dai, Danda Pani Paudel, Ajad Chhatkuli, Fisher Yu, Luc Van Gool

    Lecture notes in computer science · 2022

    This work addresses the image-level domain gap by proposing an uncertainty-rectified contrastive learning method, leading to more domain-invariant and class-discriminative features, and outperforms the previous state-of-the-art by a large margin.

    10
  • Instance-Aware Predictive Navigation in Multi-Agent Environments

    Jinkun Cao, Xin Wang, Trevor J. Darrell, Fisher Yu

    Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · 2021

    The Instance-Aware Predictive Control approach is proposed, which forecasts interactions between agents as well as future scene structures, and a sequential action sampling strategy is designed to better leverage predicted states on both scene-level and instance-level.

    10
  • Quasi-Dense Instance Similarity Learning

    Jiangmiao Pang, Linlu Qiu, Haofeng Chen, Qi Li, Trevor J. Darrell, Fisher Yu

    arXiv · 2020

    This paper presents a simple yet effective quasi-dense matching method to learn instance similarity from hundreds of region proposals in a pair of images, and can outperform existing methods without using location or motion heuristics on joint object detection and tracking.

    9
  • Task-Aware Feature Generation for Zero-Shot Compositional Learning

    Xin Wang, Fisher Yu, Trevor J. Darrell, Joseph E. Gonzalez

    arXiv · 2019

    9
  • Uncertainty-Driven Dense Two-View Structure From Motion

    Weirong Chen, Suryansh Kumar, Fisher Yu

    IEEE Robotics and Automation Letters · 2023

    The proposed approach achieves remarkable depth accuracy and state-of-the-art camera pose results superseding SuperPoint and SuperGlue accuracy when tested on benchmark datasets such as DeMoN, YFCC100 M, and ScanNet.

    8
  • Real-Time Motion Prediction via Heterogeneous Polyline Transformer with Relative Pose Encoding

    Zhejun Zhang, Alexander Liniger, Christos Sakaridis, Fisher Yu, Luc Van Gool

    neural information processing systems · 2023

    8
  • Multi-modal NeRF Self-Supervision for LiDAR Semantic Segmentation

    Xavier Timoneda, Markus Herb, Fabian Duerr, Daniel Goehring, Fisher Yu

    IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · 2024

    A Semi-Supervised Learning setup to leverage unlabeled LiDAR pointclouds alongside distilled knowledge from the camera images and shows the effectiveness of this approach in three public LiDAR Semantic Segmentation benchmarks: nuScenes, SemanticKITTI and ScribbleKITTI.

    7
  • DexDribbler: Learning Dexterous Soccer Manipulation via Dynamic Supervision

    Yutong Hu, Kehan Wen, Fisher Yu

    IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · 2024

    It is observed that the learning scheme can not only make the policy network converge faster but also enable soccer robots to perform sophisticated maneuvers like sharp cuts and turns on flat surfaces, a capability that was lacking in previous methods.

    7
  • Learning Online Multi-sensor Depth Fusion

    Erik Sandström, Martin R. Oswald, Suryansh Kumar, Silvan Weder, Fisher Yu, Cristian Sminchisescu, Luc Van Gool

    Lecture notes in computer science · 2022

    7
  • On the Practicality of Deterministic Epistemic Uncertainty

    Janis Postels, Mattia Segù, Tao Sun, Sieber, Luca Daniel, Luc Van Gool, Fisher Yu, Federico Tombari

    Repository for Publications and Research Data (ETH Zurich) · 2021

    6
  • Walker: Self-supervised Multiple Object Tracking by Walking on Temporal Appearance Graphs

    Mattia Segù, Luigi Piccinelli, Siyuan Li, Luc Van Gool, Fisher Yu, Bernt Schiele

    Lecture notes in computer science · 2024

    5
  • Babylon: Reusing Bitcoin Mining to Enhance Proof-of-Stake Security

    Ertem Nusret Tas, David N. C. Tse, Fisher Yu, Sreeram Kannan

    arXiv · 2022

    5
  • Composite Learning for Robust and Effective Dense Predictions

    Menelaos Kanakis, Thomas E. Huang, David Brüggemann, Fisher Yu, Luc Van Gool

    IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · 2023

    It is found that jointly training a dense prediction task with a self-supervised (auxiliary) task can consistently improve the performance of the target task, while eliminating the need for labeling auxiliary tasks.

    4
  • Pangu Light: Weight Re-Initialization for Pruning and Accelerating LLMs

    Hanting Chen, Qin, Jiarui, Jialong Guo, Yuan, Tao, Yichun Yin, Huiling Zhen, Yasheng Wang, Jinpeng Li, +10 more

    arXiv · 2025

    Pangu Light is introduced, a framework for LLM acceleration centered around structured pruning coupled with novel weight re-initialization techniques designed to address this ``missing piece''.

    3
  • COOLer: Class-Incremental Learning for Appearance-Based Multiple Object Tracking

    Zhizheng Liu, Mattia Segù, Fisher Yu

    Lecture notes in computer science · 2024

    2
  • A Multiplicative Value Function for Safe and Efficient Reinforcement Learning

    Nick Bührer, Zhejun Zhang, Alexander Liniger, Fisher Yu, Luc Van Gool

    IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · 2023

    This work proposes a safe model-free RL algorithm with a novel multiplicative value function consisting of a safety critic and a reward critic, and integrates this approach into two popular RL algorithms, Proximal Policy Optimization and Soft Actor-Critic.

    2
  • 3DPPE: 3D Point Positional Encoding for Multi-Camera 3D Object Detection Transformers

    Changyong Shu, Deng, JIajun, Fisher Yu, Yifan Liu

    arXiv · 2022

    3D point PE with estimated 3D point locations can bring significant improvements compared to the commonly used camera-ray PE and is shown to have superior performance since more precise positioning may lead to superior 3D detection.

    2
  • Autonomous Vehicle Vision 2021: ICCV Workshop Summary

    Rui Fan, Nemanja Djuric, Fisher Yu, Rowan McAllister, Ioannis Pitas

    IEEE/CVF International Conference on Computer Vision Workshops (ICCVW) · 2021

    2
  • Learning Rich Image Representation with Deep Layer Aggregation.

    Fisher Yu, Dequan Wang, Evan Shelhamer, Trevor J. Darrell

    International Conference on Learning Representations · 2018

    2
  • Author Correction: PatCID: an open-access dataset of chemical structures in patent documents

    Lucas Morin, Valéry Weber, Gerhard Ingmar Meijer, Fisher Yu, Peter Staar

    Nature Communications · 2025

    1
  • Fast Hierarchical Learning for Few-Shot Object Detection

    Yihang She, Goutam Bhat, Martin Danelljan, Fisher Yu

    IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · 2022

    This work poses few-shot detection as a hierarchical learning problem, where the novel classes are treated as the child classes of existing base classes and the background class, leading to significantly lower training times compared to stochastic gradient descent.

    1
  • Task-Aware Deep Sampling for Feature Generation.

    Xin Wang, Fisher Yu, Trevor J. Darrell, Joseph E. Gonzalez

    arXiv · 2019

    This work proposes a sample efficient learning model composed of a TDS generator, a discriminator and a classifier (e.g., a soft-max classifier) and finds that this model achieves state-of-the-art results on the compositional zero- shot learning benchmarks as well as improving upon the established benchmarks in conventional zero-shot learning with a faster convergence rate.

    1
  • TAFE-Net: Task-Aware Feature Embeddings for Efficient Learning and Inference.

    Xin Wang, Fisher Yu, Ruth Wang, Trevor J. Darrell, Joseph E. Gonzalez

    arXiv · 2018

    This work proposes Task-Aware Feature Embedding Networks (TAFE-Nets) to learn how to adapt the image representation to a new task in a meta-learning fashion and shows that the TAFE-Net is highly effective in generalizing to new tasks or concepts and offers efficient prediction with low computational cost.

    1
  • HelpingHand

    Jingwan Lu, Fisher Yu, Adam Finkelstein, Stephen DiVerdi

    ACM Transactions on Graphics · 2012

    1
  • DVPSFormer: Efficient Online Depth-aware Video Panoptic Segmentation for Autonomous Driving

    Yung-Hsu Yang, Luigi Piccinelli, Siyuan Li, Mattia Segù, Lei Ke, Martin Danelljan, Yuqian Fu, Zuria Bauer, +3 more

    arXiv · 2026

    DVPSFormer is proposed, a unified online architecture designed for efficient 4D scene understanding that establishes a new state-of-the-art on the Cityscapes-DVPS and SemKITTI-DVPS benchmarks, offering a streamlined solution for online robotic perception.

    –
  • Guest Editorial Introduction to the Special Issue on Segment Anything for Videos and Beyond

    Wenguan Wang, Hengshuang Zhao, Xinggang Wang, Fisher Yu, David Crandall

    IEEE Transactions on Circuits and Systems for Video Technology · 2025

    –
  • Accountability and Forensics in Blockchains: XDC Consensus Engine DPoS 2.0

    Gerui Wang, Jerome Wang, Liam Lai, Fisher Yu

    arXiv · 2021

    –

Publication data from OpenAlex, with missing venues and authors filled in from Crossref; citation counts are the higher of OpenAlex and Semantic Scholar, last synced 2026-10-14. One-sentence summaries under some papers are written by Semantic Scholar’s model. Citation counts may be lower than on Google Scholar, which indexes more sources.

Report an error

Wrong papers, two people merged into one, or a profile that should not be here? Tell us and we will fix or hide it.

Sign in to report