Is this you? Claim this profile to correct it, add a bio and choose the work people see first.

Claim this profile

Academic lineage

Possible advisorsa guess from early papers, not confirmed

  • Jiaya Jia

    Possible advisor · last author on 6 of their early first-author papers, 2016–2019

    Suggested from co-authorship

Is this you? Claim this profile to confirm or dismiss it.

Works159 from public data

TitleCited by
  • Pyramid Scene Parsing Network

    Hengshuang Zhao, Jianping Shi, Xiaojuan Qi, Xiaogang Wang, Jiaya Jia

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2017

    This paper exploits the capability of global context information by different-region-based context aggregation through the pyramid pooling module together with the proposed pyramid scene parsing network (PSPNet) to produce good quality results on the scene parsing task.

    15,291
  • Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformers

    Sixiao Zheng, Jiachen Lu, Hengshuang Zhao, Xiatian Zhu, Zekun Luo, Yabiao Wang, Yanwei Fu, Jianfeng Feng, +3 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2021

    This paper deploys a pure transformer to encode an image as a sequence of patches, termed SEgmentation TRansformer (SETR), and shows that SETR achieves new state of the art on ADE20K, Pascal Context, and competitive results on Cityscapes.

    3,852
  • Point Transformer

    Hengshuang Zhao, Li Jiang, Jiaya Jia, Philip H. S. Torr, Vladlen Koltun

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2021

    The Point Transformer design improves upon prior work across domains and tasks and crosses the 70% mIoU threshold for the first time on the challenging S3DIS dataset.

    2,467
  • Depth Anything: Unleashing the Power of Large-Scale Unlabeled Data

    Lihe Yang, Bingyi Kang, Zilong Huang, Xiaogang Xu, Jiashi Feng, Hengshuang Zhao

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    This work designs a data engine to collect and automatically annotate large-scale unlabeled data and develops an auxiliary supervision to enforce the model to inherit rich semantic priors from pre-trained encoders, which results in a better depth-conditioned ControlNet.

    2,221
  • ICNet for Real-Time Semantic Segmentation on High-Resolution Images

    Hengshuang Zhao, Xiaojuan Qi, Xiaoyong Shen, Jianping Shi, Jiaya Jia

    Lecture notes in computer science · 2018

    An image cascade network (ICNet) that incorporates multi-resolution branches under proper label guidance to address the challenging task of real-time semantic segmentation is proposed and in-depth analysis of the framework is provided.

    1,627
  • PSANet: Point-wise Spatial Attention Network for Scene Parsing

    Hengshuang Zhao, Zhang Yi, Shu Liu, Jianping Shi, Chen Change Loy, Dahua Lin, Jiaya Jia

    Lecture notes in computer science · 2018

    The point-wise spatial attention network (PSANet) is proposed to relax the local neighborhood constraint and achieves top performance on various competitive scene parsing datasets, including ADE20K, PASCAL VOC 2012 and Cityscapes, demonstrating its effectiveness and generality.

    1,191
  • Point Transformer V3: Simpler, Faster, Stronger

    Xiaoyang Wu, Li Jiang, Peng‐Shuai Wang, Zhijian Liu, Xihui Liu, Yu Qiao, Wanli Ouyang, Tong He, +1 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    This paper presents Point Transformer V3 (PTv3), which prioritizes simplicity and efficiency over the accuracy of certain mechanisms that are minor to the over-all performance after scaling, such as replacing the precise neighbor search by KNN with an efficient serialized neighbor mapping of point clouds organized with specific patterns.

    1,171
  • Exploring Self-Attention for Image Recognition

    Hengshuang Zhao, Jiaya Jia, Vladlen Koltun

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2020

    This work considers two forms of self-attention, pairwise and patchwise, which generalizes standard dot-product attention and is fundamentally a set operator and strictly more powerful than convolution.

    946
  • PointWeb: Enhancing Local Neighborhood Features for Point Cloud Processing

    Hengshuang Zhao, Li Jiang, Chi‐Wing Fu, Jiaya Jia

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2019

    840
  • DriveGPT4: Interpretable End-to-End Autonomous Driving Via Large Language Model

    Zhenhua Xu, Yujia Zhang, Enze Xie, Zhao Zhen, Yong Fang Guo, Kenneth K. Wong, Zhenguo Li, Hengshuang Zhao

    IEEE Robotics and Automation Letters · 2024

    DriveGPT4 is introduced, a novel interpretable end-to-end autonomous driving system based on LLMs capable of processing multi-frame video inputs and textual queries that facilitates the interpretation of vehicle actions, offers pertinent reasoning, and effectively addresses a diverse range of questions posed by users.

    795
  • Prior Guided Feature Enrichment Network for Few-Shot Segmentation

    Zhuotao Tian, Hengshuang Zhao, Michelle Shu, Zhicheng Yang, Ruiyu Li, Jiaya Jia

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2020

    The PFENet consists of novel designs of a training-free prior mask generation method that not only retains generalization power but also improves model performance and Feature Enrichment Module (FEM) that overcomes spatial inconsistency by adaptively enriching query features with support features and prior masks.

    764
  • Distilling Knowledge via Knowledge Review

    Pengguang Chen, Shu Liu, Hengshuang Zhao, Jiaya Jia

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2021

    For the first time in knowledge distillation, cross-stage connection paths are proposed and a new review mechanism is proposed that requires negligible computation overhead, and outperforms other methods on a variety of tasks.

    717
  • PointGroup: Dual-Set Point Grouping for 3D Instance Segmentation

    Li Jiang, Hengshuang Zhao, Shaoshuai Shi, Shu Liu, Chi‐Wing Fu, Jiaya Jia

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2020

    This paper designs a two-branch network to extract point features and predict semantic labels and offsets, for shifting each point towards its respective instance centroid, and presents PointGroup, a new end-to-end bottom-up architecture specifically focused on better grouping the points by exploring the void space between objects.

    610
  • PAConv: Position Adaptive Convolution with Dynamic Kernel Assembling on Point Clouds

    Mutian Xu, Runyu Ding, Hengshuang Zhao, Xiaojuan Qi

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2021

    Different from the existing point convolution operators whose network architectures are often heavily engineered, the PAConv integrates into classical MLP-based point cloud pipelines without changing network configurations and significantly improves baseline performance on both classification and segmentation tasks, yet with decent efficiency.

    591
  • Depth Anything V2

    Lihe Yang, Bingyi Kang, Zilong Huang, Zhen Zhao, Xiaogang Xu, Jiashi Feng, Hengshuang Zhao

    neural information processing systems · 2024

    583
  • LAVT: Language-Aware Vision Transformer for Referring Image Segmentation

    Zhao Yang, Jiaqi Wang, Yansong Tang, Kai Chen, Hengshuang Zhao, Philip H.S. Torr

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    This work shows that significantly better cross-modal alignments can be achieved through the early fusion of linguistic and visual features in intermediate layers of a vision Transformer encoder network.

    569
  • Stratified Transformer for 3D Point Cloud Segmentation

    Xin Lai, Jianhui Liu, Li Jiang, Liwei Wang, Hengshuang Zhao, Shu Liu, Xiaojuan Qi, Jiaya Jia

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    Stratified Transformer is proposed that is able to capture long-range contexts and demonstrates strong generalization ability and high performance and first-layer point embedding to aggregate local information, which facilitates convergence and boosts performance.

    564
  • AnyDoor: Zero-shot Object-level Image Customization

    Xi Chen, Lianghua Huang, Liu Yu, Yujun Shen, Deli Zhao, Hengshuang Zhao

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    This work presents AnyDoor, a diffusion-based image generator with the power to teleport target objects to new scenes at user-specified locations with desired shapes, and proposes to borrow knowledge from video datasets, which can observe various forms of a single object, leading to stronger model generalizability and robustness.

    539
  • UPSNet: A Unified Panoptic Segmentation Network

    Yuwen Xiong, Renjie Liao, Hengshuang Zhao, Rui Sheng Hu, Min Bai, Ersin Yumer, Raquel Urtasun

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2019

    A parameter-free panoptic head is introduced which solves thepanoptic segmentation via pixel-wise classification and first leverages the logits from the previous two heads and then innovatively expands the representation for enabling prediction of an extra unknown class which helps better resolving the conflicts between semantic and instance segmentation.

    469
  • SegStereo: Exploiting Semantic Information for Disparity Estimation

    Guorun Yang, Hengshuang Zhao, Jianping Shi, Zhidong Deng, Jiaya Jia

    Lecture notes in computer science · 2018

    This paper suggests that appropriate incorporation of semantic cues can greatly rectify prediction in commonly-used disparity estimation frameworks and proposes a unified model SegStereo, which employs semantic features from segmentation and introduces semantic softmax loss, which helps improve the prediction accuracy of disparity maps.

    383
  • PhysFormer: Facial Video-based Physiological Measurement with Temporal Difference Transformer

    Zitong Yu, Yuming Shen, Jingang Shi, Hengshuang Zhao, Philip H. S. Torr, Guoying Zhao

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    This paper proposes the PhysFormer, an end-to-end video transformer based architecture, to adaptively aggregate both local and global spatio-temporal features for rPPG representation enhancement, and proposes the label distribution learning and a curriculum learning inspired dynamic constraint in frequency domain.

    343
  • Semi-supervised Semantic Segmentation with Directional Context-aware Consistency

    Xin Lai, Zhuotao Tian, Li Jiang, Shu Liu, Hengshuang Zhao, Liwei Wang, Jiaya Jia

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2021

    This paper proposes to maintain the context-aware consistency between features of the same identity but with different contexts, making the representations robust to the varying environments, and presents the Directional Contrastive Loss (DC Loss) to accomplish the consistency in a pixel-to-pixel manner.

    261
  • SAM3D: Segment Anything in 3D Scenes

    Yunhan Yang, Xiaoyang Wu, Tong He, Hengshuang Zhao, Xihui Liu

    arXiv · 2023

    226
  • GridMask Data Augmentation

    Pengguang Chen, Shu Liu, Hengshuang Zhao, Wang, Xingquan, Jia, Jiaya

    arXiv · 2020

    221
  • Hierarchical Point-Edge Interaction Network for Point Cloud Semantic Segmentation

    Li Jiang, Hengshuang Zhao, Shu Liu, Xiaoyong Shen, Chi‐Wing Fu, Jiaya Jia

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2019

    This work establishes a hierarchical graph framework, where the graph is initialized from a coarse layer and gradually enriched along the point decoding process, and predicts a label to indicate the semantic consistency of the two connected points to enhance point prediction.

    219

Show all 159 works

Publication data from OpenAlex, with missing venues and authors filled in from Crossref; citation counts are the higher of OpenAlex and Semantic Scholar, last synced 2026-10-13. One-sentence summaries under some papers are written by Semantic Scholar’s model. Citation counts may be lower than on Google Scholar, which indexes more sources.

Report an error

Wrong papers, two people merged into one, or a profile that should not be here? Tell us and we will fix or hide it.

Sign in to report