Is this you? Claim this profile to correct it, add a bio and choose the work people see first.

Claim this profile

Works71 from public data

TitleCited by
  • GCNet: Non-Local Networks Meet Squeeze-Excitation Networks and Beyond

    Yue Cao, Jiarui Xu, Stephen Ching-Feng Lin, Fangyun Wei, Han Hu

    2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW) · 2019

    A simplified network based on a query-independent formulation, which maintains the accuracy of NLNet but with significantly less computation is created, and this simplified design shares similar structure with Squeeze-Excitation Network (SENet), which generally outperforms both simplified NLNet and SENet on major benchmarks for various recognition tasks.

    2,184
  • End-to-End Semi-Supervised Object Detection with Soft Teacher

    Mengde Xu, Zheng Zhang, Han Hu, Jianfeng Wang, Lijuan Wang, Fangyun Wei, Xiang Bai, Zicheng Liu

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2021

    This paper presents an end-to-end semi-supervised object detection approach, in contrast to previous more complex multi-stage methods, and proposes two simple yet effective techniques within this framework: a soft teacher mechanism where the classification loss of each unlabeled bounding box is weighed by the classification score produced by the teacher network.

    698
  • EAGLE: Speculative Sampling Requires Rethinking Feature Uncertainty

    Yuhui Li, Fangyun Wei, Chao Zhang, Hongyang Zhang

    arXiv · 2024

    This paper introduces EAGLE (Extrapolation Algorithm for Greater Language-model Efficiency), a simple yet highly efficient speculative sampling framework that effectively resolves the uncertainty, enabling precise second-to-top-layer feature prediction with minimal overhead.

    686
  • Side Adapter Network for Open-Vocabulary Semantic Segmentation

    Mengde Xu, Zheng Zhang, Fangyun Wei, Hanping Hu, Xiang Bai

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023

    This paper presents a new framework for open-vocabulary semantic segmentation with the pre-trained vision-language model, named Side Adapter Network (SAN), which significantly outperforms other counterparts, with up to 18 times fewer trainable parameters and 19 times faster inference speed.

    487
  • CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation

    Qixiu Li, Yaobo Liang, Zeyu Wang, Luo, Lin, Chen, Xi, Liao, Mozheng, Fangyun Wei, Yu Hao Deng, +10 more

    arXiv · 2024

    A new advanced VLA architecture derived from VLM that has a specialized action module conditioned on VLM output is presented that not only significantly surpasses existing VLAs in task performance and but also exhibits remarkable adaptation to new robots and generalization to unseen objects and backgrounds.

    484
  • Learning to Prompt for Open-Vocabulary Object Detection with Vision-Language Model

    Yu Du, Fangyun Wei, Zihe Zhang, Miaojing Shi, Yue Gao, Guoqi Li

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    A novel method, detection prompt (DetPro), to learn continuous prompt representations for open-vocabulary object detection based on the pre-trained vision-language model, which outperforms the baseline ViLD in all settings.

    482
  • A Simple Baseline for Open-Vocabulary Semantic Segmentation with Pre-trained Vision-Language Model

    Mengde Xu, Zheng Zhang, Fangyun Wei, Yutong Lin, Yue Cao, Hanping Hu, Xiang Bai

    Lecture notes in computer science · 2022

    This paper refuses the use of the prevalent one-stage FCN based framework, and advocates a two-stage semantic segmentation framework, with the first stage extracting generalizable mask proposals and the second stage leveraging an image based CLIP model to perform open-vocabulary classification on the masked image crops which are generated in the firststage.

    360
  • RAIN: Your Language Models Can Align Themselves without Finetuning

    Yuhui Li, Fangyun Wei, Jinjing Zhao, Chao Zhang, Hongyang Zhang

    arXiv · 2023

    This work introduces a novel inference method, Rewindable Auto-regressive INference (RAIN), that allows pre-trained LLMs to evaluate their own generation and use the evaluation results to guide rewind and generation for AI safety.

    189
  • Unsupervised Prompt Learning for Vision-Language Models

    Tony Jun Huang, Chu, Jack, Fangyun Wei

    arXiv · 2022

    This paper presents an unsupervised prompt learning (UPL) approach to avoid prompt engineering while simultaneously improving transfer performance of CLIP-like vision-language models.

    189
  • A Simple Multi-Modality Transfer Learning Baseline for Sign Language Translation

    Yutong Chen, Fangyun Wei, Xiao Na Sun, Zhirong Wu, Stephen Lin

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    This simple baseline surpasses the previous state-of-the-art results on two sign language translation benchmarks, demonstrating the effectiveness of transfer learning and can serve as a solid baseline for future research.

    169
  • Point-Set Anchors for Object Detection, Instance Segmentation and Pose Estimation

    Fangyun Wei, Xiao Na Sun, Hongyang Li, Jingdong Wang, Stephen Ching-Feng Lin

    Lecture notes in computer science · 2020

    This work argues that the image features extracted at a central point contain limited information for predicting distant keypoints or bounding box boundaries, due to object deformation and scale/orientation variation, and proposes to perform regression from a set of points placed at more advantageous positions to facilitate inference.

    158
  • Global Context Networks

    Yue Cao, Jiarui Xu, Stephen Ching-Feng Lin, Fangyun Wei, Han Hu

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2020

    This paper replaces the one-layer transformation function of the non-local block by a two-layer bottleneck, which further reduces the parameter number considerably, and effectively models global context in a lightweight manner, allowing it to be applied at multiple layers of a backbone network to form a global context network (GCNet).

    152
  • AnyTool: Self-Reflective, Hierarchical Agents for Large-Scale API Calls

    Du, Yu, Fangyun Wei, Zhang, Hongyang

    arXiv · 2024

    AnyTool, a large language model agent designed to revolutionize the utilization of a vast array of tools in addressing user queries, is introduced, operating under the assumption that a subset of these APIs could potentially resolve the queries.

    151
  • Natural Language-Assisted Sign Language Recognition

    Ronglai Zuo, Fangyun Wei, Brian Kan-Wing Mak

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023

    The Natural Language-Assisted Sign Language Recognition (NLA-SLR) framework is proposed, which exploits semantic information contained in glosses (sign labels) and introduces a novel backbone, video-keypoint network, which not only models both RGB videos and human body keypoints but also derives knowledge from sign videos of different temporal receptive fields.

    119
  • High-Fidelity and Arbitrary Face Editing

    Yue Gao, Fangyun Wei, Jianmin Bao, Shuyang Gu, Dong Chen, Fang Wen, Zhouhui Lian

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2021

    This work proposes a simple yet effective method named HifaFace, which achieves high-fidelity and arbitrary face editing, outperforming other state-of-the-art approaches.

    89
  • Dual Path Learning for Domain Adaptation of Semantic Segmentation

    Yiting Cheng, Fangyun Wei, Jianmin Bao, Dong Chen, Fang Wen, Wenqiang Zhang

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2021

    This paper proposes a novel dual path learning (DPL) framework that contains two complementary and interactive single-domain adaptation pipelines aligned in source and target domain respectively and shows superiority of the DPL model over the state-of-the-art methods.

    77
  • ADNet: Leveraging Error-Bias Towards Normal Direction in Face Alignment

    Yangyu Huang, Hao Yang, Chong Li, Jongyoo Kim, Fangyun Wei

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2021

    Anisotropic direction loss (ADL) and anisotropic attention module (AAM) for coordinate and heatmap regression, respectively are proposed and integrated into an optimized end-to-end training pipeline named ADNet, which achieves state-of-the-art results on 300W, WFLW and COFW datasets.

    72
  • Cross-Model Pseudo-Labeling for Semi-Supervised Action Recognition

    Yinghao Xu, Fangyun Wei, Xiao Na Sun, Ceyuan Yang, Yujun Shen, Bo Dai, Bolei Zhou, Stephen Ching-Feng Lin

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    This work proposes a more effective pseudo-labeling scheme, called Cross-Model Pseudo-Labeling (CMPL), which introduces a lightweight auxiliary network in addition to the primary backbone, and asks them to predict pseudo-labels for each other, and observes that these two models tend to learn complementary representations from the same video clips.

    66
  • TinyMIM: An Empirical Study of Distilling MIM Pre-trained Models

    Sucheng Ren, Fangyun Wei, Zheng Zhang, Han Hu

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023

    Distillation techniques to transfer the success of large MIM-based pre-trained models to smaller ones are explored, suggesting an alternative way for developing small vision Transformer models by exploring better training methods rather than introducing inductive biases into architectures as in most previous works.

    64
  • Revisiting Referring Expression Comprehension Evaluation in the Era of Large Multimodal Models

    Jierun Chen, Fangyun Wei, Jinjing Zhao, Sizhe Song, Bohuai Wu, Zhuoxuan Peng, S.-H. Gary Chan, Hongyang Zhang

    IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · 2025

    Ref-L4 is introduced, a comprehensive REC benchmark, specifically designed to evaluate modern REC models, and several LMMs capable of handling the REC task are evaluated, showing significant accuracy improvements, thus highlighting the impact of benchmark noise.

    62
  • CiCo: Domain-Aware Sign Language Retrieval via Cross-Lingual Contrastive Learning

    Yiting Cheng, Fangyun Wei, Jianmin Bao, Dong Chen, Wenqiang Zhang

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023

    This work adopts a domain-agnostic sign encoder pre-trained on large-scale sign videos into the target domain via pseudo-labeling, and develops a framework, termed as domain-aware sign language retrieval via Cross-lingual Contrastive learning or CiCo, which outperforms the pioneering method by large margins on various datasets.

    61
  • Improving Continuous Sign Language Recognition with Cross-Lingual Signs

    Fangyun Wei, Yutong Chen

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2023

    The feasibility of utilizing multilingual sign language corpora to facilitate monolingual CSLR is explored, and the underlying idea is to identify the cross-lingual signs in one sign language and properly leverage them as auxiliary training data to improve the recognition capability of another.

    59
  • ADPL: Adaptive Dual Path Learning for Domain Adaptation of Semantic Segmentation

    Yiting Cheng, Fangyun Wei, Jianmin Bao, Dong Chen, Wenqiang Zhang

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2023

    57
  • Scaling the Codebook Size of VQ-GAN to 100,000 with a Utilization Rate of 99%

    Lei Zhu, Fangyun Wei, Yanye Lu, Dong Chen

    neural information processing systems · 2024

    53
  • Aligning Pretraining for Detection via Object-Level Contrastive Learning

    Fangyun Wei, Yue Gao, Zhirong Wu, Hu Han, Stephen Ching-Feng Lin

    arXiv · 2021

    51

Show all 71 works

Publication data from OpenAlex, with missing venues and authors filled in from Crossref; citation counts are the higher of OpenAlex and Semantic Scholar, last synced 2026-10-15. One-sentence summaries under some papers are written by Semantic Scholar’s model. Citation counts may be lower than on Google Scholar, which indexes more sources.

Report an error

Wrong papers, two people merged into one, or a profile that should not be here? Tell us and we will fix or hide it.

Sign in to report