Is this you? Claim this profile to correct it, add a bio and choose the work people see first.

Claim this profile

Academic lineage

Possible advisorsa guess from early papers, not confirmed

  • Larry Steven Davis

    Possible advisor · last author on 3 of their early first-author papers, 2005–2007

    Suggested from co-authorship

Is this you? Claim this profile to confirm or dismiss it.

Works151 from public data

TitleCited by
  • A Metric Learning Reality Check

    Kevin Musgrave, Serge Belongie, Ser-Nam Lim

    Lecture notes in computer science · 2020

    Flaws in the experimental methodology of numerous metric learning papers are found, and it is shown that the actual improvements over time have been marginal at best.

    579
  • What Makes Fake Images Detectable? Understanding Properties that Generalize

    Lucy Chai, David Anthony Bau, Ser-Nam Lim, Phillip Isola

    Lecture notes in computer science · 2020

    This work uses a patch-based classifier with limited receptive fields to visualize which regions of fake images are more easily detectable and shows a technique to exaggerate these detectable properties and demonstrates that, even when the image generator is adversarially finetuned against a fake image classifier, it is still imperfect and leaves detectable artifacts in certain image patches.

    489
  • AdaViT: Adaptive Vision Transformers for Efficient Image Recognition

    Lingchen Meng, Hengduo Li, Bor-Chun Chen, Shiyi Lan, Zuxuan Wu, Yu–Gang Jiang, Ser-Nam Lim

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    AdaViT is introduced, an adaptive computation framework that learns to derive usage policies on which patches, self-attention heads and transformer blocks to use throughout the backbone on a per-input basis, aiming to improve inference efficiency of vision transformers with a minimal drop of accuracy for image recognition.

    355
  • Making an Invisibility Cloak: Real World Adversarial Attacks on Object Detectors

    Zuxuan Wu, Ser-Nam Lim, Larry Steven Davis, Tom Goldstein

    Lecture notes in computer science · 2020

    A systematic study of adversarial attacks on state-of-the-art object detection frameworks, and a detailed study of physical world attacks using printed posters and wearable clothes, to quantify the performance of such attacks with different metrics.

    334
  • MA-LMM: Memory-Augmented Large Multimodal Model for Long-Term Video Understanding

    Bo He, Hengduo Li, Young Kyun Jang, Menglin Jia, Xuefei Cao, Ashish Harish Shah, Abhinav Shrivastava, Ser-Nam Lim

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    This study proposes to process videos in an online manner and store past video information in a memory bank, which allows the model to reference historical video content for long-term analysis without exceeding LLMs' context length constraints or GPU memory limits.

    329
  • Enhancing Adversarial Example Transferability With an Intermediate Level Attack

    Qian Huang, Isay Katsman, Zeqi Gu, Horace He, Serge Belongie, Ser-Nam Lim

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2019

    The Intermediate Level Attack (ILA) is introduced, which attempts to fine-tune an existing adversarial example for greater black-box transferability by increasing its perturbation on a pre-specified layer of the source model, improving upon state-of-the-art methods.

    312
  • Cross-X Learning for Fine-Grained Visual Categorization

    Wei Luo, Xitong Yang, Xianjie Mo, Yuheng Lu, Larry Steven Davis, Jun Li, Jian Jun Yang, Ser-Nam Lim

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2019

    This paper proposes Cross-X learning, a simple yet effective approach that exploits the relationships between different images and between different network layers for robust multi-scale feature learning and involves two novel components: a cross-category cross-semantic regularizer that guides the extracted features to represent semantic parts and aCross-layerRegularizer that improves the robustness of multi- scale features by matching the prediction distribution across multiple layers.

    277
  • Joint Audio-Visual Deepfake Detection

    Yipin Zhou, Ser-Nam Lim

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2021

    261
  • ObjectFormer for Image Manipulation Detection and Localization

    Junke Wang, Zuxuan Wu, Jingjing Chen, Xintong Han, Abhinav Shrivastava, Ser-Nam Lim, Yu–Gang Jiang

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    This paper proposes ObjectFormer, a method to detect and localize image manipulations that outperforms state-of-the-art tampering detection and localization methods, and uses a set of learnable object prototypes as mid-level representations to model the object-level consistencies among different regions.

    240
  • Detecting Deep-Fake Videos from Appearance and Behavior

    Shruti Agarwal, Hany Farid, Tarek El-Gaaly, Ser-Nam Lim

    IEEE International Workshop on Information Forensics and Security · 2020

    A biometric-based forensic technique for detecting face-swap deep fakes that combines a static biometric based on facial recognition with a temporal, behavioral biometricbased on facial expressions and head movements and is shown to be efficacy across several large-scale video datasets.

    231
  • Graph Inductive Biases in Transformers without Message Passing

    Liheng Ma, Chen Lin, Derek Lim, Adriana Romero-Soriano, Puneet K. Dokania, Mark Coates, Philip H. S. Torr, Ser-Nam Lim

    arXiv · 2023

    The Graph Inductive bias Transformer (GRIT) is proposed -- a new Graph Transformer that incorporates graph inductive biases without using message passing and achieves state-of-the-art empirical performance across a variety of graph datasets, thus showing the power that Graph Transformers without message-passing can deliver.

    230
  • On Feature Normalization and Data Augmentation

    Boyi Li, Felix Wu, Ser-Nam Lim, Serge Belongie, Kilian Q. Weinberger

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2021

    This paper proposes Moment Exchange, an implicit data augmentation method that encourages the model to utilize the moment information also for recognition models, and replaces the moments of the learned features of one training image by those of another, and also interpolate the target labels to extract training signal from the moments.

    168
  • HNeRV: A Hybrid Neural Representation for Videos

    Hao Chen, Matthew Gwilliam, Ser-Nam Lim, Abhinav Shrivastava

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023

    With content-adaptive embeddings and redesigned architecture, HNeRV outperforms implicit methods in video regression tasks for both reconstruction quality and convergence speed, and shows better internal generalization.

    166
  • Generate, Segment, and Refine: Towards Generic Manipulation Segmentation

    Peng Zhou, Bor-Chun Chen, Xintong Han, Mahyar Najibi, Abhinav Shrivastava, Ser-Nam Lim, Larry Steven Davis

    Proceedings of the AAAI Conference on Artificial Intelligence · 2020

    A manipulated image generation process that creates true positives using currently available datasets is introduced, and a novel generator for creating examples that force the algorithm to focus on boundary artifacts during training is proposed.

    162
  • Open Vocabulary Semantic Segmentation with Patch Aligned Contrastive Learning

    Jishnu Mukhoti, Tsung‐Yu Lin, Omid Poursaeed, Rui Wang, Ashish S. Shah, Philip H. S. Torr, Ser-Nam Lim

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023

    Patch Aligned Contrastive Learning (PACL), a modified compatibility function for CLIP's contrastive loss, is introduced, intending to train an alignment between the patch tokens of the vision encoder and the CLS token of the text encoder, to transfer seamlessly to the task of open vocabulary semantic segmentation.

    149
  • On the Robustness of Large Multimodal Models Against Image Adversarial Attacks

    Xuanming Cui, Alejandro Aparcedo, Young Kyun Jang, Ser-Nam Lim

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    It is found that in general LMMs are not robust to visual adversarial inputs, but the findings suggest that context provided to the model via prompts—such as questions in a QA pair—helps to mitigate the effects of visual adversarial inputs.

    140
  • Detecting Everything in the Open World: Towards Universal Object Detection

    Zhenyu Wang, Yali Li, Xi Chen, Ser-Nam Lim, Antonio B. Torralba, Hengshuang Zhao, Shengjin Wang

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023

    UniDetector is proposed, a universal object detector that has the ability to recognize enormous categories in the open world, and surpasses the traditional supervised baselines by more than 4% on average without seeing any corresponding images.

    128
  • Quantization Guided JPEG Artifact Correction

    Max Ehrlich, Larry Steven Davis, Ser-Nam Lim, Abhinav Shrivastava

    Lecture notes in computer science · 2020

    This work creates a novel architecture which is parameterized by the JPEG files quantization matrix, which allows a single model to achieve state-of-the-art performance over models trained for specific quality settings.

    127
  • Curriculum Manager for Source Selection in Multi-source Domain Adaptation

    Luyu Yang, Yogesh Balaji, Ser-Nam Lim, Abhinav Shrivastava

    Lecture notes in computer science · 2020

    This paper proposed an adversarial agent that learns a dynamic curriculum for source samples, called Curriculum Manager for Source Selection (CMSS), which outperforms other methods on four well-known benchmarks by significant margins.

    127
  • Combining Label Propagation and Simple Models Out-performs Graph Neural Networks

    Qian Huang, Horace He, Abhay Pratap Singh, Ser-Nam Lim, Austin R. Benson

    arXiv · 2020

    117
  • Deep Co-Training with Task Decomposition for Semi-Supervised Domain Adaptation

    Luyu Yang, Yan Wang, Mingfei Gao, Abhinav Shrivastava, Kilian Q. Weinberger, Wei‐Lun Chao, Ser-Nam Lim

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2021

    It is argued that the labeled target data needs to be distinguished for effective SSDA, and proposed to explicitly decompose the SSDA task into two sub-tasks: a semi-supervised learning (SSL) task in the target domain and an unsupervised domain adaptation (UDA) task across domains.

    99
  • Monitoring, recognizing and discovering social networks

    Ting Yu, Ser-Nam Lim, Kedar A. Patwardhan, Nils O. Krahnstoever

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2009

    96
  • Computationally Budgeted Continual Learning: What Does Matter?

    Ameya Prabhu, Hasan Abed Al Kader Hammoud, Puneet K. Dokania, Philip H. S. Torr, Ser-Nam Lim, Bernard Ghanem, Adel Bibi

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023

    It is found that, under compute-constrained setting, traditional CL approaches, with no exception, fail to outperform a simple minimal baseline that samples uniformly from memory, suggesting that most existing CL methods are particularly too computationally expensive for realistic budgeted deployment.

    95
  • MTFormer: Multi-task Learning via Transformer and Cross-Task Reasoning

    Xiaogang Xu, Hengshuang Zhao, Vibhav Vineet, Ser-Nam Lim, Antonio B. Torralba

    Lecture notes in computer science · 2022

    It is demonstrated that models with transformer structures are more appropriate for MTL than convolutional neural networks (CNNs), and a novel transformer-based architecture named MTFormer is proposed, which achieves state-of-the-art results with limited network parameters and computations.

    95
  • Few-Shot Object Detection with Foundation Models

    Guangxing Han, Ser-Nam Lim

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    89

Show all 151 works

Publication data from OpenAlex, with missing venues and authors filled in from Crossref; citation counts are the higher of OpenAlex and Semantic Scholar, last synced 2026-10-13. One-sentence summaries under some papers are written by Semantic Scholar’s model. Citation counts may be lower than on Google Scholar, which indexes more sources.

Report an error

Wrong papers, two people merged into one, or a profile that should not be here? Tell us and we will fix or hide it.

Sign in to report