Deepu Rajan lists you as their PhD student. Claim this profile to confirm it and keep the rest of your record right.

Claim this profile

Academic lineage

View as a tree

Advisors

Works134 from public data

TitleCited by
  • GLaMM: Pixel Grounding Large Multimodal Model

    Hanoona Rasheed, Muhammad Maaz, Sahal Shaji, Abdelrahman Shaker, Salman Khan, Hisham Cholakkal, Rao Muhammad Anwer, Eric P. Xing, +2 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    This work presents Grounding LMM (GLaMM), the first model that can generate natural language responses seamlessly in-tertwined with corresponding object segmentation masks and is flexible enough to accept both textual and optional visual prompts (region of interest) as input.

    594
  • Foundation Models Defining a New Era in Vision: A Survey and Outlook

    Muhammad Awais, Muzammal Naseer, Salman Hameed Khan, Rao Muhammad Anwer, Hisham Cholakkal, Mubarak Shah, Ming–Hsuan Yang, Fahad Shahbaz Khan

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2025

    443
  • Transformers in Remote Sensing: A Survey

    Abdulaziz Amer Aleissaee, Amandeep Kumar, Rao Muhammad Anwer, Salman Hameed Khan, Hisham Cholakkal, Gui-Song Xia, Fahad Shahbaz Khan

    Remote Sensing · 2023

    417
  • EdgeNeXt: Efficiently Amalgamated CNN-Transformer Architecture for Mobile Vision Applications

    Muhammad Maaz, Abdelrahman Shaker, Hisham Cholakkal, Salman Khan, Syed Waqas Zamir, Rao Muhammad Anwer, Fahad Shahbaz Khan

    Lecture notes in computer science · 2023

    361
  • D2Det: Towards High Quality Object Detection and Instance Segmentation

    Jiale Cao, Hisham Cholakkal, Rao Muhammad Anwer, Fahad Shahbaz Khan, Yanwei Pang, Ling Shao

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2020

    281
  • SipMask: Spatial Information Preservation for Fast Image and Video Instance Segmentation

    Jiale Cao, Rao Muhammad Anwer, Hisham Cholakkal, Fahad Shahbaz Khan, Yanwei Pang, Ling Shao

    Lecture notes in computer science · 2020

    A fast single-stage instance segmentation method that preserves instance-specific spatial information by separating mask prediction of an instance to different sub-regions of a detected bounding-box, leading to improved mask predictions and a mask alignment weighting loss and a feature alignment scheme to better correlate mask prediction with object detection.

    200
  • Person Image Synthesis via Denoising Diffusion Model

    Ankan Kumar Bhunia, Salman Khan, Hisham Cholakkal, Rao Muhammad Anwer, Jorma T. Laaksonen, Mubarak Shah, Fahad Shahbaz Khan

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023

    This work shows how denoising diffusion models can be applied for high-fidelity person image synthesis with strong sample diversity and enhanced mode coverage of the learnt data distribution and introduces a ‘texture diffusion module’ based on cross-attention to accurately model the correspondences between appearance and pose information available in source and target images.

    186
  • 3C-Net: Category Count and Center Loss for Weakly-Supervised Action Localization

    Sanath Narayan, Hisham Cholakkal, Fahad Shahbaz Khan, Ling Shao

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2019

    This work proposes a framework, called 3C-Net, which only requires video-level supervision (weak supervision) in the form of action category labels and the corresponding count to learn discriminative action features with enhanced localization capabilities.

    183
  • Foundational Models Defining a New Era in Vision: A Survey and Outlook

    Muhammad Awais, Muzammal Naseer, Salman A. Khan, Rao Muhammad Anwer, Hisham Cholakkal, Mubarak A. Shah, Ming–Hsuan Yang, Fahad Shahbaz Khan

    arXiv · 2023

    A comprehensive review of emerging foundational models in computer vision, including typical architecture designs to combine different modalities, training objectives, pre-training datasets, fine-tuning mechanisms, and the common prompting patterns; textual, visual, and heterogeneous.

    172
  • Fine-Grained Recognition: Accounting for Subtle Differences between Similar Classes

    Guolei Sun, Hisham Cholakkal, Salman Hameed Khan, Fahad Shahbaz Khan, Ling Shao

    Proceedings of the AAAI Conference on Artificial Intelligence · 2020

    The main requisite for fine-grained recognition task is to focus on subtle discriminative details that make the subordinate classes different from each other, and this work proposes to explicitly force the network to find the subtle differences among closely related classes.

    147
  • XrayGPT: Chest Radiographs Summarization using Large Medical Vision-Language Models

    Omkar Thawakar, Abdelrahman Shaker, Sahal Shaji Mullappilly, Hisham Cholakkal, Rao Muhammad Anwer, Salman A. Khan, Jorma T. Laaksonen, Fahad Shahbaz Khan

    Workshop on Biomedical Natural Language Processing (BioNLP) · 2024

    This paper introduces XrayGPT, a conversational medical vision-language (VLMs) model that can analyze and answer open-ended questions about chest radiographs, and aligns both medical visual encoder with a fine-tuned LLM to possess visual conversation abilities, grounded in an understanding of radiographs and medical knowledge.

    145
  • Object Counting and Instance Segmentation With Image-Level Supervision

    Hisham Cholakkal, Guolei Sun, Fahad Shahbaz Khan, Ling Shao

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2019

    This work is the first to propose image-level supervised density map estimation for common object counting and demonstrate its effectiveness in image- level supervised instance segmentation and outperforms existing methods, including those using instance-level supervision, on both datasets for common objects counting.

    136
  • Rethinking Transformers Pre-training for Multi-Spectral Satellite Imagery

    Mubashir Noman, Muzammal Naseer, Hisham Cholakkal, Rao Muhammad Anwer, Salman Khan, Fahad Shahbaz Khan

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    The proposed SatMAE++ with multi-scale pre-training is equally effective for both optical as well as multi-spectral imagery and achieves mean average precision (mAP) gain of 2.5% for multi-label classification task on BigEarthNet dataset.

    135
  • LLM Post-Training: A Deep Dive Into Reasoning Large Language Models

    Komal Kumar, Tajamul Ashraf, Omkar Thawakar, Rao Muhammad Anwer, Hisham Cholakkal, Mubarak Shah, Ming–Hsuan Yang, Phillip Torr, +2 more

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2026

    This survey provides a systematic exploration of post-training methodologies, analyzing their role in refining LLMs beyond pretraining, addressing key challenges such as catastrophic forgetting, reward hacking, and inference-time trade-offs.

    132
  • Remote Sensing Change Detection With Transformers Trained From Scratch

    Mubashir Noman, Mustansar Fiaz, Hisham Cholakkal, Sanath Narayan, Rao Muhammad Anwer, Salman Hameed Khan, Fahad Shahbaz Khan

    IEEE Transactions on Geoscience and Remote Sensing · 2024

    This work develops an end-to-end CD approach with transformers that is trained from scratch and yet achieves state-of-the-art performance on five benchmarks, and introduces a change-enhanced feature fusion (CEFF) module to fuse the features from input image pairs by performing a per-channel re-weighting.

    129
  • ELGC-Net: Efficient Local–Global Context Aggregation for Remote Sensing Change Detection

    Mubashir Noman, Mustansar Fiaz, Hisham Cholakkal, Salman Hameed Khan, Fahad Shahbaz Khan

    IEEE Transactions on Geoscience and Remote Sensing · 2024

    This work proposes an efficient change detection (CD) framework, efficient global and local context aggregation network (ELGC-Net), which leverages rich contextual information to precisely estimate change regions while reducing the model size, and introduces ELGC-Net-LW, a lighter variant with significantly reduced computational complexity, suitable for resource-constrained settings.

    119
  • Learning Rich Features at High-Speed for Single-Shot Object Detection

    Tiancai Wang, Rao Muhammad Anwer, Hisham Cholakkal, Fahad Shahbaz Khan, Yanwei Pang, Ling Shao

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2019

    115
  • XrayGPT: Chest Radiographs Summarization using Medical Vision-Language Models

    Thawakar, Omkar, Abdelrahman Shaker, Sahal Shaji Mullappilly, Hisham Cholakkal, Rao Muhammad Anwer, Salman Khan, Jorma T. Laaksonen, Fahad Shahbaz Khan

    arXiv · 2023

    97
  • Handwriting Transformers

    Ankan Kumar Bhunia, Salman Hameed Khan, Hisham Cholakkal, Rao Muhammad Anwer, Fahad Shahbaz Khan, Mubarak A. Shah

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2021

    A novel transformer-based styled handwritten text image generation approach, HWT, that strives to learn both style-content entanglement as well as global and local style patterns, and is the first to introduce a transformer- based network for styling handwritten text generation.

    90
  • Enriched Feature Guided Refinement Network for Object Detection

    Jing Nie, Rao Muhammad Anwer, Hisham Cholakkal, Fahad Shahbaz Khan, Yanwei Pang, Ling Shao

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2019

    89
  • PSTR: End-to-End One-Step Person Search With Transformers

    Jiale Cao, Yanwei Pang, Rao Muhammad Anwer, Hisham Cholakkal, Jin Xie, Mubarak A. Shah, Fahad Shahbaz Khan

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    The proposed PSTR is the first to propose an end-to-end one-step transformer-based person search framework that jointly performs person detection and re-identification (re-id) in a single architecture and sets a new state-of-the-art on both benchmarks.

    88
  • D2-Net: Weakly-Supervised Action Localization via Discriminative Embeddings and Denoised Activations

    Sanath Narayan, Hisham Cholakkal, Munawar Hayat, Fahad Shahbaz Khan, Ming–Hsuan Yang, Ling Shao

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2021

    A novel loss formulation is introduced, which jointly enhances the discriminability of latent embeddings and robustness of the output temporal class activations with respect to foreground-background noise caused by weak supervision, in a weakly-supervised temporal action localization framework, called D2-Net.

    69
  • PSC-Net: learning part spatial co-occurrence for occluded pedestrian detection

    Jin Xie, Yanwei Pang, Hisham Cholakkal, Rao Muhammad Anwer, Fahad Shahbaz Khan, Ling Shao

    Science China Information Sciences · 2020

    The proposed PSC-Net contains a dedicated module that is designed to explicitly capture both inter and intra-part co-occurrence information of different pedestrian body parts through a graph convolutional network (GCN).

    61
  • MobiLlama: Towards Accurate and Lightweight Fully Transparent GPT

    Omkar Thawakar, Ashmal Vayani, Salman Hameed Khan, Hisham Cholakkal, Rao Muhammad Anwer, Michael Felsberg, Tim Baldwin, Eric P. Xing, +1 more

    arXiv · 2024

    MobiLlama is a SLM design that initiates from a larger model and applies a careful parameter sharing scheme to reduce both the pre-training and the deployment cost, and strives to not only bridge the gap in open-source SLMs but also ensures full transparency.

    60
  • DriveLMM-o1: A Step-by-Step Reasoning Dataset and Large Multimodal Model for Driving Scenario Understanding

    Ayesha Ishaq, Jean Lahoud, Ketan More, Omkar Thawakar, Ritesh Thawkar, Dinura Dissanayake, Noor Ahsan, Yuhao Li, +5 more

    IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · 2025

    A large multimodal model is introduced that is fine-tuned on the authors' reasoning dataset, demonstrating robust performance in complex driving scenarios, and various open-source and closed-source methods are benchmarked on this proposed dataset, systematically comparing their reasoning capabilities for autonomous driving tasks.

    57

Show all 134 works

Publication data from OpenAlex, with missing venues and authors filled in from Crossref; citation counts are the higher of OpenAlex and Semantic Scholar, last synced 2026-10-15. One-sentence summaries under some papers are written by Semantic Scholar’s model. Citation counts may be lower than on Google Scholar, which indexes more sources.

Report an error

Wrong papers, two people merged into one, or a profile that should not be here? Tell us and we will fix or hide it.

Sign in to report