Is this you? Claim this profile to correct it, add a bio and choose the work people see first.

Claim this profile

Academic lineage

Possible advisorsa guess from early papers, not confirmed

  • Pushpak Bhattacharyya

    Possible advisor · last author on 3 of their early first-author papers, 2017–2018

    Suggested from co-authorship
  • Soujanya Poria

    Possible advisor · last author on 11 of their early first-author papers, 2020–2022

    Suggested from co-authorship

Is this you? Claim this profile to confirm or dismiss it.

Works48 from public data

TitleCited by
  • DialogueGCN: A Graph Convolutional Neural Network for Emotion Recognition in Conversation

    Deepanway Ghosal, Navonil Majumder, Soujanya Poria, Niyati Chhaya, Alexander F. Gelbukh

    Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · 2019

    Through the graph network, DialogueGCN addresses context propagation issues present in the current RNN-based methods, and empirically show that this method alleviates such issues, while outperforming the current state of the art on a number of benchmark emotion classification datasets.

    725
  • COSMIC: COmmonSense knowledge for eMotion Identification in Conversations

    Deepanway Ghosal, Navonil Majumder, Alexander F. Gelbukh, Rada F. Mihalcea, Soujanya Poria

    Findings of the Association for Computational Linguistics: EMNLP 2020 · 2020

    This paper proposes COSMIC, a new framework that incorporates different elements of commonsense such as mental states, events, and causal relations, and build upon them to learn interactions between interlocutors participating in a conversation.

    448
  • MIME: MIMicking Emotions for Empathetic Response Generation

    Navonil Majumder, Pengfei Hong, Shanshan Peng, Jiankun Lu, Deepanway Ghosal, Alexander F. Gelbukh, Rada F. Mihalcea, Soujanya Poria

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2020

    This work argues that empathetic responses often mimic the emotion of the user to a varying degree, depending on its positivity or negativity and content, and introduces stochasticity into the emotion mixture that yields emotionally more varied emPathetic responses than the previous work.

    271
  • Multi-task Learning for Multi-modal Emotion Recognition and Sentiment Analysis

    Md Shad Akhtar, Dushyant Singh Chauhan, Deepanway Ghosal, Soujanya Poria, Asif Ekbal, Pushpak Bhattacharyya

    Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · 2019

    A deep multi-task learning framework that jointly performs sentiment and emotion analysis both as well as a context-level inter-modal attention framework for simultaneously predicting the sentiment and expressed emotions of an utterance is presented.

    217
  • Text-to-Audio Generation using Instruction-Tuned LLM and Latent Diffusion Model

    Deepanway Ghosal, Navonil Majumder, Ambuj Mehrish, Soujanya Poria

    arXiv · 2023

    This work adopts an instruction-tuned LLM Flan-T5 as the text encoder for text-to-audio (TTA) generation and finds that the latent diffusion model (LDM)-based approach TANGO outperforms the state-of-the-art AudioLDM on most metrics and stays comparable on the rest on AudioCaps test set.

    213
  • Contextual Inter-modal Attention for Multi-modal Sentiment Analysis

    Deepanway Ghosal, Md Shad Akhtar, Dushyant Singh Chauhan, Soujanya Poria, Asif Ekbal, Pushpak Bhattacharyya

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2018

    A recurrent neural network based multi-modal attention framework that leverages the contextual information for utterance-level sentiment prediction that applies attention on multi- modal multi-utterance representations and tries to learn the contributing features amongst them.

    186
  • Recognizing Emotion Cause in Conversations

    Soujanya Poria, Navonil Majumder, Devamanyu Hazarika, Deepanway Ghosal, Rishabh Bhardwaj, Samson Yu, Pengfei Hong, Romila Ghosh, +4 more

    Cognitive Computation · 2021

    This work introduces a new task highly relevant for (explainable) emotion-aware artificial intelligence: recognizing emotion cause in conversations, provides a new highly challenging publicly available dialogue-level dataset for this task, and gives strong baseline results on this dataset.

    174
  • Mustango: Toward Controllable Text-to-Music Generation

    Jan Melechovský, Zixun Guo, Deepanway Ghosal, Navonil Majumder, Dorien Herremans, Soujanya Poria

    Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · 2024

    The quality of the music generated by Mustango is state-of-the-art, and the controllability through music-specific text prompts greatly outperforms other models such as MusicGen and AudioLDM2.

    171
  • Tango 2: Aligning Diffusion-based Text-to-Audio Generations through Direct Preference Optimization

    Navonil Majumder, Chia-Yu Hung, Deepanway Ghosal, Wei-Ning Hsu, Rada F. Mihalcea, Soujanya Poria

    ACM International Conference on Multimedia (ACM MM) · 2024

    This work fine-tune the publicly available Tango text-to-audio model using diffusion-DPO (direct preference optimization) loss on the authors' preference dataset and shows that it leads to improved audio output over Tango and AudioLDM2, in terms of both automatic- and manual-evaluation metrics.

    165
  • Text-to-Audio Generation using Instruction Guided Latent Diffusion Model

    Deepanway Ghosal, Navonil Majumder, Ambuj Mehrish, Soujanya Poria

    ACM International Conference on Multimedia (ACM MM) · 2023

    This work adopts an instruction-tuned LLM Flan-T5 as the text encoder for text-to-audio generation-a task where the goal is to generate an audio from its textual description and outperforms the state-of-the-art AudioLDM on most metrics and stays comparable on the rest on AudioCaps test set.

    135
  • All-in-One: Emotion, Sentiment and Intensity Prediction Using a Multi-Task Ensemble Framework

    Md Shad Akhtar, Deepanway Ghosal, Asif Ekbal, Pushpak Bhattacharyya, Sadao Kurohashi

    IEEE Transactions on Affective Computing · 2019

    121
  • A Multilayer Perceptron based Ensemble Technique for Fine-grained Financial Sentiment Analysis

    Md Shad Akhtar, Kumar Abhishek, Deepanway Ghosal, Asif Ekbal, Pushpak Bhattacharyya

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2017

    A novel method for combining deep learning and classical feature based models using a Multi-Layer Perceptron (MLP) network for financial sentiment analysis using a classical supervised model based on Support Vector Regression (SVR).

    115
  • Music Genre Recognition Using Deep Neural Networks and Transfer Learning

    Deepanway Ghosal, Maheshkumar H. Kolekar

    Interspeech (USB) · 2018

    This work proposes a novel approach for music genre recognition using an ensemble of convolutional long short term memory based neural networks (CNN LSTM) and a transfer learning model that outperforms them and achieves new state of the art results.

    95
  • Classification of fashion article images using convolutional neural networks

    Shobhit Bhatnagar, Deepanway Ghosal, Maheshkumar H. Kolekar

    International Conference on Image Information Processing (ICIIP) · 2017

    87
  • KinGDOM: Knowledge-Guided DOMain Adaptation for Sentiment Analysis

    Deepanway Ghosal, Devamanyu Hazarika, Abhinaba Roy, Navonil Majumder, Rada F. Mihalcea, Soujanya Poria

    Annual Meeting of the Association for Computational Linguistics (ACL) · 2020

    A new framework is introduced, KinGDOM, which utilizes the ConceptNet knowledge graph to enrich the semantics of a document by providing both domain-specific and domain-general background concepts, and conditioning a popular domain-adversarial baseline method with these learned concepts helps improve its performance over state-of-the-art approaches.

    71
  • IITP at SemEval-2017 Task 5: An Ensemble of Deep Learning and Feature Based Models for Financial Sentiment Analysis

    Deepanway Ghosal, Shobhit Bhatnagar, Md Shad Akhtar, Asif Ekbal, Pushpak Bhattacharyya

    International Workshop on Semantic Evaluation (SemEval) · 2017

    An ensemble based model which combines state of the art deep learning sentiment analysis algorithms like Convolution Neural Network and Long Short Term Memory along with feature based models to identify optimistic or pessimistic sentiments associated with companies and stocks in financial texts is proposed.

    37
  • A Multi-task Ensemble Framework for Emotion, Sentiment and Intensity Prediction

    Md Shad Akhtar, Deepanway Ghosal, Asif Ekbal, Pushpak Bhattacharyya, Kurohashi, Sadao

    arXiv · 2018

    33
  • Improving Zero-Shot Learning Baselines with Commonsense Knowledge

    Abhinaba Roy, Deepanway Ghosal, Erik Cambria, Navonil Majumder, Rada F. Mihalcea, Soujanya Poria

    Cognitive Computation · 2022

    This work takes advantage of explicit relations between nodes defined in ConceptNet, a commonsense knowledge graph, to generate commonsense embeddings of the class labels by using a graph convolution network-based autoencoder.

    32
  • CICERO: A Dataset for Contextualized Commonsense Inference in Dialogues

    Deepanway Ghosal, Siqi Shen, Navonil Majumder, Rada F. Mihalcea, Soujanya Poria

    Annual Meeting of the Association for Computational Linguistics (ACL) · 2022

    31
  • CIDER: Commonsense Inference for Dialogue Explanation and Reasoning

    Deepanway Ghosal, Pengfei Hong, Siqi Shen, Navonil Majumder, Rada F. Mihalcea, Soujanya Poria

    Annual Meeting of the Special Interest Group on Discourse and Dialogue · 2021

    This work introduces CIDER – a manually curated dataset that contains dyadic dialogue explanations in the form of implicit and explicit knowledge triplets inferred using contextual commonsense inference that can be conducive to improving several downstream applications.

    30
  • Exemplars-Guided Empathetic Response Generation Controlled by the Elements of Human Communication

    Navonil Majumder, Deepanway Ghosal, Devamanyu Hazarika, Alexander F. Gelbukh, Rada F. Mihalcea, Soujanya Poria

    IEEE Access · 2022

    Three elements of human communication—emotional presence, interpretation, and exploration—and sentiment are additionally introduced using synthetic labels to guide the generation towards empathy and it is empirically shown that these approaches yield significant improvements in empathetic response quality in terms of both automated and human-evaluated metrics.

    29
  • Are Language Models Puzzle Prodigies? Algorithmic Puzzles Unveil Serious Challenges in Multimodal Reasoning

    Deepanway Ghosal, Vernon Toh Yan Han, Chia Yew Ken, Soujanya Poria

    arXiv · 2024

    This paper presents a new dataset, AlgoPuzzleVQA, designed to challenge and evaluate the capabilities of multimodal language models in solving algorithmic puzzles that necessitate both visual understanding, language understanding, and complex algorithmic reasoning.

    27
  • Exploring the Role of Context in Utterance-level Emotion, Act and Intent Classification in Conversations: An Empirical Study

    Deepanway Ghosal, Navonil Majumder, Rada F. Mihalcea, Soujanya Poria

    Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021 · 2021

    This paper explores and quantify the role of context for different aspects of a dialogue, namely emotion, dialogue act, and intent identification, using state-of-the-art dialogue understanding methods as baselines and employs various perturbations to distort the context of a given utterance.

    26
  • Evaluating LLMs’ Mathematical and Coding Competency through Ontology-guided Interventions

    Pengfei Hong, Navonil Majumder, Deepanway Ghosal, Somak Aditya, Rada F. Mihalcea, Soujanya Poria

    Findings of the Association for Computational Linguistics: ACL 2025 · 2025

    A significant performance drop is shown across all the models against the perturbed questions, suggesting that the current LLMs lack robust problem solving skills and structured reasoning abilities in many areas, as defined by the ontology.

    24
  • Flacuna: Unleashing the Problem Solving Power of Vicuna using FLAN Fine-Tuning

    Deepanway Ghosal, Yew Ken Chia, Navonil Majumder, Soujanya Poria

    arXiv · 2023

    Experimental findings strongly indicate that the enhanced problem-solving abilities of the model, FLACUNA, are obtained through fine-tuning VICUNA on the FLAN dataset, leading to significant improvements across numerous benchmark datasets in INSTRUCTEVAL.

    24
  • Multiview Contextual Commonsense Inference: A New Dataset and Task

    Siqi Shen, Deepanway Ghosal, Navonil Majumder, Lim, Henry, Rada F. Mihalcea, Soujanya Poria

    arXiv · 2022

    This work creates CICEROv2, a dataset consisting of 8,351 instances from 2,379 dialogues, containing multiple human-written answers for each contextual commonsense inference question, representing a type of explanation on cause, subsequent event, motivation, and emotional reaction.

    16
  • Utterance-level Dialogue Understanding: An Empirical Study

    Deepanway Ghosal, Navonil Majumder, Rada F. Mihalcea, Soujanya Poria

    arXiv · 2020

    16
  • The FACTS Leaderboard: A Comprehensive Benchmark for Large Language Model Factuality

    Cheng, Aileen, Alon Jacovi, Amir Globerson, Ben Golan, Kwong, Charles, Chris Alberti, Connie Tao, Ben-David, Eyal, +22 more

    arXiv · 2025

    An online leaderboard suite and associated set of benchmarks that comprehensively evaluates the ability of language models to generate factually accurate text across diverse scenarios, designed to provide a robust and balanced assessment of a model's overall factuality.

    15
  • AlgoPuzzleVQA: Diagnosing Multimodal Reasoning Challenges of Language Models with Algorithmic Multimodal Puzzles

    Deepanway Ghosal, Vernon Toh, Yew Ken Chia, Soujanya Poria

    Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL) · 2025

    This paper presents a new dataset, A LGO P UZZLE VQA, designed to challenge and evaluate the capabilities of multimodal language models in solving algorithmic puzzles that necessitate both visual understanding, language understanding, and complex algorithmic reasoning, and reveals that multimodal language models exhibit limited performance in puzzle-solving tasks.

    13
  • STaCK: Sentence Ordering with Temporal Commonsense Knowledge

    Deepanway Ghosal, Navonil Majumder, Rada F. Mihalcea, Soujanya Poria

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2021

    STaCK is introduced — a framework based on graph neural networks and temporal commonsense knowledge to model global information and predict the relative order of sentences and results are reported on five different datasets.

    12
  • Persuasive dialogue understanding: The baselines and negative results

    Hui Chen, Deepanway Ghosal, Navonil Majumder, Amir Hussain, Soujanya Poria

    Neurocomputing · 2020

    This paper demonstrates the limitations of a Transformer-based approach coupled with Conditional Random Field (CRF) for the task of persuasive strategy recognition and leverages inter- and intra-speaker contextual semantic features, as well as label dependencies to improve the recognition.

    12
  • Not All Votes Count! Programs as Verifiers Improve Self-Consistency of Language Models for Math Reasoning

    Vernon Toh, Deepanway Ghosal, Soujanya Poria

    arXiv · 2024

    Prove, a simple yet effective framework that leverages translated programs derived from natural language solutions as a verification mechanism to filter out potentially incorrect reasoning paths before aggregating final answers, is introduced.

    10
  • Two is Better than Many? Binary Classification as an Effective Approach to Multi-Choice Question Answering

    Deepanway Ghosal, Navonil Majumder, Rada F. Mihalcea, Soujanya Poria

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2022

    8
  • PuzzleVQA: Diagnosing Multimodal Reasoning Challenges of Language Models with Abstract Visual Patterns

    Yew Ken Chia, Vernon Toh, Deepanway Ghosal, Lidong Bing, Soujanya Poria

    Findings of the Association for Computational Linguistics ACL 2024 · 2024

    7
  • Deep Ensemble Model with the Fusion of Character, Word and Lexicon Level Information for Emotion and Sentiment Prediction

    Deepanway Ghosal, Md Shad Akhtar, Asif Ekbal, Pushpak Bhattacharyya

    Lecture notes in computer science · 2018

    A novel neural network based architecture which incorporates character, word and lexicon level information to predict the degree of intensity for sentiment and emotion attains the state-of-the-art performance.

    7
  • The Jumping Reasoning Curve? Tracking the Evolution of Reasoning Performance in GPT-[n] and o-[n] Models on Multimodal Puzzles

    Vernon Toh, Yew Ken Chia, Deepanway Ghosal, Soujanya Poria

    arXiv · 2025

    The evolution of the GPT-[n] and o-[n] series models are tracked on challenging multimodal puzzles from PuzzleVQA and AlgoPuzzleVQA, which demand fine-grained visual perception and shows that o-[n] series significantly outperform the GPT-[n] series and show strong scalability in multimodal reasoning.

    6
  • Emma-X: An Embodied Multimodal Action Model with Grounded Chain of Thought and Look-ahead Spatial Reasoning

    Qi Sun, Pengfei Hong, Tej Deep Pala, Vernon Toh, U-Xuan Tan, Deepanway Ghosal, Soujanya Poria

    Annual Meeting of the Association for Computational Linguistics (ACL) · 2025

    6
  • Improving Text-To-Audio Models with Synthetic Captions

    Zhifeng Kong, Sang-gil Lee, Deepanway Ghosal, Navonil Majumder, Ambuj Mehrish, Rafael Valle, Soujanya Poria, Bryan Catanzaro

    Synthetic Data’s Transformative Role in Foundational Speech Models · 2024

    6
  • MixEval-X: Any-to-Any Evaluations from Real-World Data Mixtures

    Jinjie Ni, Yifan Song, Deepanway Ghosal, Bo Li, D. Zhang, Yue, Xiang, Fuzhao Xue, Zheng, Zian, +5 more

    arXiv · 2024

    This work introduces MixEval-X, the first any-to-any, real-world benchmark designed to optimize and standardize evaluations across diverse input and output modalities, and proposes multi-modal benchmark mixture and adaptation-rectification pipelines to reconstruct real-world task distributions.

    6
  • ReTAG: Reasoning Aware Table to Analytic Text Generation

    Deepanway Ghosal, Preksha Nema, Aravindan Raghuveer

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2023

    ReTAG is the first model that can controllably use multiple reasoning methods within a structure-aware sequence to sequence model to surpass state of the art performance in multiple table to text tasks.

    6
  • Language Guided Visual Question Answering: Elevate Your Multimodal Language Model Using Knowledge-Enriched Prompts

    Deepanway Ghosal, Navonil Majumder, Roy Lee, Rada F. Mihalcea, Soujanya Poria

    Findings of the Association for Computational Linguistics: EMNLP 2023 · 2023

    4
  • Discovering the complete enhancer map of human herpesviruses using a natural language processing model

    Nilabja Roy Chowdhury, Deepanway Ghosal, Vyacheslav Gurevich, Meir Shamay

    Nature Communications · 2025

    An AI tool is presented that successfully predicts enhancers in both viral and human genomes and can identify known enhancers and predict novel enhancer elements in other herpesviruses, different viruses, and the human genome.

    1
  • Generating Intermediate Steps for NLI with Next-Step Supervision

    Deepanway Ghosal, Somak Aditya, Monojit Choudhury

    arXiv · 2022

    This work trains a sequence-to-sequence model to generate only the next step given an NLI premise and hypothesis pair; enhances it with external knowledge and symbolic search to generate intermediate steps with only next-step supervision and shows the correctness of such generated steps through automated and human verification.

    1
  • Test-Time Scaling via Error Localization

    Rajiv Shailesh Chitale, Rahul Madhavan, Gupta, Taneesh, Deepanway Ghosal, Aravindan Raghuveer

    arXiv · 2026

    This work introduces Test-Time Scaling via Error Localization (TTEL), an inference-time algorithm that utilizes fixed or environment feedback to perform token-level error localization and establishes strictly dominating Pareto frontiers across sequential reasoning domains.

    –
  • NLKI: A Lightweight Natural Language Knowledge Integration Framework for Improving Small VLMs in Commonsense VQA Tasks

    Aritra Dutta, Swapnanil Mukherjee, Deepanway Ghosal, Somak Aditya

    Findings of the Association for Computational Linguistics: EMNLP 2025 · 2025

    –
  • Prover: Generating Intermediate Steps for NLI with Commonsense Knowledge Retrieval and Next-Step Prediction

    Deepanway Ghosal, Somak Aditya, Monojit Choudhury

    International Joint Conference on Natural Language Processing and Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (IJCNLP-AACL) · 2023

    This work trains and enhances a sequence-to-sequence next-step prediction model with external commonsense knowledge and search to generate intermediate steps with limited next-step supervision and shows that such generated steps can help improve end-to-end NLI task performance using simple data augmentation strategies.

    –
  • Vector Space Interpolation for Query Expansion

    Deepanway Ghosal, Somak Aditya, Sandipan Dandapat, Monojit Choudhury

    Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the International Joint Conference on Natural Language Processing (AACL-IJCNLP) · 2022

    This work describes a method for query set expansion about emerging topics using vector space interpolation using a transformer model called OPTIMUS, which is suitable for vector space manipulation due to its variational autoencoder nature.

    –
  • Visual Interest Prediction with Attentive Multi-Task Transfer Learning

    Deepanway Ghosal, Maheshkumar H. Kolekar

    arXiv · 2020

    –

Publication data from OpenAlex, with missing venues and authors filled in from Crossref; citation counts are the higher of OpenAlex and Semantic Scholar, last synced 2026-10-12. One-sentence summaries under some papers are written by Semantic Scholar’s model. Citation counts may be lower than on Google Scholar, which indexes more sources.

Report an error

Wrong papers, two people merged into one, or a profile that should not be here? Tell us and we will fix or hide it.

Sign in to report