Is this you? Claim this profile to correct it, add a bio and choose the work people see first.

Claim this profile

Academic lineage

Possible advisorsa guess from early papers, not confirmed

  • Pushpak Bhattacharyya

    Possible advisor · last author on 3 of their early first-author papers, 2017–2018

    Suggested from co-authorship
  • Soujanya Poria

    Possible advisor · last author on 11 of their early first-author papers, 2020–2022

    Suggested from co-authorship

Is this you? Claim this profile to confirm or dismiss it.

Works48 from public data

TitleCited by
  • DialogueGCN: A Graph Convolutional Neural Network for Emotion Recognition in Conversation

    Deepanway Ghosal, Navonil Majumder, Soujanya Poria, Niyati Chhaya, Alexander F. Gelbukh

    Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · 2019

    Through the graph network, DialogueGCN addresses context propagation issues present in the current RNN-based methods, and empirically show that this method alleviates such issues, while outperforming the current state of the art on a number of benchmark emotion classification datasets.

    725
  • COSMIC: COmmonSense knowledge for eMotion Identification in Conversations

    Deepanway Ghosal, Navonil Majumder, Alexander F. Gelbukh, Rada F. Mihalcea, Soujanya Poria

    Findings of the Association for Computational Linguistics: EMNLP 2020 · 2020

    This paper proposes COSMIC, a new framework that incorporates different elements of commonsense such as mental states, events, and causal relations, and build upon them to learn interactions between interlocutors participating in a conversation.

    448
  • MIME: MIMicking Emotions for Empathetic Response Generation

    Navonil Majumder, Pengfei Hong, Shanshan Peng, Jiankun Lu, Deepanway Ghosal, Alexander F. Gelbukh, Rada F. Mihalcea, Soujanya Poria

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2020

    This work argues that empathetic responses often mimic the emotion of the user to a varying degree, depending on its positivity or negativity and content, and introduces stochasticity into the emotion mixture that yields emotionally more varied emPathetic responses than the previous work.

    271
  • Multi-task Learning for Multi-modal Emotion Recognition and Sentiment Analysis

    Md Shad Akhtar, Dushyant Singh Chauhan, Deepanway Ghosal, Soujanya Poria, Asif Ekbal, Pushpak Bhattacharyya

    Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · 2019

    A deep multi-task learning framework that jointly performs sentiment and emotion analysis both as well as a context-level inter-modal attention framework for simultaneously predicting the sentiment and expressed emotions of an utterance is presented.

    217
  • Text-to-Audio Generation using Instruction-Tuned LLM and Latent Diffusion Model

    Deepanway Ghosal, Navonil Majumder, Ambuj Mehrish, Soujanya Poria

    arXiv · 2023

    This work adopts an instruction-tuned LLM Flan-T5 as the text encoder for text-to-audio (TTA) generation and finds that the latent diffusion model (LDM)-based approach TANGO outperforms the state-of-the-art AudioLDM on most metrics and stays comparable on the rest on AudioCaps test set.

    213
  • Contextual Inter-modal Attention for Multi-modal Sentiment Analysis

    Deepanway Ghosal, Md Shad Akhtar, Dushyant Singh Chauhan, Soujanya Poria, Asif Ekbal, Pushpak Bhattacharyya

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2018

    A recurrent neural network based multi-modal attention framework that leverages the contextual information for utterance-level sentiment prediction that applies attention on multi- modal multi-utterance representations and tries to learn the contributing features amongst them.

    186
  • Recognizing Emotion Cause in Conversations

    Soujanya Poria, Navonil Majumder, Devamanyu Hazarika, Deepanway Ghosal, Rishabh Bhardwaj, Samson Yu, Pengfei Hong, Romila Ghosh, +4 more

    Cognitive Computation · 2021

    This work introduces a new task highly relevant for (explainable) emotion-aware artificial intelligence: recognizing emotion cause in conversations, provides a new highly challenging publicly available dialogue-level dataset for this task, and gives strong baseline results on this dataset.

    174
  • Mustango: Toward Controllable Text-to-Music Generation

    Jan Melechovský, Zixun Guo, Deepanway Ghosal, Navonil Majumder, Dorien Herremans, Soujanya Poria

    Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · 2024

    The quality of the music generated by Mustango is state-of-the-art, and the controllability through music-specific text prompts greatly outperforms other models such as MusicGen and AudioLDM2.

    171
  • Tango 2: Aligning Diffusion-based Text-to-Audio Generations through Direct Preference Optimization

    Navonil Majumder, Chia-Yu Hung, Deepanway Ghosal, Wei-Ning Hsu, Rada F. Mihalcea, Soujanya Poria

    ACM International Conference on Multimedia (ACM MM) · 2024

    This work fine-tune the publicly available Tango text-to-audio model using diffusion-DPO (direct preference optimization) loss on the authors' preference dataset and shows that it leads to improved audio output over Tango and AudioLDM2, in terms of both automatic- and manual-evaluation metrics.

    165
  • Text-to-Audio Generation using Instruction Guided Latent Diffusion Model

    Deepanway Ghosal, Navonil Majumder, Ambuj Mehrish, Soujanya Poria

    ACM International Conference on Multimedia (ACM MM) · 2023

    This work adopts an instruction-tuned LLM Flan-T5 as the text encoder for text-to-audio generation-a task where the goal is to generate an audio from its textual description and outperforms the state-of-the-art AudioLDM on most metrics and stays comparable on the rest on AudioCaps test set.

    135
  • All-in-One: Emotion, Sentiment and Intensity Prediction Using a Multi-Task Ensemble Framework

    Md Shad Akhtar, Deepanway Ghosal, Asif Ekbal, Pushpak Bhattacharyya, Sadao Kurohashi

    IEEE Transactions on Affective Computing · 2019

    121
  • A Multilayer Perceptron based Ensemble Technique for Fine-grained Financial Sentiment Analysis

    Md Shad Akhtar, Kumar Abhishek, Deepanway Ghosal, Asif Ekbal, Pushpak Bhattacharyya

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2017

    A novel method for combining deep learning and classical feature based models using a Multi-Layer Perceptron (MLP) network for financial sentiment analysis using a classical supervised model based on Support Vector Regression (SVR).

    115
  • Music Genre Recognition Using Deep Neural Networks and Transfer Learning

    Deepanway Ghosal, Maheshkumar H. Kolekar

    Interspeech (USB) · 2018

    This work proposes a novel approach for music genre recognition using an ensemble of convolutional long short term memory based neural networks (CNN LSTM) and a transfer learning model that outperforms them and achieves new state of the art results.

    95
  • Classification of fashion article images using convolutional neural networks

    Shobhit Bhatnagar, Deepanway Ghosal, Maheshkumar H. Kolekar

    International Conference on Image Information Processing (ICIIP) · 2017

    87
  • KinGDOM: Knowledge-Guided DOMain Adaptation for Sentiment Analysis

    Deepanway Ghosal, Devamanyu Hazarika, Abhinaba Roy, Navonil Majumder, Rada F. Mihalcea, Soujanya Poria

    Annual Meeting of the Association for Computational Linguistics (ACL) · 2020

    A new framework is introduced, KinGDOM, which utilizes the ConceptNet knowledge graph to enrich the semantics of a document by providing both domain-specific and domain-general background concepts, and conditioning a popular domain-adversarial baseline method with these learned concepts helps improve its performance over state-of-the-art approaches.

    71
  • IITP at SemEval-2017 Task 5: An Ensemble of Deep Learning and Feature Based Models for Financial Sentiment Analysis

    Deepanway Ghosal, Shobhit Bhatnagar, Md Shad Akhtar, Asif Ekbal, Pushpak Bhattacharyya

    International Workshop on Semantic Evaluation (SemEval) · 2017

    An ensemble based model which combines state of the art deep learning sentiment analysis algorithms like Convolution Neural Network and Long Short Term Memory along with feature based models to identify optimistic or pessimistic sentiments associated with companies and stocks in financial texts is proposed.

    37
  • A Multi-task Ensemble Framework for Emotion, Sentiment and Intensity Prediction

    Md Shad Akhtar, Deepanway Ghosal, Asif Ekbal, Pushpak Bhattacharyya, Kurohashi, Sadao

    arXiv · 2018

    33
  • Improving Zero-Shot Learning Baselines with Commonsense Knowledge

    Abhinaba Roy, Deepanway Ghosal, Erik Cambria, Navonil Majumder, Rada F. Mihalcea, Soujanya Poria

    Cognitive Computation · 2022

    This work takes advantage of explicit relations between nodes defined in ConceptNet, a commonsense knowledge graph, to generate commonsense embeddings of the class labels by using a graph convolution network-based autoencoder.

    32
  • CICERO: A Dataset for Contextualized Commonsense Inference in Dialogues

    Deepanway Ghosal, Siqi Shen, Navonil Majumder, Rada F. Mihalcea, Soujanya Poria

    Annual Meeting of the Association for Computational Linguistics (ACL) · 2022

    31
  • CIDER: Commonsense Inference for Dialogue Explanation and Reasoning

    Deepanway Ghosal, Pengfei Hong, Siqi Shen, Navonil Majumder, Rada F. Mihalcea, Soujanya Poria

    Annual Meeting of the Special Interest Group on Discourse and Dialogue · 2021

    This work introduces CIDER – a manually curated dataset that contains dyadic dialogue explanations in the form of implicit and explicit knowledge triplets inferred using contextual commonsense inference that can be conducive to improving several downstream applications.

    30
  • Exemplars-Guided Empathetic Response Generation Controlled by the Elements of Human Communication

    Navonil Majumder, Deepanway Ghosal, Devamanyu Hazarika, Alexander F. Gelbukh, Rada F. Mihalcea, Soujanya Poria

    IEEE Access · 2022

    Three elements of human communication—emotional presence, interpretation, and exploration—and sentiment are additionally introduced using synthetic labels to guide the generation towards empathy and it is empirically shown that these approaches yield significant improvements in empathetic response quality in terms of both automated and human-evaluated metrics.

    29
  • Are Language Models Puzzle Prodigies? Algorithmic Puzzles Unveil Serious Challenges in Multimodal Reasoning

    Deepanway Ghosal, Vernon Toh Yan Han, Chia Yew Ken, Soujanya Poria

    arXiv · 2024

    This paper presents a new dataset, AlgoPuzzleVQA, designed to challenge and evaluate the capabilities of multimodal language models in solving algorithmic puzzles that necessitate both visual understanding, language understanding, and complex algorithmic reasoning.

    27
  • Exploring the Role of Context in Utterance-level Emotion, Act and Intent Classification in Conversations: An Empirical Study

    Deepanway Ghosal, Navonil Majumder, Rada F. Mihalcea, Soujanya Poria

    Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021 · 2021

    This paper explores and quantify the role of context for different aspects of a dialogue, namely emotion, dialogue act, and intent identification, using state-of-the-art dialogue understanding methods as baselines and employs various perturbations to distort the context of a given utterance.

    26
  • Evaluating LLMs’ Mathematical and Coding Competency through Ontology-guided Interventions

    Pengfei Hong, Navonil Majumder, Deepanway Ghosal, Somak Aditya, Rada F. Mihalcea, Soujanya Poria

    Findings of the Association for Computational Linguistics: ACL 2025 · 2025

    A significant performance drop is shown across all the models against the perturbed questions, suggesting that the current LLMs lack robust problem solving skills and structured reasoning abilities in many areas, as defined by the ontology.

    24
  • Flacuna: Unleashing the Problem Solving Power of Vicuna using FLAN Fine-Tuning

    Deepanway Ghosal, Yew Ken Chia, Navonil Majumder, Soujanya Poria

    arXiv · 2023

    Experimental findings strongly indicate that the enhanced problem-solving abilities of the model, FLACUNA, are obtained through fine-tuning VICUNA on the FLAN dataset, leading to significant improvements across numerous benchmark datasets in INSTRUCTEVAL.

    24

Show all 48 works

Publication data from OpenAlex, with missing venues and authors filled in from Crossref; citation counts are the higher of OpenAlex and Semantic Scholar, last synced 2026-10-12. One-sentence summaries under some papers are written by Semantic Scholar’s model. Citation counts may be lower than on Google Scholar, which indexes more sources.

Report an error

Wrong papers, two people merged into one, or a profile that should not be here? Tell us and we will fix or hide it.

Sign in to report