Is this you? Claim this profile to correct it, add a bio and choose the work people see first.

Claim this profile

Works245 from public data

TitleCited by
  • Graph Retrieval-Augmented Generation: A Survey

    Boci Peng, Yun Zhu, Yongchao Liu, Xiaohe Bo, Haizhou Shi, Chuntao Hong, Yan Zhang, Siliang Tang

    ACM Transactions on Information Systems · 2025

    This article provides the first comprehensive overview of GraphRAG methodologies, encompassing Graph-Based Indexing, Graph-Guided Retrieval, and Graph-Enhanced Generation, and outlines the core technologies and training methods at each stage.

    647
  • NaturalSpeech 3: Zero-Shot Speech Synthesis with Factorized Codec and Diffusion Models

    Zeqian Ju, Yuancheng Wang, Kai Shen, Xu Tan, Detai Xin, Dongchao Yang, Yanqing Liu, Yichong Leng, +11 more

    arXiv · 2024

    This work proposes NaturalSpeech 3, a TTS system with novel factorized diffusion models to generate natural speech in a zero-shot way that outperforms the state-of-the-art TTS systems on quality, similarity, prosody, and intelligibility, and achieves on-par quality with human recordings.

    447
  • AnyEdit: Mastering Unified High-Quality Image Editing for Any Idea

    Qifan Yu, Wei Chow, Zhongqi Yue, Kaihang Pan, Yang Fang Wu, Xiaoyang Wan, Juncheng Li, Siliang Tang, +2 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2025

    AnyEdit is presented, a comprehensive multi-modal instruction editing dataset, comprising 2.5 million high-quality editing pairs spanning over 20 editing types and five domains, and shows that AnyEdit consistently boosts the performance of diffusion-based editing models.

    261
  • Rethinking the Bottom-Up Framework for Query-Based Video Localization

    Long Chen, Chujie Lu, Siliang Tang, Jun Xiao, Dong liang Zhang, Chilie Tan, Xiaolin Li

    Proceedings of the AAAI Conference on Artificial Intelligence · 2020

    It is argued that the performance of bottom-up framework is severely underestimated by current unreasonable designs, including both the backbone and head network, and designed a novel top-up model: Graph-FPN with Dense Predictions (GDP).

    189
  • HalluciDoctor: Mitigating Hallucinatory Toxicity in Visual Instruction Data

    Qifan Yu, Juncheng Li, Longhui Wei, Liang Pang, Wentao Ye, Bosheng Qin, Siliang Tang, Qi Tian, +1 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    This work presents a novel hallucination detection and elimination framework, HalluciDoctor, based on the cross-checking paradigm, and uses this framework to identify and eliminate hallucinations in the training data automatically, and indicates that spurious correlations arising from long-tail object cooccurrences contribute to hallucinations.

    167
  • Momentor: Advancing Video Large Language Model with Fine-Grained Temporal Reasoning

    Qian Long, Juncheng Li, Wu, Yu, Yaobo Ye, Hao Fei, Tat‐Seng Chua, Yueting Zhuang, Siliang Tang

    arXiv · 2024

    The proposed Momentor, a Video-LLM capable of accomplishing fine-grained temporal understanding tasks, is designed and trained on Moment-10M, a large-scale video instruction dataset with segment-level instruction data, enabling it to perform segment-level reasoning and localization.

    156
  • HealthGPT: A Medical Large Vision-Language Model for Unifying Comprehension and Generation via Heterogeneous Knowledge Adaptation

    Lin, Tianwei, Wenqiao Zhang, Li, Sijing, Yuqian Yuan, Bo Yu, Haoyuan Li, Wanggui He, Hao Jiang, +7 more

    arXiv · 2025

    This work presents HealthGPT, a powerful Medical Large Vision-Language Model (Med-LVLM) that integrates medical visual comprehension and generation capabilities within a unified autoregressive paradigm through a novel heterogeneous low-rank adaptation technique and a tailored hierarchical visual perception approach.

    138
  • Sparse Multi-Modal Hashing

    Fei Qing Wu, Yu Zhou, Yi Ping Yang, Siliang Tang, Yin Zhang, Yueting Zhuang

    IEEE Transactions on Multimedia · 2013

    136
  • NTIRE 2019 Challenge on Real Image Super-Resolution: Methods and Results

    Jianrui Cai, Shuhang Gu, Radu Timofte, Lei Zhang, Xiao Liu, Yukang Ding, Dongliang He, Chao Li, +22 more

    IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · 2019

    123
  • Fine-Grained Semantically Aligned Vision-Language Pre-Training

    Juncheng Li, Xin He, Longhui Wei, Qian Long, Linchao Zhu, Lingxi Xie, Yueting Zhuang, Qi Tian, +1 more

    arXiv · 2022

    This paper introduces LOUPE, a fine-grained semantically aLigned visiOn-langUage PrE-training framework, which learns fine- grained semantic alignment from the novel perspective of game-theoretic interactions, and proposes an uncertainty-aware neural Shapley interaction learning module.

    111
  • NTIRE 2020 Challenge on Real Image Denoising: Dataset, Methods and Results

    Abdelrahman Abdelhamed, Mahmoud Afifi, Radu Timofte, Michael S. Brown, Yue Cao, Zhilu Zhang, Wangmeng Zuo, Xiaoling Zhang, +22 more

    IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · 2020

    This paper reviews the NTIRE 2020 challenge on real image denoising with focus on the newly introduced dataset, the proposed methods and their results, based on the SIDD benchmark.

    106
  • Compositional Temporal Grounding with Structured Variational Cross-Graph Correspondence Learning

    Juncheng Li, Junlin Xie, Long Qian, Linchao Zhu, Siliang Tang, Fei Qing Wu, Yi Ping Yang, Yueting Zhuang, +1 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    A variational cross-graph reasoning framework that explicitly decomposes video and language into multiple structured hierarchies and learns fine-grained semantic correspondence among them is proposed and empirically finds that they fail to generalize to queries with novel combinations of seen words.

    105
  • Cascaded Deep Networks With Multiple Receptive Fields for Infrared Image Super-Resolution

    Zewei He, Siliang Tang, Jiangxin Yang, Yanlong Cao, Michael Ying Yang, Yanpeng Cao

    IEEE Transactions on Circuits and Systems for Video Technology · 2018

    105
  • A Study on ReLU and Softmax in Transformer

    Shen, Kai, Junliang Guo, Xu Tan, Siliang Tang, Rui Wang, Jiang Bian

    arXiv · 2023

    A full ReLU architecture named ReLUFormer is proposed which performs better than the baseline Transformer on long sequence tasks such as document translation and FFN and key-value memory are equivalent, and thus the Transformer can be viewed as a memory network where FFNs and self-attention networks are both key- value memories.

    94
  • MRFN: Multi-Receptive-Field Network for Fast and Accurate Single Image Super-Resolution

    Zewei He, Yanpeng Cao, Lei Du, Baobei Xu, Jiangxin Yang, Yanlong Cao, Siliang Tang, Yueting Zhuang

    IEEE Transactions on Multimedia · 2019

    89
  • WorldGPT: Empowering LLM as Multimodal World Model

    Zhiqi Ge, Hongzhe Huang, Mingze Zhou, Juncheng Li, Guoming Wang, Siliang Tang, Yueting Zhuang

    ACM International Conference on Multimedia (ACM MM) · 2024

    WorldGPT is introduced, a generalist world model built upon Multimodal Large Language Model (MLLM) that acquires an understanding of world dynamics through analyzing millions of videos across various domains and is integrated with a novel cognitive architecture that combines memory offloading, knowledge retrieval, and context reflection.

    80
  • Unsupervised Reinforcement Learning of Transferable Meta-Skills for Embodied Navigation

    Juncheng Li, Xin Wang, Siliang Tang, Haizhou Shi, Fei Qing Wu, Yueting Zhuang, William Yang Wang

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2020

    This paper proposes a novel unsupervised reinforcement learning approach to learn transferable meta-skills from unannotated environments without any supervisory signals, and shows that this method learns transferable motor primitives for visual navigation.

    80
  • GraphCLIP: Enhancing Transferability in Graph Foundation Models for Text-Attributed Graphs

    Yun Zhu, Haizhou Shi, X. C. Wang, Yongchao Liu, Yaoke Wang, Boci Peng, Chuntao Hong, Siliang Tang

    Proceedings of the ACM on Web Conference 2025 · 2025

    This work generates and curates large-scale graph-summary pair data with the assistance of LLMs, and introduces a novel graph-summary pretraining method, combined with invariant learning, to enhance graph foundation models with strong cross-domain zero-shot transferability.

    79
  • Cross-Relation Cross-Bag Attention for Distantly-Supervised Relation Extraction

    Yujin Yuan, Liyuan Liu, Siliang Tang, Zhongfei Mark Zhang, Yueting Zhuang, Shiliang Pu, Fei Wu, Xiang Ren

    Proceedings of the AAAI Conference on Artificial Intelligence · 2019

    This paper proposes to conduct multi-instance learning with a novel Cross-relation Cross-bag Selective Attention (C2SA), which leads to noise-robust training for distant supervised relation extractor and employs the sentence-level selective attention to reduce the effect of noisy or mismatched sentences.

    73
  • Learning Dynamic Context Augmentation for Global Entity Linking

    Xiyuan Yang, Xiaotao Gu, Sheng Yao Lin, Siliang Tang, Yueting Zhuang, Fei Qing Wu, Zhigang Chen, Guoping Hu, +1 more

    Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · 2019

    A simple yet effective solution, called Dynamic Context Augmentation (DCA), for collective EL, which requires only one pass through the mentions in a document, and can cope with different local EL models as a plug-and-enhance module.

    72
  • Deep Sequential Feature Learning in Clinical Image Classification of Infectious Keratitis

    Yesheng Xu, Ming Chai Kong, Wenjia Xie, Runping Duan, Zhengqing Fang, Yuxiao Lin, Qiang Zhu, Siliang Tang, +2 more

    Engineering · 2020

    A sequential-level deep learning model is proposed to effectively discriminate the distinction and subtlety of infectious corneal disease via the classification of clinical images through the preservation of spatial structures and disentangle the informative features for clinical image classification of infectious keratitis.

    68
  • Learning Hybrid Behavior Patterns for Multimedia Recommendation

    Zongshen Mu, Yueting Zhuang, Jie Tan, Jun Xiao, Siliang Tang

    ACM International Conference on Multimedia (ACM MM) · 2022

    A Hybrid Clustering Graph Convolutional Network (HCGCN) is proposed for multimedia recommendation that performs high-order graph convolutions inside user- item clusters and item-item clusters to capture various user behavior patterns and designs corresponding clustering losses to enhance user-item preference feedback and multimodal representation learning constraint to adjust the modality importance.

    65
  • CIL: Contrastive Instance Learning Framework for Distantly Supervised Relation Extraction

    Tao Chen, Haizhou Shi, Siliang Tang, Zhigang Chen, Fei Qing Wu, Yueting Zhuang

    Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · 2021

    This paper proposes a novel contrastive instance learning (CIL) framework, which regards the initial MIL as the relational triple encoder and constraint positive pairs against negative pairs for each instance.

    64
  • Consensus Graph Representation Learning for Better Grounded Image Captioning

    Wenqiao Zhang, Haochen Shi, Siliang Tang, Jun Xiao, Qiang Yu, Yueting Zhuang

    Proceedings of the AAAI Conference on Artificial Intelligence · 2021

    The Consensus Rraph Representation Learning framework (CGRL) is proposed for GIC that incorporates a consensus representation into the grounded captioning pipeline that can capture both the correct linguistic characteristics and visual relevance, and then grounding appropriate image regions further.

    64
  • Visually-Prompted Language Model for Fine-Grained Scene Graph Generation in an Open World

    Qifan Yu, Juncheng Li, Yu Wu, Siliang Tang, Wei Ji, Yueting Zhuang

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2023

    A Cross-modal prediCate boosting (CaCao) framework, where a visually-prompted language model is learned to generate diverse fine-grained predicates in a low-resource way for open-world predicate scene graph generation (Epic).

    63

Show all 245 works

Publication data from OpenAlex, with missing venues and authors filled in from Crossref; citation counts are the higher of OpenAlex and Semantic Scholar, last synced 2026-10-12. One-sentence summaries under some papers are written by Semantic Scholar’s model. Citation counts may be lower than on Google Scholar, which indexes more sources.

Report an error

Wrong papers, two people merged into one, or a profile that should not be here? Tell us and we will fix or hide it.

Sign in to report