Is this you? Claim this profile to correct it, add a bio and choose the work people see first.
Claim this profileWorks472 from public data
- Video Question Answering via Gradually Refined Attention over Appearance and Motion840
This paper proposes an end-to-end model which gradually refines its attention over the appearance and motion features of the video using the question as guidance and demonstrates the effectiveness of the model by analyzing the refined attention weights during the question answering procedure.
- ActivityNet-QA: A Dataset for Understanding Complex Web Videos via Question Answering793
This work introduces ActivityNet-QA, a fully annotated and large scale VideoQA dataset, which consists of 58,000 QA pairs on 5,800 complex web videos derived from the popular ActivityNet dataset and explores various video representation strategies to improve videoQA performance.
- 576
- 538
- Make-An-Audio: Text-To-Audio Generation with Prompt-Enhanced Diffusion Models533
This work proposes Make-An- audio with a prompt-enhanced diffusion model that alleviates data scarcity with orders of magnitude concept compositions by using language-free audios, and presents its controllability and generalization for X-to-Audio with "No Modality Left Behind", for the first time unlocking the ability to generate high-definition, high-fidelity audios given a user-defined modality input.
- 503
- 490
- Improving automatic source code summarization via deep reinforcement learning435
An abstract syntax tree structure as well as sequential content of code snippets into a deep reinforcement learning framework (i.e., actor-critic network) which provides the confidence of predicting the next word according to current state and an advantage reward composed of BLEU metric to train both networks.
- Investigating Capsule Networks with Dynamic Routing for Text Classification392
This work proposes three strategies to stabilize the dynamic routing process to alleviate the disturbance of some noise capsules which may contain “background” information or have not been successfully trained.
- DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanism383
This work proposes DiffSinger, an acoustic model for SVS based on the diffusion probabilistic model, a parameterized Markov chain that iteratively converts the noise into mel-spectrogram conditioned on the music score that outperforms state-of-the-art SVS work.
- ProDiff264
ProDiff parameterizes the denoising model by directly predicting clean data to avoid distinct quality degradation in accelerating sampling, and enables a sampling speed of 24x faster than real-time on a single NVIDIA 2080Ti GPU, making diffusion models practically applicable to text-to-speech synthesis deployment for the first time.
- Cross-Modal Interaction Networks for Query-Based Moment Retrieval in Videos251
A novel Cross-Modal Interaction Network (CMIN) is introduced to consider multiple crucial factors for this challenging task, including the syntactic structure of natural language queries; long-range semantic dependencies in video context and the sufficient cross-modal interaction.
- WavTokenizer: an Efficient Acoustic Discrete Codec Tokenizer for Audio Language Modeling240
WavTokenizer achieves state-of-the-art reconstruction quality with outstanding UTMOS scores and inherently contains richer semantic information by designing a broader VQ space, extended contextual windows, and improved attention networks, as well as introducing a powerful multi-scale discriminator and an inverse Fourier transform structure.
- Chat-Scene: Bridging 3D Scene and Large Language Models with Object Identifiers232
This paper introduces the use of object identifiers and object-centric representations to interact with scenes at the object level, and decomposes the input 3D scene into a set of object proposals, each assigned a unique identifier token, which enables efficient object referencing and grounding during user-assistant interactions.
- UniAudio: An Audio Foundation Model Toward Universal Audio Generation230
The UniAudio system is presented, which, unlike prior task-specific approaches, leverages LLM techniques to generate multiple types of audio with given input conditions, and has the potential to become a foundation model for universal audio generation.
- GeneFace: Generalized and High-Fidelity Audio-Driven 3D Talking Face Synthesis225
GeneFace is proposed, a generalized and high-fidelity NeRF-based talking face generation method, which can generate natural results corresponding to various out-of-domain audio and introduces a domain adaptative post-net to calibrate the result.
- Multi-modal Attention Network Learning for Semantic Source Code Retrieval195
Comprehensive experiments and analysis on a large-scale real-world dataset show that the proposed MMAN model can accurately retrieve code snippets and outperforms the state-of-the-art methods.
- Where Does It Exist: Spatio-Temporal Video Grounding for Multi-Form Sentences187
A novel Spatio-Temporal Graph Reasoning Network (STGRN) is proposed for this task, which builds a spatio-temporal region graph to capture the region relationships with temporal object dynamics, which involves the implicit and explicit spatial subgraphs in each frame and the temporal dynamic subgraph across frames.
- Weakly-Supervised Video Moment Retrieval via Semantic Completion Network178
This paper proposes a novel weakly-supervised moment retrieval framework requiring only coarse video-level annotations for training, and devise a proposal generation module that aggregates the context information to generate and score all candidate proposals in one single pass.
- 176
- Hierarchical Multi-label Text Classification172
This paper proposes a novel framework called Hierarchical Attention-based Recurrent Neural Network (HARNN) for classifying documents into the most relevant categories level by level via integrating texts and the hierarchical category structure, and designs a hybrid method capable of predicting the categories of each level while classifying all categories in the entire hierarchical structure precisely.
- Chat-3D: Data-efficiently Tuning Large Language Model for Universal Dialogue of 3D Scenes158
Chat-3D is presented, which combines the 3D visual perceptual ability of pre-trained 3D representations and the impressive reasoning and conversation capabilities of advanced LLMs to achieve the first universal dialogue systems for 3D scenes.
- Rethinking Diversified and Discriminative Proposal Generation for Visual Grounding150
This paper introduces the diversity and discrimination simultaneously when generating proposals, and in doing so proposes Diversified and Discriminative Proposal Networks model (DDPN), a high performance baseline model for visual grounding and evaluates it on four benchmark datasets.
- PopMAG148
A novel MUlti-track MIDI representation (MuMIDI), which enables simultaneous multi-track generation in a single sequence and explicitly models the dependency of the notes from different tracks and is called PopMAG, which largely outperforms other state-of-the-art music accompaniment generation models and multi- track MIDI representations in terms of subjective and objective metrics.
- Multi-Singer: Fast Multi-Singer Singing Voice Vocoder With A Large-Scale Corpus140
Multi-Singer, a fast multi-singer vocoder with generative adversarial networks improves unseen singer singing voices modeling in both speed and quality over previous methods, and achieves strong robustness in the multi- singer singing voice synthesis pipeline.
Publication data from OpenAlex, with missing venues and authors filled in from Crossref; citation counts are the higher of OpenAlex and Semantic Scholar, last synced 2026-10-12. One-sentence summaries under some papers are written by Semantic Scholar’s model. Citation counts may be lower than on Google Scholar, which indexes more sources.
Report an error
Wrong papers, two people merged into one, or a profile that should not be here? Tell us and we will fix or hide it.