Is this you? Claim this profile to correct it, add a bio and choose the work people see first.

Claim this profile

Works248 from public data

TitleCited by
  • X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrieval

    Yiwei Ma, Guohai Xu, Xiaoshuai Sun, Ming Yan, Ji Zhang, Rongrong Ji

    ACM International Conference on Multimedia (ACM MM) · 2022

    This paper presents a novel multi-grained contrastive model, namely X-CLIP, and proposes the Attention Over Similarity Matrix (AOSM) module to make the model focus on the contrast between essential frames and words, thus lowering the impact of unnecessary frames and Words on retrieval results.

    541
  • Pix2Vox: Context-Aware 3D Reconstruction From Single and Multi-View Images

    Haozhe Xie, Hongxun Yao, Xiaoshuai Sun, Shangchen Zhou, Shengping Zhang

    IEEE Conference Proceedings · 2019

    Experimental results on the ShapeNet and Pix3D benchmarks indicate that the proposed Pix2Vox outperforms state-of-the-arts by a large margin, and the proposed method is 24 times faster than 3D-R2N2 in terms of backward inference time.

    392
  • Multi-Task Collaborative Network for Joint Referring Expression Comprehension and Segmentation

    Gen Luo, Yiyi Zhou, Xiaoshuai Sun, Liujuan Cao, Chenglin Wu, Cheng Dan Deng, Rongrong Ji

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2020

    A novel Multi-task Collaborative Network (MCN) is proposed to achieve a joint learning of REC and RES for the first time and addresses a key challenge in this multi-task setup, i.e., the prediction conflict.

    385
  • Dual-level Collaborative Transformer for Image Captioning

    Yunpeng Luo, Jiayi Ji, Xiaoshuai Sun, Liujuan Cao, Yongjian Wu, Feiyue Huang, Chia‐Wen Lin, Rongrong Ji

    Proceedings of the AAAI Conference on Artificial Intelligence · 2021

    A novel Dual-Level Collaborative Transformer (DLCT) network is introduced to realize the complementary advantages ofriptive region features extracted by object detection networks and address the semantic noises caused by the direct fusion of these two features.

    366
  • Exploring Principles-of-Art Features For Image Emotion Recognition

    Sicheng Zhao, Yue Gao, Xiaolei Jiang, Hongxun Yao, Tat‐Seng Chua, Xiaoshuai Sun

    ACM International Conference on Multimedia (ACM MM) · 2014

    Experiments demonstrate the superiority of PAEF for affective image classification and regression (with about 5% improvement on classification accuracy and 0.2 decrease in mean squared error), as compared to the state-of-the-art approaches.

    363
  • RSTNet: Captioning with Adaptive Attention on Visual and Non-Visual Words

    Xuying Zhang, Xiaoshuai Sun, Yunpeng Luo, Jiayi Ji, Yiyi Zhou, Yongjian Wu, Feiyue Huang, Rongrong Ji

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2021

    275
  • Two-Stream 3-D convNet Fusion for Action Recognition in Videos With Arbitrary Size and Length

    Xuanhan Wang, Lianli Gao, Peng Wang, Xiaoshuai Sun, Xianglong Liu

    IEEE Transactions on Multimedia · 2017

    263
  • SeqTR: A Simple Yet Universal Network for Visual Grounding

    Chaoyang Zhu, Yiyi Zhou, Yunhang Shen, Gen Luo, Xingjia Pan, Mingbao Lin, Chao Chen, Liujuan Cao, +2 more

    Lecture notes in computer science · 2022

    Experiments on five benchmark datasets demonstrate that the proposed SeqTR outperforms (or is on par with) the existing state-of-the-arts, proving that a simple yet universal approach for visual grounding is indeed feasible.

    247
  • Improving Image Captioning by Leveraging Intra- and Inter-layer Global Representation in Transformer Network

    Jiayi Ji, Yunpeng Luo, Xiaoshuai Sun, Fuhai Chen, Gen Luo, Yongjian Wu, Yue Gao, Rongrong Ji

    Proceedings of the AAAI Conference on Artificial Intelligence · 2021

    This paper introduces a Global Enhanced Transformer (termed GET) to enable the extraction of a more comprehensive global representation, and then adaptively guide the decoder to generate high-quality captions.

    213
  • Cascade Grouped Attention Network for Referring Expression Segmentation

    Gen Luo, Yiyi Zhou, Rongrong Ji, Xiaoshuai Sun, Jinsong Su, Chia‐Wen Lin, Qi Chuan Tian

    ACM International Conference on Multimedia (ACM MM) · 2020

    A Cascade Grouped Attention Network with two innovative designs: Cascade Grouping Attention (CGA) and Instance-level Attention (ILA) loss that can achieve the high efficiency of one-stage RES while possessing a strong reasoning ability comparable to the two-stage methods.

    160
  • Rotated Multi-Scale Interaction Network for Referring Remote Sensing Image Segmentation

    Sihan Liu, Yiwei Ma, Xiaoqing Zhang, Haowei Wang, Jiayi Ji, Xiaoshuai Sun, Rongrong Ji

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    The Rotated Multi-Scale In-teraction Network (RMSIN) is introduced, an innovative approach de-signed for the unique demands of RRSIS, surpassing existing state-of-the-art models by a signif-icant margin.

    149
  • Towards local visual modeling for image captioning

    Yiwei Ma, Jiayi Ji, Xiaoshuai Sun, Yiyi Zhou, Rongrong Ji

    Pattern Recognition · 2023

    Experimental results show that the proposed Locality-Sensitive Transformer Network (LSTNet) is not only capable of local visual modeling, but also outperforms a bunch of state-of-the-art captioning models on offline and online testings, i.e., 134.8 CIDEr and 136.3 C IDEr, respectively.

    137
  • TRAR: Routing the Attention Spans in Transformer for Visual Question Answering

    Yiyi Zhou, Tianhe Ren, Chaoyang Zhu, Xiaoshuai Sun, Jianzhuang Liu, Xinghao Ding, Mingliang Xu, Rongrong Ji

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2021

    134
  • Exploiting the complementary strengths of multi-layer CNN features for image retrieval

    Wei Yu, Kuiyuan Yang, Hongxun Yao, Xiaoshuai Sun, Pengfei Xu

    Neurocomputing · 2016

    A mapping function is designed to highlight the effectiveness of low-layer similarity, when measuring fine-grained similarity between query image and its nearest neighbors with similar semantic, and can achieve competitive performance on popular retrieval benchmarks.

    133
  • Photo assessment based on computational visual attention model

    Xiaoshuai Sun, Hongxun Yao, Rongrong Ji, Shaohui Liu

    ACM International Conference on Multimedia (ACM MM) · 2009

    By integrating top-down supervision into the visual attention model, this work achieves personalized photo assessment to take user preference into quality evaluation, which can be extended into object or semantic oriented photo assessment scenarios.

    101
  • Active Teacher for Semi-Supervised Object Detection

    Peng Mi, Jianghang Lin, Yiyi Zhou, Yunhang Shen, Gen Luo, Xiaoshuai Sun, Liujuan Cao, Rongrong Fu, +2 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    The experimental results not only validate the superior performance gain of Active Teacher over the compared methods, but also show that it enables the baseline network, i.e., Faster-RCNN, to achieve 100% supervised performance with much less label expenditure,i.e. 40% labeled examples on MS-COCO.

    98
  • Task-Dependent Visual-Codebook Compression

    Rongrong Ji, Hongxun Yao, Wei Liu, Xiaoshuai Sun, Qi Chuan Tian

    IEEE Transactions on Image Processing · 2011

    98
  • A Real-Time Global Inference Network for One-Stage Referring Expression Comprehension

    Yiyi Zhou, Rongrong Ji, Gen Luo, Xiaoshuai Sun, Jinsong Su, Xinghao Ding, Chia‐Wen Lin, Qi Chuan Tian

    IEEE Transactions on Neural Networks and Learning Systems · 2021

    The proposed RealGIN outperforms most existing methods and achieves very competitive performances against the most advanced one, i.e., MAttNet, under the same hardware, and can boost the processing speed by 10–20 times over the existing methods.

    86
  • GroupCap: Group-Based Image Captioning with Structured Relevance and Diversity Constraints

    Fuhai Chen, Rongrong Ji, Xiaoshuai Sun, Yongjian Wu, Jinsong Su

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2018

    86
  • SPTF: A Scalable Probabilistic Tensor Factorization Model for Semantic-Aware Behavior Prediction

    Hongzhi Yin, Hongxu Chen, Xiaoshuai Sun, Hao Henry Wang, Yang Wang, Quoc Viet Hung Nguyen

    Proceedings · 2017

    81
  • Deep Saliency Hashing for Fine-Grained Retrieval

    Sheng Jin, Hongxun Yao, Xiaoshuai Sun, Shangchen Zhou, Lei Zhang, Xian‐Sheng Hua

    IEEE Transactions on Image Processing · 2020

    This work proposes a novel deep hashing model, named deep saliency hashing (DSaH), which automatically mines salient regions and learns semantic-preserving hashing codes simultaneously, and performs the best for the fine-grained retrieval task and beats the strongest competitor by approximately 10% on both Stanford Dogs and CUB Birds.

    77
  • Towards Optimal Fine Grained Retrieval via Decorrelated Centralized Loss with Normalize-Scale Layer

    Xiawu Zheng, Rongrong Ji, Xiaoshuai Sun, Baochang Zhang, Yongjian Wu, Feiyue Huang

    Proceedings of the AAAI Conference on Artificial Intelligence · 2019

    A novel metric learning scheme, termed Normalize-Scale Layer and Decorrelated Global Centralized Ranking Loss, which achieves extremely efficient and discriminative learning, i.e., 5× speedup over triplet loss and 12% recall boost on CARS196.

    77
  • DIFNet: Boosting Visual Information Flow for Image Captioning

    Mingrui Wu, Xuying Zhang, Xiaoshuai Sun, Yiyi Zhou, Chao Chen, Jiaxin Gu, Xing Sun, Rongrong Ji

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    72
  • Clover: Towards A Unified Video-Language Alignment and Fusion Model

    Jingjia Huang, Yinan Li, Jiashi Feng, Xinglong Wu, Xiaoshuai Sun, Rongrong Ji

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023

    Clover is introduced, a Correlated Video-Language pre-training method-towards a universal Video- language model for solving multiple video understanding tasks with neither performance nor efficiency compromise, and improves cross-modal feature alignment and fusion via a novel tri- modal alignment pre- training task.

    65
  • Towards Lightweight Transformer Via Group-Wise Transformation for Vision-and-Language Tasks

    Gen Luo, Yiyi Zhou, Xiaoshuai Sun, Yan Wang, Liujuan Cao, Yongjian Wu, Feiyue Huang, Rongrong Ji

    IEEE Transactions on Image Processing · 2022

    WL-Transformer applies Group-wise Transformation to reduce both the parameters and computations of Transformer, while also preserving its two main properties, i.e., the efficient attention modeling on diverse subspaces of MHA, and the expanding-scaling feature transformation of FFN.

    65

Show all 248 works

Publication data from OpenAlex, with missing venues and authors filled in from Crossref; citation counts are the higher of OpenAlex and Semantic Scholar, last synced 2026-10-13. One-sentence summaries under some papers are written by Semantic Scholar’s model. Citation counts may be lower than on Google Scholar, which indexes more sources.

Report an error

Wrong papers, two people merged into one, or a profile that should not be here? Tell us and we will fix or hide it.

Sign in to report