Is this you? Claim this profile to correct it, add a bio and choose the work people see first.

Claim this profile

Works93 from public data

TitleCited by
  • Learning 2D Temporal Adjacent Networks for Moment Localization with Natural Language

    Songyang Zhang, Houwen Peng, Jianlong Fu, Jiebo Luo

    Proceedings of the AAAI Conference on Artificial Intelligence · 2020

    A Temporal Adjacent Network (2D-TAN) is proposed, a single-shot framework for moment localization that is capable of encoding the adjacent temporal relation, while learning discriminative features for matching video moments with referring expressions.

    640
  • MMBench: Is Your Multi-modal Model an All-Around Player?

    Yuan Liu, Haodong Duan, Yuanhan Zhang, Bo Li, Songyang Zhang, Wangbo Zhao, Yike Yuan, Jiaqi Wang, +4 more

    Lecture notes in computer science · 2024

    430
  • Part-Aware Prototype Network for Few-Shot Semantic Segmentation

    Yongfei Liu, Xiangyi Zhang, Songyang Zhang, Xuming He

    Lecture notes in computer science · 2020

    A novel few-shot semantic segmentation framework based on the prototype representation, capable of capturing diverse and fine-grained object features, and a novel graph neural network model to generate and enhance the proposed part-aware prototypes based on labeled and unlabeled images.

    424
  • InternLM-XComposer2: Mastering Free-form Text-Image Composition and Comprehension in Vision-Language Large Model

    Xiaoyi Dong, Pan Zhang, Yuhang Zang, Yuhang Cao, Bin Wang, Linke Ouyang, Xilin Wei, Songyang Zhang, +15 more

    arXiv · 2024

    Experimental results demonstrate the superiority of InternLM-XComposer2 based on InternLM2-7B in producing high-quality long-text multi-modal content and its exceptional vision-language understanding performance across various benchmarks, where it not only significantly outperforms existing multimodal models but also matches or even surpasses GPT-4V and Gemini Pro in certain assessments.

    397
  • Distribution Alignment: A Unified Framework for Long-tail Visual Recognition

    Songyang Zhang, Zeming Li, Shipeng Yan, Xuming He, Jian Sun

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2021

    This work develops an adaptive calibration function that enables us to adjust the classification scores for each data point in the two-stage learning to balance the class prior, which provides a flexible and unified solution to diverse scenarios in visual recognition tasks.

    376
  • InternLM-XComposer: A Vision-Language Large Model for Advanced Text-image Comprehension and Composition

    Pan Zhang, Xiaoyi Dong, Bin Wang, Yuhang Cao, Chao Xu, Linke Ouyang, Zhiyuan Zhao, Haodong Duan, +13 more

    arXiv · 2023

    This work proposes InternLM-XComposer, a vision-language large model that enables advanced image-text comprehension and composition that achieves competitive text-image composition scores compared to public solutions, including GPT4-V and GPT3.5.

    361
  • Expanding Language-Image Pretrained Models for General Video Recognition

    Bolin Ni, Houwen Peng, Minghao Chen, Songyang Zhang, Gaofeng Meng, Jianlong Fu, Shiming Xiang, Haibin Ling

    Lecture notes in computer science · 2022

    323
  • On Geometric Features for Skeleton-Based Action Recognition Using Multilayer LSTM Networks

    Songyang Zhang, Xiaoming Liu, Jun Xiao

    IEEE Winter Conference on Applications of Computer Vision · 2017

    314
  • Make-A-Video: Text-to-Video Generation without Text-Video Data

    Uriel Singer, Adam Polyak, Hayes, Thomas, Xi Yin, Jie An, Songyang Zhang, Qiyuan Hu, Harry C. Yang, +5 more

    arXiv · 2022

    309
  • Bipartite Graph Network with Adaptive Message Passing for Unbiased Scene Graph Generation

    Rongjie Li, Songyang Zhang, Bo Wan, Xuming He

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2021

    This work introduces a novel confidence-aware bipartite graph neural network with adaptive message propagation mechanism for unbiased scene graph generation and proposes an efficient bi-level data resampling strategy to alleviate the imbalanced data distribution problem in training the authors' graph network.

    282
  • InternLM-XComposer-2.5: A Versatile Large Vision Language Model Supporting Long-Contextual Input and Output

    Pan Zhang, Xiaoyi Dong, Yuhang Zang, Yuhang Cao, Rui Qian, Lin Chen, Qipeng Guo, Haodong Duan, +19 more

    arXiv · 2024

    A versatile large-vision language model that supports long-contextual input and output, InternLM-XComposer-2.5 excels in various text-image comprehension and composition applications, achieving GPT-4V level capabilities with merely 7B LLM backend.

    216
  • Boundary Proposal Network for Two-stage Natural Language Video Localization

    Shaoning Xiao, Long Chen, Songyang Zhang, Wei Ji, Jian Shao, Lu Ye, Jun Xiao

    Proceedings of the AAAI Conference on Artificial Intelligence · 2021

    A novel Boundary Proposal Network (BPNet) is proposed, a universal two-stage framework that gets rid of the issues mentioned above and outperforms the state-of-the-art NLVL methods.

    196
  • SGTR: End-to-end Scene Graph Generation with Transformer

    Rongjie Li, Songyang Zhang, Xuming He

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    A transformer-based end-to-end framework that first generates the entity and predicate proposal set, followed by inferring directed edges to form the relation triplets, and a new entity-aware predicate representation based on a structural predicate generator that leverages the compositional property of relationships is developed.

    193
  • Fusing Geometric Features for Skeleton-Based Action Recognition Using Multilayer LSTM Networks

    Songyang Zhang, Yang Yang, Jun Xiao, Xiaoming Liu, Yi Ping Yang, Di Xie, Yueting Zhuang

    IEEE Transactions on Multimedia · 2018

    193
  • Latent-Shift: Latent Diffusion with Temporal Shift for Efficient Text-to-Video Generation

    Jie An, Songyang Zhang, Harry C. Yang, Gupta, Sonal, Jia‐Bin Huang, Jiebo Luo, Xi Yin

    arXiv · 2023

    This work proposes a parameter-free temporal shift module that can leverage the spatial U-Net as is for video generation and achieves comparable or better results while being significantly more efficient.

    152
  • The Devil is in the Labels: Noisy Label Correction for Robust Scene Graph Generation

    Lin Li, Long Chen, Yifeng Huang, Zhimeng Zhang, Songyang Zhang, Jun Xiao

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    This paper proposes a novel model-agnostic NoIsy label CorrEction strategy for SGG: NICE, which can not only detect noisy samples but also reassign more high-quality predicate labels to them.

    113
  • T-Eval: Evaluating the Tool Utilization Capability of Large Language Models Step by Step

    Zehui Chen, Weihua Du, Wenwei Zhang, Kuikun Liu, Jiangning Liu, Miao Zheng, Jingming Zhuo, Songyang Zhang, +3 more

    Annual Meeting of the Association for Computational Linguistics (ACL) · 2024

    T-Eval provides a more fine-grained analysis of the capabilities of LLMs, providing a new perspective in LLM evaluation on tool-utilization ability, and comprehensively decompose the tool utilization into multiple sub- processes, including instruction following, planning, reasoning, retrieval, understanding, and review.

    112
  • Dynamic Context Correspondence Network for Semantic Alignment

    Shuaiyi Huang, Qiuyue Wang, Songyang Zhang, Shipeng Yan, Xuming He

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2019

    This paper proposes a context-aware semantic representation that incorporates spatial layout for robust matching against local ambiguities and develops a novel dynamic fusion strategy based on attention mechanism to weave the advantages of both local and context features by integrating semantic cues from multiple scales.

    98
  • LawBench: Benchmarking Legal Knowledge of Large Language Models

    Zhiwei Fei, Xiaoyu Shen, Dawei Zhu, Fengzhe Zhou, Zhuo Rachel Han, Alan Huang, Songyang Zhang, Kai Chen, +4 more

    Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2024

    Using LawBench, the first evaluation benchmark composed of 20 tasks aimed to assess the ability of Large Language Models (LLMs) to perform Chinese legal-related tasks, this work presents a comprehensive evaluation of 21 popular LLMs and the first comparative analysis of the empirical results.

    89
  • From Pixels to Graphs: Open-Vocabulary Scene Graph Generation with Vision-Language Models

    Rongjie Li, Songyang Zhang, Dahua Lin, Kai Chen, Xuming He

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    A new open-vocabulary SGG framework based on sequence generation that leverages vision-language pre-trained models (VLM) by incorporating an image-to-graph generation paradigm and seamlessly integrate explicit relational modeling for enhancing the VL tasks.

    81
  • Exploiting Temporal Relationships in Video Moment Localization with Natural Language

    Songyang Zhang, Jinsong Su, Jiebo Luo

    ACM International Conference on Multimedia (ACM MM) · 2019

    A novel Temporal Compositional Modular Network (TCMN) where a tree attention network first automatically decomposes a sentence into three descriptions with respect to the main event, context event and temporal signal is proposed.

    78
  • Multi-Scale 2D Temporal Adjacency Networks for Moment Localization With Natural Language

    Songyang Zhang, Houwen Peng, Jianlong Fu, Yijuan Lu, Jiebo Luo

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2021

    A Multi-Scale Temporal Adjacency Network (MS-2D-TAN), a single-shot framework for moment localization capable of encoding the adjacent temporal contexts at each scale, while learning discriminative features for matching video moments with referring expressions is proposed.

    75
  • A Dual Attention Network with Semantic Embedding for Few-Shot Learning

    Shipeng Yan, Songyang Zhang, Xuming He

    AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · 2019

    This work proposes a novel meta-learning method for few-shot classification based on two simple attention mechanisms: one is a spatial attention to localize relevant object regions and the other is a task attention to select similar training data for label prediction.

    70
  • NeedleBench: Evaluating LLM Retrieval and Reasoning Across Varying Information Densities

    Li, Mo, Songyang Zhang, Zhang, Taolin, Duan, Haodong, Liu, Yunxin, Chen, Kai

    arXiv · 2024

    The NeedleBench framework is used to assess how well the leading open-source models can identify key information relevant to the question and apply that information to reasoning in bilingual long texts, and the Ancestral Trace Challenge (ATC) is proposed to mimic the complexity of logical reasoning challenges that are likely to be present in real-world long-context tasks.

    67
  • Action Quality Assessment with Temporal Parsing Transformer

    Yang Bai, Desen Zhou, Songyang Zhang, Jian Wang, Jian Wang, Errui Ding, Yu Guan, Yang Long, +2 more

    Lecture notes in computer science · 2022

    65

Show all 93 works

Publication data from OpenAlex, with missing venues and authors filled in from Crossref; citation counts are the higher of OpenAlex and Semantic Scholar, last synced 2026-10-14. One-sentence summaries under some papers are written by Semantic Scholar’s model. Citation counts may be lower than on Google Scholar, which indexes more sources.

Report an error

Wrong papers, two people merged into one, or a profile that should not be here? Tell us and we will fix or hide it.

Sign in to report