Is this you? Claim this profile to correct it, add a bio and choose the work people see first.

Claim this profile

Works24 from public data

TitleCited by
  • InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Models

    Jinguo Zhu, Weiyun Wang, Chen, Zhe, Zhaoyang Liu, Ye, Shenglong, Gu, Lixin, Hao Tian, Duan, Yuchen, +22 more

    arXiv · 2025

    InternVL3 incorporates variable visual position encoding (V2PE) to support extended multimodal contexts, employs advanced post-training techniques such as supervised fine-tuning (SFT) and mixed preference optimization (MPO), and adopts test-time scaling strategies alongside an optimized training infrastructure.

    1,936
  • Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling

    Chen, Zhe, Weiyun Wang, Yue Qin Cao, Yangzhou Liu, Zhangwei Gao, Erfei Cui, Jinguo Zhu, Ye, Shenglong, +22 more

    arXiv · 2024

    This work explores the relationship between model scaling and performance, systematically exploring the performance trends in vision encoders, language models, dataset sizes, and test-time configurations and hopes this model contributes to the open-source community by setting new standards for developing and applying multimodal AI systems.

    1,813
  • SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generation

    Yuying Ge, Zhao, Sijie, Jinguo Zhu, Yixiao Ge, Kun Yi, Song Lin, Chen Li, Xiaohan Ding, +1 more

    arXiv · 2024

    This work presents a unified and versatile foundation model, namely, SEED-X, which is able to model multi-granularity visual semantics for comprehension and generation tasks and demonstrates its effectiveness in handling real-world applications across various domains after instruction tuning.

    365
  • Enhancing the Reasoning Ability of Multimodal Large Language Models via Mixed Preference Optimization

    Wei‐Yun Wang, Zhe Chen, Wenhai Wang, Cao, Yue, Yangzhou Liu, Zhangwei Gao, Jinguo Zhu, Xizhou Zhu, +3 more

    arXiv · 2024

    This work designs an automated preference data construction pipeline to create MMPR, a high-quality, large-scale multimodal reasoning preference dataset and explores integrating PO with MLLMs, developing a simple yet effective method, termed Mixed Preference Optimization (MPO), which boosts multimodal CoT performance.

    270
  • Uni-Perceiver: Pre-training Unified Architecture for Generic Perception for Zero-shot and Few-shot Tasks

    Xizhou Zhu, Jinguo Zhu, Hao Li, Xiaoshi Wu, Hongsheng Li, Xiaohua Wang, Jifeng Dai

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    Results show that the pre-trained model without any tuning can achieve reasonable performance even on novel tasks, and the performance can be improved to a level close to state-of-the-art methods by conducting prompt tuning on 1% of downstream task data.

    163
  • VisualPRM: An Effective Process Reward Model for Multimodal Reasoning

    Wei‐Yun Wang, Zhangwei Gao, Lianjie Chen, Zhe Chen, Jinguo Zhu, Xiangyu Zhao, Yangzhou Liu, Yue Cao, +7 more

    arXiv · 2025

    140
  • Complementary Relation Contrastive Distillation

    Jinguo Zhu, Shixiang Tang, Dapeng Chen, Shijie Yu, Yakun Liu, Mingzhe Rong, Aijun Yang, Xiaohua Wang

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2021

    This paper proposes a novel knowledge distillation method, namely Complementary Relation Contrastive Distillation (CRCD), to transfer the structural knowledge from the teacher to the student and estimates the mutual relation in an anchor-based way and distill the anchorstudent relation under the supervision of its corresponding anchor-teacher relation.

    110
  • Layerwise Optimization by Gradient Decomposition for Continual Learning

    Shixiang Tang, Dapeng Chen, Jinguo Zhu, Shijie Yu, Wanli Ouyang

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2021

    This work decomposed the gradient of an old task into a part shared by all old tasks and a part specific to that task, and performs optimization for the gradients of each layer separately rather than the concatenation of all gradients as in previous works.

    100
  • Uni-Perceiver v2: A Generalist Model for Large-Scale Vision and Vision-Language Tasks

    Hao Li, Jinguo Zhu, Xiaohu Jiang, Xizhou Zhu, Hongsheng Li, Chun Yuan, Xiaohua Wang, Yu Qiao, +3 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023

    This paper proposes Uni-Perceiver v2, which is the first generalist model capable of handling major large-scale vision and vision-language tasks with competitive performance and proposes an effective optimization technique named Task-Balanced Gradient Normalization to ensure stable multi-task learning with an unmixed sampling strategy, helpful for tasks requiring large batch-size training.

    75
  • A Deep Learning Method to Detect Foreign Objects for Inspecting Power Transmission Lines

    Jinguo Zhu, Yue Guo, Fanding Yue, Huan Yuan, Aijun Yang, Xiaohua Wang, Mingzhe Rong

    IEEE Access · 2020

    A deep learning method to detect invading foreign objects for power transmission line inspection is proposed, based on the regression strategy with oriented bounding boxes to accurately predict spatial location and orientation angle of foreign objects, as well as their categories in cluttered backgrounds.

    51
  • VL-GPT: A Generative Pre-trained Transformer for Vision and Language Understanding and Generation

    Jinguo Zhu, Xiaohan Ding, Yixiao Ge, Yuying Ge, Sijie Zhao, Hengshuang Zhao, Xiaohua Wang, Ying Shan

    arXiv · 2023

    50
  • SynerGen-VL: Towards Synergistic Image Understanding and Generation with Vision Experts and Token Folding

    Hao Li, Changyao Tian, Jie Shao, Xizhou Zhu, Zhaokai Wang, Jinguo Zhu, Wenhan Dou, Xiaogang Wang, +3 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2025

    To address challenges identified in existing encoder-free unified MLLMs, the token folding mechanism and the vision-expert-based progressive alignment pretraining strategy are introduced, which effectively support high-resolution image understanding while reducing training complexity.

    49
  • ZeroGUI: Automating Online GUI Learning at Zero Human Cost

    Chenyu Yang, Shiqian Su, Shi Liu, Dong, Xuan, Yue Yu, Su, Weijie, Wang, Xuehui, Zhaoyang Liu, +6 more

    arXiv · 2025

    ZeroGUI is proposed, a scalable, online learning framework for automating GUI Agent training at Zero human cost that integrates VLM-based automatic task generation to produce diverse training goals from the current environment state, and two-stage online reinforcement learning to continuously interact with and learn from GUI environments.

    38
  • V2PE: Improving Multimodal Long-Context Capability of Vision-Language Models with Variable Visual Position Encoding

    Junqi Ge, Ziyi Chen, Jintao Lin, Jinguo Zhu, Xihui Liu, Jifeng Dai, Xizhou Zhu

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2025

    This work proposes Variable Visual Position Encoding (V2PE), a novel positional encoding approach that employs variable and smaller increments for visual tokens, enabling more efficient management of long multimodal sequences.

    36
  • Enhanced sensing of sulfur hexafluoride decomposition components based on noble-metal-functionalized cerium oxide

    Aijun Yang, Weijuan Li, Jifeng Chu, Dawei Wang, Huan Yuan, Jinguo Zhu, Xiaohua Wang, Mingzhe Rong

    Materials & Design · 2019

    30
  • Power-Llava: Large Language and Vision Assistant for Power Transmission Line Inspection

    Jiahao Wang, Mingxuan Li, Haichen Luo, Jinguo Zhu, Aijun Yang, Mingzhe Rong, Xiaohua Wang

    Proceedings - International Conference on Image Processing · 2024

    Power-LLaVA, the first large language and vision assistant designed to offer professional and reliable inspection services for power transmission line by engaging in dialogues with humans, is introduced and a large-scale and high-quality dataset specialized for the inspection task is constructed.

    17
  • Multiple Domain Experts Collaborative Learning: Multi-Source Domain Generalization For Person Re-Identification

    Shijie Yu, Feng Zhu, Dapeng Chen, Rui Zhao, Haobin Chen, Shixiang Tang, Jinguo Zhu, Yu Qiao

    arXiv · 2021

    13
  • Crowded Human Detection via an Anchor-pair Network

    Jinguo Zhu, Zejian Yuan, Chong Zhang, Wanchao Chi, Yonggen Ling, Shenghao Zhang

    IEEE Winter Conference on Applications of Computer Vision · 2020

    11
  • Welding Joints Inspection via Residual Attention Network

    Jinguo Zhu, Zejian Yuan, Tie Liu

    2019 16th International Conference on Machine Vision Applications (MVA) · 2019

    3
  • Vision Model Pre-training on Interleaved Image-Text Data via Latent Compression Learning

    Chenyu Yang, Xizhou Zhu, Jinguo Zhu, Lewei Lu, J. Wang, Xuan Dong, Wenhai Wang, Lewei Lu, +4 more

    neural information processing systems · 2024

    1
  • Transmission Lines Monitoring Based on Convolution Neural Network and Edge Computation

    Yue Guo, Huan Yuan, Jinguo Zhu, Lujin Wang, Aijun Yang, Xiaohua Wang

    Lecture notes in electrical engineering · 2021

    Convolutional neural networks combining with an edge computation platform are used for feature extraction in this paper and comprehensively considers some features, such as complex image scenes, the difficulty in extracting hidden dangers type features, and large target size variation spans.

    1
  • NaViL: Rethinking Scaling Properties of Native Multimodal Large Language Models under Data Constraints

    Changyao Tian, Hao Li, Gen Luo, Xizhou Zhu, Weijie Su, Hanming Deng, Jinguo Zhu, Jie Shao, +6 more

    neural information processing systems · 2025

    –
  • Enhancing the Outcome Reward-based RL Training of MLLMs with Self-Consistency Sampling

    Jiahao Wang, Weiye Xu, Aijun Yang, Wengang Zhou, Lewei Lu, Houqiang Li, Xiaohua Wang, Jinguo Zhu

    neural information processing systems · 2025

    –
  • SARS-COV-2 Induce Pulmonary Injury from Basic to Clinical Research

    Jinguo Zhu

    World Journal of Cardiovascular Diseases · 2022

    This review analyzes the SARS-CoV-2 biological characteristics, in-sights the effect of alveolar epithelium and its adjacent microvascular endothelium, investigates human host cells immune response and immunothrombosis, and explains clinical manifestations of COVID-19 associated lung injury.

    –

Publication data from OpenAlex, with missing venues and authors filled in from Crossref; citation counts are the higher of OpenAlex and Semantic Scholar, last synced 2026-10-15. One-sentence summaries under some papers are written by Semantic Scholar’s model. Citation counts may be lower than on Google Scholar, which indexes more sources.

Report an error

Wrong papers, two people merged into one, or a profile that should not be here? Tell us and we will fix or hide it.

Sign in to report