Is this you? Claim this profile to correct it, add a bio and choose the work people see first.

Claim this profile

Academic lineage

Possible advisorsa guess from early papers, not confirmed

  • Mac Schwager

    Possible advisor · last author on 5 of their early first-author papers, 2022–2023

    Suggested from co-authorship
  • Bolei Zhou

    Possible advisor · last author on 3 of their early first-author papers, 2020–2021

    Suggested from co-authorship

Is this you? Claim this profile to confirm or dismiss it.

Works68 from public data

TitleCited by
  • Open X-Embodiment: Robotic Learning Datasets and RT-X Models : Open X-Embodiment Collaboration 0

    Abby O'Neill, Abdul Rehman, Abhiram Maddukuri, Abhishek Gupta, Abhishek Padalkar, Abraham Lee, Acorn Pooley, Agrim Gupta, +22 more

    Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · 2024

    1,232
  • Foundation models in robotics: Applications, challenges, and the future

    Roya Firoozi, Johnathan Tucker, Stephen Tian, Anirudha Majumdar, Jiankai Sun, Weiyu Liu, Yuke Zhu, Shuran Song, +7 more

    The International Journal of Robotics Research · 2024

    How foundation models contribute to improving robot capabilities in the domains of perception, decision-making, and control is explored and the challenges hindering the adoption of foundation models in robot autonomy are discussed.

    459
  • MimicPlay: Long-Horizon Imitation Learning by Watching Human Play

    Chen Wang, Linxi Fan, Jiankai Sun, Ruohan Zhang, Li Fei-Fei, Danfei Xu, Yuke Zhu, Animashree Anandkumar

    arXiv · 2023

    A hierarchical learning framework named MimicPlay is introduced that learns latent plans from human play data to guide low-level visuomotor control trained on a small number of teleoperated demonstrations and outperforms state-of-the-art imitation learning methods in task success rate, generalization ability, and robustness to disturbances.

    391
  • Cross-View Semantic Segmentation for Sensing Surroundings

    Bowen Pan, Jiankai Sun, Ho Yin Tiga Leung, Alex Andonian, Bolei Zhou

    IEEE Robotics and Automation Letters · 2020

    A novel visual task called Cross-view Semantic Segmentation as well as a framework named View Parsing Network (VPN) to address it and the experimental results show that the model can effectively make use of the information from different views and multi-modalities to understanding spatial information.

    336
  • Large AI Models in Health Informatics: Applications, Challenges, and the Future

    Jianing Qiu, Lin Li, Jiankai Sun, Jiachuan Peng, Peilun Shi, Ruiyang Zhang, Yinzhao Dong, Kyle Lam, +6 more

    IEEE Journal of Biomedical and Health Informatics · 2023

    Seven key sectors in which large AI models are applicable and might have substantial influence, including: 1) bioinformatics; 2) medical diagnosis; 3) medical imaging; 4) medical informatics; 5) medical education; 6) public health; and 7) medical robotics are identified.

    233
  • BEHAVIOR-1K: A Human-Centered, Embodied AI Benchmark with 1,000 Everyday Activities and Realistic Simulation

    Chengshu Li, Ruohan Zhang, Josiah Wong, Cem Gökmen, Sanjana Srivastava, Roberto Martín-Martín, Chen Wang, Gabrael Levine, +22 more

    arXiv · 2024

    BEHAVIOR-1K's human-grounded nature, diversity, and realism make it valuable for embodied AI and robot learning research, and it is hoped that its human-grounded nature, diversity, and realism make it valuable for embodied AI and robot learning research.

    197
  • CamNet: Coarse-to-Fine Retrieval for Camera Re-Localization

    Mingyu Ding, Zhe Wang, Jiankai Sun, Jianping Shi, Ping Luo

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2019

    176
  • A Survey of Reasoning with Foundation Models: Concepts, Methodologies, and Outlook

    Jiankai Sun, Chuanyang Zheng, Enze Xie, Zhengying Liu, Ruihang Chu, Jianing Qiu, Jiaqi Xu, Mingyu Ding, +22 more

    ACM Computing Surveys · 2025

    This article introduces seminal foundation models proposed or adaptable for reasoning, highlighting the latest advancements in various reasoning tasks, methods, and benchmarks, and delves into the potential future directions behind the emergence of reasoning abilities within foundation models.

    142
  • Open X-Embodiment: Robotic Learning Datasets and RT-X Models

    Embodiment Collaboration, O'Neill, Abby, Rehman, Abdul, Gupta, Abhinav, Maddukuri, Abhiram, Gupta, Abhishek, Abhishek Padalkar, Lee, Abraham, +22 more

    arXiv · 2023

    100
  • Dojo: A Differentiable Physics Engine for Robotics

    Taylor A. Howell, Simon Le Cleac’h, Brüdigam, Jan, Qianzhong Chen, Jiankai Sun, J. Zico Kolter, Mac Schwager, Zachary R. Manchester

    arXiv · 2022

    A differentiable rigid-body-dynamics simulator for robotics that prioritizes physical accuracy and differentiability is presented and the usefulness of the simulator and its gradients is demonstrated through a number of examples including: simulation, trajectory optimization, reinforcement learning, and system identification.

    84
  • Conformal Prediction for Uncertainty-Aware Planning with Diffusion Dynamics Model

    Jiankai Sun, Yiqi Jiang, Jianing Qiu, Parth Nobel, Mykel J. Kochenderfer, Mac Schwager

    neural information processing systems · 2023

    This paper quantifies the uncertainty of diffusion dynamics models using Conformal Prediction (CP), inspired by concepts from conformal prediction, and modify the loss function for training the diffusion model to include a quantile term to encourage more robust performance across the variety of training examples.

    81
  • A Survey of Reasoning with Foundation Models

    Jiankai Sun, Chuanyang Zheng, Enze Xie, Zhengying Liu, Ruihang Chu, Jianing Qiu, Jiaqi Xu, Mingyu Ding, +22 more

    arXiv · 2023

    This paper introduces seminal foundation models proposed or adaptable for reasoning, highlighting the latest advancements in various reasoning tasks, methods, and benchmarks and discusses the relevance of multimodal learning, autonomous agents, and super alignment in the context of reasoning.

    73
  • PlaTe: Visually-Grounded Planning With Transformers in Procedural Tasks

    Jiankai Sun, De-An Huang, Bo Lu, Yunhui Liu, Bolei Zhou, Animesh Garg

    IEEE Robotics and Automation Letters · 2022

    This work addresses the problem of how to leverage instructional videos to facilitate the understanding of human decision-making processes, focusing on training a model with the ability to plan a goal-directed procedure from real-world videos with Planning Transformer (PlaTe), which has the advantage of circumventing the compounding prediction errors that occur with single-step models during long model-based rollouts.

    69
  • SegVoxelNet: Exploring Semantic Context and Depth-aware Features for 3D Vehicle Detection from Point Cloud

    Hongwei Yi, Shaoshuai Shi, Mingyu Ding, Jiankai Sun, Kui Xu, Hui Zhou, Zhe Wang, Sheng Li, +1 more

    Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · 2020

    A semantic context encoder is proposed to leverage the free-of-charge semantic segmentation masks in the bird's eye view to address the semantic context information in LiDAR.

    65
  • Adversarial Inverse Reinforcement Learning With Self-Attention Dynamics Model

    Jiankai Sun, Lantao Yu, Pinqian Dong, Bo Lu, Bolei Zhou

    IEEE Robotics and Automation Letters · 2021

    37
  • ClawsBench: Evaluating Capability and Safety of LLM Productivity Agents in Simulated Workspaces

    Xiangyi Li, Kyoung Whan Choe, Yimin Liu, Xiaokun Chen, Tao, Chujun, Bingran You, Wenbo Chen, Zonglin Di, +7 more

    arXiv · 2026

    ClawsBench, a benchmark for evaluating and improving LLM agents in realistic productivity settings, is introduced and eight recurring patterns of unsafe behavior are identified, including multi-step sandbox escalation and silent contract modification.

    36
  • Lyra: Orchestrating Dual Correction in Automated Theorem Proving

    Chuanyang Zheng, Haiming Wang, Enze Xie, Zhengying Liu, Jiankai Sun, Huajian Xin, Jianhao Shen, Zhenguo Li, +1 more

    arXiv · 2023

    The Lyra is introduced, a new framework that employs two distinct correction mechanisms: Tool Correction (TC) and Conjecture Correction (CC), an error feedback mechanism designed to interact with prover to refine formal proof conjectures with prover error messages.

    35
  • ParticleFormer: A 3D Point Cloud World Model for Multi-Object, Multi-Material Robotic Manipulation

    Suning Huang, Qianzhong Chen, Xiaohan Zhang, Jiankai Sun, Mac Schwager

    arXiv · 2025

    This work presents ParticleFormer, a Transformer-based point cloud world model trained with a hybrid point cloud reconstruction loss, supervising both global and local dynamics features in multi-material, multi-object robot interactions, and extends existing dynamics learning benchmarks to include diverse multi-material, multi-object interaction scenarios.

    34
  • Egocentric Human Trajectory Forecasting With a Wearable Camera and Multi-Modal Fusion

    Jianing Qiu, Lipeng Chen, Xiao Gu, Frank P.-W. Lo, Ya-Yen Tsai, Jiankai Sun, Jiaqi Liu, Benny P. L. Lo

    IEEE Robotics and Automation Letters · 2022

    A Transformer-based encoder-decoder neural network model, integrated with a novel cascaded cross-attention mechanism that fuses multiple modalities, has been designed to predict the future trajectory of the camera wearer, with results showing that the model outperforms the state-of-the-art methods in egocentric human trajectory forecasting.

    29
  • ARCH: Hierarchical Hybrid Learning for Long-Horizon Contact-Rich Robotic Assembly

    Jiankai Sun, Aidan Curtis, Yang You, Yan Xu, Koehle, Michael, Qianzhong Chen, Huang, Suning, Leonidas J. Guibas, +3 more

    arXiv · 2024

    This work proposes a hierarchical modular approach, named Adaptive Robotic Compositional Hierarchy (ARCH), which enables long-horizon, high-precision robotic assembly in contact-rich settings and shows that ARCH generalizes well to unseen objects and outperforms baseline methods in terms of success rate and data efficiency.

    27
  • GRAD-NAV++: Vision-Language Model Enabled Visual Drone Nav igation With G aussian Ra diance Fields and D ifferentiable Dynamics

    Qianzhong Chen, Naixiang Gao, Suning Huang, JunEn Low, Timothy Chen, Jiankai Sun, Mac Schwager

    IEEE Robotics and Automation Letters · 2025

    This work introduces a lightweight Vision–Language–Action (VLA) framework that runs fully onboard and follows natural-language commands in real time and establishes a new benchmark for fully onboard Vision-Language-Action (VLA) flight and demonstrates that compact, efficient models can enable reliable, language-guided navigation without relying on external infrastructure.

    26
  • Transferable Active Grasping and Real Embodied Dataset

    Xiangyu Chen, Zelin Ye, Jiankai Sun, Yuda Fan, Fang Hu, Chenxi Wang, Cewu Lu

    Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · 2020

    A novel mask-guided reward is proposed to overcome the sparse reward issue in grasping and ensure category-irrelevant behavior in grasping in a real-world UR-5 robotic arm.

    23
  • Leveraging Print Debugging to Improve Code Generation in Large Language Models

    Xueyu Hu, Kun Kuang, Jiankai Sun, Hongxia Yang, Fei Qing Wu

    arXiv · 2024

    This work proposes an in-context learning approach that guides LLMs to debug by using a "print debugging" method, which involves inserting print statements to trace and analysing logs for fixing the bug.

    22
  • Low-bit Quantization Needs Good Distribution

    Haibao Yu, Tuopu Wen, Guangliang Cheng, Jiankai Sun, Qi Han, Jianping Shi

    IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · 2020

    22
  • Research Challenges and Progress in the End-to-End V2X Cooperative Autonomous Driving Competition

    Ruiyang Hao, Haibao Yu, Jiaru Zhong, Chuanye Wang, Jiahao Wang, Yiming Kan, Wenxian Yang, Siqi Fan, +11 more

    IEEE/CVF International Conference on Computer Vision Workshops (ICCVW) · 2025

    The design and outcomes of the End-to-End Autonomous Driving through V2X Cooperation Challenge are described, key research problems including bandwidth-aware fusion, robust multi-agent planning, and heterogeneous sensor integration are highlighted, and emerging technical trends among top-performing solutions are analyzed.

    17

Show all 68 works

Publication data from OpenAlex, with missing venues and authors filled in from Crossref; citation counts are the higher of OpenAlex and Semantic Scholar, last synced 2026-10-15. One-sentence summaries under some papers are written by Semantic Scholar’s model. Citation counts may be lower than on Google Scholar, which indexes more sources.

Report an error

Wrong papers, two people merged into one, or a profile that should not be here? Tell us and we will fix or hide it.

Sign in to report