Is this you? Claim this profile to correct it, add a bio and choose the work people see first.

Claim this profile

Works486 from public data

TitleCited by
  • Visual interpretability for deep learning: a survey

    Quanshi Zhang, Song‐Chun Zhu

    Frontiers of Information Technology & Electronic Engineering · 2018

    It is believed that high model interpretability may help people break several bottlenecks of deep learning, e.g., learning from a few annotations, learning via human–computer communications at the semantic level, and semantically debugging network representations.

    949
  • Interpretable Convolutional Neural Networks

    Quanshi Zhang, Ying Nian Wu, Song‐Chun Zhu

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2018

    A method to modify a traditional convolutional neural network into an interpretable CNN, in order to clarify knowledge representations in high conv-layers of the CNN, which can help people understand the logic inside a CNN.

    855
  • Cross-View Action Modeling, Learning, and Recognition

    Jiang Wang, Xiaohan Nie, Xia Yin, Ying Nian Wu, Song‐Chun Zhu

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2014

    A novel multiview spatio-temporal and-or graph (MST-AOG) representation for cross-view action recognition, which takes advantage of the 3D human skeleton data obtained from Kinect cameras to avoid annotating enormous multi-view video frames, but the recognition does not need 3D information and is based on 2D video input.

    659
  • Image Parsing: Unifying Segmentation, Detection, and Recognition

    Zhuowen Tu, Xiang-Rong Chen, Alan Yuille, Song‐Chun Zhu

    International Journal of Computer Vision · 2005

    647
  • Learning Human-Object Interactions by Graph Parsing Neural Networks

    Siyuan Qi, Wenguan Wang, Baoxiong Jia, Jianbing Shen, Song‐Chun Zhu

    Lecture notes in computer science · 2018

    This paper addresses the task of detecting and recognizing human-object interactions (HOI) in images and videos with the Graph Parsing Neural Network (GPNN), a framework that incorporates structural knowledge while being differentiable end-to-end.

    596
  • Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoning

    Pan Lu, Ran Gong, Shibiao Jiang, Liang Qiu, Siyuan Huang, Xiaodan Liang, Song‐Chun Zhu

    Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · 2021

    This work constructs a new largescale benchmark, Geometry3K, consisting of 3,002 geometry problems with dense annotation in formal language, and proposes a novel geometry solving approach with formal language and symbolic reasoning, called Interpretable Geometry Problem Solver (InterGPS).

    571
  • Dynamic Prompt Learning via Policy Gradient for Semi-structured Mathematical Reasoning

    Pan Lu, Qiu, Liang, Kai-Wei Chang, Ying Nian Wu, Song‐Chun Zhu, Tanmay Rajpurohit, Peter A. Clark, Ashwin Kalyan

    arXiv · 2022

    A novel approach is proposed, PromptPG, which utilizes policy gradient to learn to select in-context examples from a small amount of training data and then constructs the corresponding prompt for the test example, which verifies its effectiveness in selecting in- context examples.

    476
  • An Embodied Generalist Agent in 3D World

    Jiangyong Huang, Silong Yong, Xiaojian Ma, Xiongkun Linghu, Puhao Li, Yan Wang, Qing Li, Song‐Chun Zhu, +2 more

    arXiv · 2023

    This work introduces LEO, an embodied multi-modal generalist agent that excels in perceiving, grounding, reasoning, planning, and acting in the 3D world and demonstrates its remarkable proficiency across a wide spectrum of tasks, including 3D captioning, question answering, embodied reasoning, navigation and manipulation.

    453
  • RAVEN: A Dataset for Relational and Analogical Visual REasoNing

    Chi Zhang, Feng Gao, Baoxiong Jia, Yixin Zhu, Song‐Chun Zhu

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2019

    This work proposes a new dataset, built in the context of Raven's Progressive Matrices (RPM) and aimed at lifting machine intelligence by associating vision with structural, relational, and analogical reasoning in a hierarchical representation and establishes a semantic link between vision and reasoning by providing structure representation.

    421
  • A Stochastic Grammar of Images

    Song‐Chun Zhu, David B. Mumford

    now publishers, Inc. eBooks · 2006

    395
  • Learning Pose Grammar to Encode Human Body Configuration for 3D Pose Estimation

    Hao-Shu Fang, Yuanlu Xu, Wenguan Wang, Xiaobai Liu, Song‐Chun Zhu

    Proceedings of the AAAI Conference on Artificial Intelligence · 2018

    This paper proposes a pose grammar to tackle the problem of 3D human pose estimation, which takes 2D pose as input and learns a generalized 2D-3D mapping function and enforces high-level constraints over human poses.

    392
  • Diffusion-based Generation, Optimization, and Planning in 3D Scenes

    Siyuan Huang, Zan Wang, Puhao Li, Baoxiong Jia, Tengyu Liu, Yixin Zhu, Wei Liang, Song‐Chun Zhu

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023

    The SceneDiffuser is introduced, a conditional generative model for 3D scene understanding that jointly formulates the scene-aware generation, physics-based optimization, and goal-oriented planning via a diffusion-based denoising process in a fully differentiable fashion.

    358
  • Spatio-temporal Self-Supervised Representation Learning for 3D Point Clouds

    Siyuan Huang, Yichen Xie, Song‐Chun Zhu, Yixin Zhu

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2021

    Experimental results demonstrate that, compared with supervised learning methods, the learned self-supervised representation facilitates various models to attain comparable or even better performances while capable of generalizing pre-trained models to downstream tasks, including 3D shape classification, 3D object detection, and 3D semantic segmentation.

    276
  • What are Textons?

    Song‐Chun Zhu, Cheng-en Guo, Yizhou Wang, Zijian Xu

    International Journal of Computer Vision · 2004

    A three-level generative image model for learning textons from texture images and the geometric, dynamic, and photometric structures of the texton representation are studied by further extending the generative model to account for motion and illumination variations.

    271
  • Interpreting CNN Knowledge via an Explanatory Graph

    Quanshi Zhang, Ruiming Cao, Feng Shi, Ying Nian Wu, Song‐Chun Zhu

    Proceedings of the AAAI Conference on Artificial Intelligence · 2018

    This paper learns a graphical model, namely an explanatory graph, which reveals the knowledge hierarchy hidden inside a pre-trained CNN in an unsupervised manner, i.e., without a need of annotating object parts.

    255
  • Introduction to a Large-Scale General Purpose Ground Truth Database: Methodology, Annotation Tool and Benchmarks

    Benjamin Yao, Xiong Yang, Song‐Chun Zhu

    Lecture notes in computer science · 2007

    A large scale general purpose image database with human annotated ground truth consisting of more than 636,748 annotated images and video frames is presented.

    246
  • Attentive Fashion Grammar Network for Fashion Landmark Detection and Clothing Category Classification

    Wenguan Wang, Yuanlu Xu, Jianbing Shen, Song‐Chun Zhu

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2018

    241
  • Human-Centric Indoor Scene Synthesis Using Stochastic Grammar

    Siyuan Qi, Yixin Zhu, Siyuan Huang, Chenfanfu Jiang, Song‐Chun Zhu

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2018

    A human-centric method to sample and synthesize 3D room layouts and 2D images thereof, to obtain large-scale 2D/3D image data with the perfect per-pixel ground truth is presented.

    209
  • Joint action recognition and pose estimation from video

    Bruce Xiaohan Nie, Caiming Xiong, Song‐Chun Zhu

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2015

    207
  • DenseRaC: Joint 3D Pose and Shape Estimation by Dense Render-and-Compare

    Yuanlu Xu, Song‐Chun Zhu, Tony Tung

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2019

    A novel end-to-end framework for jointly estimating 3D human pose and body shape from a monocular RGB image and a large-scale synthetic dataset utilizing web-crawled Mocap sequences, 3D scans and animations is constructed.

    203
  • On the Anatomy of MCMC-Based Maximum Likelihood Learning of Energy-Based Models

    Erik Nijkamp, Mitch Hill, Tian Han, Song‐Chun Zhu, Ying Nian Wu

    Proceedings of the AAAI Conference on Artificial Intelligence · 2020

    This study investigates the effects of Markov chain Monte Carlo (MCMC) sampling in unsupervised Maximum Likelihood (ML) learning and identifies a variety of ML learning outcomes that depend solely on the implementation of MCMC sampling.

    195
  • CERN: Confidence-Energy Recurrent Network for Group Activity Recognition

    Tianmin Shu, Siniša Todorović, Song‐Chun Zhu

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2017

    This work is about recognizing human activities occurring in videos at distinct semantic levels, including individual actions, interactions, and group activities, using a two-level hierarchy of Long Short-Term Memory networks, forming a feed-forward deep architecture, which can be trained end-to-end.

    193
  • Synthesizing Diverse and Physically Stable Grasps With Arbitrary Hand Structures Using Differentiable Force Closure Estimator

    Tengyu Liu, Zeyu Liu, Ziyuan Jiao, Yixin Zhu, Song‐Chun Zhu

    IEEE Robotics and Automation Letters · 2021

    A fast and differentiable force closure estimator, capable of producing diverse and physically stable grasps with arbitrary hand structures, without any training data is formulated, which can test a force closure within milliseconds.

    188
  • Multi-view People Tracking via Hierarchical Trajectory Composition

    Yuanlu Xu, Xiaobai Liu, Yang Liu, Song‐Chun Zhu

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2016

    188
  • Joint inference of groups, events and human roles in aerial videos

    Tianmin Shu, Dan Xie, Brandon Rothrock, Siniša Todorović, Song‐Chun Zhu

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2015

    This paper addresses a new problem of parsing low-resolution aerial videos of large spatial areas, in terms of grouping, recognizing events and 3) assigning roles to people engaged in events, using a spatiotemporal AND-OR graph.

    187

Show all 486 works

Publication data from OpenAlex, with missing venues and authors filled in from Crossref; citation counts are the higher of OpenAlex and Semantic Scholar, last synced 2026-10-14. One-sentence summaries under some papers are written by Semantic Scholar’s model. Citation counts may be lower than on Google Scholar, which indexes more sources.

Report an error

Wrong papers, two people merged into one, or a profile that should not be here? Tell us and we will fix or hide it.

Sign in to report