Is this you? Claim this profile to correct it, add a bio and choose the work people see first.

Claim this profile

Works134 from public data

TitleCited by
  • Video Enhancement with Task-Oriented Flow

    Tianfan Xue, Baian Chen, Jiajun Wu, Donglai Wei, William T. Freeman

    International Journal of Computer Vision · 2019

    T task-oriented flow (TOFlow), a motion representation learned in a self-supervised, task-specific manner, is proposed, which outperforms traditional optical flow on standard benchmarks as well as the Vimeo-90K dataset in three video processing tasks.

    1,802
  • MedMNIST v2 - A large-scale lightweight benchmark for 2D and 3D biomedical image classification

    Jiancheng Yang, Rui Shi, Donglai Wei, Zequan Liu, Lin Zhao, Bilian Ke, Hanspeter Pfister, Bingbing Ni

    Scientific Data · 2023

    Covering primary data modalities in biomedical images, MedMNIST v2 is designed to perform classification on lightweight 2D and 3D images with various dataset scales (from 100 to 100,000) and diverse tasks (binary/multi-class, ordinal regression, and multi-label).

    1,572
  • Learning and Using the Arrow of Time

    Donglai Wei, Joseph J. Lim, Andrew Zisserman, William T. Freeman

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2018

    A ConvNet suitable for extended temporal footprints and for class activation visualization, and the effect of artificial cues, such as cinematographic conventions, on learning is studied, which achieves state-of-the-art performance on large-scale real-world video datasets.

    369
  • A petavoxel fragment of human cerebral cortex reconstructed at nanoscale resolution

    Alexander Shapson-Coe, Michał Januszewski, Daniel Raimund Berger, Art Pope, Yuelong Wu, Tim M. Blakely, Richard Lee Schalek, Peter H. Li, +22 more

    Science · 2024

    355
  • A Video Representation Using Temporal Superpixels

    Jason S. Chang, Donglai Wei, John Sheridan Fisher

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2013

    242
  • A connectomic study of a petascale fragment of human cerebral cortex

    Alexander Shapson-Coe, Michał Januszewski, Daniel Raimund Berger, Art Pope, Yuelong Wu, Tim M. Blakely, Richard Lee Schalek, Peter H. Li, +21 more

    bioRxiv (Cold Spring Harbor Laboratory) · 2021

    In studying these neurons, it is found that deep layer excitatory cell types can be classified into new subsets, based on structural and connectivity differences, and that chandelier interneurons not only innervate excitatories neuron initial segments as previously described, but also each other’s initial segments.

    241
  • Dynamic High-Pass Filtering and Multi-Spectral Attention for Image Super-Resolution

    Salma Abdel Magid, Yulun Zhang, Donglai Wei, Won-Dong Jang, Zudi Lin, Yun Fu, Hanspeter Pfister

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2021

    A dynamic high-pass filtering module that locally applies adaptive filter weights for each spatial location and channel group to preserve high-frequency signals and a matrix multi-spectral channel attention module that predicts the attention map of features decomposed in the frequency domain.

    138
  • MitoEM Dataset: Large-Scale 3D Mitochondria Instance Segmentation from EM Images

    Donglai Wei, Zudi Lin, Daniel Franco-Barranco, Nils Wendt, Xingyu Liu, Wenjie Yin, Xin Huang, Aarush Gupta, +5 more

    Lecture notes in computer science · 2020

    The MitoEM dataset is introduced, a 3D mitochondria instance segmentation dataset with two (30μm)3 volumes from human and rat cortices respectively, 3, 600× larger than previous benchmarks.

    132
  • Seeing the Arrow of Time

    L. Pickup, Pan Zheng, Donglai Wei, YiChang Shih, Changshui Zhang, Andrew Zisserman, Bernhard Schölkopf, William T. Freeman

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2014

    Good video forwards/backwards classification results are demonstrated on a selection of YouTube video clips, and on natively-captured sequences (with no temporally-dependent video compression), and what motions the models have learned that help discriminate forwards from backwards time are examined.

    116
  • Motion microscopy for visualizing and quantifying small motions

    Neal Wadhwa, Justin G. Chen, Jonathan B. Sellon, Donglai Wei, Michael Rubinstein, Roozbeh Ghaffari, Dennis M. Freeman, Oral Büyüköztürk, +6 more

    Proceedings of the National Academy of Sciences · 2017

    A computational tool is presented that quantifies tiny motions in videos and then visualizes them by producing a new video in which the motions are made large enough to see, leading to the discovery of previously unknown phenomena.

    94
  • Context Reasoning Attention Network for Image Super-Resolution

    Yulun Zhang, Donglai Wei, Can Qin, Huan Wang, Hanspeter Pfister, Yun Fu

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2021

    88
  • Learning to Generate Realistic Noisy Images via Pixel-level Noise-aware Adversarial Training

    Yuanhao Cai, Xiaowan Hu, Haoqian Wang, Yulun Zhang, Hanspeter Pfister, Donglai Wei

    arXiv · 2022

    Qualitative validation shows that noise generated by PNGAN is highly similar to real noise in terms of intensity and distribution, and an efficient architecture Simple Multi-scale Network (SMNet) as the generator is presented.

    81
  • Understanding Intra-Class Knowledge Inside CNN

    Donglai Wei, Bolei Zhou, Antonio Torrabla, William T. Freeman

    arXiv · 2015

    59
  • QuantArt: Quantizing Image Style Transfer Towards High Visual Fidelity

    Siyu Huang, Jie An, Donglai Wei, Jiebo Luo, Hanspeter Pfister

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023

    A new style transfer framework for high visual-fidelity stylization called QunntArt, which fusing the quantized and continuous latent representations of the generated artwork toward the centroids of the real artwork distribution with vector quantization.

    55
  • MSAF: Multimodal Supervise-Attention Enhanced Fusion for Video Anomaly Detection

    Donglai Wei, Yang Liu, Xiaoguang Zhu, Jing Liu, Xinhua Zeng

    IEEE Signal Processing Letters · 2022

    55
  • UnMICST: Deep learning with real augmentation for robust segmentation of highly multiplexed images of human tissues

    Clarence Yapp, Edward Novikov, Won-Dong Jang, Tuulia Vallius, Yuan Chen, Marcelo Cicconet, Zoltan Maliga, Connor A. Jacobson, +4 more

    Communications Biology · 2022

    Two approaches to improving tissue segmentation that are applicable to multiple deep learning frameworks are demonstrated and cumulatively and substantially improve segmentation on a wide range of tissue types and provide a set of improved segmentation models.

    54
  • $R^2$-Tuning: Efficient Image-to-Video Transfer Learning for Video Temporal Grounding

    Ye Liu, Jixuan He, Wanhua Li, Junsik Kim, Donglai Wei, Hanspeter Pfister, Chang Wen Chen

    arXiv · 2024

    Reversed Recurrent Tuning ($R^2$-Tuning), a parameter- and memory-efficient transfer learning framework for video temporal grounding, achieves state-of-the-art performance across three VTG tasks (i.e., moment retrieval, highlight detection, and video summarization) on six public benchmarks.

    52
  • Learning Causality-inspired Representation Consistency for Video Anomaly Detection

    Yang Liu, Zhaoyang Xia, Mengyang Zhao, Donglai Wei, Yuzheng Wang, Siao Liu, Bobo Ju, Gaoyun Fang, +2 more

    ACM International Conference on Multimedia (ACM MM) · 2023

    A causality-inspired representation consistency (CRC) framework to implicitly learn the unobservable causal variables of normality directly from available normal videos and detect abnormal events with the learned representation consistency.

    52
  • VizAbility: Enhancing Chart Accessibility with LLM-based Conversational Interaction

    Joshua Gorniak, Yoon Kim, Donglai Wei, Nam Wook Kim

    ACM Symposium on User Interface Software and Technology (UIST) · 2024

    VizAbility is a novel system that enriches chart content navigation with conversational interaction, enabling users to use natural language for querying visual data trends, and adapts to the user’s navigation context for improved response accuracy and facilitates verbal command-based chart navigation.

    50
  • Stochastic video normality network for abnormal event detection in surveillance videos

    Yang Liu, Dingkang Yang, Dingkang Yang, Yuzheng Wang, Donglai Wei, Mengyang Zhao, Kai Cheng, Jing Liu, +1 more

    Knowledge-Based Systems · 2023

    50
  • Dense 4D nanoscale reconstruction of living brain tissue

    Philipp Velicky, Eder Miguel, Julia M. Michalska, Julia Lyudchik, Donglai Wei, Zudi Lin, Jake F. Watson, Jakob Troidl, +12 more

    Nature Methods · 2023

    An integrated optical/machine-learning technology, LIONESS (live information-optimized nanoscopy enabling saturated segmentation) leverages optical modifications to stimulated emission depletion microscopy in comprehensively, extracellularly labeled tissue and previous information on sample structure via machine learning to simultaneously achieve isotropic super-resolution, high signal-to-noise ratio and compatibility with living tissue.

    48
  • The impact of ChatGPT and LLMs on medical imaging stakeholders: Perspectives and use cases

    Jiancheng Yang, Hongwei Li, Donglai Wei

    Meta-Radiology · 2023

    This paper introduces an analytic framework for presenting the complex interactions between LLMs and the broader ecosystem of medical imaging stakeholders, including businesses, insurance entities, governments, research institutions, and hospitals (nicknamed BIGR-H).

    45
  • Learning Task-Specific Representation for Video Anomaly Detection with Spatial-Temporal Attention

    Yang Liu, Jing Liu, Xiaoguang Zhu, Donglai Wei, Xiaohong Huang, Liang Song

    IEEE International Conference on Acoustics Speech and Signal Processing · 2022

    45
  • Automated Measurements of Key Morphological Features of Human Embryos for IVF

    Brian Leahy, Won-Dong Jang, Helen Y. Yang, Robbert Struyven, Donglai Wei, Zhe Sun, Kylie R. Lee, Charlotte Royston, +6 more

    Lecture notes in computer science · 2020

    This work automates feature extraction of time-lapse microscopy of human embryos with a machine-learning pipeline of five convolutional neural networks (CNNs) that greatly speeds up the measurement of quantitative, biologically relevant features that may aid in embryo selection.

    45
  • Revisiting RCAN: Improved Training for Image Super-Resolution

    Zudi Lin, Prateek Garg, Atmadeep Banerjee, Salma Abdel Magid, Deqing Sun, Yulun Zhang, Luc Van Gool, Donglai Wei, +1 more

    arXiv · 2022

    44
  • NucMM Dataset: 3D Neuronal Nuclei Instance Segmentation at Sub-Cubic Millimeter Scale

    Zudi Lin, Donglai Wei, Mariela D. Petkova, Yuelong Wu, Zergham Ahmed, Krishna Swaroop K, Silin Zou, Nils Wendt, +7 more

    Lecture notes in computer science · 2021

    A novel hybrid-representation learning model is proposed that combines the merits of foreground mask, contour map, and signed distance transform to produce high-quality 3D masks and significantly outperforms state-of-the-art nuclei segmentation approaches.

    42
  • Pulse-driven robot: Motion via solitary waves

    Bolei Deng, Liyuan Chen, Donglai Wei, Vincent Tournat, Katia Bertoldi

    Science Advances · 2020

    This study expands the range of possible applications of nonlinear waves and demonstrates that they offer a new platform to make flexible machines to move and reaches a maximum efficiency when the initiated pulses are solitons.

    41
  • RibSeg Dataset and Strong Point Cloud Baselines for Rib Segmentation from CT Scans

    Jiancheng Yang, Shixuan Gu, Donglai Wei, Hanspeter Pfister, Bingbing Ni

    Lecture notes in computer science · 2021

    A labeled rib segmentation benchmark, named RibSeg, is developed, including 490 CT scans (11,719 individual ribs) from a public dataset, and a point cloud-based baseline method is designed, achieving state-of-the-art segmentation performance with significant efficiency.

    40
  • Look, Listen and Pay More Attention: Fusing Multi-Modal Information for Video Violence Detection

    Donglai Wei, Chengeng Liu, Yang Liu, Jing Liu, Xiaoguang Zhu, Xinhua Zeng

    IEEE International Conference on Acoustics Speech and Signal Processing · 2022

    38
  • Biologically-Constrained Graphs for Global Connectomics Reconstruction

    Brian Matejek, Daniel Haehn, Haidong Zhu, Donglai Wei, Toufiq Parag, Hanspeter Pfister

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2019

    37
  • Biomedical image analysis competitions: The state of current participation practice

    Matthias Eisenmann, Annika Reinke, Vivienn Weru, Minu D. Tizabi, Fabian Isensee, Tim Julian Adler, Patrick Godau, Veronika Cheplygina, +22 more

    arXiv · 2022

    An international survey was designed that was issued to all participants of challenges conducted in conjunction with the IEEE ISBI 2021 and MICCAI 2021 conferences, covering participants' expertise and working environments, their chosen strategies, as well as algorithm characteristics.

    36
  • Why is the Winner the Best?

    Matthias Eisenmann, A. Reinke, Vivienn Weru, Minu D. Tizabi, Fabian Isensee, T. J. Adler, Sharib Ali, Vincent Andrearczyk, +22 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023

    A multicenter study with all 80 benchmarking competitions that were conducted in the scope of IEEE ISBI 2021 and MICCAI 2021 revealed common characteristics of winning solutions: the reflection of the metrics in the method design and the focus on analyzing and handling failure cases.

    34
  • CLIPTrans: Transferring Visual Knowledge with Pre-trained Models for Multimodal Machine Translation

    Devaansh Gupta, Siddhant Kharbanda, Jiawei Zhou, Wanhua Li, Hanspeter Pfister, Donglai Wei

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2023

    The merits of this framework, which simply adapts the independently pre-trained multimodal M-CLIP and the multilingual mBART, are demonstrated and consequently push forward the state-of-the-art across standard benchmarks by an average of +2.67 BLEU.

    33
  • Immersion Fixation and Staining of Multicubic Millimeter Volumes for Electron Microscopy–Based Connectomics of Human Brain Biopsies

    Neha Karlupia, Richard Lee Schalek, Yuelong Wu, Yaron Meirovitch, Donglai Wei, Alexander W. Charney, Brian Harris Kopell, Jeff William Lichtman

    Biological Psychiatry · 2023

    An immersion fixation, heavy metal staining and tissue processing method that consistently provides excellent ultrastructure throughout human and rodent surgical brain samples of volumes 2 × 2 × 2 mm3 and of volumes up to 37 mm3 with one dimension ≤ 2mm is described.

    30
  • RibSeg v2: A Large-Scale Benchmark for Rib Labeling and Anatomical Centerline Extraction

    Liang Jin, Shixuan Gu, Donglai Wei, Jason Ken Adhinarta, Kaiming Kuang, Yongjie Jessica Zhang, Hanspeter Pfister, Bingbing Ni, +2 more

    IEEE Transactions on Medical Imaging · 2023

    This work extends their prior dataset (RibSeg) on the binary rib segmentation task to a comprehensive benchmark, named RibSeg v2, and develops a pipeline including deep learning-based methods for rib labeling, and a skeletonization-based method for centerline extraction.

    28
  • Current Progress and Challenges in Large-Scale 3D Mitochondria Instance Segmentation

    Daniel Franco-Barranco, Zudi Lin, Won-Dong Jang, Xueying Wang, Qijia Shen, Wenjie Yin, Yutian Fan, Mingxing Li, +19 more

    IEEE Transactions on Medical Imaging · 2023

    This paper presents eight top-performing approaches from the MitoEM challenge on mitochondria 3D instance segmentation from electron microscopy images, and proposes a new scoring system that better reflects the correctness of the segmentation results.

    27
  • AxonEM Dataset: 3D Axon Instance Segmentation of Brain Cortical Regions

    Donglai Wei, Kisuk Lee, Hanyu Li, Ran Lu, J. Alexander Bae, Zequan Liu, Lifu Zhang, Márcia dos Santos, +8 more

    Lecture notes in computer science · 2021

    The AxonEM dataset is introduced, which consists of two 30x30x30 um^3 EM image volumes from the human and mouse cortex, respectively, to provide dense 3D axon instance segmentation, enabling large-scale evaluation of axon reconstruction methods.

    27
  • Super-BPD: Super Boundary-to-Pixel Direction for Fast Image Segmentation

    Jianqiang Wan, Yang Liu, Donglai Wei, Xiang Bai, Yongchao Xu

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2020

    This paper proposes a fast image segmentation method based on a novel super boundary-to-pixel direction (super-BPD) and a customized segmentation algorithm with super-B PD, which are novel informative superpixels with robust direction similarity for fast grouping into segmentation regions.

    26
  • Deviation magnification

    Neal Wadhwa, Tali Dekel, Donglai Wei, Frédo Durand, William T. Freeman

    ACM Transactions on Graphics · 2015

    The framework, termed Deviation Magnification, takes a still image as input, fits parametric models to objects of interest, computes the geometric deviations, and renders an output image in which the departures from ideal geometries are exaggerated.

    25
  • Deep Rib Fracture Instance Segmentation and Classification From CT on the RibFrac Challenge

    Jiancheng Yang, Rui Shi, Liang Jin, Xiaoyang Huang, Kaiming Kuang, Donglai Wei, Shixuan Gu, Jianying Liu, +17 more

    IEEE Transactions on Medical Imaging · 2025

    The analysis revealed that several top rib fracture detection solutions achieved performance comparable or even better than human experts, and lay a foundation for future research and development in AI-assisted rib fracture diagnosis.

    23
  • Learning Vector Quantized Shape Code for Amodal Blastomere Instance Segmentation

    Won-Dong Jang, Donglai Wei, Xingxuan Zhang, Brian Leahy, Helen Y. Yang, James Tompkin, Dalit Ben‐Yosef, Daniel J. Needleman, +1 more

    IEEE International Symposium on Biomedical Imaging (ISBI) · 2023

    The proposed method would enable accurate measurement of blastomeres in In Vitro Fertilization (IVF) clinics, potentially increasing the IVF success rate and generalizability, and outperforms previous state-of-the-art methods.

    22
  • PyTorch Connectomics: A Scalable and Flexible Segmentation Framework for EM Connectomics

    Zudi Lin, Donglai Wei, Jeff William Lichtman, Hanspeter Pfister

    arXiv · 2021

    22
  • Two Stream Active Query Suggestion for Active Learning in Connectomics

    Zudi Lin, Donglai Wei, Won-Dong Jang, Siyan Zhou, Xupeng Chen, Xueying Wang, Richard Lee Schalek, Daniel Raimund Berger, +8 more

    Lecture notes in computer science · 2020

    An end-to-end active learning framework with the query suggestion method for 3D synapse detection and mitochondria segmentation in connectomics, and an unsupervised one optimized on all raw images to capture diverse image features, which can later be improved by fine-tuning on new labels.

    22
  • RNAG: a new Gibbs sampler for predicting RNA secondary structure for unaligned sequences

    Donglai Wei, Lauren A. Sugden, Charles E. Lawrence

    Bioinformatics · 2011

    A new global structural alignment algorithm, RNAG, is presented to predict consensus secondary structures for unaligned sequences using a blocked Gibbs sampling algorithm, which has a theoretical advantage in convergence time.

    21
  • A connectomic resource for neural cataloguing and circuit dissection of the larval zebrafish brain

    Mariela D. Petkova, Michał Januszewski, Tim M. Blakely, Kristian J. Herrera, Gregor F. P. Schuhknecht, Robert Tiller, Jinhan Choi, Richard Lee Schalek, +22 more

    bioRxiv (Cold Spring Harbor Laboratory) · 2025

    A correlated light and electron microscopy dataset from a 7-day-old larval zebrafish, integrating confocal imaging of genetically labeled excitatory and inhibitory neurons with nanometer-resolution serial section EM, demonstrates that this resource enables rigorous hypothesis testing as well as exploratory-driven circuit analysis.

    19
  • BiaPy: accessible deep learning on bioimages

    Daniel Franco-Barranco, Jesuś A. Andrés-San Román, Iván Hidalgo-Cenalmor, Lenka Backová, Aitor González-Marfil, Clément Caporal, Anatole Chessel, Pedro Gómez‐Gálvez, +4 more

    Nature Methods · 2025

    BiaPy is an open-source library and application that streamlines the use of common deep learning approaches for bioimage analysis by providing a ready-to-use environment with customizable templates that facilitate sophisticated bioimage analysis workflows.

    19
  • Multiplexed expansion revealing for imaging multiprotein nanostructures in healthy and diseased brain

    Jinyoung Kang, Margaret E. Schroeder, Young-Mi Lee, Chandni Kapoor, Eunah Yu, Tyler B. Tarr, Kat Titterton, Menglong Zeng, +5 more

    Nature Communications · 2024

    Multiplexed expansion revealing (multiExR) is reported, which enables high-fidelity antibody visualization of >20 proteins in the same specimen, over serial rounds of staining and imaging, for nanoscale localisation and antibody visualisation of >20 proteins in the same specimen.

    19
  • BlastAssist: a deep learning pipeline to measure interpretable features of human embryos

    Helen Y Yang, Brian Leahy, Won-Dong Jang, Donglai Wei, Yael Kalma, Roni Rahav, Ariella Carmon, Rotem Kopel, +7 more

    Human Reproduction · 2024

    The BlastAssist pipeline can measure a comprehensive set of interpretable features of human embryos and either outperform or perform comparably to embryologists and human experts in measuring these features.

    18
  • $$\mathrm R^2$$-Tuning: Efficient Image-to-Video Transfer Learning for Video Temporal Grounding

    Ye Liu, Jixuan He, Wanhua Li, Junsik Kim, Donglai Wei, Hanspeter Pfister, Chang Wen Chen

    Lecture notes in computer science · 2024

    18
  • A Data-Driven Regularization Model for Stereo and Flow

    Donglai Wei, Ce Liu, William T. Freeman

    International Conference on 3D Vision (3DV) · 2014

    This paper incorporates this data-driven regularization model for stereo or flow through transferring the shape information of the disparity or flow from semantically matched patches in the training database into a standard Markov Random Field model, inferred with a gradient descent algorithm and learned with a discriminative learning approach.

    18
  • The Wood Image Analysis and Dataset (WIAD): Open‐access visual analysis tools to advance the ecological data revolution

    Tim Rademacher, Bijan Seyednasrollah, David Basler, Jian Cheng, Tessa Mandra, Elise W. Miller, Zudi Lin, David A. Orwig, +5 more

    Methods in Ecology and Evolution · 2021

    The Wood Image Analysis and Dataset (WIAD) an open-source application including a web-interface to integrate visual analysis of wood samples, such as increment cores, thin sections or x-ray films, basic data processing, and arching of the images and derived data to facilitate transparency and reproducibility in studies using visual characteristics of wood.

    17
  • Parallel Separable 3D Convolution for Video and Volumetric Data Understanding

    Felix Gonda, Donglai Wei, Toufiq Parag, Hanspeter Pfister

    arXiv · 2018

    17
  • Texture-based Error Analysis for Image Super-Resolution

    Salma Abdel Magid, Zudi Lin, Donglai Wei, Yulun Zhang, Jinjin Gu, Hanspeter Pfister

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    This work uses a texture classifier, which enables it to assign patches with semantic labels, to identify the source of SR errors both globally and locally and hopes this work serves as an initial step for debugging blackbox SR networks.

    16
  • TriSAM: Tri-Plane SAM for Zero-Shot Cortical Blood Vessel Segmentation in VEM Images

    Jia Wan, Wanhua Li, Jason Ken Adhinarta, Atmadeep Banerjee, Evelina Sjöstedt, Jingpeng Wu, Jeff William Lichtman, Hanspeter Pfister, +1 more

    IEEE Journal of Biomedical and Health Informatics · 2025

    This paper introduces the first-in-class public benchmark, BvEM, designed specifically for cortical blood vessel segmentation in vEM images, and develops a zero-shot cortical blood vessel segmentation method named TriSAM, which leverages the powerful segmentation model SAM for 3D segmentation.

    14
  • Developmental Stage Classification of Embryos Using Two-Stream Neural Network with Linear-Chain Conditional Random Field

    Stanislav Lukyanenko, Won-Dong Jang, Donglai Wei, Robbert Struyven, Yoon Kim, Brian Leahy, Helen Y. Yang, Alexander M. Rush, +3 more

    Lecture notes in computer science · 2021

    This work proposes a two-stream model for developmental stage classification and develops a linear-chain conditional random field on top of neural network features extracted from the temporal and image streams to make use of both modalities.

    14
  • Detecting Synapse Location and Connectivity by Signed Proximity Estimation and Pruning with Deep Nets

    Toufiq Parag, Daniel Raimund Berger, Lee D. Kamentsky, Benedikt Staffler, Donglai Wei, Moritz N. Helmstaedter, Jeff William Lichtman, Hanspeter Pfister

    Lecture notes in computer science · 2019

    An algorithm to automatically predict the location as well as the direction of both dyadic and polyadic synapses is presented, which outperforms the existing methods for determining synapses in both rodent and fruit fly brain.

    14
  • OccTransformer: Improving BEVFormer for 3D camera-only occupancy prediction

    Liu, Jian, Sipeng Zhang, Chuixin Kong, Wenyuan Zhang, Yuhang Wu, Yikang Ding, Borun Xu, Ruibo Ming, +2 more

    arXiv · 2024

    13
  • ViMO - Visual Analysis of Neuronal Connectivity Motifs

    Jakob Troidl, Simon Warchol, Jinhan Choi, Jordan Matelsky, Nagaraju Dhanyasi, Xueying Wang, Brock A. Wester, Donglai Wei, +3 more

    IEEE Transactions on Visualization and Computer Graphics · 2023

    13
  • Efficient anatomical labeling of pulmonary tree structures via deep point-graph representation-based implicit fields

    K.L. Yu Z.Y. Xie, Jiancheng Yang, Donglai Wei, Ziqiao Weng, Pascal Fua

    Medical Image Analysis · 2024

    This work introduces graph learning on skeletonized structures, incorporating differentiable feature fusion for improved topology and long-distance context capture and employs an implicit function for efficient conversion of sparse representations into dense reconstructions end-to-end.

    11
  • Affordance-Aware Object Insertion via Mask-Aware Dual Diffusion

    Jixuan He, Wanhua Li, Liu Ye, Junsik Kim, Donglai Wei, Hanspeter Pfister

    arXiv · 2024

    This paper defines the affordance-aware object insertion task, which aims to seamlessly insert any object into any scene with various position prompts, and proposes the Mask-Aware Dual Diffusion model, which utilizes a dual-stream architecture to simultaneously denoise the RGB image and the insertion mask.

    11
  • VizAbility: Multimodal Accessible Data Visualization with Keyboard Navigation and Conversational Interaction

    Joshua Gorniak, Jacob Ottiger, Donglai Wei, Nam Wook Kim

    ACM Symposium on User Interface Software and Technology (UIST) · 2023

    VizAbility is introduced, a novel multimodal accessible system that combines keyboard navigation with conventional interaction, enabling individuals with visual impairments to actively engage with and explore data visualizations.

    11
  • Multiplexed volumetric CLEM enabled by scFvs provides insights into the cytology of cerebellar cortex

    Xiaomeng Han, Xiaotang Lu, Peter H. Li, Shuohong Wang, Richard Lee Schalek, Yaron Meirovitch, Zudi Lin, Jason Ken Adhinarta, +13 more

    Nature Communications · 2024

    An approach that uses fluorescent single-chain variable fragments (scFvs) to perform multiplexed detergent-free immunolabeling and volumetric-correlated-light-and-electron-microscopy on the same sample suggests potential for molecularly annotated connectomic data.

    10
  • Ultrasound for assessing paediatric body composition and nutritional status: Scoping review and future directions

    Bryan J. Ranger, Allison Lombardi, Susie Kwon, Mary Loeb, Hayoung Cho, Keshi He, Donglai Wei, Jinhee Park

    Acta Paediatrica · 2024

    10
  • One-Dimensional Convolutional Neural Network Model for Abnormal Driving Behaviors Detection Using Smartphone Sensors

    Jing Liu, Yang Liu, Jieyu Lin, Donglai Wei, Xu Xia, Wei Ni, Xiaohong Huang, Liang Song

    International Conference on Networking Systems of AI (INSAI) · 2021

    9
  • Mining Visual Evolution in 21 Years of Web Design

    Ali Jahanian, Phillip Isola, Donglai Wei

    Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems · 2017

    This paper presents a curated dataset of 21 years of web design, scraped from the Internet Archive, and demonstrates how the data can be modeled with deep neural networks to enable novel design applications, such as predicting the apparent year of a web design.

    9
  • 3D Domain Adaptive Instance Segmentation via Cyclic Segmentation GANs

    Leander Lauenburg, Zudi Lin, Ruihan Zhang, Márcia dos Santos, Siyu Huang, Ignacio Arganda‐Carreras, Edward S. Boyden, Hanspeter Pfister, +1 more

    IEEE Journal of Biomedical and Health Informatics · 2023

    The proposed CySGAN outperforms pre-trained generalist models, feature-level domain adaptation models, and the baselines that conduct image translation and segmentation sequentially and benchmarked on the task of 3D neuronal nuclei segmentation with annotated electron microscopy images and unlabeled expansion microscope data.

    8
  • Decoding of the neural representation of the visual RGB color model

    Yijia Wu, Yanjing Mao, Kaiqiang Feng, Donglai Wei, Liang Song

    PeerJ Computer Science · 2023

    It is shown that RGB color information can be decoded from EEG data and, with the task-irrelevant paradigm, features can bedecoded across fast changes in VEP stimuli, consistent with the theory of both event-related potential (ERP) and P300 mechanisms.

    8
  • Domain-Scalable Unpaired Image Translation via Latent Space Anchoring

    Siyu Huang, Jie An, Donglai Wei, Zudi Lin, Jiebo Luo, Hanspeter Pfister

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2023

    This work proposes a new domain-scalable UNIT method, termed as latent space anchoring, which can be efficiently extended to new visual domains and does not need to fine-tune encoders and decoders of existing domains.

    8
  • Edge-colored directed subgraph enumeration on the connectome

    Brian Matejek, Donglai Wei, Tianyi Chen, Charalampos E. Tsourakakis, Michael Mitzenmacher, Hanspeter Pfister

    Scientific Reports · 2022

    A parallel, general-purpose sub graph enumeration strategy to count motifs in the connectome is proposed and a divide-and-conquer community-based subgraph enumeration technique is introduced that allows for enumeration per brain region and allows for differentiation of edges by types to better reflect the underlying biological properties of the graph.

    8
  • Genopathomic profiling identifies signatures for immunotherapy response of lung adenocarcinoma via confounder-aware representation learning

    Jiajun Deng, Jiancheng Yang, Likun Hou, Junqi Wu, Yi Fei He, Mengmeng Zhao, Bingbing Ni, Donglai Wei, +6 more

    iScience · 2022

    PITER was found to be a useful biomarker to identify patients of lung adenocarcinoma with both favorable progression-free and overall survival in the immunotherapy cohort, and indicated the biological basis in identifying patients with favorable outcome of immunotherapy.

    8
  • SCMM: Calibrating cross-modal representations for text-based person search

    Jing Liu, Donglai Wei, Yang Liu, Sipeng Zhang, Tong Yang, Wei Zhou, Weiping Ding, Victor C. M. Leung

    Pattern Recognition · 2026

    Sew Calibration and Masked Modeling is a unified framework that calibrates cross-modal representations for effective multimodal visual-textual pattern matching and strikes an optimal balance between representation expressiveness and computational efficiency by adopting a training-only decoder design.

    7
  • Ultrastructural reconstruction of the endodermal nerve net of Hydra vulgaris

    Shulin Zhang, Netanel Ofer, Christophe Dupré, Xueying Wang, Richard Lee Schalek, Yuelong Wu, Michael Lin, Mark D. Roth, +7 more

    Current Biology · 2025

    It is speculated that Hydra's endodermal nerve net operates as a non-synaptic circuit, using a neuroendocrine chemical network to implement its functional operations.

    7
  • Structure-Preserving Instance Segmentation via Skeleton-Aware Distance Transform

    Zudi Lin, Donglai Wei, Aarush Gupta, Xingyu Liu, Deqing Sun, Hanspeter Pfister

    Lecture notes in computer science · 2023

    A skeleton-aware distance transform is proposed that combines the merits of object skeleton in preserving connectivity and DT in modeling geometric arrangement to represent instances with arbitrary structures and achieves state-of-the-art performance.

    7
  • Attention-Based Auto-Encoder Framework for Abnormal Driving Detection

    Jing Liu, Yang Liu, Donglai Wei, Wei Ni, Xinhua Zeng, Liang Song

    IEEE International Symposium on Circuits and Systems proceedings · 2022

    7
  • Instance Segmentation of Unlabeled Modalities via Cyclic Segmentation GAN

    Leander Lauenburg, Zudi Lin, Ruihan Zhang, Márcia dos Santos, Siyu Huang, Ignacio Arganda‐Carreras, Edward S. Boyden, Hanspeter Pfister, +1 more

    arXiv · 2022

    This work proposes a novel Cyclic Segmentation Generative Adversarial Network (CySGAN) that conducts image translation and instance segmentation jointly using a unified framework and introduces additional self-supervised and segmentation-based adversarial objectives to improve the model performance by leveraging unlabeled target domain images.

    6
  • A Survey of Recent Advances in Driving Behavior Analysis

    Jing Liu, Yang Liu, Chengwen Tian, Donglai Wei, Mengyang Zhao, Wei Ni, Xinhua Zeng, Liang Song

    International Symposium on Smart and Healthy Cities (ISHC) · 2021

    6
  • Consistent Recurrent Neural Networks For 3d Neuron Segmentation

    Felix Gonda, Donglai Wei, Hanspeter Pfister

    IEEE International Symposium on Biomedical Imaging (ISBI) · 2021

    A recurrent network for 3D reconstruction of neurons that sequentially generates binary masks for every object in an image with spatio-temporal consistency is presented and achieved state-of-the-art performance on the SNEMI3D challenge.

    6
  • Synapse-Aware Skeleton Generation for Neural Circuits

    Brian Matejek, Donglai Wei, Xueying Wang, Jinglin Zhao, Kálmán Palágyi, Hanspeter Pfister

    Lecture notes in computer science · 2019

    This work proposes a synapse-aware skeleton generation strategy to transform the reconstructed volumes into an information-rich yet abstract format on which neuroscientists can perform biological analysis and run simulations and demonstrates the results on three large-scale connectomic datasets.

    6
  • Scalable and multiplexed recorders of gene regulation dynamics across weeks

    Lirong Zheng, Dongqing Shi, Yixiao Yan, Bingxin Zhou, Jormay Lim, Yongjie Hou, Bobae An, Jason Ken Adhinarta, +15 more

    Nature · 2026

    CytoTape reveals that divergent transcriptional trajectories correlate with transcriptional history and signal integration, and that distinct immediate early genes (IEGs) exhibit complex temporal correlations within single cells, and establishes a versatile platform for scalable and multiplexed analysis of cell physiological processes in vitro and in vivo.

    5
  • WASPSYN: A Challenge for Domain Adaptive Synapse Detection in Microwasp Brain Connectomes

    Yicong Li, Wanhua Li, Qi Chen, Wei Huang, Yuda Zou, Xin Xiao, Kazunori Shinomiya, Pat Gunn, +8 more

    IEEE Transactions on Medical Imaging · 2024

    To enable developments of domain adaptive synapse detection methods for large-scale connectomics applications, 14 image volumes from a biologically diverse set of Megaphragma viggianii brain regions originating from three different whole-brain datasets are annotated and the WASPSYN challenge at ISBI 2023 is organized.

    5
  • Learning Gaze-aware Compositional GAN from Limited Annotations

    Nerea Aranjuelo, Siyu Huang, Ignacio Arganda‐Carreras, Luis Unzueta, Oihana Otaegui, Hanspeter Pfister, Donglai Wei

    Proceedings of the ACM on Computer Graphics and Interactive Techniques · 2024

    This work proposes a Gaze-aware Compositional GAN that learns to generate annotated facial images from a limited labeled dataset and transfers this model to an unlabeled data domain to take advantage of the diversity it provides.

    5
  • Multiplexed volumetric CLEM enabled by antibody derivatives provides new insights into the cytology of the mouse cerebellar cortex

    Xiaomeng Han, Xiaotang Lu, Peter H. Li, Shuohong Wang, Richard Lee Schalek, Yaron Meirovitch, Zudi Lin, Jason Ken Adhinarta, +11 more

    bioRxiv (Cold Spring Harbor Laboratory) · 2023

    This work developed an approach that uses small fluorescent single-chain variable fragment (scFv) immuno-probes to perform multiplexed detergent-free immuno-labeling and ssEM on the same samples to document a poorly described cell type in the cerebellum, two types of mossy fiber terminals, and the subcellular localization of one type of ion channel.

    5
  • High-Throughput Microscopy Image Deblurring with Graph Reasoning Attention Network

    Yulun Zhang, Donglai Wei, Richard Lee Schalek, Yuelong Wu, Stephen G. Turney, Jeff William Lichtman, Hanspeter Pfister, Yun Fu

    IEEE International Symposium on Biomedical Imaging (ISBI) · 2023

    5
  • YouMVOS: An Actor-centric Multi-shot Video Object Segmentation Dataset

    Donglai Wei, Siddhant Kharbanda, Sarthak Arora, Roshan Roy, Nishant Jain, Akash Palrecha, Tanav Shah, Shray Mathur, +10 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2022

    5
  • See the World, Discover Knowledge: A Chinese Factuality Evaluation for Large Vision Language Models

    Jihao Gu, Yingyao Wang, Pi Bu, Chen Wang, Ziming Wang, Tengtao Song, Donglai Wei, Jiale Yuan, +11 more

    Findings of the Association for Computational Linguistics: ACL 2025 · 2025

    This paper introduces the first factuality-based visual question-answering benchmark in Chinese, named ChineseSimpleVQA, aimed at assessing the visual factuality of LVLMs across 8 major topics and 56 subtopics, and decoupling the visual factuality into two parts: seeing the world and discovering knowledge.

    4
  • Mapping Alzheimer’s Molecular Pathologies in Large-Scale Connectomics Data: A Publicly Accessible Correlative Microscopy Resource

    Xiaomeng Han, Peter H. Li, Shuohong Wang, Tim M. Blakely, Sneha Aggarwal, Bhavika Gopalani, Morgan Sanchez, Richard Lee Schalek, +13 more

    bioRxiv (Cold Spring Harbor Laboratory) · 2023

    A volumetric-correlated-light-and-electron microscopy protocol using fluorescent nanobodies to localize Aβ and pTau within a large-scale connectomics dataset from the hippocampus of the 3xTg AD mouse model is presented, uncovered new localizations of Aβ and pTau.

    4
  • The XPRESS Challenge: Xray Projectomic Reconstruction -- Extracting Segmentation with Skeletons

    Nguyen, Tri, Mukul Narwani, Larson, Mark, Yicong Li, Shuhan Xie, Hanspeter Pfister, Donglai Wei, Nir Shavit, +4 more

    arXiv · 2023

    This task provides volumetric XNH images of cortical white matter axons from the mouse brain along with ground truth annotations for axon trajectories along with two types of ground-truth annotations: a small volume of voxel-wise annotations and a larger volume with skeleton-based annotations.

    4
  • A Topological Nomenclature for 3D Shape Analysis in Connectomics

    Abhimanyu Talwar, Zudi Lin, Donglai Wei, Yuesong Wu, Bowen Zheng, Jinglin Zhao, Won-Dong Jang, Xueying Wang, +2 more

    IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · 2020

    A novel topological nomenclature system to name objects like the appellation for chemical compounds to promote neuroscience analysis based on their skeletal structures by converting the volumetric representation into the topology-preserving reduced graph to untangle the objects.

    4
  • Learning Vector Quantized Shape Code for Amodal Blastomere Instance Segmentation

    Won-Dong Jang, Donglai Wei, Xingxuan Zhang, Brian Leahy, Helen Y. Yang, James Tompkin, Dalit Ben‐Yosef, Daniel J. Needleman, +1 more

    arXiv · 2020

    4
  • Frenet–Serret Frame-Based Decomposition for Part Segmentation of 3-D Curvilinear Structures

    Shixuan Gu, Jason Ken Adhinarta, Mikhail Bessmeltsev, Jiancheng Yang, Yongjie Jessica Zhang, Wenjie Yin, Daniel Raimund Berger, Jeff William Lichtman, +2 more

    IEEE Transactions on Medical Imaging · 2025

    A novel Frenet-Serret Frame-based Decomposition is introduced, which decomposes 3D curvilinear structures into a globally smooth continuous curve that captures the overall shape, and a cylindrical primitive that encodes local geometric properties.

    3
  • Reconstructing sources location of visual color cortex by the task-irrelevant visual stimuli through machine learning decoding

    Yijia Wu, Yanni Zhang, Yanjing Mao, Kaiqiang Feng, Donglai Wei, Liang Song

    Heliyon · 2022

    It is shown that visual color EEG in V1 can reconstruct endocranial neuronal source location, through the machine learning decoding of channel location, and it is explored to trace the brain activity neural source location of EEG inversion problem and assess its reconstructive possibility.

    3
  • Scalable Biologically-Aware Skeleton Generation for Connectomic Volumes

    Brian Matejek, Tim Franzmeyer, Donglai Wei, Xueying Wang, Jinglin Zhao, Kálmán Palágyi, Jeff William Lichtman, Hanspeter Pfister

    IEEE Transactions on Medical Imaging · 2022

    3
  • Channel Embedding for Informative Protein Identification from Highly Multiplexed Images

    Salma Abdel Magid, Won-Dong Jang, Denis Schapiro, Donglai Wei, James Tompkin, Peter Karl Sorger, Hanspeter Pfister

    Lecture notes in computer science · 2020

    3
  • Learning Deformations with Parallel Transport

    Donglai Wei, Dahua Lin, John Sheridan Fisher

    Lecture notes in computer science · 2012

    This work aims to provide a generative model that explicitly decouples deformation from appearance, which is fundamentally different from the prior work that focuses on deformation-resilient features or metrics.

    3
  • NucleoNet and DropNet: Generalist deep learning models for instance segmentation of nuclei and lipid droplets from electron microscopy images

    Abhishek Bhardwaj, Christopher W. Dell, Melissa R. Mikolaj, Helen Spiers, Adam Harned, Kuppusamy Balamurugan, Peng Liu, Donglai Wei, +2 more

    bioRxiv (Cold Spring Harbor Laboratory) · 2026

    C crowdsourced the manual step of labeling nuclei and lipid droplets from complex cellular EM images and trained Panoptic DeepLab (PDL) models on these large, heterogenous annotated datasets as well as on publicly available vEM datasets, yielding high-quality models for nuclei and LDs.

    2
  • Developing a Deep Learning Approach for Automated Body Composition Prediction in Newborns Using Ultrasound Images

    Keshi He, Yi Li, Hayoung Cho, Julia Hohenberg, Emily Nagel, Sara E. Ramel, Katherine Bell, Jinhee Park, +2 more

    IEEE Access · 2025

    This study represents the first demonstration of deep learning for automated human body composition prediction from ultrasound images and lays a critical foundation for a novel ultrasound scanning and interpretation protocol to assess malnutrition.

    2
  • Developmental Connectomics of the Mouse Cerebellum

    Nagaraju Dhanyasi, Yaron Meirovitch, Vikrant Kapoor, Alyssa Michelle Wilson, Shuohong Wang, Donglai Wei, Richard Lee Schalek, Rong Ma, +16 more

    bioRxiv (Cold Spring Harbor Laboratory) · 2025

    A mechanistic sequence in which early afferent activity and transient cellular structures guide the selective wiring and expansion of parallel fiber input to Purkinje cells, establishing developmental principles that ensure functional specificity in the mature brain is uncovered.

    2
  • Enhancing Newborn Health Assessment: Ultrasound-based Body Composition Prediction Using Deep Learning Techniques

    Keshi He, Julia Hohenberg, Yi Li, Audrey Xiao, Hayoung Cho, Emily Nagel, Sara E. Ramel, Katherine Bell, +3 more

    Ultrasound in Medicine & Biology · 2025

    Deep learning provides a promising approach for predicting body composition with ultrasound and a valuable tool for assessing nutritional status in neonatal care.

    2
  • WormID-Bench: A Benchmark for Whole-Brain Activity Extraction in C. elegans

    Jason Ken Adhinarta, Jizheng Dong, Tianxiao He, Junxiang Huang, Daniel Sprague, Jia Wan, Hyun Jee Lee, Zikai Yu, +6 more

    bioRxiv (Cold Spring Harbor Laboratory) · 2025

    WormID-Bench is introduced, a large-scale, multi-laboratory dataset comprising 118 worms from five distinct research groups, along with standardized evaluation metrics for detection, identification, and tracking, which reveals that existing computational approaches show substantial room for improvement in sensitivity, specificity, and generalization across diverse experimental conditions.

    2
  • MitoEM 2.0: A Benchmark for Challenging 3D Mitochondria Instance Segmentation from EM Images

    Peng Liu, Boyu Shen, Liyuan Liu, Qiong Wang, Shulin Zhang, Abhishek Bhardwaj, Ignacio Arganda‐Carreras, Kedar Narayan, +1 more

    bioRxiv (Cold Spring Harbor Laboratory) · 2025

    MitoEM 2.0 facilitates robust model development and fair comparison across methods while supporting reuse in bioimage analysis, algorithm benchmarking, and teaching, and facilitates robust model development and fair comparison across methods while supporting reuse in bioimage analysis, algorithm benchmarking, and teaching.

    2
  • Two-stage error detection to improve electron microscopy image mosaicking

    Jiahao Shi, Hongyu Ge, Shuohong Wang, Donglai Wei, Jiancheng Yang, Ao Cheng, Richard Lee Schalek, Jun Qing Guo, +3 more

    Computers in Biology and Medicine · 2024

    A two-stage error detection method that firstly uses point-based error detection in combination with a hybrid feature framework to expedite the stitching computation while maintaining high accuracy and following is the second detection of unresolved errors with a newly designed metric of EM stitched image quality assessment (EMSIQA).

    2
  • An Out-of-Domain Synapse Detection Challenge for Microwasp Brain Connectomes

    Jingpeng Wu, Yicong Li, Nishika Gupta, Kazunori Shinomiya, Gunn, Pat, Alexey A. Polilov, Hanspeter Pfister, Dmitri B. Chklovskii, +1 more

    arXiv · 2023

    Domain adaptation and generalization approaches were proposed to address similar issues for natural images, which were less evaluated on connectomics data due to a lack of out-of-domain benchmarks.

    2
  • The time is ripe to reverse engineer an entire nervous system: simulating behavior from neural interactions

    Gal Haspel, Baker, Ben, Beets, Isabel, Edward S. Boyden, Brown, Jeffrey, George McDonald Church, Netta Cohen, Daniel A. Colón‐Ramos, +22 more

    arXiv · 2023

    2
  • Decoding Human Visual Colour EEG Information Using Machine Learning and Visual Evoked Potentials

    Yijia Wu, Xinhua Zeng, Kaiqiang Feng, Donglai Wei, Liang Song

    Research Square · 2022

    The experimental results show that the VEPs can be used for reliable colour real-time decoding in a new kind of task-irrelevant, simple and fast-stimulus BCI-based experimental paradigm that relies on visual evoked potentials (VEPs) during colour observation.

    2
  • Visual Color Decoding Using Brain-Computer Interfaces

    Yijia Wu, Xinhua Zeng, Kaiqiang Feng, Donglai Wei, Liang Song

    International Conference on Networking Systems of AI (INSAI) · 2021

    2
  • Simultaneous brain-wide single-cell recording resolves spatiotemporal memory architecture

    Dongqing Shi, Yongjie Hou, Yixiao Yan, Tian-hao Zhang, William C. Joesten, Peng Liu, Yixuan Wang, Mehul Gautam, +13 more

    bioRxiv (Cold Spring Harbor Laboratory) · 2026

    GLOBE resolves the brain-wide spatiotemporal structure of single-cell activity, revealing that Fos transcriptional dynamics associated with fear learning and memory retrieval are distributed across the brain with region-specific temporal heterogeneity, and that the variance of this structure scales down as the number of sampled cells increases.

    1
  • VesiclePy: A machine learning vesicle analysis toolbox for volume electron microscopy

    Jason Ken Adhinarta, Yutian Fan, Adam Gohain, Michael Che-Hung Lin, Paige Nurkin, Richard Ren, Mark D. Roth, Shulin Zhang, +3 more

    PLoS Computational Biology · 2026

    1
  • SocialGPT: Prompting LLMs for Social Relation Reasoning via Greedy Segment Optimization

    Wanhua Li, Zibin Meng, Jiawei Zhou, Donglai Wei, Chuang Gan, Hanspeter Pfister

    neural information processing systems · 2024

    1
  • Learning Causal Domain-Invariant Temporal Dynamics for Few-Shot Action Recognition

    Yuke Li, Guangyi Chen, Ben Abramowitz, Stefano Anzellott, Donglai Wei

    arXiv · 2024

    DITeD is proposed, a generative framework with a two-stage training strategy during pre-training that explicitly model invariant dynamics including temporal dynamic generation and transitions, and the variant visual and domain encoders, and validate that the learned temporal dynamic transition and temporal dynamic generation modules possess transferable qualities.

    1
  • Learning Socio-Temporal Graphs for Multi-Agent Trajectory Prediction

    Yuke Li, Lixiong Chen, Guangyi Chen, Ching‐Yao Chan, Kun Zhang, Stefano Anzellotti, Donglai Wei

    Proceedings of the 5th International Workshop on Human-centric Multimedia Analysis · 2024

    This work introduces a Directed Acyclic Graph-based structure, which is term Socio-Temporal Graph (STG), to explicitly capture pair-wise socio-temporal interactions among a group of people across both space and time.

    1
  • Multi-Task Curriculum Learning for Partially Labeled Data

    Won-Dong Jang, Stanislav Lukyanenko, Donglai Wei, Jiancheng Yang, Brian Leahy, Helen Y. Yang, Dalit Ben‐Yosef, Daniel J. Needleman, +1 more

    IEEE International Symposium on Biomedical Imaging (ISBI) · 2023

    This work proposes a multi-task curriculum learning method that prioritizes less performing tasks during training by setting different supervised learning frequencies for each task, and outperforms standard approaches on one biomedical and two natural image datasets.

    1
  • Author response for "The Wood Image Analysis and Dataset (WIAD): open‐access visual analysis tools to advance the ecological data revolution"

    Tim Rademacher, Bijan Seyednasrollah, David Basler, Jian Cheng, Tessa Mandra, Elise Miller, Zuid Lin, David A. Orwig, +5 more

    2021

    1
  • Rib Fracture Detection and Classification Challenge

    Jiancheng Yang, Xiaoyang Huang, Jiajun Chen, Donglai Wei, Bingbing Ni, Liang Jin, Ming Li

    Zenodo (CERN European Organization for Nuclear Research) · 2020

    1
  • Benchmarking Vision-Language Models on Synapse Detection and Proofreading in Connectomics

    Yicong Li, Junjie Wang, Leander Lauenburg, Ella Hugie, Alexandra Irger, Wanhua Li, Donglai Wei, Hanspeter Pfister

    arXiv · 2026

    –
  • Protocol for a prospective cohort study of multimodal ultrasound and artificial intelligence for maternal body composition assessment in Ethiopia

    Bryan J. Ranger, Rubyane Franca, Donglai Wei, Melkamu Berhane, Tsinuel Girma, Demisew Amenu Sori, Jinhee Park

    2026

    –
  • NuGraph: Graph-Based Reasoning over 3D Primitives for Nucleus Segmentation Correction

    Mao Wang, Peng Liu, Yi Zhao, Bingzhang Wang, Jia Wan, Liqiang Nie, Donglai Wei

    bioRxiv (Cold Spring Harbor Laboratory) · 2026

    NuGraph is proposed, a graph-based reasoning framework that operates over atomic 3D primitives obtained by decomposing erroneous masks that encodes primitive geometry via a 3D point-cloud backbone and performs global relational reasoning through graph attention, capturing inter-primitive dependencies across entire clusters rather than isolated pairs.

    –
  • A machine learning approach to using ultrasound for body composition and nutritional status assessment in newborns: a pilot study protocol

    Bryan J. Ranger, Marisa Albert, Ji In Kim, Hayoung Cho, Julie Hohenberg, Keshi He, Donglai Wei, Melkamu Berhane, +4 more

    Pilot and Feasibility Studies · 2026

    This study will determine the feasibility of integrating ultrasound-based body composition assessment into neonatal clinical workflows as a potential future application, and establish a foundation for artificial intelligence (AI)-enabled analysis to enable whole-body composition estimation from ultrasound images.

    –
  • Deep Learning for Clinical Ultrasound Imaging: From Supervised Approaches to Foundation Models

    Keshi He, Donglai Wei, Bryan J. Ranger

    IEEE Journal of Biomedical and Health Informatics · 2025

    –
  • SynAnno: Interactive Guided Proofreading of Synaptic Annotations

    Leander Lauenburg, Jakob Troidl, Adam Gohain, Zudi Lin, Hanspeter Pfister, Donglai Wei

    IEEE Transactions on Visualization and Computer Graphics · 2025

    –
  • S3-TTA: Scale-Style Selection for Test-Time Augmentation in Biomedical Image Segmentation

    Kangxian Xie, Siyu Huang, Sebastián Andrés Cajas, Hanspeter Pfister, Donglai Wei

    IEEE International Symposium on Biomedical Imaging (ISBI) · 2024

    A new TTA framework is proposed, S3-TTA, which selects the suitable image scale and style for each test image based on a transformation consistency metric, and constructs an end-to-end augmentation-segmentation joint-training pipeline to ensure a task-oriented augmentation.

    –
  • Real-Time Point of Interest Segmentation for Electron Microscopy Images via Machine Learning

    Michael Che-Hung Lin, Yousra Nahas, Sergei Prokhorenko, Sujit Das, Ruijuan Xu, Harold Y. Hwang, R. Ramesh, L. Bellaïche, +3 more

    Microscopy and Microanalysis · 2024

    –
  • Anatomics MLT, an AI tool for large scale quantification of ultrastructural traits

    Aaron Brookhouse, Yuting Ji, Jan Knoblauch, Petr Gaburak, Brittney M Wager, Zudi Lin, Hans‐Henning Kunz, Assefaw Hadish Gebremedhin, +4 more

    bioRxiv (Cold Spring Harbor Laboratory) · 2024

    This work developed much improved fixation and embedding protocols for plants to drastically reduce processing artifacts and generated an easy-to-use AI tool for quantitative analysis and visualization of large-scale data sets.

    –
  • RnR-Exm Validation Dataset

    Emma Besier, Donglai Wei, Hanspeter Pfister, Edward S. Boyden, Ruihan Zhang, Yosuke Bando, Quéméner, Yves, Mansour Alawi, +6 more

    Zenodo (CERN European Organization for Nuclear Research) · 2023

    –
  • Real-time Image Deblurring to Improve Throughput of Serial-Section Volume Electron Microscopy for Neural Connectomic Studies

    Richard Lee Schalek, N Parikh, Yuelong Wu, Jeff William Lichtman, Donglai Wei

    Microscopy and Microanalysis · 2023

    A machine learning-based, real-time image deblurring tool that eliminates the need for retaking out-of-focus images and improves the overall image acquisition performance of smaller datasets where labor costs, storage costs, and machine rental costs are major project considerations.

    –
  • RnR-ExM Test Dataset

    Emma Besier, Donglai Wei, Hanspeter Pfister, Edward S. Boyden, Ruihan Zhang, Yosuke Bando, Quéméner, Yves, Mansour Alawi, +6 more

    Zenodo (CERN European Organization for Nuclear Research) · 2023

    –
  • Development and Validation of a Pathomic Biomarker for Immunotherapy Response via Confounder-Aware Representation Learning

    Jiajun Deng, Jiancheng Yang, Likun Hou, Junqi Wu, Yi He, Mengmeng Zhao, Bingbing Ni, Donglai Wei, +6 more

    SSRN Electronic Journal · 2022

    –
  • Genopathomic Profiling Identifies Signatures for Immunotherapy Response of Lung Cancer Via Confounder-Aware Representation Learning

    Jiajun Deng, Jiancheng Yang, Likun Hou, Junqi Wu, Yi He, Mengmeng Zhao, Bingbing Ni, Donglai Wei, +6 more

    SSRN Electronic Journal · 2022

    –
  • RnR-ExM Training Dataset

    Emma Besier, Donglai Wei, Hanspeter Pfister, Edward S. Boyden, Ruihan Zhang, Yosuke Bando, Quéméner Yves, Mansour Alawi, +6 more

    Zenodo (CERN European Organization for Nuclear Research) · 2022

    –
  • Where and What We Should Look at: A Cross-Modal Fusion Method with Attention for Object Counting

    Shiyu Zhao, Donglai Wei, Liang Song

    International Symposium on Smart and Healthy Cities (ISHC) · 2022

    –
  • Object Propagation via Inter-Frame Attentions for Temporally Stable Video Instance Segmentation

    Anirudh Srinivasan Chakravarthy, Won-Dong Jang, Zudi Lin, Donglai Wei, Song Bai, Hanspeter Pfister

    arXiv · 2021

    –
  • Intervention-based Recurrent Casual Model for Non-stationary Video Causal Discovery

    Yuke Li, Kenneth Li, Pin Wang, Donglai Wei, Hanspeter Pfister, Ching‐Yao Chan

    2021

    –
  • Discovering physics and design trends from visual temporal structures

    Donglai Wei

    DSpace@MIT (Massachusetts Institute of Technology) · 2017

    This dissertation builds computational models to discover and apply the knowledge of the physics for arrow of time, and the design trends for web pages from image sequences, and investigates the evolution of visual cues and layout in web page design through screenshots over time.

    –
  • Data driven stereo vision

    Donglai Wei

    DSpace@MIT (Massachusetts Institute of Technology) · 2013

    –
  • Smoothness- transferred random field

    Donglai Wei

    2013

    A new random field model, smoothness-transfer random field (ST-RF) model, for image modeling that with transferred ground truth smoothness, random field can achieve state-of-the-art results in stereo matching and image denoising on standard benchmark dataset.

    –

Publication data from OpenAlex, with missing venues and authors filled in from Crossref; citation counts are the higher of OpenAlex and Semantic Scholar, last synced 2026-10-15. One-sentence summaries under some papers are written by Semantic Scholar’s model. Citation counts may be lower than on Google Scholar, which indexes more sources.

Report an error

Wrong papers, two people merged into one, or a profile that should not be here? Tell us and we will fix or hide it.

Sign in to report