Is this you? Claim this profile to correct it, add a bio and choose the work people see first.

Claim this profile

Academic lineage

Possible advisorsa guess from early papers, not confirmed

  • Xiaoou Tang

    Possible advisor · last author on 4 of their early first-author papers, 2010–2012

    Suggested from co-authorship
  • William T. Freeman

    Possible advisor · last author on 3 of their early first-author papers, 2014–2015

    Suggested from co-authorship

Is this you? Claim this profile to confirm or dismiss it.

Works105 from public data

TitleCited by
  • Video Enhancement with Task-Oriented Flow

    Tianfan Xue, Baian Chen, Jiajun Wu, Donglai Wei, William T. Freeman

    DSpace@MIT (Massachusetts Institute of Technology) · 2019

    T task-oriented flow (TOFlow), a motion representation learned in a self-supervised, task-specific manner, is proposed, which outperforms traditional optical flow on standard benchmarks as well as the Vimeo-90K dataset in three video processing tasks.

    1,801
  • Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modeling

    Jiajun Wu, Chengkai Zhang, Tianfan Xue, William T. Freeman, Joshua B. Tenenbaum

    arXiv · 2016

    1,394
  • Unprocessing Images for Learned Raw Denoising

    Tim Brooks, Ben Mildenhall, Tianfan Xue, Jiawen Chen, Dillon Sharlet, Jonathan T. Barron

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2019

    This work presents a technique to “unprocess” images by inverting each step of an image processing pipeline, thereby allowing us to synthesize realistic raw sensor measurements from commonly available Internet photos.

    572
  • Pix3D: Dataset and Methods for Single-Image 3D Shape Modeling

    Xingyuan Sun, Jiajun Wu, Xiuming Zhang, Zhoutong Zhang, Chengkai Zhang, Tianfan Xue, Joshua B. Tenenbaum, William T. Freeman

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2018

    A novel model is designed that simultaneously performs 3D reconstruction and pose estimation; this multi-task learning approach achieves state-of-the-art performance on both tasks.

    529
  • Visual Dynamics: Probabilistic Future Frame Synthesis via Cross Convolutional Networks

    Tianfan Xue, Jiajun Wu, Katherine L. Bouman, William T. Freeman

    arXiv · 2016

    320
  • Single Image 3D Interpreter Network

    Yuandong Tian, Jiajun Wu, Tianfan Xue, Joseph J. Lim, Joshua B. Tenenbaum, Antonio B. Torralba, William T. Freeman

    DSpace@MIT (Massachusetts Institute of Technology) · 2016

    This work proposes 3D INterpreter Network (3D-INN), an end-to-end framework which sequentially estimates 2D keypoint heatmaps and 3D object structure, trained on both real 2D-annotated images and synthetic 3D data, and achieves state-of-the-art performance on both 2DKeypoint estimation and3D structure recovery.

    292
  • A computational approach for obstruction-free photography

    Tianfan Xue, Michael Rubinstein, Ce Liu, William T. Freeman

    ACM Transactions on Graphics · 2015

    A unified computational approach for taking photos through reflecting or occluding elements such as windows and fences by instructing the user to take a short image sequence while slightly moving the camera.

    253
  • MarrNet: 3D Shape Reconstruction via 2.5D Sketches

    Jiajun Wu, Yifan Wang, Tianfan Xue, Xingyuan Sun, William T. Freeman, Joshua B. Tenenbaum

    arXiv · 2017

    244
  • EmbodiedScan: A Holistic Multi-Modal 3D Perception Suite Towards Embodied AI

    Tai Wang, Xiaohan Mao, Chenming Zhu, Runsen Xu, Ruiyuan Lyu, Peisen Li, Xiao Chen, Wenwei Zhang, +6 more

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    This work introduces EmbodiedScan, a multi-modal, ego-centric 3D perception dataset and benchmark for holistic 3D scene understanding, and a baseline framework named Embodied Perceptron, capable of processing an arbitrary number of multi-modal inputs and demonstrating remarkable 3D perception capabilities.

    206
  • Teaching Large Language Models to Regress Accurate Image Quality Scores Using Score Distribution

    Zhiyuan You, Xin Chen Cai, Jinjin Gu, Tianfan Xue, Chao Dong

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2025

    The distribution-based Depicted image Quality Assessment model for Score regression (DeQA-Score) is developed, showing that DeQA-Score stably outperforms baselines in score regression and can predict the score distribution that closely aligns with human annotations.

    183
  • How to Train Neural Networks for Flare Removal

    Yicheng Wu, Qiurui He, Tianfan Xue, Rahul Dev Garg, Jiawen Chen, Ashok Veeraraghavan, Jonathan T. Barron

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2021

    Experiments show that the data synthesis approach is critical for accurate flare removal, and that models trained with the technique generalize well to real lens flares across different scenes, lighting conditions, and cameras.

    113
  • Joint Example-Based Depth Map Super-Resolution

    Yanjie Li, Tianfan Xue, Lifeng Sun, Jianzhuang Liu

    IEEE International Conference on Multimedia and Expo (ICME) · 2012

    99
  • Best-Buddies Similarity—Robust Template Matching Using Mutual Nearest Neighbors

    Shaul Oron, Tali Dekel, Tianfan Xue, William T. Freeman, Shai Avidan

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2017

    The Best-Buddies Similarity (BBS) is proposed, a useful, robust, and parameter-free similarity measure between two sets of points that is robust against complex geometric deformations and high levels of outliers.

    89
  • Neural Light Transport for Relighting and View Synthesis

    Xiuming Zhang, Sean Fanello, Yun‐Ta Tsai, Tiancheng Sun, Tianfan Xue, Pandey?, Rohit, Sergio Orts‐Escolano, Davidson?, Philip, +5 more

    DSpace@MIT (Massachusetts Institute of Technology) · 2021

    88
  • CineMaster: A 3D-Aware and Controllable Framework for Cinematic Text-to-Video Generation

    Qinghe Wang, Yawen Luo, Xiaoyu Shi, Xu Jia, Huchuan Lu, Tianfan Xue, Xintao Wang, Pengfei Wan, +2 more

    ACM SIGGRAPH Conference Papers (SIGGRAPH) · 2025

    To overcome the scarcity of in-the-wild datasets with 3D object motion and camera pose annotations, this work carefully establish an automated data annotation pipeline that extracts 3D bounding boxes and camera trajectories from large-scale video data.

    81
  • Joint Bilateral Learning for Real-Time Universal Photorealistic Style Transfer

    Xide Xia, Meng Zhang, Tianfan Xue, Zheng Sun, Hui Fang, Brian Kulis, Jiawen Chen

    Lecture notes in computer science · 2020

    Compared to the state of the art, the proposed end-to-end model for photorealistic style transfer produces visually superior results and is three orders of magnitude faster, enabling real-time performance at 4K on a mobile phone.

    64
  • Depicting Beyond Scores: Advancing Image Quality Assessment Through Multi-modal Language Models

    Zhiyuan You, Zhaodonghui Li, Jinjin Gu, Zhenfei Yin, Tianfan Xue, Chao Dong

    Lecture notes in computer science · 2024

    55
  • Refraction Wiggles for Measuring Fluid Depth and Velocity from Video

    Tianfan Xue, Michael Rubinstein, Neal Wadhwa, Anat Levin, Frédo Durand, William T. Freeman

    Lecture notes in computer science · 2014

    Different from previous approaches for measuring refractive flow, these methods operate directly on videos captured with ordinary cameras, do not require auxiliary sensors, light sources or designed backgrounds, and can correctly detect the motion and location of refractive fluids even when they are invisible to the naked eye.

    54
  • AligNeRF: High-Fidelity Neural Radiance Fields via Alignment-Aware Training

    Yifan Jiang, Peter Hedman, Ben Mildenhall, Dejia Xu, Jonathan T. Barron, Zhangyang Wang, Tianfan Xue

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2023

    This work proposes the corresponding solutions to marry the multilayer perceptron (MLP) with convolutional layers which can encode more neighborhood information while reducing the total number of parameters, and proposes a novel training strategy to address misalignment caused by moving objects or small camera calibration errors.

    53
  • CamCloneMaster: Enabling Reference-based Camera Control for Video Generation

    Yawen Luo, Xiaoyu Shi, Jianhong Bai, Menghan Xia, Tianfan Xue, Xintao Wang, Pengfei Wan, Di Zhang, +1 more

    SIGGRAPH Asia Conference Papers · 2025

    This work proposes CamCloneMaster, a framework that enables users to replicate camera movements from reference videos without requiring camera parameters or test-time fine-tuning, and presents the Camera Clone Dataset, a large-scale synthetic dataset designed for camera clone learning, encompassing diverse scenes, subjects, and camera movements.

    51
  • AutoDIR: Automatic All-in-One Image Restoration with Latent Diffusion

    Yitong Jiang, Zhaoyang Zhang, Tianfan Xue, Jinwei Gu

    Lecture notes in computer science · 2024

    50
  • Defocus Map Estimation and Deblurring from a Single Dual-Pixel Image

    Shumian Xin, Neal Wadhwa, Tianfan Xue, Jonathan T. Barron, Pratul P. Srinivasan, Jiawen Chen, Ioannis Gkioulekas, Rahul Dev Garg

    IEEE/CVF International Conference on Computer Vision (ICCV) · 2021

    This work presents a method that takes as input a single dual-pixel image, and simultaneously estimates the image’s defocus map—the amount of defocus blur at each pixel—and recovers an all-in-focus image, which improves upon prior works for bothdefocus map estimation and blur removal, despite being entirely unsupervised.

    50
  • Enhancing Descriptive Image Quality Assessment With a Large-Scale Multi-Modal Dataset

    Zhiyuan You, Jinjin Gu, Xin Cai, Zheyuan Li, Kaiwen Zhu, Chao Dong, Tianfan Xue

    IEEE Transactions on Image Processing · 2025

    Experimental results demonstrate that EDQA significantly outperforms traditional score-based methods, prior VLM-based IQA models, and proprietary GPT-4V in distortion identification, instant rating, and reasoning tasks.

    45
  • HDRFlow: Real-Time HDR Video Reconstruction with Large Motions

    Gangwei Xu, Yujin Wang, Jinwei Gu, Tianfan Xue, Xin Yang

    IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 2024

    HDRFlow is the first real-time HDR video reconstruction method for video sequences captured with alternating exposures, capable of processing 720p resolution inputs at 25ms, and outperforms previous methods on standard benchmarks.

    43
  • Visual Dynamics: Stochastic Future Generation via Layered Cross Convolutional Networks

    Tianfan Xue, Jiajun Wu, Katherine L. Bouman, William T. Freeman

    IEEE Transactions on Pattern Analysis and Machine Intelligence · 2018

    The probabilistic model makes it possible for us to sample and synthesize many possible future frames from a single input image, and to synthesize realistic movement of objects, a novel network structure is proposed, namely a Cross Convolutional Network.

    37

Show all 105 works

Publication data from OpenAlex, with missing venues and authors filled in from Crossref; citation counts are the higher of OpenAlex and Semantic Scholar, last synced 2026-10-13. One-sentence summaries under some papers are written by Semantic Scholar’s model. Citation counts may be lower than on Google Scholar, which indexes more sources.

Report an error

Wrong papers, two people merged into one, or a profile that should not be here? Tell us and we will fix or hide it.

Sign in to report