pottrait

Zhiwen ("Aaron") Fan

University of Texas at Austin

EmailGoogle ScholarCV

About Me

I am a Ph.D. candidate in Electrical Computer Engineering at The University of Texas at Austin advised by Prof. Atlas Wang at VITA group. Previously, I was a senior researcher at Alibaba Cloud worked with Prof. Ping Tan and Prof. Siyu Zhu. I am the awardees of Qualcomm Innovation Fellowship 2022.

Recent News

  • Our IROS'24 (Multi-modal 3DGS SLAM) is selected as oral pitch finalist presentation.
  • Our CVPR'24 (Feature-3DGS) is selected as highlight presentation.
  • Our CVPR'23 (NeuralLift-360) is selected as highlight presentation.
  • I was one of the awardees of the Qualcomm Innovation Fellowship (North America) 2022 (QIF 2022). Innovation title: "Real-time Visual Processing for Autonomous Driving via Video Transformer with Data-Model-Accelerator Tri-design".
  • We won 3rd place in the University Demo Best Demonstration at the 59th Design Automation Conference (DAC 2022). We demo for a multi-task vision transformer on FPGA.
  • Our CVPR'22 (CADTransformer) is selected as oral presentation.
  • Our paper for CVPR'20 (Cascade Cost Volume) is selected as oral presentation.

Commitment

  • I am dedicated to collecting high-quality, accessible online courses in artificial intelligence, machine learning and computer vision. Check the note page: LINK.
  • I dedicate 1 hour weekly (2:00pm-2:30pm, 2:30pm-3:00pm, PST on Friday) to mentor and guide students from underrepresented groups or those in need. Interested? Fill out this form.

Selected Publications
Full publication list at Google Scholar

* denotes equal contribution, † denotes project lead.
Large Spatial Model: Real-time Unposed Images to Semantic 3D
Zhiwen Fan* †, Jian Zhang*, Wenyan Cong, Peihao Wang, Renjie Li, Kairun Wen, Shijie Zhou, Achuta Kadambi, Zhangyang Wang, Danfei Xu, Boris Ivanovic, Marco Pavone, Yue Wang
Preprint 
PaperProjectCode
4K4DGen: Panoramic 4D Generation at 4K Resolution
Renjie Li, Panwang Pan, Dejia Xu, Shijie Zhou, Xuanyang Zhang, Zeming Li, Achuta Kadambi, Zhangyang Wang, Zhiwen Fan†
Preprint 
PaperProjectCode
InstantSplat: Sparse-view Pose-free Gaussian Splatting in Seconds
Zhiwen Fan*†, Wenyan Cong*, Kairun Wen*, Kevin Wang, Jian Zhang, Xinghao Ding, Danfei Xu, Boris Ivanovic, Marco Pavone, Georgios Pavlakos, Zhangyang Wang, Yue Wang
Preprint 
PaperProjectCode
LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPS
Zhiwen Fan*†Kevin Wang*Kairun WenZehao ZhuDejia XuZhangyang Wang
Preprint 
PaperProjectCode
DreamScene360: Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splatting
Shijie Zhou*, Zhiwen Fan*, Dejia Xu*, Haoran Chang, Pradyumna Chari, Tejas Bharadwaj, Suya You, Zhangyang Wang, Achuta Kadambi
ECCV 2024 
PaperProjectCode
Feature 3DGS: Supercharging 3D Gaussian Splatting to Enable Distilled Feature Fields
Shijie Zhou, Haoran Chang, Sicheng Jiang, Zhiwen Fan, Zehao Zhu, Dejia Xu, Pradyumna Chari, Suya You, Zhangyang Wang, Achuta Kadambi,
CVPR 2024(Highlight, 2.8% of 11532) 
PaperProjectCode
NeRF-SOS: Any-View Self-supervised Object Segmentation from Complex Real-World Scenes
Zhiwen FanPeihao WangYifan JiangXinyu GongDejia XuZhangyang Wang
ICLR2023 
PaperProjectCode
NeuralLift-360: Lifting An In-the-wild 2D Photo to A 3D Object with 360° Views
Dejia XuYifan JiangPeihao WangZhiwen FanYi WangZhangyang Wang
CVPR2023  (Highlight, 2.5% of 9155)
PaperProjectCode
Unified Implicit Neural Stylization
Zhiwen Fan*†Yifan Jiang*Peihao Wang*Xinyu GongDejia XuZhangyang Wang
ECCV2022 
PaperProjectCode
M^3ViT Video thumbnail loading...
M^3ViT: Mixture-of-Experts Vision Transformer for Efficient Multi-task Learning with Model-Accelerator Co-design
Zhiwen Fan*†Hanxue Liang*Rishov SarkarZiyu JiangTianlong ChenKai ZouYu ChengCong HaoZhangyang Wang
NeurIPS2022  (QIF 2022 Award & DAC 3rd best demo)
PaperCode
CADTransformer...
CADTransformer: Panoptic Symbol Spotting Transformer for CAD Drawings
Zhiwen FanTianlong ChenPeihao WangZhangyang Wang
CVPR2022 (Oral Presentation, top 5% in all submissions)
PaperCode
CascadeCostVolume...
Cascade Cost Volume for High-Resolution Multi-View Stereo and Stereo Matching
Zhiwen Fan* Xiaodong Gu* Siyu Zhu Zuozhuo Dai Feitong Tan Ping Tan
CVPR2020 (Oral Presentation, top 5% in all submissions)
PaperVideoCode
CascadeCostVolume...
Joint CS-MRI Reconstruction and Segmentation with a Unified Deep Network
Liyan Sun* Zhiwen Fan* Xinghao Ding Yue Huang John Paisley
IPMI2019 
Paper

Experience

  • Meta, Reality Lab, Burlingame:
    Research Intern (year of 2024).
  • NVIDIA Research (remote):
    Research Intern (year of 2024).
  • Meta, Reality Lab, Redmond:
    Research Intern (year of 2023).
  • Google AR, San Francisco:
    Research Intern (year of 2022).
  • Alibaba Group, Hangzhou:
    Senior Algorithm Engineer(2019 - 2021).

Services

  • Journal Reviewers: 
    TPAMI, TIP, IJCV, Neurocomputing.
  • Conference Reviewers: 
    NeurIPS 22/23, ICML 22/23, CVPR 22/23, ICCV 21/23, AAAI 21, ICME 2019.