PENG, Yifan (Evan Peng)


Postdoctoral Research Scholar at Stanford


evanpeng@stanford.edu / evan.y.peng@gmail.com


350 Jane Stanford Way, Stanford, CA 94305


[Stanford Profile] [Google Scholar] [LinkedIn] [Twitter] [CV]



I am a Postdoctoral Research Scholar in the Stanford Computational Imaging Laboratory, working with Gordon Wetzstein. I received my PhD in Computer Science from Imager Lab, UBC, working with Wolfgang Heidrich. During the PhD, I was a Visiting Student Researcher at Visual Computing Center, KAUST. I received both my MSc and BS in Optical Science and Engineering from State Key Lab of Modern Optical Instrumentation, Zhejiang University. My research interest lies in the interdisciplinary field of Optics, Graphics, Vision, and Artificial Intelligence, particularly with the focus of: Computational Optics, Photography, Sensing, and Display; Holographic Imaging/Display & VR/AR/MR; Computational Microscope Imaging; Low-level Computer Vision; Inverse Rendering; Human-centered Visual & Sensory Systems.






News

May 2022

I am delivering an invited talk/seminar on Advances in Machine Intelligence-driven Holographic Displays at SID Display Week 2022. I am serving as the Session Chair of Holographic Displays session for Display Week 2022. Come and enjoy the excellent work at this amazing event.

Apr 2022

I am continuing to serve as the Paper Program Committee for IEEE ICCP 2022. Welcome to share your excellent work at this amazing event.

Mar 2022

Our paper on Video See-Through Mixed Reality with Focus Cues won the Best Journal Paper Award in IEEE VR 2022 (TVCG).

Feb 2022

I am continuing to serve as the Science and Technology Program Committee for IEEE ISMAR 2022. Welcome to share your excellent work at this amazing event.

Jan 2022

I am continuing to serve as the Technical Committee for SID Display Week 2022 Display Systems Track. Welcome to share your excellent work at this amazing event.

Nov 2021

Our papers on Partially-coherent Neural Holography and Neural 3D Holography are featured in Stanford News, in ScienceBlog, and in California News Times.

Sep 2021

I am serving as the Session Chair of Displays session for IEEE ISMAR 2021. Come and enjoy the excellent work at this amazing event.

Jul 2021

I am serving as the Technical Program Committee for International Conference on Computational Visual Media (CVM 2022). Welcome to share your excellent work at this amazing event.

Apr 2021

I am continuing to serve as the Science and Technology Program Committee for IEEE ISMAR 2021. Welcome to share your excellent work at this amazing event.

Mar 2021

Our long-standing work on Holographic Displays and VR/AR is featured in Scientia Global.

Feb 2021

I am serving as the Session Co-Chair of Holographic and Light Field Display session for SID Display Week 2021. Come and enjoy the excellent work at this amazing event.

Jan 2021

Our recent paper on Michelson Holography is featured in OSA Journal News, in Communications of ACM News, in Photonics Media, in Sci Tech Daily, in Physics.org News, and in SPIE Optics.org.

Dec 2020

I am continuing to serve as the Technical Committee for IEEE ICCP 2021. Welcome to share your excellent work at this amazing event.

Nov 2020

I am serving as the Session Chair of Near-eye Displays session for IEEE ISMAR 2020. Come and enjoy the excellent work at this amazing event.

Oct 2020

I am continuing to serve as the Technical Committee for SID Display Week 2021 Display Systems Track. Welcome to share your excellent work at this amazing event.

Sep 2020

An invited talk in OSA Frontiers in Optics 2020 on Holographic display and image synthesis for VRAR.

Aug 2020

My course on Deep optics: joint design of optics and image recovery algorithms for domain specific cameras is live at SIGGRAPH 2020. I’m joined by excellent instructors Gordon Wetzstein, Wolfgang Heidrich, and Ashok Veeraraghavan.

Aug 2020

My paper on Neural Holography is featured in Stanford Engineering News, in ExtremeTech Media Press, and in Nweon Media Press.

Jul 2020

I am serving as the Technical Committee for SPIE AR|VR|MR 2021. Welcome to share your excellent work at this amazing event.

Jun 2020

I am serving as the Science and Technology Program Committee for IEEE ISMAR 2020. Welcome to share your excellent work at this amazing event.



Featured Publications


Time-multiplexed Neural Holography: A Flexible Framework for Holographic Near-eye Displays

Suyeon Choi*, Manu Gopakumar*, Yifan (Evan) Peng, Jonghyun Kim, Matthew O'Toole, Gordon Wetzstein

ACM SIGGRAPH 22'

We develop a flexible framework for holographic near-eye displays with fast heavily-quantized spatial light modulators.

Holography VR Glasses

Jonghyun Kim, Manu Gopakumar, Suyeon Choi, Yifan (Evan) Peng, Ward Lopes, Gordon Wetzstein

ACM SIGGRAPH 22'

We develop an ultra-thin VR display using computer-generated holography, in tandemw with machine intelligence.

Video See-Through Mixed Reality with Focus Cues

Christoph Ebner, Shohei Mori, Peter Mohr, Yifan (Evan) Peng, Dieter Schmalstieg, Gordon Wetzstein, Denis Kalkofen

IEEE VR 22' (Best Journal Paper)

We develop a novel display architecture for video see-through mixed reality with full support for focus cues.

Partially-coherent neural holography: Speckle-free holography with partially coherent light sources and camera-in-the-loop calibration

Yifan (Evan) Peng*, Suyeon Choi*, Jonghyun Kim, Gordon Wetzstein

Science Advances 21'

We develop a holographic display combining artificial intelligence with partially coherent light sources to reduce speckle in AR/VR applications.

Neural 3D holography: Learning accurate wave propagation models for 3D holographic virtual and augmented reality displays

Suyeon Choi*, Manu Gopakumar*, Yifan (Evan) Peng, Jonghyun Kim, Gordon Wetzstein

ACM SIGGRAPH ASIA 21'

We develop a differentiable camera-calibrated wave propagation model for holographic near-eye displays that enables unprecedented 3D image fidelity.

Unfiltered holography: optimizing high diffraction orders without optical filtering for compact holographic displays

Manu Gopakumar, Jonghyun Kim, Suyeon Choi, Yifan (Evan) Peng, and Gordon Wetzstein

OSA Optics Letters 21' (Editors' Pick)

We design an algorithmic framework for optimizing high diffraction orders without optical filtering to enable compact holographic displays.

Shift-variant color-coded diffractive spectral imaging system

Henry Arguello, Samuel Pinilla, Yifan (Evan) Peng, Hayato Ikoma, Jorge Bacca, and Gordon Wetzstein

OSA OPTICA 21'

We jointly design the DOE and the CCA parameters with a fully differentiable image formation model using an end-to-end approach, in order to enable high-fideility snapshot spectral imaging.

Foveated light-field display and real-time rendering for virtual reality

Chen Gao, Yifan (Evan) Peng, Rui Wang, Zhuopeng Zhang, Haifeng Li, and Xu Liu

OSA Applied Optics 21' (Editors' Pick)

We deliver a foveated light field to each eye subject to the gaze point, providing more natural visual experiences than state-of-the-art solutions in VR display scenarios.

Depth from defocus with learned optics for imaging and occlusion-aware depth estimation

Hayato Ikoma, Cindy Nguyen, Christopher Metzler, Yifan (Evan) Peng, Gordon Wetzstein

IEEE ICCP 21'

We develop an end-to-end optimization of optics and image processing for passive depth estimation and all-in-focus imaging.

Optimizing image quality for holographic near-eye displays with Michelson Holography

Suyeon Choi, Jonghyun Kim, Yifan (Evan) Peng, Gordon Wetzstein

OSA OPTICA 21'

We develop a holographic display technology that optimizes image quality for emerging holographic near-eye displays using 2 SLMs and camera-in-the-loop calibration.

Deep-learned broadband encoding stochastic filters for computational spectroscopic instruments

Hongya Song, Yaoguang Ma, Yubing Han, Weidong Shen, Wenyi Zhang, Yanghui Li, Xu Liu, Yifan (Evan) Peng, Xiang Hao

Wiley Advanced Theory and Simulations 21'

We propose the Parameter Constrained Spectral Encoder and Decoder (PCSED) - a neural network-based framework for the design of Broadband Encoding Stochastic (BEST) filters in spectroscopic instruments.

Neural holography with camera-in-the-loop training

Yifan (Evan) Peng, Suyeon Choi, Nitish Padmanaban, Jonghyun Kim, Gordon Wetzstein

ACM SIGGRAPH 20' / SIGGRAPH Asia 20'

We develop an algorithmic CGH framework that uses camera-in-the-loop training to achieve unprecedented image fidelity and real-time framerates.

Learned diffractive achromat for full-spectrum imaging

Xiong Dun, Hayato Ikoma, Gordon Wetzstein, Zhanshan Wang, Xinbin Cheng, Yifan (Evan) Peng

OSA OPTICA 20'

We realize the joint learning of a diffractive achromat with a realistic aperture size and an image recovery neural network in an end-to-end manner across the full visible spectrum.

End-to-end learned, optically coded super-resolution SPAD camera

Qilin Sun, Jian Zhang, Xiong Dun, Bernard Ghanem, Yifan (Evan) Peng, Wolfgang Heidrich

ACM SIGGRAPH 20'

We investigate a low-cost,and compact optical coding camera design that supports high-resolution image reconstructions from raw measurements with low pixel counts.

Deep optics for single-shot high-dynamic-range imaging

Christopher A. Metzler, Hayato Ikoma, Yifan (Evan) Peng, Gordon Wetzstein

IEEE CVPR 20'

We develop an end-to-end optimization of optics and image processing for snapshot HDR imaging.

Learned large field-of-view imaging with thin-plate optics

Yifan (Evan) Peng*, Qilin Sun*, Xiong Dun*, Gordon Wetzstein, Wolfgang Heidrich, Felix Heide

ACM SIGGRAPH Asia 19'

We propose a lens design and learned reconstruction architecture that provide an order of magnitude increase in field of view for computational imaging using a single thin-plate lens.

Overlap-add stereograms for holographic near-eye displays

Nitish Padmanaban, Yifan (Evan) Peng, Gordon Wetzstein

ACM SIGGRAPH Asia 19'

The overlap-add stereogram (OLAS) algorithm uses overlapping hogels to encode the view-dependent lighting effects of a light field into a hologram achieving better quality than other holographic stereograms.

Wirtinger holography for near-eye displays

Praneeth Chakravarthula, Yifan (Evan) Peng, Joel Kollin, Henry Fuchs, Felix Heide

ACM SIGGRAPH Asia 19'

We revisit complex Wirtinger derivatives and devleop a phase retrieval algorithm that leads to holographic reconstructions with an order of magnitude lower error, both in simulation and on an experimental prototype.

End-to-end optimization of optics and image processing

Vincent Sitzmann*, Steven Diamond*, Yifan (Evan) Peng*, Xiong Dun, Stephen Boyd, Wolfgang Heidrich, Felix Heide, Gordon Wetzstein

ACM SIGGRAPH 18'

We jointly optimize high-level image processing and camera optics to design novel domain-specific cameras. This end-to-end design paradigm is beneficial in computational optics, imaging, and display.

Focal sweep imaging with multi-focal diffractive optics

Yifan (Evan) Peng, Xiong Dun, Qilin Sun, Felix Heide, Wolfgang Heidrich

IEEE ICCP 18'

We extend the concept of focal sweep from refractive optics to diffractive optics. Experimental results indicate that the depth-of-field can be significantly extended with fewer artifacts remaining.

Depth and transient imaging with compressive SPAD array cameras

Qilin Sun, Xiong Dun, Yifan Peng, Wolfgang Heidrich

IEEE CVPR 18'

We overcome the spatial resolution limit of SPAD arrays by employing a compressive sensing camera design. We suppress the noise while abstracting the phase and amplitude information, so as to realize a temporal resolution of a few tens of picoseconds.

Mix-and-match holography (aka. Multiplexing holograms)

Yifan (Evan) Peng, Xiong Dun, Qilin Sun, Wolfgang Heidrich,

ACM SIGGRAPH Asia 17'

We computationally design pairs of diffractive optical elements that encode multiple holograms or target images under different geometric alignments or pairings. This provides the extra bandwidth required to multiplex several images.

Revisiting cross-channel information transfer for chromatic aberration correction

Tiancheng Sun, Yifan (Evan) Peng, Wolfgang Heidrich

IEEE ICCV 17'

We revisit the pixel-wise similarity between different color channels of the image and accordingly propose a novel algorithm for correcting chromatic aberration based on this cross-channel correlation.

Encoded diffractive optics for full-spectrum computational imaging

Felix Heide, Qiang Fu, Yifan (Evan) Peng, Wolfgang Heidrichc

Nature Publishing Group Scientific Reports 16'

We introduce numerically optimized encoded phase masks in which different optical parameters such as focus or zoom can be accessed through changes in the mechanical alignment of a ultra-thin stack of two or more masks. This co-design of optics and computation enables tunable, full-spectrum imaging using thin optics.

The diffractive achromat: Full spectrum computational imaging with diffractive optics

Yifan (Evan) Peng, Qiang Fu, Felix Heide, Wolfgang Heidrich

ACM SIGGRAPH 16'

The diffractive achromat is a computationally optimized diffractive lens for full visible spectrum imaging, which is used jointly with a computational image reconstruction algorithm. We demonstrate high fidelity color diffractive-only imaging over the full visible spectrum with ultrathin flat lenses.

Computational imaging with lightweight diffractive-refractive optics

Yifan (Evan) Peng, Qiang Fu, Hadi Amata, Shuochen Su, Felix Heide, and Wolfgang Heidrich

OSA Optics Express 15'

We jointly design lightweight diffractive-refractive optics and post-processing algorithms to enable imaging under white light illumination.

Other Publications


Deep learning multi-shot 3D localization microscopy using hybrid optical-electronic computing

Hayato Ikoma, Takamasa Kudo, Yifan (Evan) Peng, Michael Broxton, and Gordon Wetzstein

OSA Optics letters 21'

We develop a deep learning multi-shot 3D localization microscopy using hybrid optical–electronic computing.

Highly efficient waveguide display with space-variant volume holographic gratings

Chao Yu, Yifan (Evan) Peng, Qing Zhao, Haifeng Li, and Xu Liu

OSA Applied Optics 17' (Editors' Pick)

We propose a waveguide display based on space-variant volume holographic gratings (SVVHGs), achieving high efficiency and large FOV at the same time.

Beam shaping for multicolour LEDs with diffractive optical elements

Chao Yu, Yifan (Evan) Peng, Tianyi Guo, Qiang Fu, Haifeng Li, Xu Liu

Taylor & Francis Journal of Modern Optics 17'

We propsoe an improved particle swarm optimization for the design of ultra-thin diffractive optical elements enabling multicolour beam shaping functionality. Pre-optimized initial structures and adaptive weight strategy achieve better and identical shaping performance for multiple colours.

Towards VR and AR: 360 light field display with mid-air interaction

Chen Su, Yifan (Evan) Peng, Qing Zhong, Haifeng Li, Rui Wang, Wolfgang Heidrich, Xu Liu

ACM SIGGRAPH Asia E-tech 16'

We present a 360-deg. light field display to visualize 3D objects above the table-top screen, and provide a graspable and measurable virtual or augmented reality environment. Multiple users mid-air interactions based on their virtual measurement perception are enabled.

Optimized image synthesis for multi-projector-type light field display

Qing Zhong, Yifan (Evan) Peng, Haifeng Li, and Xu Liu

IEEE Journal of Display Tech 16'

We introduce a weighted average optimization to the image synthesis process of light field displays, aiming to tradeoff the reconstructed depth range and the image sharpness without changing the hardware configuration, particularly for multi-projector-type light field displays.

Interactive performance animation for VR/AR using low-cost motion capture

Yifan (Evan) Peng, Chen Su, Wolfgang Heidrich

SID Display Week Symposium 16'

We evaluate a robust 3D interactive approach for creating performance animation using a low?cost motion capture device. Our approach effectively combines hand motion capture, interactive locomotion control, and user-editing animation editing.

Gray-scale enhancement for time-mulitiplexing light field rendering

Chen Su, Qing Zhong, Yifan (Evan) Peng, Liang Xu, Rui Wang, Haifeng Li, and Xu Liu

OSA Optics Express 15'

The proposed 3D ordered-dithering algorithm presents better visual perception than the conventional halftone algorithms with respect to grayscale representation, and is flexible to be applied in different time-multiplexing light field display systems.

Multi-LCDs based intergral light field display

Yifan (Evan) Peng, Haifeng Li, Qing Zhong, and Xu Liu

OSA Applied Optics 13'

We achieve a light field three-dimensional display with a large viewing angular range based on spliced multi-LCDs. By measuring the coordinate distributions, calibration is implemented considering both imaging aberration and geometrical inaccuracy of the whole system.

Projector array based large-scale light field display

Qing Zhong, Yifan (Evan) Peng, Haifeng Li, Chen Su, Weidong Shen, and Xu Liu

OSA Applied Optics 13'

We proposed an optimized reconstruction algorithm that unifies the conventional multiview and light-field reconstruction algorithms, which can indicate the perfromance difference when switching from multiview to light-field reconstruction. A prototype consisting of 60 projectors with an arc diffuser screen is constructed.

Spinning type omnidirectional light field reconstruction

Xinxing Xia, Xu Liu, Haifeng Li, Zhenrong Zheng, Han Wang, Yifan (Evan) Peng, and Weidong Shen

OSA Optics Express 13'

Using light field reconstruction technique, we display a floating 3D scene in the air, which is 360-degree surrounding viewable with correct occlusion effect. The prototype is achieved and the true 3D color animation image has been presented vividly.


Conferences/Talks


SPIE Photonics West | ARVRMR 2022
The Stanford Center for Image System Engineering (SCIEN) Seminars 2021
ACM SIGGRAPH 2014 2015 2016 2017 2018 2019 2020
ACM SIGGRAPH Asia 2016 2017 2018 2019 2020
IEEE International Symposium on Mixed and Augmented Reality (ISMAR) 2020
IEEE Computer Vision and Pattern Recognition (CVPR) 2017 2018 2019
IEEE International Conference on Computer Vision (ICCV) 2017
IEEE International Conference on Computational Photography (ICCP) 2016 2017 2018 2020 2021
SID Display Week 2011-2014 2016 2018 2019 2021
OSA Imaging and Applied Optics Congress 2020
OSA Frontiers in Optics (FiO) 2020
The Computational Imaging (Wetzlar Networking) at Leica Camera World 2019
GAMES: Graphics And Mixed Environment Seminar (Webinar) 2020 2021

PhD Thesis "Computational Imaging with Diffractive Optics"



Intelligent Optics Sharing (Tech. News/Reports/Comments)

I'm running a WeChat Public Account (Chinese Mandarin) that covers computational optics, imaging, and display.




Acknowledgements (Current/Past Collaboration)


         
     

To grow old when you do not despise yourself...


© 2018 Hello world. All rights reserved | Design by Evan Yifan Peng