- This event has passed.
Albert Parra Pozo (Facebook): “An Integrated 6DoF Video Camera and System Design”
March 4, 2020 @ 4:30 pm - 5:30 pm
Location: Packard 101
Talk Title: An Integrated 6DoF Video Camera and System Design
Abstract: Designing a fully integrated 360◦ video camera supporting 6DoF head motion parallax requires overcoming many technical hurdles, including camera placement, optical design, sensor resolution, system calibration, real-time video capture, depth reconstruction, and real-time novel view synthesis. While there is a large body of work describing various system components, such as multi-view depth estimation, our paper is the first to describe a complete, reproducible system that considers the challenges arising when designing, building, and deploying a full end-to-end 6DoF video camera and playback environment. Our system includes a computational imaging software pipeline supporting online markerless calibration, high-quality reconstruction, and real-time streaming and rendering. Most of our exposition is based on a professional 16-camera configuration, which will be commercially available to film producers. However, our software pipeline is generic and can handle a variety of camera geometries and configurations. The entire calibration and reconstruction software pipeline along with example datasets is open sourced to encourage follow-up research in high-quality 6DoF video reconstruction and rendering.
More information: An Integrated 6DoF Video Camera and Systems Design
Open source repository: https://github.com/facebook/facebook360_dep
Demo: There will be a VR demo of the full 6DoF 360 degree 60 fps live content where depth and color from 16 high resolution cameras are fused in real time. The content comes straight from the depth estimation pipeline, and has not been post processed.
Bio: Albert Para Pozo is the Tech Lead of the AR/VR Capture team that is responsible for developing next generation virtual and augmented reality technologies. Before joining Facebook in 2014, Albert received a PhD in Electrical and Computer Engineering from Purdue University, and a BS in Telecommunications Engineering from the Polytechnic University of Catalonia. His research interests include virtual reality, augmented reality, computational imaging and image processing.