Ricardo Martin-Brualla

I am a researcher interested in the intersection of AI and 3D, and excited about creating new products in that space.

Previously, I worked at Google for eight years, most recently as a Senior Staff Research Scientist, leading and managing a team working on generating 3D assets for all products in Google Search , using NeRFs, diffusion and video models. Before that, I worked for five years on 3D telepresence on Project Starline, from building the first end-to-end demos to leading the ML efforts for real-time novel view synthesis.

I obtained my PhD in Computer Science and Engineering at the University of Washington in 2016 with Steve Seitz as my advisor. Two of my PhD projects went viral online: timelapse mining from Internet photos, and a timelapse of Seattle from the Space Needle. I hold two bachelor degrees in Math and Informatics from Barcelona Tech / UPC.

Outside of work, I love the outdoors and adventures. During COVID-19, my wife and I crossed Alaska from Ketchikan to Kotzebue on foot, packraft and cycling. We wrote about it on our blog called north2arctic, and we were featured in the Mountaineers magazine.

Email  /  Google Scholar  /  Twitter  /  Github

profile photo
Research
CAT3D: Create Anything in 3D with Multi-View Diffusion Models
Ruiqi Gao, Aleksander Holynski, Philipp Henzler, Arthur Brussee, Ricardo Martin-Brualla, Pratul P Srinivasan, Jonathan T Barron, Ben Poole
NeurIPS, 2024
project page / arXiv

IllumiNeRF: 3D Relighting without Inverse Rendering
Xiaoming Zhao, Pratul P Srinivasan, Dor Verbin, Keunhong Park, Ricardo Martin-Brualla, Philipp Henzler
NeurIPS, 2024
project page / arXiv / code

LFM-3D: Learnable Feature Matching Across Wide Baselines Using 3D Signals
Arjun Karpur, Guilherme Perrotta, Ricardo Martin-Brualla, Howard Zhou, André Araujo
3DV, 2024
project page / arXiv

NAVI: Category-Agnostic Image Collections with High-Quality 3D Shape and Pose Annotations
Varun Jampani, Kevis-Kokitsi Maninis, Andreas Engelhardt, Arjun Karpur, Karen Truong, Kyle Sargent, Stefan Popov, André Araujo, Ricardo Martin-Brualla, Kaushal Patel, Daniel Vlasic, Vittorio Ferrari, Ameesh Makadia, Ce Liu, Yuanzhen Li, Howard Zhou
NeurIPS, 2023
project page / arXiv / code

CamP: Camera Preconditioningfor Neural Radiance Fields
Keunhong Park, Philipp Henzler, Ben Mildenhall, Jonathan T Barron, Ricardo Martin-Brualla
Siggraph Asia, 2023
project page / arXiv

SCADE: NeRFs from Space Carving with Ambiguity-Aware Depth Estimates
Mikaela Angelina Uy, Ricardo Martin-Brualla, Leonidas Guibas, Ke Li
CVPR, 2023
project page / arXiv / code / video

Novel view synthesis with diffusion models
Daniel Watson, William Chan, Ricardo Martin-Brualla, Jonathan Ho, Andrea Tagliasacchi, Mohammad Norouzi
ICLR, 2023
project page / arXiv

NeRF in the Dark: High Dynamic Range View Synthesis from Noisy Raw Images
Ben Mildenhall, Peter Hedman, Ricardo Martin-Brualla, Pratul P Srinivasan, Jonathan T Barron
CVPR, 2022
project page / arXiv / video

Project Starline: A high-fidelity telepresence system
Jason Lawrence, Dan B Goldman, Supreeth Achar, Gregory M Blascovich, Joseph G Desloge, Tommy Fortes, Eric M Gomez, Sascha Haberling, Hugues Hoppe, Andy Huibers, Claude Knaus, Brian Kuschak, Ricardo Martin-Brualla, Harris Nover, Andrew Ian Russell, Steven M Seitz, Kevin Tong
SIGGRAPH Asia, 2021
paper / video

Advances in Neural Rendering
Ayush Tewari, Justus Thies, Ben Mildenhall, Pratul P Srinivasan, Edgar Tretschk, Yifan Wang, Christoph Lassner, Vincent Sitzmann, Ricardo Martin-Brualla, Stephen Lombardi, Tomas Simon, Christian Theobalt, Matthias Niessner, Jonathan T. Barron, Gordon Wetzstein, Michael Zollhöfer, Vladislav Golyanik
Eurographics STAR report, 2022
arXiv

Time-travel rephotography
Xuan Luo, Xuaner Zhang, Paul Yoo, Ricardo Martin-Brualla, Jason Lawrence, Steven M Seitz
SIGGRAPH Asia, 2021
project page / arXiv / code

Featured in Two Minute Papers

HyperNeRF: A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fields
Keunhong Park, Utkarsh Sinha, Peter Hedman, Jonathan T Barron, Sofien Bouaziz, Dan B Goldman, Ricardo Martin-Brualla, Steven M Seitz
SIGGRAPH Asia, 2021
project page / arXiv / code

Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fields
Jonathan T Barron, Ben Mildenhall, Matthew Tancik, Peter Hedman, Ricardo Martin-Brualla, Pratul P Srinivasan
ICCV, 2021
project page / arXiv / code / video

Best Paper Honorable Mention (top 5 papers)

Nerfies: Deformable neural radiance fields
Keunhong Park, Utkarsh Sinha, Jonathan T Barron, Sofien Bouaziz, Dan B Goldman, Steven M Seitz, Ricardo Martin-Brualla
ICCV, 2021
project page / arXiv / video

Press: Gizmodo. Featured in Two Minute Papers.

Neural RGB-D Surface Reconstruction
Dejan Azinović, Ricardo Martin-Brualla, Dan B Goldman, Matthias Nießner, Justus Thies
CVPR, 2022
project page / arXiv / video

Nerf in the wild: Neural radiance fields for unconstrained photo collections
Ricardo Martin-Brualla, Noha Radwan, Mehdi SM Sajjadi, Jonathan T Barron, Alexey Dosovitskiy, Daniel Duckworth
CVPR, 2021
project page / arXiv / video

Press: PetaPixel Featured in Two Minute Papers

IBRNet: Learning multi-view image-based rendering
Qianqian Wang, Zhicheng Wang, Kyle Genova, Pratul P Srinivasan, Howard Zhou, Jonathan T Barron, Ricardo Martin-Brualla, Noah Snavely, Thomas Funkhouser
CVPR, 2021
project page / arXiv / code

No Shadow Left Behind: Removing Objects and their Shadows using Approximate Lighting and Geometry
Edward Zhang, Ricardo Martin-Brualla, Janne Kontkanen, Brian L Curless
CVPR, 2021
project page / paper

Sharf: Shape-conditioned radiance fields from a single view
Konstantinos Rematas, Ricardo Martin-Brualla, Vittorio Ferrari
ICML, 2021
project page / arXiv / code

FiG-NeRF: Figure-Ground Neural Radiance Fields for 3D Object Category Modelling
Christopher Xie, Keunhong Park, Ricardo Martin-Brualla, Matthew Brown
3DV, 2021
project page / arXiv / video

State of the art on neural rendering
Ayush Tewari, Ohad Fried, Justus Thies, Vincent Sitzmann, Stephen Lombardi, Kalyan Sunkavalli, Ricardo Martin-Brualla, Tomas Simon, Jason Saragih, Matthias Nießner, Rohit Pandey, Sean Fanello, Gordon Wetzstein, Jun-Yan Zhu, Christian Theobalt, Maneesh Agrawala, Eli Shechtman, Dan B Goldman, Michael Zollhöfer
Eurographics STAR report, 2020
arXiv

KeystoneDepth: History in 3D
Xuan Luo, Yanmeng Kong, Jason Lawrence, Ricardo Martin-Brualla, Steven M Seitz
3DV, 2020
project page / paper / video

Gelato: Generative latent textured objects
Ricardo Martin-Brualla, Rohit Pandey, Sofien Bouaziz, Matthew Brown, Dan B Goldman
ECCV, 2020
project page / arXiv

Multi-view image fusion
Marc Comino Trinidad, Ricardo Martin Brualla, Florian Kainz, Janne Kontkanen
ICCV, 2019
project page / paper

Neural rerendering in the wild
Moustafa Meshry, Dan B Goldman, Sameh Khamis, Hugues Hoppe, Rohit Pandey, Noah Snavely, Ricardo Martin-Brualla
CVPR, 2019
arXiv / code / video

Best Paper Award Finalist (top 1% of submissions)

Volumetric capture of humans with a single rgbd camera via semi-parametric learning
Rohit Pandey, Anastasia Tkach, Shuoran Yang, Pavel Pidlypenskyi, Jonathan Taylor, Ricardo Martin-Brualla, Andrea Tagliasacchi, George Papandreou, Philip Davidson, Cem Keskin, Shahram Izadi, Sean Fanello
CVPR, 2019
arXiv / video

Lookingood: Enhancing performance capture with real-time neural re-rendering
Ricardo Martin-Brualla, Rohit Pandey, Shuoran Yang, Pavel Pidlypenskyi, Jonathan Taylor, Julien Valentin, Sameh Khamis, Philip Davidson, Anastasia Tkach, Peter Lincoln, Adarsh Kowdle, Christoph Rhemann, Dan B Goldman, Cem Keskin, Steven M Seitz, Shahram Izadi, Sean Fanello,
SIGGRAPH Asia, 2018
arXiv / video

3D time-lapse reconstruction from internet photos
Ricardo Martin-Brualla, David Gallup, Steven M Seitz
ICCV, 2015
project page / paper / video

Press: PetaPixel

Time-lapse mining from internet photos
Ricardo Martin-Brualla, David Gallup, Steven M Seitz
SIGGRAPH, 2015
project page / paper / video

Press: WIRED, BBC, Seattle Times & more.

The 3d jigsaw puzzle: Mapping large indoor spaces
Ricardo Martin-Brualla, Yanling He, Bryan C Russell, Steven M Seitz
ECCV, 2014
project page / paper / video

3D Wikipedia: Using online text to automatically label and navigate reconstructed geometry
Bryan C Russell, Ricardo Martin-Brualla, Daniel J Butler, Steven M Seitz, Luke Zettlemoyer
SIGGRAPH Asia, 2013
project page / paper / video

Press: New Scientist, Gizmodo

Viewport: A distributed, immersive teleconferencing system with infrared dot pattern
Cha Zhang, Qin Cai, Philip A Chou, Zhengyou Zhang, Ricardo Martin-Brualla
IEEE MultiMedia, 2013
paper

The role of query sessions in extracting instance attributes from web search queries
Marius Pasca, Enrique Alfonseca, Enrique Robledo-Arnuncio, Ricardo Martin-Brualla, Keith Hall
European Conference on Information Retrieval, 2010
paper

Instance sense induction from attribute sets
Ricardo Martin-Brualla, Enrique Alfonseca, Marius Pasca, Keith Hall, Enrique Robledo-Arnuncio, Massimiliano Ciaramita
Coling, 2010
paper