Marc Levoy


VMware Founders Professor of Computer Science and Electrical Engineering, Emeritus
Affiliations:
Computer Graphics Laboratory
Computer Systems Laboratory
Computer Science Department
Electrical Engineering Department
School of Engineering
Stanford University
Office:
Gates Computer Science Building
Room 366, Wing 3B
Stanford University
Stanford, CA 94305
Press here for directions.
Personal data:
Born in New York City
B. Architecture, Cornell, 1976
M.S. in Architecture, Cornell, 1978
PhD in Computer Science, Univ. North Carolina, 1989
Office hours:
AY 2014-2015: Tue 11:00am - noon
Phone:
(650) 725-4089
(650) 723-0033 (fax)
Email (the best way to reach me):
Web address:
http://graphics.stanford.edu/~levoy/

Administrative assistant:
Monica Niemiec
(650) 725-9494
niemiec@stanford.edu


I have retired from Stanford to lead a team at Google. My team is in GoogleX, and we work broadly on cameras and photography. One of our projects is computational photography for Glass. See also this post about better photos on Glass. Other projects include HDR+ mode on the Nexus 6 and a more flexible application programming interface (API) and hardware abstraction layer (HAL) for the cameras on Android devices. See also this presentation by my former PhD student Eddy Talvala at Google I/O 2014, or this summary by Android Police. Although I am Emeritus, I have been recalled to active to advise my existing students. I may also continue teaching CS 178, my digital photography course. However, I will not be taking on any new PhD students. I will hold regular office hours during the academic year, but not during the summer.


Biographical sketch

Marc Levoy is the VMware Founders Professor of Computer Science and Electrical Engineering, Emeritus. He received a Bachelor's and Master's in Architecture from Cornell University in 1976 and 1978, and a PhD in Computer Science from the University of North Carolina at Chapel Hill in 1989. In the 1970's Levoy worked on computer animation, developing a cartoon animation system that was used by Hanna-Barbera Productions to make The Flintstones, Scooby Doo, and other shows. In the 1980's Levoy worked on volume rendering, a technique for displaying three-dimensional functions such as computed tomography (CT) or magnetic resonance (MR) data. In the 1990's he worked on 3D laser scanning, culminating in the Digital Michelangelo Project, in which he and his students spent a year in Italy digitizing the statues of Michelangelo. In the 2000's he worked on computational photography and microscopy, including light field imaging as commercialized by Lytro and other companies. At Stanford he taught computer graphics and the science of art, and still teaches digital photography. Outside of academia, Levoy co-designed the Google book scanner, launched Google's Street View project, and currently leads a team in GoogleX that has worked on Project Glass and the Nexus 6 HDR+ mode. Awards: Charles Goodwin Sands Medal for best undergraduate thesis (1976), National Science Foundation Presidential Young Investigator (1991), ACM SIGGRAPH Computer Graphics Achievement Award (1996), ACM Fellow (2007).


Professional stuff

List of publications
(with pictures, abstracts, and links to papers)


Photography

I am fortunate that my research (and my teaching) are also my hobby - photography. Also fortunately, California is a wonderful place to practice this art. At left is an HDR shot taken along the coast south of Carmel. Here are some of my Google+ photo albums. By the way, here are some group photos with colleagues and students.
Although my favorite camera is a Canon 5D II, I'm gradually moving towards mirrorless interchangeable cameras like the Panasonic GX1, Olympus OMD EM-5, or Sony NEX-7. Here's a recent album from Thailand and Cambodia that uses the NEX-7. Of course the best camera is one you have with you, and cell phone cameras have been getting better - especially as they incorporate burst-mode capture and other kinds of computational photography. HDR+ mode on the Nexus 6 is one example; it captures, aligns, and combines multiple shots to improve performance in low light and high dynamic range situations. The pictures at left were taken with this camera: the top image with HDR+ mode off, and the bottom image with HDR+ mode on. Click on the thumbnails to see them at full resolution. Look how much cleaner, brighter, and sharper the HDR+ image is. Also, the stained-glass window at the end of the nave is not over-exposed, and there is more detail in the side arches.
My research has recently focused on making cameras programmable. One concrete outcome of this project is our Frankencamera architecture, published in this SIGGRAPH 2010 paper and commercialized in Android's Camera2/HAL3 APIs. To help me understand the challenges of building photographic applications for a mobile platform, I tried writing a cell phone app myself. The result is SynthCam. By capturing, tracking, aligning, and blending a sequence of video frames, the app makes the near-pinhole aperture on an iPhone camera act like the large aperture of a single-lens-reflex (SLR) camera. This includes the SLR's shallow depth of field and resistance to noise in low light. The app is available for $0.99 in the iTunes app store. I don't expect to get rich from this app, but I learned a lot by writing it, and seeing it appear in the app store was a thrill. (Update - it's now free.) Here are a few of my favorite reviews of the app: MIT Technology Review, WiReD, The Economist.

In 1999 the National Academies published Funding a Revolution: Government Support for Computing Research. This landmark study, sometimes called the Brooks-Sutherland report, argued that research in computer science often takes 15 years to pay off. The iconic illustration from that report is reproduced at right. In 1996 Pat Hanrahan and I begin working on light fields and synthetic focusing, supported by the National Science Foundation. In 2005 Ren Ng, a PhD student in our lab, worked out an optical design that allowed dense light fields to be captured by a handheld camera. This design enabled everyday photographs to be refocused after they are captured. In 2006 Ren started a company called Refocus Imaging to commercialize this technology. In 2011 that company, now called Lytro, announced its first camera. So 15 years from initial idea to first product. An exciting ride, but a long wait. At left is a picture I took using the Lytro. Click here for my public page of Lytro pictures.

Autobiography

In 2012 I was invited to give the commencement address at the 2012 Doctoral Hooding Ceremony of the University of North Carolina (from which I graduated with a doctorate in 1989). After the ceremony a number of people asked for the text of my address. Here it is, retrospectively titled "Where do disruptive ideas come from?". Or here is UNC's version, with more photos like the one at left. And here is the video.
Portrait photographer Louis Fabian Bachrach took some nice photographs (here and here) of me in 1997 for the Computer Museum in Boston (now closed). I do occasionally wear something besides blue dress shirts. Here are shots with other shirts, from August 2001 and July 2003. Yes, that's a Death Ride T-shirt in the last shot. I also rode in 2005, and yes, I finished all 5 passes - 15,000 feet of climbing. That's why I'm smiling in the official ride photograph (shown at left), taken at the top of Carson Pass after 12 hours of cycling.
During a 1998-99 sabbatical in Italy, my students and I digitized 10 of Michelangelo's statues in Florence. We called this the Digital Michelangelo Project. Here are some photographic essays about personal aspects of the sabbatical. In particular, I spent the year learning to carve in marble. At left is my first piece - a mortar with decorated supports. Here are some sculptures by my mother, who unlike me had real talent.
The Digital Michelangelo Project was not my first foray into measuring and rendering 3D objects. Here are some drawings I made in college for the Historic American Buildings Survey. In this project the measuring was done by hand - using rulers, architect's combs, and similar devices.
I still like finding and measuring old objects, especially if it involves getting dirty. This photographic essay describes a week I spent on an archaeological dig in the Roman Forum. The image at left, taken during the dig, graces the front cover of The Bluffer's Guide to Archaeology.
My favorite radio interview, by Noah Adams of National Public Radio's All Things Considered - about the diverging gaze directions of the two eyes in Michelangelo's David (June 13, 2000). (Click to hear the interview using RealAudio at 14.4Kbs or 28.8Kbs, or as a .wav file.)
This interview, by Guy Raz, weekend host of All Things Considered, runs a close second. It's about the Frankencamera (October 11, 2009), pictured at left. (Click here for NPR's web page containing the story and pictures, and here for a direct link to the audio as an .mp3 file.)
Finally, here's a text-only interview at SIGGRAPH 2003, by Wendy Ju, with reminiscences of my early mentors in computer graphics.
Speaking of computer graphics, I'm fond of the front cover of the Siggraph 2001 proceedings. The image is from a paper (in the proceedings) on subsurface scattering, co-authored with Henrik Wann Jensen, Steve Marschner, and Pat Hanrahan. And check out this milk. This paper won a Technical Academy Award in 2004. Subsurface scattering is now ubiquitous in CG-intensive movies.
However, not everything went smoothly at Siggraph 2001. A more-strenuous-than-expected after-Siggraph hike inspired Pat Hanrahan's and my students to create this humorous movie poster. Click here for the innocent version of this story. And here for the real story.

Genealogy

A lot of my research relates to volume data. The cause may be genetic. My mother's cousin David Chesler is credited with the first demonstration of filtered backprojection, the dominant method used in computed tomography (CT) and positron emission tomography (PET) for combining multiple projections to yield 3D medical data. Here is a description of his contributions.
My father's genes also seem to be guiding my research tastes. Optics has been in my family for four generations. My father Barton Monroe Levoy and my grandfather Monroe Benjamin Levoy were opticians and sellers of eyeglasses through their company, Tura. At left is an early brochure.
Going back further, my great-grandfather Benjamin Monroe Levoy sold eyeglasses, cameras, microscopes, and other optical instruments in New York City a century ago. Here is a piece of stationery from his store. He later moved to 42nd street, as evidenced by the address on the case of these eyeglasses, remade as pince-nez with a retractor. (At left is a closeup of the embossed address.) And here is a wooden box he used to mail eyeglasses to customers. The stamp is dated 1902.
In the drawing (at left) illustrating that stationary, I believe you can see a microscope. In any case I have an old microscope from his store. This specimen of a silkworm mouth, which accompanied the microscope, appears in our SIGGRAPH 2006 paper on light field microscopy.
My great-grandfather apparently also sold binoculars from the store. This pair, made by Jena Glass about 100 years ago and inscribed with the name B.M. Levoy, New York, was recovered by a SWAT team during a drug raid in South Florida in 2008. They have undoubtedly passed through many hands during their long and storied life. It would be fascinating to watch a video of everything these lenses have seen.
When my students work at the optical bench, they're perplexed by my arcane knowledge of mirror technology. Returning to my mother's side of the family, my great-grandfather Jacob Chesler built a factory in Brooklyn (pictured at left) that made hardware. The building passed to my grandfather Nathan Chesler, who converted it to making decoratively bevelled mirrors. I spent many pleasant hours studying the factory's machinery, designed by my uncle Bertram Chesler, for silvering large plate-glass mirrors.


© 1994-2010 Marc Levoy
Last update: October 28, 2014 12:31:02 AM