Making Images at the Speed of Light

Oct 01, 2012
By Spectroscopy Editors

Today, the capabilities of modern technologies are constantly increasing, and instruments are becoming smaller, faster, cheaper, more portable, and more easily interconnected. This is true for many analytical spectroscopy techniques as well as for a wide range of other technologies that have the potential to intersect with the field of spectroscopy and expand its boundaries. To explore these developments, Spectroscopy is launching an article series about new technologies and new applications of existing technologies that are based on or related to light. We kick off the series with this interview with Andreas Velten about his work as a postdoctoral associate at the Massachusetts Institute of Technology (MIT) Media Lab in Cambridge, Massachusetts. (Velten has since taken a position as associate scientist at the Morgridge Institute for Research at the University of Wisconsin in Madison).

Velten and his colleagues in Professor Ramesh Raskar's "Camera Culture" group at the MIT Media Lab, in collaboration with the spectroscopy laboratory of MIT Professor Moungi Bawendi, developed a technique they called "femto photography." The technique uses a titanium–sapphire laser that emits pulses every ~13 ns, picosecond-accurate detectors, and complex mathematical reconstruction techniques. By combining hundreds of "streak" images (one-dimensional movies of a line), captured with this high-speed camera, they have created moving pictures (never perhaps was there a more apt use of the term) that show the movement of light (groups of photons). Examples of their use of the technique include combined images of light traveling through a soda bottle and, in a separate application, over a piece of fruit.

Spectroscopy: How did the femto photography project get started?

Velten: About two years ago, I joined Ramesh Raskar's group at the MIT Media Lab to do a post-doc. Ramesh had been thinking for a long time about combining ultrafast optics and computational photography to build an imaging system that can look around corners. He and his group had taken some initial steps in implementing the idea. It's kind of an unusual match, because my background is in ultrafast optics and this group is doing computer vision and computational photography. But it's very interesting to combine the two fields. People in ultrafast optics are trying to push the envelope of the hardware — to see how short we can make the pulses, to improve ranging. For example, with light detection and ranging (LIDAR) we send a laser pulse to a target and wait until the light comes back, and from the time that has passed, we can measure the distance to the target. It's used in traffic control these days. But I was thinking about imaging and what could be done with imaging data in signal processing.

On the other hand, with computational photography people basically take consumer cameras and make small modifications to them, and do amazing things by processing the data and looking at the data in a new way. Our project is kind of a combination of the two fields. We use nonstandard hardware — hardware you can set to the time of flight of the light that you are using it for imaging. We wanted to develop new capabilities of this method by further processing the data. The initial goal was to build a camera that could image around a corner (a special application).

Spectroscopy: So how did you end up photographing visible light photons — in other words, doing photography at the speed of light?

Velten: Once you have the time-of-flight imaging, you can get a lot more information from the light by post-processing the data. Professor Raskar and our whole Camera Culture group is very interested in computational photography and were inspired by the "bullet through an apple" strobe photos by Doc Edgerton. I had taken some of our streak camera images and created one-dimensional movies. Professor Raskar challenged us to think about ways to convert the one-dimensional streak tube to create visually meaningful ultrafast two-dimensional movies. I realized at some point, from playing with the camera, that you could actually compose movies — that you could stitch the data together in a way that would allow you to reconstruct a complete movie out of the data that you capture. Making these movies was really a side project. Our team, especially Everett Lawson and I, started to put together a mirror based system. Then a set of collaborators, Diego Gutierez, Di Wu, and members of Diegos group, Adrian Jarabo, Elisa Amoros Galindo, and Belen Masia, got excited and worked on visualizing the results better in the videos and doing things like generating single pictures from them.