Refocus and See-Thru result

Digital Refocus & See-Thru Effect

Based on Stanford University's paper on plane+parallax calibration, I was able to learn how light field consists of images of a scene taken from different viewpoints. They introduce how it is possible to obtain refocusing and see-through effect by using the light field. The goal of this exercise was to acheive the same effect using my own photos and coding. The original photos in this project were taken by Nikon Coolpix P80 camera with 10.1 megapixel sensor. I used openFrameworks for coding in this project.

Video capture of Refocus and See-Through effect using openFrameworks | vimeo link

Understanding Light Field Camera

Imagine taking a series of images from different viewpoint on a plane. For each image, a ray starting from the viewpoint on the camera plane can be applied to every pixels. This database of rays is called ‘light field.’ I drew a simple diagram to help myself understand the basics of this concept. (Figure 9)

Let’s say that ‘y’ is the distance between the target object and the camera’s lens. ‘x’ is the distance from the lens to the sensor. With simple math, you can figure out how shifting each pixels of every images can define the distance, ‘y.’ (If ‘y’ is smaller, depth of field becomes shorter. If ‘y’ is larger, depth of field becomes further)

Fall 2011, MAS.131: Computational Camera and Photography, MIT Media lab | Project website link