Generating stereoscopic light field panoramas using concentric viewing circles

1. A system for generating stereoscopic light field panoramas, comprising:

a receiver to receive a plurality of synchronized images;

a calibrator and projector to calibrate the synchronized images, undistort the synchronized images, and project the undistorted synchronized images to a sphere to generate undistorted rectilinear images;

a disparity estimator to estimate a disparity between neighboring views of the undistorted rectilinear images to determine an optical flow between the undistorted rectilinear images;

a view interpolator to perform in-between view interpolation on the undistorted rectilinear images based on the optical flow, wherein a smoothness factor indicating an amount of the in-between view interpolation to be used for a pair of the undistorted rectilinear images is based on a view density threshold or a head motion speed threshold; and

a light field panorama generator to generate a stereoscopic light field panorama for a plurality of perspectives using two different concentric viewing circles for a left eye viewpoint and a right eye viewpoint, wherein the two different concentric viewing circles are concentric to each other and constrained by an inter-pupillary distance.

2. The system of claim 1 , further including a transmitter to transmit a stereoscopic light field panorama corresponding to a particular perspective to a head mounted display.

3. The system of claim 1 , wherein the smoothness factor is based on the view density threshold and the head motion speed threshold.

4. The system of claim 1 , wherein the stereoscopic light field panoramas each include a plurality of slices of a plurality of image planes corresponding to the two different concentric viewing circles for each perspective.

5. The system of claim 1 , wherein the synchronized images include objects that were at least a meter away from a circle of cameras used to capture the synchronized images.

6. The system of claim 1 , wherein the plurality of synchronized images are synchronized using audio.

7. The system of claim 1 , wherein the calibrator and projector is to further rectify the undistorted rectilinear images to compensate for a camera misalignment.

8. The system of claim 1 , further including a head mounted display to detect a translation and send updated coordinates corresponding to a perspective to the receiver.

9. The system of claim 1 , further including a plurality of cameras arranged in a camera ring, wherein the cameras include a plurality of wide angle lenses designed based on a target range of parallax, a radius of the camera ring of the cameras, and a target field of view for the wide angle lenses.

10. A method for generating stereoscopic light field panoramas, comprising:

receiving, via a processor, a plurality of synchronized images;

calibrating, via the processor, the synchronized images, undistorting the synchronized images, and projecting the undistorted synchronized images to a sphere to generate undistorted rectilinear images;

estimating, via the processor, a disparity between neighboring views of the undistorted rectilinear images to determine an optical flow between the undistorted rectilinear images;

performing, via the processor, in-between view interpolation on the undistorted rectilinear images based on the optical flow, wherein a smoothness factor indicating an amount of the in-between view interpolation to be used for a pair of the undistorted rectilinear images is based on a view density threshold or a head motion speed threshold; and

generating, via the processor, a stereoscopic light field panorama for a plurality of perspectives using two different concentric viewing circles for a left eye viewpoint and a right eye viewpoint, wherein the two different concentric viewing circles are concentric to each other and constrained by an inter-pupillary distance.

11. The method of claim 10 , further including transmitting, via the processor, the stereoscopic light field panorama corresponding to a perspective to a head mounted display in response to receiving coordinates corresponding to the perspective from the head mounted display.

12. The method of claim 10 , further including capturing the synchronized images, wherein the synchronized images are synchronized using audio.

13. The method of claim 10 , wherein the generating of the stereoscopic light field panorama includes performing omnistereo stitching using the two different concentric viewing circles.

14. The method of claim 10 , wherein the generating of the stereoscopic light field panorama includes stitching a plurality of slices of a plurality of image planes corresponding to the two different concentric viewing circles for each perspective.

15. The method of claim 10 , further including rectifying the undistorted rectilinear images to compensate for a camera misalignment.

16. The method of claim 10 , further including receiving updated coordinates corresponding to a detected translation from a head mounted display and sending an updated stereoscopic light field panorama corresponding to an updated perspective to the head mounted display.

17. The method of claim 10 , wherein the smoothness factor is based on the view density threshold and the head motion speed threshold.

18. The method of claim 10 , wherein the in-between view interpolation is performed on undistorted rectilinear images from neighboring cameras.

19. At least one non-transitory computer readable medium for generating stereoscopic light field panoramas having instructions stored therein that, in response to being executed on a computing device, cause the computing device to:

receive a plurality of synchronized images;

calibrate the synchronized images, undistort the synchronized images, and project the undistorted synchronized images to a sphere to generate undistorted rectilinear images;

estimate a disparity between neighboring views of the undistorted rectilinear images to determine an optical flow between the undistorted rectilinear images;

perform in-between view interpolation on the undistorted rectilinear images based on the optical flow, wherein a smoothness factor indicating an amount of the in-between view interpolation to be used for a pair of the undistorted rectilinear images is based on a view density threshold or a head motion speed threshold;

generate a stereoscopic light field panorama for a plurality of perspectives using two different concentric viewing circles for a left eye viewpoint and a right eye viewpoint, wherein the two different concentric viewing circles are concentric to each other and constrained by an inter-pupillary distance;

receive coordinates corresponding to a perspective from a head mounted display; and

transmit a stereoscopic light field panorama of the perspective corresponding to the coordinates to the head mounted display.

20. The at least one non-transitory computer readable medium of claim 19 , further including instructions to perform omnistereo stitching using the two different concentric viewing circles.

21. The at least one non-transitory computer readable medium of claim 19 , wherein the smoothness factor is based on a detected speed of translation of the head mounted display.

22. The at least one non-transitory computer readable medium of claim 19 , further including instructions to rectify the undistorted rectilinear images to compensate for a camera misalignment.

23. The at least one non-transitory computer readable medium of claim 19 , further including instructions to transmit an updated stereoscopic light field panorama corresponding to a different perspective to the head mounted display in response to receiving an updated coordinate corresponding to the different perspective.