Video system for real-time panoramic video delivery

1. A video processing method, comprising;

capturing a video at a first location from a camera including a plurality of sensors, wherein each of the plurality of sensors are placed along an arc;

synchronizing and stitching images corresponding to the plurality of sensors to produce a panoramic video having at least a 100° field of view;

processing the panoramic video at cloud-based server for delivery to each of a plurality of client devices, wherein the processing is performed based on determination of a region of interest (ROI) for each of the plurality of client devices based on at least one of zooming and panning information received from each of the plurality of client devices; and

streaming the corresponding processed video to each of the plurality of client devices.

2. The method of claim 1 , wherein the capturing and the stitching is performed at a latency of less than 1.2 times a frame-time for captured video.

3. The method of claim 1 , wherein the cloud-based server processes the video with a latency of less than 0.4 times a frame-time for the captured video.

4. The method of claim 1 , wherein the processing by the cloud-based server comprises customizing the panoramic video on a stream-by-stream basis, wherein each customized stream is customized for a particular client device based on a region of interest (ROI) associated with the client device.

5. The method of claim 4 , wherein each customized stream includes more bits in the video stream for areas corresponding to the region of interest (ROI) associated with that client device for that stream.

6. The method of claim 1 , wherein the stitching is based on a non-linear seam selected from a region of overlap between two adjacent images.

7. The method of claim 1 , wherein the stitching is based on a seam calculated between two adjacent images based on a technique that minimizes the temporal and spatial distortion seen when traversing the adjacent images in the region of overlap between the two images from top to bottom.

8. The method of claim 1 , further comprising:

encoding the panoramic video by determining a number of slices into which to slice each input frame of the panoramic video;

determining a number of stacks associated with an output encoding;

slicing each input frame into the number of slices; and

stacking each slice into encoded frames of the output encoding.

9. A video capture and delivery system, comprising:

a camera including a plurality of sensors placed along an arc configured to:

capture video at a first location;

synchronize and stitch images corresponding to the plurality of sensors to produce a panoramic video having at least a 100° field of view; and

a cloud-based server configured to:

process the panoramic video for delivery to each of a plurality of client devices, wherein the processing is performed based on determination of a region of interest (ROI) for each of the plurality of client devices based on at least one of zooming and panning information received from each of the plurality of client devices; and

stream the corresponding processed video to each of the plurality of client devices.

10. The system of claim 9 , wherein the capturing and the stitching is performed at a latency of less than 1.2 times a frame-time of captured video.

11. The system of claim 9 , wherein the cloud-based server processes the video with a latency of less than 0.4 times a frame-time of the captured video.

12. The system of claim 9 , wherein the processing by the cloud-based server comprises customizing the panoramic video on a stream-by stream basis, wherein each customized stream is customized for a particular client device based on region of interest (ROI) associated with the client device.

13. The system of claim 11 , wherein each customized stream includes more bits in the video stream for areas corresponding to the region of interest (ROI) associated with that client device for that stream.

14. The system of claim 9 , wherein the stitching is based on a non-linear seam selected from a region of overlap between two adjacent images.

15. The system of claim 9 , wherein the stitching is based on a seam calculated between two adjacent images based on a technique that minimizes the temporal and spatial distortion seen when traversing the adjacent images in region of overlap between the two images from top to bottom.

16. The system of claim 9 , wherein the camera is further configured to:

encode the panoramic video based on a technique comprising determining a number of slices into which to slice each input frame of the panoramic video;

determining a number of stacks associated with an output encoding;

slicing each input frame into the number of slices; and

stacking each slice into encoded frames of the output encoding.