IP Library Granted Patent US 9,838,687
Granted Patent B1
US 9,838,687 · App. 14/040,390 · Granted Dec 5, 2017

Apparatus and method for panoramic video hosting with reduced bandwidth streaming

Inventors: Bill Banta (Lafayette, CA); Paul Alioshin (Palo Alto, CA)
Assignee: AMAZON TECHNOLOGIES, INC.
H04N19/00903H04N21/21805H04N21/4728H04N21/47202
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,838,687
App. No.
14/040,390
Granted
Dec 5, 2017
Kind
B1
Abstract

A server includes an input node to receive video streams forming a panoramic video. A module forms a suggested field of view in the panoramic video. The suggested field of view is based upon a viewing parameter, such as a client device motion parameter or a motion prediction parameter. An output node sends the suggested field of view to a client device.

Claims (45)

1. A server, comprising:

a processor programmed to:

receive a plurality of image frames;

generate a panoramic video from the plurality of image frames;

receive a request from a requesting client device for at least a portion of the panoramic video;

determine a suggested field of view in the panoramic video, wherein the suggested field of view is determined based upon data received from a plurality of client devices, the data representing viewing parameters associated with the client devices;

identify a direction in which the plurality of client devices navigate in the panoramic video;

increase a size of a buffer of the suggested field of view in the direction in which the plurality of client devices navigated in the panoramic video; and

send the suggested field of view to the requesting client device.

2. The server of claim 1 wherein the viewing parameters comprise a motion parameter of the requesting client device.

3. The server of claim 1 wherein the viewing parameters comprise a motion prediction parameter based upon view selections from the plurality of client devices.

4. The server of claim 3 wherein the motion prediction parameter is based upon evaluating panning sequences from the plurality of client devices.

5. The server of claim 3 wherein the motion prediction parameter is based upon evaluating popular field of view selections from the plurality of client devices.

6. The server of claim 1 , wherein the processor is further programmed to determine a direction in which a user of the requesting client device is looking relative to the suggested field of view.

7. The server of claim 1 wherein the processor is further programmed to determine a current field of view of a user of the requesting client device within the panoramic video.

8. The server of claim 1 wherein the processor is further programmed to modulate panoramic video delivered to the requesting client device based upon a dynamic assessment of available network bandwidth.

9. The server of claim 1 , wherein the processor is further programmed to supply panoramic video to the requesting client device, wherein the panoramic video has high resolution video in a field of view and low resolution video outside the field of view.

10. The server of claim 1 , wherein the processor is further programmed to evaluate time stamps associated with the plurality of image frames.

11. The server of claim 1 , wherein the processor is further programmed to:

determine an average navigation speed of the plurality of client devices in terms of a first number of degrees per unit of time; and

increase the size of the buffer to a second number of degrees, wherein the second number of degrees is at least twice the first number of degrees.

12. The server of claim 1 , wherein the buffer comprises buffered image data, and wherein the processor is further programmed to segment the buffered image data into a number of polygons including at least one oblique angle.

13. The server of claim 1 , wherein the processor is further programmed to:

send the suggested field of view to the requesting client device at a first resolution; and

send a different field of view to a second requesting client device at a second resolution lower than the first resolution, wherein the different field of view has been requested fewer times by the plurality of client devices relative to the suggested field of view.

14. The server of claim 1 , wherein:

the plurality of image frames are recorded for an event; and

the processor is further programmed to send the suggested field of view to a client device while the event is occurring.

15. A method, comprising:

receiving a plurality of image frames;

generating a panoramic video from the plurality of image frames;

receiving a request from a requesting client device for at least a portion of the panoramic video;

determining a suggested field of view in the panoramic video, wherein the suggested field of view is determined based upon data received from a plurality of client devices, the data representing viewing parameters associated with the client devices;

identify a direction in which the plurality of client devices navigate in the panoramic video;

increase a size of a buffer of the suggested field of view in the direction in which the plurality of client devices navigated in the panoramic video; and

send the suggested field of view to the requesting client device.

16. The method of claim 15 , further comprising:

recording the plurality of image frames for an event; and

sending the suggested field of view to a client device while the event is occurring.

17. The method of claim 15 , wherein the buffer comprises buffered image data, and wherein the method further comprises segmenting the buffered image data into a number of polygons including at least one oblique angle.

18. The method of claim 15 , further comprising:

sending the suggested field of view to the requesting client device at a first resolution; and

sending a different field of view to a second requesting client device at a second resolution lower than the first resolution, wherein the different field of view has been requested fewer times by the plurality of client devices relative to the suggested field of view.

19. The method of claim 15 wherein the viewing parameters comprise a motion parameter of the requesting client device.

20. The method of claim 15 wherein the viewing parameters comprise a motion prediction parameter based upon view selections from the plurality of client devices.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 4, 2016
From: STEALTHHD LLC
To: AMAZON TECHNOLOGIES, INC.
Reel/Frame 038338/0297 →
CHANGE OF NAME Recorded Jan 9, 2015
From: STEALTHHD, INC.
To: STEALTHHD LLC
Reel/Frame 034749/0590 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 27, 2013
From: BANTA, BILL; ALIOSHIN, PAUL
To: STEALTHHD, INC.
Reel/Frame 031303/0128 →
Continuity (3)
Continuation In Part 13691654 · Nov 30, 2012
Provisional Application 61707746 · Sep 28, 2012
Provisional Application 61566269 · Dec 2, 2011