IP Library Granted Patent US 10,349,068
Granted Patent B1
US 10,349,068 · App. 15/807,421 · Granted Jul 9, 2019

Apparatus and method for panoramic video hosting with reduced bandwidth streaming

Inventors: Bill Banta (Lafayette, CA); Paul Alioshin (Palo Alto, CA)
Assignee: AMAZON TECHNOLOGIES, INC.
H04N19/40H04N21/21805H04N21/4728H04N21/47202
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,349,068
App. No.
15/807,421
Granted
Jul 9, 2019
Kind
B1
Abstract

A server includes an input node to receive video streams forming a panoramic video. A module forms a suggested field of view in the panoramic video. The suggested field of view is based upon a viewing parameter, such as a client device motion parameter or a motion prediction parameter. An output node sends the suggested field of view to a client device.

Claims (59)

1. A method, comprising:

receiving a request from a requesting client device for at least a first portion of a video comprising multiple fields of view;

determining a first suggested field of view of the video at a first time, wherein the first suggested field of view is determined based upon first data received from a plurality of client devices, the first data based on viewing parameters associated with the plurality of client devices at the first time;

identifying a second portion of the video that at least one of the plurality of client devices displayed;

sending the first suggested field of view to the requesting client device;

sending the second portion of the video to the requesting client device;

determining a second suggested field of view of the video at a second time, the second suggested field of view different from the first suggested field of view, wherein the second suggested field of view is determined based upon second data received from the plurality of client devices, the second data based on viewing parameters associated with the plurality of client devices at the second time; and

sending the second suggested field of view to the requesting client device.

2. The method of claim 1 , further comprising:

receiving a plurality of image frames;

generating the video from the plurality of image frames; and

evaluating time stamps associated with the plurality of image frames.

3. The method of claim 1 , further comprising:

increasing a size of a buffer associated with the first suggested field of view to include the second portion of the video;

determining an average navigation speed of the plurality of client devices in terms of a first number of degrees per unit of time; and

increasing the size of the buffer to a second number of degrees, wherein the second number of degrees is at least twice the first number of degrees.

4. The method of claim 1 , further comprising:

increasing a size of a buffer associated with the first suggested field of view to include the second portion of the video, wherein the buffer comprises buffered image data; and

segmenting the buffered image data into a number of polygons including at least one oblique angle.

5. The method of claim 1 , further comprising:

sending the first suggested field of view to the requesting client device at a first resolution; and

sending a different field of view to a second requesting client device at a second resolution lower than the first resolution, wherein the different field of view has been requested fewer times by the plurality of client devices relative to the first suggested field of view.

6. The method of claim 1 , further comprising:

receiving a plurality of image frames, wherein the plurality of image frames are recorded for an event; and

sending the first suggested field of view to the requesting client device while the event is occurring.

7. The method of claim 1 , wherein the viewing parameters associated with the plurality of client devices at the first time comprise a motion parameter of the requesting client device.

8. The method of claim 1 , wherein the viewing parameters associated with the plurality of client devices at the first time comprise a motion prediction parameter based upon view selections from the plurality of client devices.

9. The method of claim 8 , wherein the motion prediction parameter is based upon evaluating panning sequences from the plurality of client devices.

10. The method of claim 8 , wherein the motion prediction parameter is based upon evaluating popular field of view selections from the plurality of client devices.

11. The method of claim 1 , wherein the video has a first resolution in the first suggested field of view and a second resolution outside the first suggested field of view, wherein the first resolution is higher than the second resolution.

12. A method, comprising:

determining a first suggested field of view of a recorded event at a first time, wherein the first suggested field of view is determined based upon first data received from a plurality of client devices, the first data based on viewing parameters associated with the plurality of client devices at the first time;

sending to a requesting client device a first video stream comprising the first suggested field of view of the recorded event;

determining a second suggested field of view of the first video stream at a second time, the second suggested field of view different from the first suggested field of view, wherein the second suggested field of view is determined based upon second data received from the plurality of client devices, the second data based on viewing parameters associated with the plurality of client devices at the second time;

sending the second suggested field of view to the requesting client device;

determining a third suggested field of view of the recorded event, wherein the third suggested field of view is determined based upon user interactions; and

sending to the requesting client device a second video stream comprising the third suggested field of view of the recorded event.

13. The method of claim 12 , further comprising increasing a size of a buffer associated with the first suggested field of view to include the third suggested field of view of the recorded event.

14. The method of claim 12 , further comprising:

sending the first suggested field of view to the requesting client device at a first resolution; and

sending a different field of view to a second requesting client device at a second resolution lower than the first resolution, wherein the different field of view has been requested fewer times by the plurality of client devices relative to the first suggested field of view.

15. A method, comprising:

sending to a requesting client device at least a first portion of a multiview video requested by the requesting client device, the multiview video comprising a plurality of fields of view;

determining a first suggested field of view of the multiview video at a first time, wherein the first suggested field of view is determined based upon first data received from a plurality of client devices, the first data based on viewing parameters associated with the plurality of client devices at the first time;

identifying a second portion of the multiview video that the plurality of client devices displayed;

increasing a size of a buffer associated with the first suggested field of view to include the second portion of the multiview video;

sending to the requesting client device the first suggested field of view and the buffer including the second portion of the multiview video;

determining a second suggested field of view of the video at a second time, the second suggested field of view different from the first suggested field of view, wherein the second suggested field of view is determined based upon second data received from the plurality of client devices, the second data based on viewing parameters associated with the plurality of client devices at the second time; and

sending the second suggested field of view to the requesting client device.

16. The method of claim 15 , further comprising:

receiving a plurality of image frames of an event;

generating the multiview video from the plurality of image frames; and

sending the first suggested field of view to the requesting client device while the event is occurring.

17. The method of claim 15 , wherein the buffer comprises buffered image data, and wherein the method further comprises segmenting the buffered image data into a number of polygons including at least one oblique angle.

18. The method of claim 15 , further comprising:

sending the first suggested field of view to the requesting client device at a first resolution; and

sending a different field of view to a second requesting client device at a second resolution lower than the first resolution, wherein the different field of view has been requested fewer times by the plurality of client devices relative to the suggested field of view.

19. The method of claim 15 , wherein the viewing parameters associated with the plurality of client devices at the first time comprise a motion parameter of the requesting client device.

20. The method of claim 15 , wherein the viewing parameters associated with the plurality of client devices at the first time comprise a motion prediction parameter based upon view selections from the plurality of client devices.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 8, 2017
From: STEALTHHD LLC
To: AMAZON TECHNOLOGIES, INC.
Reel/Frame 044413/0302 →
CHANGE OF NAME Recorded Nov 8, 2017
From: STEALTHHD, INC.
To: STEALTHHD LLC
Reel/Frame 044580/0123 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 8, 2017
From: BANTA, BILL; ALIOSHIN, PAUL
To: STEALTHHD, INC.
Reel/Frame 044076/0749 →
Continuity (4)
Continuation 14040390 · Sep 27, 2013
Continuation In Part 13691654 · Nov 30, 2012
Provisional Application 61707746 · Sep 28, 2012
Provisional Application 61566269 · Dec 2, 2011