IP Library Granted Patent US 10,657,702
Granted Patent B2
US 10,657,702 · App. 15/847,184 · Granted May 19, 2020

Systems and methods for content streaming

Inventors: David Young Joon Pio (Santa Clara, CA); Evgeny V. Kuzyakov (San Jose, CA); Chien-Nan Chen (Champaign, IL)
Assignee: Facebook, Inc.
G06T15/20G06F3/011G06T3/005G06T2200/04H04N21/6125H04N21/816
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,657,702
App. No.
15/847,184
Granted
May 19, 2020
Kind
B2
Abstract

Systems, methods, and non-transitory computer-readable media can obtain a spherical media content item that captures at least one scene from a plurality of different positions. A three-dimensional shape having a plurality of faces is determined, each face being associated with a respective set of original boundaries. A respective set of expanded boundaries for one or more of the plurality of faces is determined. Respective portions of the spherical media content item are mapped to each of the one or more faces, wherein a first portion of the spherical media content item is mapped to a first face having a set of expanded boundaries.

Claims (33)

1. A computer-implemented method comprising:

determining, by a computing device, a viewport interface for accessing a content item, the content item being composed using a set of content streams that capture at least one scene from a plurality of different positions;

predicting, by the computing device, at least one change in a direction of the viewport interface while accessing the content item, wherein the predicted change in the direction corresponds to a second viewport interface for accessing at least one different content stream of the content item, the predicting further comprising:

determining, by the computing device, the change in the direction to correspond to the second viewport interface for accessing the at least one different content stream based at least in part on aggregated user data indicating playback times at which viewport interfaces of different users transitioned to the at least one different content stream while accessing the content item; and

buffering, by the computing device, the at least one different content stream corresponding to the second viewport interface prior to the viewport interface transitioning to the second viewport interface.

2. The computer-implemented method of claim 1 , wherein the viewport interface presents one or more content streams from the set of content streams, the one or more content streams being determined based at least in part on the direction of the viewport interface.

3. The computer-implemented method of claim 1 , wherein the at least one change in the direction is predicted based at least in part on aggregated user viewing patterns associated with the content item.

4. The computer-implemented method of claim 1 , wherein the at least one change in the direction is predicted based at least in part on aggregated user data that measures one or more changes to respective directions of user viewport interfaces while accessing the content item.

5. The computer-implemented method of claim 4 , wherein the aggregated user data indicates at least one playback time at which a viewport interface of a given user transitioned from a first direction to a second direction.

6. The computer-implemented method of claim 1 , wherein the prediction is based at least in part on a probability transition map that provides respective likelihoods of a direction of a viewport interface transitioning from a first direction to a second direction at a given playback time.

7. The computer-implemented method of claim 6 , wherein the probability transition map is implemented as a Markov model.

8. The computer-implemented method of claim 1 , wherein the computing device is a mobile device or virtual reality apparatus.

9. The computer-implemented method of claim 1 , wherein the plurality of content streams collectively capture a 360-degree view of the at least one scene.

10. A system comprising:

at least one processor; and

a memory storing instructions that, when executed by the at least one processor, cause the system to perform:

determining a viewport interface for accessing a content item, the content item being composed using a set of content streams that capture at least one scene from a plurality of different positions;

predicting at least one change in a direction of the viewport interface while accessing the content item, wherein the predicted change in the direction corresponds to a second viewport interface for accessing at least one different content stream of the content item, the predicting further comprising:

determining the change in the direction to correspond to the second viewport interface for accessing the at least one different content stream based at least in part on aggregated user data indicating playback times at which viewport interfaces of different users transitioned to the at least one different content stream while accessing the content item; and

buffering the at least one different content stream corresponding to the second viewport interface prior to the viewport interface transitioning to the second viewport interface.

11. The system of claim 10 , wherein the viewport interface presents one or more content streams from the set of content streams, the one or more content streams being determined based at least in part on the direction of the viewport interface.

12. The system of claim 10 , wherein the at least one change in the direction is predicted based at least in part on aggregated user viewing patterns associated with the content item.

13. The system of claim 10 , wherein the at least one change in the direction is predicted based at least in part on aggregated user data that measures one or more changes to respective directions of user viewport interfaces while accessing the content item.

14. The system of claim 13 , wherein the aggregated user data indicates at least one playback time at which a viewport interface of a given user transitioned from a first direction to a second direction.

15. A non-transitory computer-readable storage medium including instructions that, when executed by at least one processor of a computing system, cause the computing system to perform:

determining a viewport interface for accessing a content item, the content item being composed using a set of content streams that capture at least one scene from a plurality of different positions;

predicting at least one change in a direction of the viewport interface while accessing the content item, wherein the predicted change in the direction corresponds to a second viewport interface for accessing at least one different content stream of the content item, the predicting further comprising:

determining the change in the direction to correspond to the second viewport interface for accessing the at least one different content stream based at least in part on aggregated user data indicating playback times at which viewport interfaces of different users transitioned to the at least one different content stream while accessing the content item; and

buffering the at least one different content stream corresponding to the second viewport interface prior to the viewport interface transitioning to the second viewport interface.

16. The non-transitory computer-readable storage medium of claim 15 , wherein the viewport interface presents one or more content streams from the set of content streams, the one or more content streams being determined based at least in part on the direction of the viewport interface.

17. The non-transitory computer-readable storage medium of claim 15 , wherein the at least one change in the direction is predicted based at least in part on aggregated user viewing patterns associated with the content item.

18. The non-transitory computer-readable storage medium of claim 15 , wherein the at least one change in the direction is predicted based at least in part on aggregated user data that measures one or more changes to respective directions of user viewport interfaces while accessing the content item.

19. The non-transitory computer-readable storage medium of claim 18 , wherein the aggregated user data indicates at least one playback time at which a viewport interface of a given user transitioned from a first direction to a second direction.

Assignments (2)
CHANGE OF NAME Recorded Dec 3, 2021
From: FACEBOOK, INC.
To: META PLATFORMS, INC.
Reel/Frame 058302/0925 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 2, 2019
From: PIO, DAVID YOUNG JOON; KUZYAKOV, EVGENY V.; CHEN, CHIEN-NAN
To: FACEBOOK, INC.
Reel/Frame 048775/0533 →