IP Library Granted Patent US 10,542,328
Granted Patent B2
US 10,542,328 · App. 15/395,951 · Granted Jan 21, 2020

Systems and methods for providing content

Inventors: Michael Hamilton Coward (Solana Beach, CA); Amit Puntambekar (Fremont, CA); David Young Joon Pio (Santa Clara, CA); Evgeny V. Kuzyakov (San Jose, CA)
Assignee: Facebook, Inc.
H04N21/8456H04N5/23238H04N21/21805H04N21/47217H04N21/6587H04N21/816
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,542,328
App. No.
15/395,951
Granted
Jan 21, 2020
Kind
B2
Abstract

Systems, methods, and non-transitory computer-readable media can present one or more base segments of a first stream of a content item in a viewport interface, the content item being composed using a set of streams that each capture at least one scene from a particular direction, wherein the viewport interface is provided through a display screen of the computing device. A determination is made that a direction of the viewport interface has changed to a different direction during playback of a first base segment of the first stream. One or more offset segments of a second stream that correspond to the different direction are presented in the viewport interface, the offset segments being offset from the set of base segments of the first stream.

Claims (46)

1. A computer-implemented method comprising:

receiving, by a computing device, a plurality of streams of an immersive video of a scene, wherein each stream corresponds to a viewable direction in the immersive video;

partitioning, by the computing device, each stream into a set of base segments;

presenting, by the computing device, a set of base segments of a first stream corresponding to a first direction in a viewport interface; and

upon detecting a change from the first direction of the viewport interface to a second direction during playback of the first stream,

stopping, by the computing device, presentation of the set of base segments of the first stream, and

starting, by the computing device, presentation of offset segments of a second stream corresponding to the second direction in the viewport interface to reduce latency,

wherein the offset segments are offset from base segments of the second stream;

wherein the amount of offset of the second stream is determined based at least in part on a probability transition map predicting changes from the first direction in the viewport interface to the second direction during playback of the first stream.

2. The computer-implemented method of claim 1 , wherein the base segments of the first stream each correspond to a pre-determined fixed-length duration of the first stream.

3. The computer-implemented method of claim 2 , wherein the offset segments of the second stream each correspond to a pre-determined fixed-length duration of the second stream, each offset segment being offset from the respective playback positions of the base segments of the first stream by a pre-determined amount.

4. The computer-implemented method of claim 1 , wherein the offset segments of the second stream are generated based at least in part on a publisher of the content item.

5. The computer-implemented method of claim 1 , wherein the offset segments of the second stream are generated based at least in part on a popularity of the content item as measured by a social networking system.

6. The computer-implemented method of claim 1 , wherein the offset segments of the second stream are generated based at least in part on a probability transition map that predicts a direction of the viewport interface while accessing the content item for any given playback position.

7. The computer-implemented method of claim 1 , wherein the offset segments of the second stream are generated based at least in part on subject matter captured in the scene.

8. The computer-implemented method of claim 1 , wherein the amount of offset of the second stream is determined based on subject matter captured in the scene.

9. The computer-implemented method of claim 1 , wherein the set of streams collectively capture a 360-degree view of the scene.

10. The computer-implemented method of claim 1 , wherein the second stream being presented through the viewport interface is selected based at least in part on a direction of the viewport interface relative to the scene.

11. A system comprising:

at least one processor; and

a memory storing instructions that, when executed by the at least one processor, cause the system to perform:

receiving a plurality of streams of an immersive video of a scene, wherein each stream corresponds to a viewable direction in the immersive video;

partitioning each stream into a set of base segments;

presenting a set of base segments of a first stream corresponding to a first direction in a viewport interface; and

upon detecting a change from the first direction of the viewport interface to a second direction during playback of the first stream,

stopping presentation of the set of base segments of the first stream, and

starting presentation of offset segments of a second stream corresponding to the second direction in the viewport interface to reduce latency,

wherein the offset segments are offset from base segments of the second stream;

wherein the amount of offset of the second stream is determined based at least in part on a probability transition map predicting changes from the first direction in the viewport interface to the second direction during playback of the first stream.

12. The system of claim 11 , wherein the base segments of the first stream each correspond to a pre-determined fixed-length duration of the first stream.

13. The system of claim 12 , wherein the offset segments of the second stream each correspond to a pre-determined fixed-length duration of the second stream, each offset segment being offset from the respective playback positions of the base segments of the first stream by a pre-determined amount.

14. The system of claim 11 , wherein the offset segments of the second stream are generated based at least in part on a publisher of the content item.

15. The system of claim 11 , wherein the offset segments of the second stream are generated based at least in part on a popularity of the content item as measured by a social networking system.

16. A non-transitory computer-readable storage medium including instructions that, when executed by at least one processor of a computing system, cause the computing system to perform a method comprising:

receiving a plurality of streams of an immersive video of a scene, wherein each stream corresponds to a viewable direction in the immersive video;

partitioning each stream into a set of base segments;

presenting a set of base segments of a first stream corresponding to a first direction in a viewport interface; and

upon detecting a change from the first direction of the viewport interface to a second direction during playback of the first stream,

stopping presentation of the set of base segments of the first stream, and

starting presentation of offset segments of a second stream corresponding to the second direction in the viewport interface to reduce latency,

wherein the offset segments are offset from base segments of the second stream;

wherein the amount of offset of the second stream is determined based at least in part on a probability transition map predicting changes from the first direction in the viewport interface to the second direction during playback of the first stream.

17. The non-transitory computer-readable storage medium of claim 16 , wherein the base segments of the first stream each correspond to a pre-determined fixed-length duration of the first stream.

18. The non-transitory computer-readable storage medium of claim 17 , wherein the offset segments of the second stream each correspond to a pre-determined fixed-length duration of the second stream, each offset segment being offset from the respective playback positions of the base segments of the first stream by a pre-determined amount.

19. The non-transitory computer-readable storage medium of claim 16 , wherein the offset segments of the second stream are generated based at least in part on a publisher of the content item.

20. The non-transitory computer-readable storage medium of claim 16 , wherein the offset segments of the second stream are generated based at least in part on a popularity of the content item as measured by a social networking system.

Assignments (2)
CHANGE OF NAME Recorded Dec 1, 2021
From: FACEBOOK, INC.
To: META PLATFORMS, INC.
Reel/Frame 058294/0384 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 5, 2019
From: COWARD, MICHAEL HAMILTON; PUNTAMBEKAR, AMIT; PIO, DAVID YOUNG JOON; KUZYAKOV, EVGENY V.
To: FACEBOOK, INC.
Reel/Frame 048244/0489 →
Continuity (1)
Related Publication 20180190327A1 · Jul 5, 2018