IP Library › Granted Patent US 10,547,825
Granted Patent B2
US 10,547,825 · App. 14/856,511 · Granted Jan 28, 2020

Transmission of three-dimensional video

Inventors: Sajid Sadi (San Jose, CA); Sergio Perdices-Gonzalez (Santa Clara, CA); Rahul Budhiraja (Masaieed, QA); Brian Dongwoo Lee (Gyeonggido, KR); Ayesha Mudassir Khwaja (Stanford, CA); Pranav Mistry (Cupertino, CA)
Assignee: Samsung Electronics Company, Ltd.
H04N13/194G02B27/017G03B35/08G03B37/04H04N5/23229H04N5/247H04N5/265H04N13/111H04N13/117H04N13/161H04N13/243H04N13/254H04N13/261H04N13/271H04N19/54H04N19/597H04N19/61G02B2027/0134G02B2027/0138G06T2200/04
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,547,825
App. No.
14/856,511
Granted
Jan 28, 2020
Kind
B2
Abstract

In one embodiment, a method includes receiving, from a client device, a request corresponding to a particular view of a three-dimensional video comprising multiple views. The method also includes accessing a data stream corresponding to the video. The method further includes selecting, based on the request, one or more portions of the accessed data stream, at least one of the selected portions corresponding to the particular view. The method also includes transmitting the selected portion of the accessed data stream to the client device.

Claims (73)

1. A method comprising:

receiving, from a client device, a request to provide for display on the client device during a first time period a particular view of a three-dimensional video comprising a plurality of views;

accessing a data stream corresponding to the video;

selecting, based on the request, a plurality of portions of the accessed data stream to transmit to the client device, wherein the plurality of selected portions comprise:

a high-resolution video of the particular view of the three-dimensional video for display during the first time period; and

a low-resolution video of one or more views of the three-dimensional video that are adjacent to but outside the particular view, wherein the low-resolution video is not for display on the client device during the first time period; and

transmitting to the client device a content container comprising the selected portions of the accessed data stream such that the low-resolution video of the one or more views of the three-dimensional video that are adjacent to but outside the particular view is transmitted to the client device before the high-resolution video of the particular view is displayed on the client device.

2. The method of claim 1 , wherein the received request comprises instructions for transmitting one or more of the portions of the accessed data stream at a specified bit rate or omitting one or more portions of the accessed data stream.

3. The method of claim 1 , wherein the received request comprises instructions for transforming the accessed data stream.

4. The method of claim 3 , wherein the transformation comprises transcoding or resizing the accessed data stream.

5. The method of claim 3 , further comprising storing the results of a transformed data stream.

6. The method of claim 1 , further comprising:

decoding the accessed data stream; and

extracting each portion of the selected data stream from the decoded data stream.

7. The method of claim 6 , wherein:

the accessed data stream comprises a plurality of data streams; and

each of the plurality of data streams comprises a particular one of the extracted portions.

8. The method of claim 1 , wherein the video comprises a video stream with multiple resolutions, a video stream from a single camera, a manipulated video stream, or a video stream from a top camera.

9. The method of claim 1 , wherein the accessed data stream comprises a 360° stereoscopic three-dimensional (3-D) video.

10. The method of claim 1 , wherein the accessed data stream comprises one or more audio streams that are time synchronized to the video.

11. The method of claim 1 , wherein the accessed data stream comprises data to reconstruct the video on the client device.

12. The method of claim 11 , wherein the reconstruction data comprises spatial filtering data, distortion data, correction information, or projection parameters of the video.

13. The method of claim 11 , wherein the reconstruction data comprises audio spatial reconstruction data.

14. The method of claim 1 , wherein when the low-resolution video of one or more views of the three-dimensional video that are adjacent to but outside the particular view is displayed on the client device during a second time period, a resolution of the low-resolution video increases proportionally to an amount of time a view corresponding to the low-resolution video is stationary.

15. The method of claim 1 , further comprising

inferring a change in the particular view; and

selecting, based on the inferred change, one or more portions of the accessed data stream corresponding to the inferred change.

16. The method of claim 1 , wherein transmitting the selected portions comprises adjusting a bit rate of the selected portions based on a detected bandwidth of a connection with the client device.

17. The method of claim 1 , further comprising selecting one or more of the plurality of portions of the accessed data stream based on the capabilities of the client device.

18. The method of claim 1 , further comprising receiving, from the client device, a subsequent request for a high-resolution video of a particular one of the one or more views of the three-dimensional video that are adjacent to but outside the particular view, wherein the request is generated based on a determination that the client device is displaying the particular one of the one or more views of the three-dimensional video that are adjacent to but outside the particular view during a second time period that is after the first time period.

19. The method of claim 1 , wherein:

the particular view of the three-dimensional video comprises at least one left-eye image of the view at a particular time and one right-eye image of the view at the particular time;

the data stream comprises the left-eye image or the right-eye image and a description of a plurality of spatial offsets between the left-eye image and the right-eye image; and

transmitting the selected portion of the accessed data stream to the client device comprises transmitting the left-eye image or the right-eye image and the spatial offsets to the client device.

20. The method of claim 19 , wherein the particular view of three-dimensional video further comprises at least one left-eye image of the view at a subsequent time and one right-eye image of the view at the subsequent time;

the data stream further comprises a plurality of time-dependent spatial offsets between:

the left-eye image at the particular time and the left-eye image at the subsequent time; or

the right-eye image at the particular time and the right-eye image at the subsequent time; and

transmitting the selected portion of the accessed data stream to the client device further comprises transmitting the left-eye image at the subsequent time or the right-eye image at the subsequent time and the plurality of time-dependent spatial offsets.

21. One or more non-transitory computer-readable storage media embodying instructions that are operable when executed to:

receive, from a client device, a request to provide for display on the client device during a first time period a particular view of a three-dimensional video comprising a plurality of views;

access a data stream corresponding to the video;

select, based on the request, a plurality of portions of the accessed data stream to transmit to the client device, wherein the plurality of selected portions comprise:

a high-resolution video of the particular view of the three-dimensional video for display during the first time period; and

a low-resolution video of one or more views of the three-dimensional video that are adjacent to but outside the particular view, wherein the low-resolution video is not for display on the client device during the first time period; and

transmit to the client device a content container comprising the selected portions of the accessed data stream such that the low-resolution video of the one or more views of the three-dimensional video that are adjacent to but outside the particular view is transmitted to the client device before the high-resolution video of the particular view is displayed on the client device.

22. The media of claim 21 , wherein the received request comprises instructions for transmitting one or more of the portions of the accessed data stream at a specified bit rate or omitting one or more portions of the accessed data stream.

23. The media of claim 21 , wherein the received request comprises instructions for transforming the accessed data stream.

24. The media of claim 21 , wherein the instructions are further operable when executed to:

decode the accessed data stream; and

extract each portion of the accessed data stream from the decoded data stream.

25. The media of claim 21 , wherein the video comprises a video stream with multiple resolutions, a video stream from a single camera, a manipulated video stream, or a video stream from a top camera.

26. The media of claim 21 , wherein the instructions are further operable when executed to:

infer a change in the particular view; and

select, based on the inferred change, one or more portions of the accessed data stream corresponding to the inferred change.

27. An apparatus comprising:

one or more non-transitory computer-readable storage media embodying instructions; and

one or more processors coupled to the storage media and configured to execute the instructions to:

receive, from a client device, a request to provide for display on the client device during a first time period a particular view of a three-dimensional video comprising a plurality of views;

access a data stream corresponding to the video;

select, based on the request, a plurality of portions of the accessed data stream to transmit to the client device, wherein the plurality of selected portions comprise:

a high-resolution video of the particular view of the three-dimensional video for display during the first time period; and

a low-resolution video of one or more views of the three-dimensional video that are adjacent to but outside the particular view, wherein the low-resolution video is not for display on the client device during the first time period; and

transmit to the client device a content container comprising the selected portions of the accessed data stream such that the low-resolution video of the one or more views of the three-dimensional video that are adjacent to but outside the particular view is transmitted to the client device before the high-resolution video of the particular view is displayed on the client device.

28. The apparatus of claim 27 , wherein the received request comprises instructions for transmitting one or more of the portions of the accessed data stream at a specified bit rate or omitting one or more portions of the accessed data stream.

29. The apparatus of claim 27 , wherein the received request comprises instructions for transforming the accessed data stream.

30. The apparatus of claim 27 , wherein the processors are further configured to execute the instructions to:

decode the accessed data stream; and

extract each portion of the accessed data stream from the decoded data stream.

31. The apparatus of claim 27 , wherein the video comprises a video stream with multiple resolutions, a video stream from a single camera, a manipulated video stream, or a video stream from a top camera.

32. The apparatus of claim 27 , wherein the processors are further configured to execute the instructions to:

infer a change in the particular view; and

select, based on the inferred change, one or more portions of the accessed data stream corresponding to the inferred change.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 19, 2015
From: SADI, SAJID; PERDICES-GONZALEZ, SERGIO; BUDHIRAJA, RAHUL; LEE, BRIAN DONGWOO; KHWAJA, AYESHA MUDASSIR; MISTRY, PRANAV
To: SAMSUNG ELECTRONICS COMPANY, LTD.
Reel/Frame 036824/0905 →
Continuity (7)
Provisional Application 62053726 · Sep 22, 2014
Provisional Application 62053729 · Sep 22, 2014
Provisional Application 62053737 · Sep 22, 2014
Provisional Application 62053743 · Sep 22, 2014
Provisional Application 62141018 · Mar 31, 2015
Provisional Application 62053750 · Sep 22, 2014
Related Publication 20160088282A1 · Mar 24, 2016