IP Library › Granted Patent US 10,313,763
Granted Patent B2
US 10,313,763 · App. 15/660,710 · Granted Jun 4, 2019

Method and apparatus for requesting and receiving selected segment streams based on projection information

Inventors: Wang Lin Lai (San Jose, CA); Shan Liu (San Jose, CA); Xin Wang (Rancho Palos Verdes, CA)
Assignee: MEDIATEK, INC.
H04N21/816H04N7/0117H04N21/234363H04N21/44008H04N21/8146
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,313,763
App. No.
15/660,710
Granted
Jun 4, 2019
Kind
B2
Abstract

Aspects of the disclosure provide an apparatus having an interface circuit, a processing circuit, and a display device. The interface circuit is configured to receive media presentation description information of media data. The media data includes video content on a two-dimensional (2D) plane that is projected from video content of a sphere surface. The video content on the 2D plane includes a plurality of segment streams having different coverages on the 2D plane. The media presentation description information uses projection based spatial relationship description (P-SRD) to describe the different coverages of the video content on the 2D plane according to the projection. The processing circuit is configured to determine one or more segment streams based on a region of interests for image generation and the P-SRD, select segments in the one or more segment streams, and cause the interface circuit to request and receive the selected segments.

Claims (42)

1. An apparatus, comprising:

an interface circuit configured to receive media presentation description information of media data, the media data including video content on a two-dimensional (2D) plane that is projected from video content of a sphere surface according to a projection, the video content on the plane including a plurality of segment streams having different video coverage on the 2D plane, and the media presentation description information using projection based spatial relationship description (P-SRD) to describe the different video coverage by the video content on the 2D plane according to the projection;

a processing circuit configured to determine one or more segment streams based on a region of interests for image generation and the P-SRD, select segments in the one or more segment streams, and cause the interface circuit to request and receive the selected segments; and

a display device configured to display images generated based on the selected segments.

2. The apparatus of claim 1 , wherein the processing circuit is configured to parse a projection indicator from the P-SRD.

3. The apparatus of claim 2 , wherein the processing circuit is configured to parse yaw and pitch coordinates in a sphere coordinate system from the P-SRD when the projection indicator is indicative of an equirectangular projection (ERP).

4. The apparatus of claim 3 , wherein the processing circuit is configured to parse a minimum value of yaw coordinate, a maximum value of yaw coordinate, a minimum value of pitch coordinate, and a maximum value of pitch coordinate from the projection based spatial relationship description that define a region in the 2D plane.

5. The apparatus of claim 3 , wherein the processing circuit is configured to parse yaw and pitch coordinates that define a corner point of a rectangular region, and parse a width and a height of the rectangular region in yaw and pitch coordinates from the P-SRD.

6. The apparatus of claim 2 , wherein the processing circuit is configured to parse one or more face indexes from the P-SRD when the projection indicator is indicative of a platonic solid projection.

7. The apparatus of claim 2 , wherein the processing circuit is configured to parse coordinates in an Euclidean coordinate system from the projection based spatial relationship description when the projection indicator is indicative of no projection.

8. The apparatus of claim 1 , wherein the media presentation description information uses the P-SRD in at least one of an adaptation set level, a representation level and a sub-representation level to describe the different video coverage in the 2D plane according to the projection.

9. The apparatus of claim 1 , wherein the processing circuit is configured to parse the media presentation description information to extract a dependency of a first segment stream to a second segment stream, and select segments in the first segment stream and the second segment stream, and cause the interface circuit to request and receive the selected segments.

10. The apparatus of claim 9 , wherein the processing circuit is configured to extract at least one of a region dependency, a bandwidth dependency and an image size dependency of the first segment stream to the second segment stream.

11. A method for image rendering, comprising:

receiving media presentation description information of media data, the media data including video content in a two-dimensional (2D) plane that is projected from video content of a sphere surface according to a projection, the video content in the 2D plane including a plurality of segment streams having different video coverage in the 2D plane, the media presentation description information using projection based spatial relationship description (P-SRD) to describe the different video coverage in the 2D plane according to the projection;

determining one or more segment streams based on a region of interests for image generation and the projection based spatial relationship description;

selecting segments in the one or more segment streams;

transmitting a request for the selected segments;

receiving the selected segments; and

displaying images generated based on the selected segments.

12. The method of claim 11 , further comprising:

parsing the projection based spatial relationship description to extract a projection indicator.

13. The method of claim 12 , further comprising:

parsing yaw and pitch coordinates in a sphere coordinate system from the projection based spatial relationship description when the projection indicator is indicative of an equirectangular projection (ERP).

14. The method of claim 13 , wherein parsing the yaw and pitch coordinates in the sphere coordinate system from the projection based spatial relationship description when the projection indicator is indicative of the equirectangular projection (ERP) further comprises:

parsing a minimum value of yaw coordinate, a maximum value of yaw coordinate, a minimum value of pitch coordinate, and a maximum value of pitch coordinate from the projection based spatial relationship description that define a region in the 2D plane.

15. The method of claim 13 , wherein parsing the yaw and pitch coordinates in the sphere coordinate system from the projection based spatial relationship description when the projection indicator is indicative of the equirectangular projection (ERP) further comprises:

parsing yaw and pitch coordinates that define a corner point of a rectangular region from the projection based spatial relationship description; and

parsing a width and a height of the rectangular region in yaw and pitch coordinates from the projection based spatial relationship description.

16. The method of claim 12 , further comprising:

parsing one or more face indexes from the projection based spatial relationship description when the projection indicator is indicative of a platonic solid projection.

17. The method of claim 12 , further comprising:

parsing coordinates in an Euclidean coordinate system from the projection based spatial relationship description when the projection indicator is indicative of no projection.

18. The method of claim 11 , further comprising:

parsing the media presentation description information to extract a dependency of a first segment stream to a second segment stream;

selecting segments in the first segment stream and the second segment stream;

transmitting a request for the selected segments in the first segment stream and the second segment stream;

receiving the selected segments; and

displaying images generated based on the selected segments in the first segment stream and the second segment stream.

19. The method of claim 11 , wherein the media presentation description information uses the P-SRD in at least one of an adaptation set level, a representation level, and a sub-representation level to describe the different video coverage in the 2D plane according to the projection.

20. The method of claim 18 , wherein parsing the media presentation description information to extract the dependency of the first segment stream to the second segment stream further comprises:

extracting at least one of a region dependency, a bandwidth dependency and an image size dependency of the first segment stream to the second segment stream.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 26, 2017
From: LAI, WANG LIN; LIU, SHAN; WANG, XIN
To: MEDIATEK INC.
Reel/Frame 043105/0904 →
Continuity (2)
Provisional Application 62368205 · Jul 29, 2016
Related Publication 20180035172A1 · Feb 1, 2018