IP Library Granted Patent US 10,587,883
Granted Patent B2
US 10,587,883 · App. 16/028,255 · Granted Mar 10, 2020

Region-wise packing, content coverage, and signaling frame packing for media content

Inventor: Ye-Kui Wang (San Diego, CA)
Assignee: Qualcomm Incorporated
H04N19/176G06F3/011H04L65/4084H04L65/605H04L65/607H04L65/608H04N19/167H04N19/172H04N19/188H04N19/44H04N19/583H04N19/597H04N19/70H04N21/6332H04N21/64322H04N21/8456H04N21/85406H04L67/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,587,883
App. No.
16/028,255
Filed
Jul 5, 2018
Granted
Mar 10, 2020
Kind
B2
Art Unit
2421
USPC
375/240.12
Abstract

In one example, a device for processing media content includes a memory configured to store media content; and one or more processors implemented in circuitry and configured to process a first packed region of the media content, wherein to process the first packed region, the one or more processors are configured to unpack the first packed region to produce a first unpacked region, and form a first projected region from the first unpacked region; and process a second packed region of the media content, the second packed region overlapping the first packed region at least in part, wherein to process the second packed region, the one or more processors are configured to unpack the second packed region to produce a second unpacked region, and form a second projected region from the second unpacked region.

Claims (105)

1. A method of processing media content, the method comprising:

processing a first packed region of media content, the first packed region comprising first decoded video data, wherein processing the first packed region comprises:

unpacking the first packed region to produce a first unpacked region; and

forming a first projected region from the first unpacked region, wherein forming the first projected region comprises interpolating the first decoded video data and repositioning the interpolated first decoded video data; and

processing a second packed region of the media content, the second packed region comprising second decoded video data, and the second packed region overlapping the first packed region at least in part, wherein processing the second packed region comprises:

unpacking the second packed region to produce a second unpacked region; and

forming a second projected region from the second unpacked region, the second projected region being different than the first projected region, wherein forming the second projected region comprises repositioning the second decoded video data.

2. The method of claim 1 ,

wherein processing the first packed region comprises:

determining a first width of the first packed region from a first width value;

determining a first height of the first packed region from a first height value;

determining a first top offset of the first packed region from a first top value; and

determining a first left offset of the first packed region from a first left value; and

wherein processing the first packed region comprises:

determining a second width of the second packed region from a second width value;

determining a second height of the second packed region from a second height value;

determining a second top offset of the second packed region from a second top value; and

determining a second left offset of the second packed region from a second left value.

3. The method of claim 2 , wherein the first width value comprises a packed_reg_width[i] value, the first height value comprises a packed_reg_height[i] value, the first top value comprises a packed_reg_top[i] value, the first left value comprises a packed_reg_left[i], the second width value comprises a packed_reg_width[j] value, the second height value comprises a packed_reg_height[j] value, the second top value comprises a packed_reg_top[j] value, and the second left value comprises a packed_reg_left[j] value.

4. The method of claim 1 , wherein processing the second packed region further comprises:

determining a portion of the second packed region that overlaps the first packed region; and

filling the portion of the second packed region with a corresponding portion of the first packed region that overlaps the portion of the second packed region,

wherein unpacking the second packed region comprises unpacking the second packed region, including the filled portion, to produce the second unpacked region.

5. The method of claim 1 , wherein the media content is monoscopic.

6. The method of claim 1 , wherein the media content is stereoscopic.

7. The method of claim 6 , wherein the first packed region corresponds to a first picture of the media content, and wherein the second packed region corresponds to a second picture of the media content.

8. The method of claim 6 , wherein the first packed region corresponds to a picture of the media content, and wherein the second packed region corresponds to the picture of the media content.

9. The method of claim 1 , further comprising processing data of a manifest file defining the first packed region and the second packed region.

10. The method of claim 9 , wherein the manifest file comprises a Dynamic Adaptive Streaming over HTTP (DASH) Media Presentation Description (MPD).

11. The method of claim 1 , further comprising processing a content coverage description at a Preselection level of the media content.

12. The method of claim 11 , wherein processing the content coverage description comprises processing a manifest file comprising the content coverage description.

13. The method of claim 12 , wherein the manifest file comprises a Dynamic Adaptive Streaming over HTTP (DASH) Media Presentation Description (MPD).

14. The method of claim 1 , further comprising:

processing a video frame packing type value of a FramePacking element of Dynamic Adaptive Streaming over HTTP (DASH) data for the media content; and

processing a quincunx sampling flag value of the FramePacking element of the DASH data.

15. The method of claim 14 , wherein the DASH data comprises a DASH Media Presentation Description (MPD).

16. A device for processing media content, the device comprising:

a memory configured to store media content; and

one or more processors implemented in circuitry and configured to:

process a first packed region of the media content, the first packed region comprising first decoded video data, wherein to process the first packed region, the one or more processors are configured to:

unpack the first packed region to produce a first unpacked region; and

form a first projected region from the first unpacked region, wherein to form the first projected region, the one or more processors are configured to interpolate the first decoded video data and reposition the interpolated first decoded video data; and

process a second packed region of the media content, the second packed region comprising second decoded video data, and the second packed region overlapping the first packed region at least in part, wherein to process the second packed region, the one or more processors are configured to:

unpack the second packed region to produce a second unpacked region; and

form a second projected region from the second unpacked region, wherein to form the second projected region, the one or more processors are configured to reposition the second decoded video data.

17. The device of claim 16 ,

wherein to process the first packed region, the one or more processors are configured to:

determine a first width of the first packed region from a first width value;

determine a first height of the first packed region from a first height value;

determine a first top offset of the first packed region from a first top value; and

determine a first left offset of the first packed region from a first left value; and

wherein to process the second packed region, the one or more processors are configured to:

determine a second width of the second packed region from a second width value;

determine a second height of the second packed region from a second height value;

determine a second top offset of the second packed region from a second top value; and

determine a second left offset of the second packed region from a second left value.

18. The device of claim 17 , wherein the first width value comprises a packed_reg_width[i] value, the first height value comprises a packed_reg_height[i] value, the first top value comprises a packed_reg_top[i] value, the first left value comprises a packed_reg_left[i], the second width value comprises a packed_reg_width[j] value, the second height value comprises a packed_reg_height[j] value, the second top value comprises a packed_reg_top[j] value, and the second left value comprises a packed_reg_left[j] value.

19. The device of claim 16 , wherein to process the second packed region, the one or more processors are further configured to:

determine a portion of the second packed region that overlaps the first packed region; and

fill the portion of the second packed region with a corresponding portion of the first packed region that overlaps the portion of the second packed region,

wherein to unpack the second packed region, the one or more processors are configured to unpack the second packed region, including the filled portion, to produce the second unpacked region.

20. The device of claim 16 , wherein the media content is monoscopic.

21. The device of claim 16 , wherein the media content is stereoscopic.

22. The device of claim 21 , wherein the first packed region corresponds to a first picture of the media content, and wherein the second packed region corresponds to a second picture of the media content.

23. The device of claim 21 , wherein the first packed region corresponds to a picture of the media content, and wherein the second packed region corresponds to the picture of the media content.

24. The device of claim 16 , wherein the one or more processors are further configured to process data of a manifest file defining the first packed region and the second packed region.

25. The device of claim 24 , wherein the manifest file comprises a Dynamic Adaptive Streaming over HTTP (DASH) Media Presentation Description (MPD).

26. The device of claim 16 , wherein the one or more processors are further configured to process a content coverage description at a Preselection level of the media content.

27. The device of claim 26 , wherein processing the content coverage description comprises processing a manifest file comprising the content coverage description.

28. The device of claim 27 , wherein the manifest file comprises a Dynamic Adaptive Streaming over HTTP (DASH) Media Presentation Description (MPD).

29. The device of claim 16 , wherein the one or more processors are further configured to:

process a video frame packing type value of a FramePacking element of Dynamic Adaptive Streaming over HTTP (DASH) data for the media content; and

process a quincunx sampling flag value of the FramePacking element of the DASH data.

30. The device of claim 29 , wherein the DASH data comprises a DASH Media Presentation Description (MPD).

31. The device of claim 16 , wherein the device comprises at least one of:

an integrated circuit;

a microprocessor; and

a wireless communication device.

32. The device of claim 16 , wherein the device comprises a client device.

33. A device for processing media content, the device comprising:

means for processing a first packed region of media content, the first packed region comprising first decoded video data, wherein the means for processing the first packed region comprises:

means for unpacking the first packed region to produce a first unpacked region; and

means for forming a first projected region from the first unpacked region wherein the means for forming the first projected region comprises means for interpolating the first decoded video data and means for repositioning the interpolated first decoded video data; and

means for processing a second packed region of the media content, the second packed region comprising second decoded video data, and the second packed region overlapping the first packed region at least in part, wherein the means for processing the second packed region comprises:

means for unpacking the second packed region to produce a second unpacked region; and

means for forming a second projected region from the second unpacked region, the second projected region being different than the first projected region, wherein the means for forming the second projected region comprises means for repositioning the second decoded video data.

34. The device of claim 33 ,

wherein the means for processing the first packed region comprises:

means for determining a first width of the first packed region from a first width value;

means for determining a first height of the first packed region from a first height value;

means for determining a first top offset of the first packed region from a first top value; and

means for determining a first left offset of the first packed region from a first left value; and

wherein the means for processing the first packed region comprises:

means for determining a second width of the second packed region from a second width value;

means for determining a second height of the second packed region from a second height value;

means for determining a second top offset of the second packed region from a second top value; and

means for determining a second left offset of the second packed region from a second left value.

35. The device of claim 34 , wherein the first width value comprises a packed_reg_width[i] value, the first height value comprises a packed_reg_height[i] value, the first top value comprises a packed_reg_top[i] value, the first left value comprises a packed_reg_left[i], the second width value comprises a packed_reg_width[j] value, the second height value comprises a packed_reg_height[j] value, the second top value comprises a packed_reg_top[j] value, and the second left value comprises a packed_reg_left[j] value.

36. The device of claim 33 , wherein the means for processing the second packed region further comprises:

means for determining a portion of the second packed region that overlaps the first packed region; and

means for filling the portion of the second packed region with a corresponding portion of the first packed region that overlaps the portion of the second packed region,

wherein the means for unpacking the second packed region comprises means for unpacking the second packed region, including the filled portion, to produce the second unpacked region.

37. The device of claim 33 , wherein the media content is stereoscopic.

38. The device of claim 37 , wherein the first packed region corresponds to a first picture of the media content, and wherein the second packed region corresponds to a second picture of the media content.

39. The device of claim 37 , wherein the first packed region corresponds to a picture of the media content, and wherein the second packed region corresponds to the picture of the media content.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 14, 2019
From: WANG, YE-KUI
To: QUALCOMM INCORPORATED
Reel/Frame 048339/0529 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 21, 2018
From: WANG, YEKUI
To: QUALCOMM INCORPORATED
Reel/Frame 046934/0452 →
Continuity (2)
Provisional Application 62532862 · Jul 14, 2017
Related Publication 20190020880A1 · Jan 17, 2019
Cited By (2)
US 12,493,578 US 12,526,471