IP Library › Granted Patent US 12,301,645
Granted Patent B2
US 12,301,645 · App. 16/938,125 · Granted May 13, 2025

Efficient association between DASH objects

Inventors: Ye-Kui Wang (San Diego, CA); Yuqun Fan (Shenzhen, CN); Peiyun Di (Shenzhen, CN)
Assignee: Huawei Technologies Co., Ltd.
H04L65/65H04N21/21805H04N21/2353H04N21/816H04N21/8456
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,301,645
App. No.
16/938,125
Granted
May 13, 2025
Kind
B2
Abstract

A method mechanism for streaming multi-viewpoint virtual reality (VR) content via Dynamic Adaptive Streaming over Hypertext Transfer Protocol (HTTP) (DASH) is disclosed. The mechanism includes receiving media content including a VR video sequence. A DASH Media Presentation Description (MPD) is generated. The MPD includes an indication specifying that a portion of the media content that is related to a first viewpoint is associated with a timed metadata representation. A request is received from a client for the media content. The DASH MPD, including the indication, is transmitted to the client in response to receiving the request to support communication of the media content to the client.

Claims (28)

1. A method implemented by a Dynamic Adaptive Streaming over Hypertext Transfer Protocol (HTTP) (DASH) server, the method comprising:

receiving media content including a virtual reality (VR) video sequence at a viewpoint and a timed metadata representation, wherein the timed metadata representation comprises recommended viewport timed metadata;

generating a DASH Media Presentation Description (MPD) including an indication specifying that the timed metadata representation is collectively associated with one or more media representations of the viewpoint, wherein the indication is an association descriptor that includes a viewpoint identifier (ID) of the viewpoint in an association element of a type AdaptationSet and that collectively associates the timed metadata representation with the media representations, and wherein the viewpoint ID is one value contained in an @value attribute;

receiving a request from a client for the media content; and

transmitting the DASH MPD including the indication to the client in response to receiving the request to support communication of the media content to the client.

2. The method of claim 1 , wherein the indication further comprises an association ID that is a representation attribute that associates a list of one or more adaptation sets of the media content to the timed metadata representation.

3. The method of claim 1 , wherein the indication further comprises an association ID that is a representation attribute that associates a list of one or more viewpoints to the timed metadata representation.

4. The method of claim 1 , wherein the indication further comprises an association ID that is a representation attribute that associates a list of one or more preselections of the media content to the timed metadata representation.

5. The method of claim 1 , wherein the indication further comprises an association ID that is a representation attribute, an adaptation set attribute, a preselection attribute, a viewpoint element attribute, or combinations thereof.

6. The method of claim 1 , wherein the indication further comprises an association ID that is an attribute indicating that the association ID references a unique ID attribute amongst IDs for a plurality of adaptation sets describing the media content and IDs for representations associated with the plurality of adaptation sets.

7. A method implemented by a Dynamic Adaptive Streaming over Hypertext Transfer Protocol (HTTP) (DASH) client, the method comprising:

receiving a DASH Media Presentation Description (MPD), the MPD describing a media content including a virtual reality (VR) video sequence at a viewpoint, and the media content also including a timed metadata representation, wherein the timed metadata representation comprises recommended viewport timed metadata, the MPD also including an indication specifying that the timed metadata representation is collectively associated with one or more media representations of the viewpoint, and wherein the indication comprises an association descriptor that includes a viewpoint identifier (ID) of the viewpoint in an association element of a type AdaptationSet and that collectively associates the timed metadata representation with the media representations, and wherein the viewpoint ID is one value contained in an @value attribute;

transmitting a request for the media content related to the viewpoint and a request for the timed metadata representation based on the indication; and

receiving the media content related to the viewpoint and the timed metadata representation.

8. The method of claim 7 , wherein the indication further comprises an association ID that is a representation attribute that associates a list of one or more adaptation sets of the media content to the timed metadata representation.

9. The method of claim 7 , wherein the indication further comprises an association ID that is a representation attribute that associates a list of one or more viewpoints to the timed metadata representation.

10. The method of claim 7 , wherein the indication further comprises an association ID that is a representation attribute that associates a list of one or more preselections of the media content to the timed metadata representation.

11. The method of claim 7 , wherein the indication further comprises an association ID that is a representation attribute, an adaptation set attribute, a preselection attribute, a viewpoint element attribute, or combinations thereof.

12. The method of claim 7 , wherein the indication further comprises an association ID that is an attribute indicating that the association ID references a unique ID attribute amongst IDs for a plurality of adaptation sets describing the media content and IDs for representations associated with the plurality of adaptation sets.

13. A method implemented by a Dynamic Adaptive Streaming over Hypertext Transfer Protocol (HTTP) (DASH) server, the method comprising:

generating a DASH Media Presentation Description (MPD), wherein a timed metadata representation of the MPD comprises recommended viewport timed metadata, wherein an association descriptor of the MPD is in an element of the timed metadata representation and includes a viewpoint identifier (ID) of a viewpoint in an association element of a type AdaptationSet, wherein the viewpoint ID collectively associates the timed metadata representation with all media representations of the viewpoint in the DASH MPD, and wherein the viewpoint ID is one value contained in an @value attribute; and

providing the DASH MPD to a client.

14. The method of claim 13 , wherein the association descriptor is present as a child element of a DASH Representation element of the timed metadata representation.

15. The method of claim 14 , wherein the association element includes an attribute of Association@associationKindList.

16. The method of claim 15 , wherein a value of the Association@associationKindList includes ‘cdtg’.

17. The method of claim 16 , wherein cdtg is a track reference that describes referenced media tracks and track groups collectively.

18. The method of claim 1 , wherein the viewpoint ID is expressed as an association by viewpoint ID (@associationVwptId) attribute.

19. The method of claim 7 , wherein the viewpoint ID is expressed as an association by viewpoint ID (@associationVwptId) attribute.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 25, 2024
From: FUTUREWEI TECHNOLOGIES, INC.
To: HUAWEI TECHNOLOGIES CO., LTD.
Reel/Frame 066239/0167 →
Continuity (3)
Continuation PCTUS2019024824 · Mar 29, 2019
Provisional Application 62653205 · Apr 5, 2018
Related Publication 20200358838A1 · Nov 12, 2020
References Cited (33)
US 9860293B2 · Thang · 2018 [cited by examiner]
US 20150262428A1 · Tatzgern · 2015 [cited by examiner]
US 20160255417A1 · Yamagishi · 2016 [cited by examiner]
US 20170339415A1 · Wang et al. · 2017 [cited by applicant]
US 20170347026A1 · Hannuksela · 2017 [cited by applicant]
US 20180061002A1 · Lee · 2018 [cited by examiner]
US 20190020863A1 · Wang · 2019 [cited by examiner]
US 20190158933A1 · Ouedraogo · 2019 [cited by examiner]
US 20190373245A1 · Lee · 2019 [cited by examiner]
US 20190379856A1 · Hur · 2019 [cited by examiner]
US 20200053392A1 · Hannuksela · 2020 [cited by examiner]
US 20200105063A1 · Wang · 2020 [cited by examiner]
US 20210029294A1 · Deshpande · 2021 [cited by examiner]
US 20210058600A1 · Deshpande · 2021 [cited by examiner]
US 20210377571A1 · Deshpande · 2021 [cited by examiner]
CN 105230024A · 2016 [cited by applicant]
CN 105556976A · 2016 [cited by applicant]
CN 107529064A · 2017 [cited by applicant]
WO WO2017205794A1 · 2017 [cited by examiner]
“Information technology—Coded representation of immersive media—Part 2: Omnidirectional media format,” International Standard, ISO/IEC 23090-2, Jan. 2019, 10 pages. [cited by applicant]
Zare, A., “HEVC-compliant Viewport-adaptive Streaming of Stereoscopic Panoramic Video,” IEEE, Dec. 2016, 5 pages. [cited by applicant]
Zhang, S., “Quality Information Signalling for DASH using Metadata Track,” ISO/IEC JTC1/SC29/WG11 MPEG2013/m30352, Jul. 2013, 6 pages. [cited by applicant]
“Line Transmission of Non-Telephone Signals Video Codec for Audiovisual Services at p×64 kbits,” ITU-T Recommendation H.261, Mar. 1993, 29 pages. [cited by applicant]
“Transmission of Non-Telephone Signals; Information Technology—Generic Coding of Moving Pictures and Associated Audio Information: Video,” ITU-T Recommendation H.262, Jul. 1995, 211 pages. [cited by applicant]
“Series H: Audiovisual and Multimedia Systems; Infrastructure of audiovisual services—Coding of moving video; Video coding for low bit rate communication,” ITU-T Recommendation H.263, Jan. 2005, 226 pages. [cited by applicant]
“Series H: Audiovisual and Multimedia Systems; Infrastructure of audiovisual services—Coding of moving video; Advanced video coding for generic audiovisual services,” Recommendation ITU-T H.264, Jun. 2019, 836 pages. [cited by applicant]
“Series H: Audiovisual and Multimedia Systems; Infrastructure of audiovisual services - Coding of moving video; High efficiency video coding” Recommendation ITU-T H.265, Apr. 2013, 317 pages. [cited by applicant]
“Information technology—Coding of audio-visual objects—Part 12: ISO base media file format,” ISO/IEC 14496-12, Fifth Edition, Dec. 15, 2015, 248 pages. [cited by applicant]
“Information technology—Coding of audio-visual objects—Part 14: MP4 file format,” ISO/IEC 14496-14, Second Edition, Nov. 2018, 22 pages. [cited by applicant]
“Information technology—Coding of audio-visual objects—Part 15: Advanced Video Coding (AVC) file format,” ISO/IEC 14496-15, First edition, Apr. 15, 2004, 29 pages. [cited by applicant]
“3rd Generation Partnership Project; Technical Specification Group Services and System Aspects; Transparent end-to-end packet switched streaming service (PSS); 3GPP file format (3GP) (Release 16),” 3GPP TS 26.244 V16.1.… [cited by applicant]
Moats, R., “URN Syntax,” RFC 2141, May 1997, 8 pages. [cited by applicant]
Berners-Lee, T., et al., “Uniform Resource Identifier (URI): Generic Syntax,” Network Working Group, RFC 3986, Jan. 2005, 61 pages. [cited by applicant]