IP Library › Granted Patent US 11,044,294
Granted Patent B2
US 11,044,294 · App. 15/925,190 · Granted Jun 22, 2021

ATSC 3.0 playback using MPEG media transport protocol (MMTP)

Inventors: Tanmay Agnihotri (San Diego, CA); Graham Anthony Clift (Poway, CA); Mimi Vu Tran (San Diego, CA)
Assignee: Sony Group Corporation
H04L65/604H04L65/4084H04L67/02H04N21/2383H04N21/4382H04N21/8456H04N21/85406H04N21/426
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,044,294
App. No.
15/925,190
Granted
Jun 22, 2021
Kind
B2
Abstract

Moving Picture Experts Group (MPEG) media transport protocol (MMTP) content is received from a source of content such as an ATSC 3.0 source. The MMTP content is converted to Dynamic Adaptive Streaming over Hypertext Transfer Protocol (DASH), and the receiving media player then plays the DASH.

Claims (66)

1. A media playback apparatus comprising:

at least one computer memory storing instructions executable by at least one processor;

the at least one processor programmed with the instructions to:

receive Moving Picture Experts Group (MPEG) media transport protocol (MMTP) content from a source of content via a MMTP delivers channel;

extract the MMTP content from user datagram protocol (UDP) data from the MMTP delivery channel, the extracted MMTP content comprising extracted data;

identify a type of the extracted data;

responsive to the type being identified as signaling data, identify whether the signaling data is user service, description block (USDB) data or a playback asset;

responsive to identifying the signaling data as USDB data, save a component ID, role, and type indicated by the USDB data in a component data structure; and

responsive to identifying the signaling data as a playback asset, save a packet ID, asset ID, and associated codec of the playback asset;

convert the MMTP content to Dynamic Adaptive Streaming over Hypertext Transfer Protocol (DASH) content; and

play the DASH content using a DASH player, wherein the MMTP content is converted to the DASH content by rearranging the MMTP content into a data structure comprising:

video data stored in a video buffer;

audio data stored in an audio buffer;

text data stored in a text buffer,

each of the buffers comprising a respective initial block of media processing unit (MPU) metadata, including the first fragment of MPU data plus a complete unit of such data, followed by any additional MPU metadata, and following the metadata, fragment metadata following which are blocks of media in each respective buffer, wherein media playback on a fragment-by-fragment basis is commenced upon encountering associated metadata.

2. The media playback apparatus of claim 1 , wherein the at least one processor is agnostic of a protocol of media played by the at least one processor.

3. The media playback apparatus of claim 1 , wherein the source of content comprises an Advanced Television System Committee (ATSC) 3.0 system source.

4. The media playback apparatus of claim 1 , wherein the instructions are executable to:

responsive to the type not being identified as signaling data, identify whether the extracted data is media data; and

responsive to the type being media data, store the media data and determine whether sufficient media data along with requisite assets has been received to start playback of the media data.

5. The media playback apparatus of claim 4 , wherein the instructions are executable to:

responsive to sufficient media data along with requisite assets not being received to start playback, continue to receive the MMTP content from the source of content;

responsive to sufficient media data along with requisite assets being received to start playback, return an indication that playback of the media data may be commenced.

6. The media playback apparatus of claim 5 , wherein the instructions are executable to, responsive to the indication, commence playback of the media data.

7. The media playback apparatus of claim 1 , wherein the component data structure comprises a DASH Media Presentation Description (MPD) file.

8. A method comprising:

receiving Moving Picture Experts Group (MPEG) media transport protocol (MMTP) content from a source of content via a MMTP delivery channel;

extracting the MMTP content from user datagram protocol (UDP) data from the MMTP delivery channel, the extracted MMTP content comprising extracted data;

arranging the MMTP content as Dynamic Adaptive Streaming over Hypertext Transfer Protocol (DASH) content;

playing the DASH content using a DASH player, wherein the method comprises:

identifying a type of the extracted data;

responsive to the type not being identified as signaling data, identifying whether the extracted data is media data;

responsive to the type being media data, storing the media data and determining whether sufficient media data along with requisite assets has been received to start playback of the media data;

responsive to the type being identified as signaling data, identifying whether the signaling data is user service description block (USDB) data or a playback asset;

responsive to identifying the signaling data as USDB data, saving a component ID, role, and type indicated by the USDB data in a component data structure; and

responsive to identifying the signaling data as a playback asset, saving a packet ID, asset ID, and associated codec of the playback asset,

wherein the MMTP content is converted to the DASH content by rearranging the MMTP content into a data structure comprising:

video data stored in a video buffer;

audio data stored in an audio buffer:

text data stored in a text buffer,

each of the buffers comprising a respective initial block of media processing unit (MPU) metadata, including the first fragment of MPU data plus a complete unit of such data, followed by any additional MPU metadata, and following the metadata, fragment metadata following which are blocks of media in each respective buffer, wherein media playback on a fragment-by-fragment basis is commenced upon encountering associated metadata.

9. The method of claim 8 , comprising:

responsive to sufficient media data along with requisite assets not being received to start playback, continuing to receive the MMTP content from the source of content;

responsive to sufficient media data along with requisite assets being received to start playback, returning an indication that playback of the media data may be commenced.

10. The method of claim 9 , comprising, responsive to the indication, commencing playback of the media data.

11. The method of claim 8 , wherein the component data structure comprises a DASH Media Presentation Description (MPD) file.

12. An apparatus comprising:

at least one computer memory storing instructions executable by at least one processor;

the at least ono processor programmed with the instructions to:

extract Moving Picture Experts Group (MPEG) media transport protocol (MMTP) content from a source of content via a MMTP delivery channel to render extracted data;

identify a type of the extracted data;

responsive to the type being identified as signaling data, identify whether the signaling data is user service description block (USDB) data or a playback asset;

responsive to identifying the signaling data as USDB data, save a component ID, role, and type indicated by the USDB data in a component data structure;

responsive to identifying the signaling data as a playback asset, save a packet ID, asset ID, and associated codec of the playback asset;

arrange the extracted data from the MMTP content in a Dynamic Adaptive Streaming over Hypertext Transfer Protocol (DASH) media presentation description (MPD) such that the DASH MPD is constructed from the MMTP content; and

play DASH content in accordance with the DASH MPD, wherein the MMTP content is converted to the DASH content by rearranging the MMTP content into a data structure comprising:

video data stored in a video buffer:

audio data stored in an audio buffer:

text data stored in a text buffer,

each of the buffers comprising a respective initial block of media processing unit (MPU) metadata, including the first fragment of MPU data plus a complete unit of such data, followed by any additional MPU metadata, and following the metadata, fragment metadata following which are blocks of media in each respective buffer, wherein media playback on a fragment-by-fragment basis is commenced upon encountering associated metadata.

13. The apparatus of claim 12 , wherein the instructions are executable to:

responsive to the type not being identified as signaling data, identify whether the extracted data is media data; and

responsive to the type being media data, store the media data.

14. The apparatus of claim 13 , wherein the instructions are executable to:

responsive to sufficient media data along with requisite assets not being received to start playback, continue to receive the MMTP content from the source of content;

responsive to sufficient media data along with requisite assets being received to start playback, return an indication that playback of the media data may be commenced.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 27, 2021
From: SONY GROUP CORPORATION
To: SATURN LICENSING LLC
Reel/Frame 057939/0387 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 21, 2021
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 057871/0646 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 2, 2018
From: AGNIHOTRI, TANMAY; CLIFT, GRAHAM ANTHONY; TRAN, MIMI VU
To: SONY CORPORATION
Reel/Frame 046405/0131 →
Continuity (2)
Provisional Application 62613155 · Jan 3, 2018
Related Publication 20190207998A1 · Jul 4, 2019
Cited By (1)
US 12,532,050