IP Library › Granted Patent US 11,544,108
Granted Patent B2
US 11,544,108 · App. 16/854,869 · Granted Jan 3, 2023

Method and apparatus for functional improvements to moving picture experts group network based media processing

Inventor: Iraj Sodagar (Los Angeles, CA)
Assignee: TENCENT AMERICA LLC
G06F9/4881H04L67/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,544,108
App. No.
16/854,869
Granted
Jan 3, 2023
Kind
B2
Abstract

A method of processing media content in Moving Picture Experts Group (MPEG) Network Based Media Processing (NBMP) includes obtaining, from a function repository storing one or more functions for processing the media content, at least one among the one or more functions, each of the at least one among the one or more functions having a function descriptor indicating, for a respective one among the one or more functions, a maximum throughput, a minimum buffer size, a maximum size of metadata and a maximum frequency between two instances of the metadata, and obtaining a task for processing the media content, based on the obtained at least one among the one or more functions, the task having a task descriptor indicating, for the task, a maximum throughput, a minimum buffer size, a maximum size of metadata and a maximum frequency between two instances of the metadata.

Claims (37)

1. A method of processing media content in Moving Picture Experts Group (MPEG) Network Based Media Processing (NBMP), the method being performed by at least one processor, and the method comprising:

obtaining, from a function repository storing one or more functions for processing the media content, at least one among the one or more functions, each of the at least one among the one or more functions having a function descriptor;

obtaining a task for processing the media content, based on the obtained at least one among the one or more functions, the task having a task descriptor, each of the function descriptor and the task descriptor having a flag indicating whether a respective one of the function descriptor and the task descriptor describes a function group including multiple functions, among the one or more functions;

determining, based on a setting of the flag, whether a connection map descriptor exists for the respective one of the function descriptor and the task descriptor; and

processing the media content, using the obtained task, based on the task descriptor and on determining, based on the setting of the flag, whether the connection map descriptor exists.

2. The method of claim 1 , further comprising obtaining, from an NBMP source, a workflow describing the at least one among the one or more functions to be performed, the workflow having a workflow descriptor,

wherein the at least one among the one or more functions is obtained based on the obtained workflow.

3. The method of claim 2 , wherein each of the at least one among the one or more functions, the task and the workflow is for input resource consumption or output resource production.

4. The method of claim 2 , wherein the workflow descriptor has the flag indicating whether the workflow descriptor describes the function group.

5. The method of claim 4 , wherein, based on the flag indicating that the respective one of the workflow descriptor, the function descriptor and the task descriptor describes the function group, the respective one of the workflow descriptor, the function descriptor and the task descriptor further has the connection map descriptor indicating a connection between the multiple functions.

6. The method of claim 2 , wherein each of the workflow descriptor, the function descriptor and the task descriptor has a same general descriptor having a same plurality of parameters.

7. The method of claim 2 , wherein the workflow descriptor has a source or sink parameter indicating whether the at least one among the one or more functions is to be performed by a media source or a media sink.

8. An apparatus for processing media content in Moving Picture Experts Group (MPEG) Network Based Media Processing (NBMP), the apparatus comprising:

at least one memory configured to store program code; and

at least one processor configured to read the program code and operate as instructed by the program code, the program code comprising:

first obtaining code configured to cause the at least one processor to obtain, from a function repository storing one or more functions for processing the media content, at least one among the one or more functions, each of the at least one among the one or more functions having a function descriptor;

second obtaining code configured to cause the at least one processor to obtain a task for processing the media content, based on the obtained at least one among the one or more functions, the task having a task descriptor, each of the function descriptor and the task descriptor having a flag indicating whether a respective one of the function descriptor and the task descriptor describes a function group including multiple functions, among the one or more functions;

determining code configured to cause the at least one processor to determine, based on a setting of the flag, whether a connection map descriptor exists for the respective one of the function descriptor and the task descriptor; and

processing code configured to cause the at least one processor to process the media content, using the obtained task, based on the task descriptor and on determining, based on the setting of the flag, whether the connection map descriptor exists.

9. The apparatus of claim 8 , wherein the program code further comprises third obtaining code configured to cause the at least one processor to obtain, from an NBMP source, a workflow describing the at least one among the one or more functions to be performed, the workflow having a workflow descriptor, and

wherein the at least one among the one or more functions is obtained based on the obtained workflow.

10. The apparatus of claim 9 , wherein each of the at least one among the one or more functions, the task and the workflow is for input resource consumption or output resource production.

11. The apparatus of claim 9 , wherein the workflow descriptor has the flag indicating whether the workflow descriptor describes the function group.

12. The apparatus of claim 11 , wherein, based on the flag indicating that the respective one of the workflow descriptor, the function descriptor and the task descriptor describes the function group, the respective one of the workflow descriptor, the function descriptor and the task descriptor further has the connection map descriptor indicating a connection between the multiple functions.

13. The apparatus of claim 9 , wherein each of the workflow descriptor, the function descriptor and the task descriptor has a same general descriptor having a same plurality of parameters.

14. The apparatus of claim 9 , wherein the workflow descriptor has a source or sink parameter indicating whether the at least one among the one or more functions is to be performed by a media source or a media sink.

15. A non-transitory computer-readable medium storing instructions that, when executed by at least one processor of an apparatus for processing media content in Moving Picture Experts Group (MPEG) Network Based Media Processing (NBMP), cause the at least one processor to:

obtain, from a function repository storing one or more functions for processing the media content, at least one among the one or more functions, each of the at least one among the one or more functions having a function descriptor;

obtain a task for processing the media content, based on the obtained at least one among the one or more functions, the task having a task descriptor, each of the function descriptor and the task descriptor having a flag indicating whether a respective one of the function descriptor and the task descriptor describes a function group including multiple functions, among the one or more functions;

determine, based on a setting of the flag, whether a connection map descriptor exists for the respective one of the function descriptor and the task descriptor; and

process the media content, using the obtained task, based on the task descriptor and whether the setting of the flag indicates that the connection map descriptor exists.

16. The non-transitory computer-readable medium of claim 15 , wherein the instructions further cause the at least one processor to obtain, from an NBMP source, a workflow describing the at least one among the one or more functions to be performed, the workflow having a workflow descriptor, and

wherein the at least one among the one or more functions is obtained based on the obtained workflow.

17. The non-transitory computer-readable medium of claim 16 , wherein each of the at least one among the one or more functions, the task and the workflow is for input resource consumption or output resource production.

18. The non-transitory computer-readable medium of claim 16 , wherein the workflow descriptor has the flag indicating whether the workflow descriptor describes the function group.

19. The non-transitory computer-readable medium of claim 18 , wherein, based on the flag indicating that the respective one of the workflow descriptor, the function descriptor and the task descriptor describes the function group, the respective one of the workflow descriptor, the function descriptor and the task descriptor further has the connection map descriptor indicating a connection between the multiple functions.

20. The non-transitory computer-readable medium of claim 16 , wherein each of the workflow descriptor, the function descriptor and the task descriptor has a same general descriptor having a same plurality of parameters.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 22, 2022
From: SODAGAR, IRAJ
To: TENCENT AMERICA LLC
Reel/Frame 061859/0242 →
Continuity (2)
Provisional Application 62837608 · Apr 23, 2019
Related Publication 20200341806A1 · Oct 29, 2020