IP Library › Granted Patent US 11,743,512
Granted Patent B2
US 11,743,512 · App. 17/337,964 · Granted Aug 29, 2023

Methods for NBMP deployments through 5G FLUS control

Inventor: Iraj Sodagar (Palo Alto, CA)
Assignee: TENCENT AMERICA LLC
H04N21/2187H04L65/61H04N21/2393H04N21/254
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,743,512
App. No.
17/337,964
Granted
Aug 29, 2023
Kind
B2
Abstract

Systems and methods for media processing and streaming are provided. A method includes receiving, by a first application operating on an application server, a live session request from a second application operating on a user device separate from the application server to start a Framework for Live Uplink Streaming (FLUS) session; obtaining a list of a plurality of FLUS sinks; selecting a FLUS media sink operating on a sink device from among the plurality of FLUS sinks, wherein the sink device is separate from the application server and the user device; sending a workflow request to a Network-Based Media Processing (NBMP) source to start an NBMP workflow associated with the FLUS media sink; and sending a response to the second application including session information for establishing the FLUS session using the NBMP workflow and the FLUS media sink.

Claims (46)

1. A method of processing media content in Moving Picture Experts Group (MPEG) Network Based Media Processing (NBMP), the method being performed by at least one processor, and the method comprising:

receiving, by a first application operating on an application server, a live session request from a second application operating on a user device separate from the application server to start a Framework for Live Uplink Streaming (FLUS) session;

obtaining a list of a plurality of FLUS sinks;

selecting a FLUS media sink operating on a sink device from among the plurality of FLUS sinks, wherein the sink device is separate from the application server and the user device, and wherein the sink device includes a FLUS control sink, an NBMP workflow manager, and at least one media processing entity;

sending a workflow request to an NBMP source to start an NBMP workflow associated with the FLUS media sink; and

sending a response to the second application including session information for establishing the FLUS session using the NBMP workflow and the FLUS media sink,

wherein the FLUS session comprises a live video streaming session.

2. The method of claim 1 , wherein the application server includes the NBMP source,

and

wherein the user device includes a FLUS control source and a FLUS media source.

3. The method of claim 2 , wherein the FLUS media sink is selected based on a capability of the at least one media processing entity,

wherein the workflow request includes address information of the FLUS media sink,

wherein a workflow description document corresponding to the NBMP workflow is constructed by the NBMP source and instantiated by the NBMP workflow manager in the at least one media processing entity, and

wherein the session information includes sink control information corresponding to the FLUS control sink and media sink information corresponding to the FLUS media sink.

4. The method of claim 1 ,

wherein the user device includes a FLUS control source, a FLUS media source, and the NBMP source.

5. The method of claim 4 , wherein a workflow description document corresponding to the NBMP workflow is constructed by the NBMP source and instantiated by the NBMP workflow manager, and

wherein the session information includes address information of the NBMP workflow manager.

6. The method of claim 1 , wherein the user device includes an edge enabler client.

7. An apparatus for processing media content in Moving Picture Experts Group (MPEG) Network Based Media Processing (NBMP), the apparatus comprising:

at least one memory configured to store program code; and

at least one processor configured to read the program code and operate as instructed by the program code, the program code comprising:

receiving code configured to cause the at least one processor to receive, by a first application operating on an application server, a live session request from a second application operating on a user device separate from the application server to start a Framework for Live Uplink Streaming (FLUS) session;

obtaining code configured to cause the at least one processor to obtain a list of a plurality of FLUS sinks;

selecting code configured to cause the at least one processor to select a FLUS media sink operating on a sink device from among the plurality of FLUS sinks, wherein the sink device is separate from the application server and the user device, and wherein the sink device includes a FLUS control sink, an NBMP workflow manager, and at least one media processing entity;

first sending code configured to cause the at least one processor to send a workflow request to an NBMP source to start an NBMP workflow associated with the FLUS media sink; and

second sending code configured to cause the at least one processor to send a response to the second application including session information for establishing the FLUS session using the NBMP workflow and the FLUS media sink,

wherein the FLUS session comprises a live video streaming session.

8. The apparatus of claim 7 , wherein the application server includes the NBMP source,

and

wherein the user device includes a FLUS control source and a FLUS media source.

9. The apparatus of claim 8 , wherein the FLUS media sink is selected based on a capability of the at least one media processing entity,

wherein the workflow request includes address information of the FLUS media sink,

wherein a workflow description document corresponding to the NBMP workflow is constructed by the NBMP source and instantiated by the NBMP workflow manager in the at least one media processing entity, and

wherein the session information includes sink control information corresponding to the FLUS control sink and media sink information corresponding to the FLUS media sink.

10. The apparatus of claim 7 , FLUS control sink, an NBMP workflow manager, and at least one media processing entity, and

wherein the user device includes a FLUS control source, a FLUS media source and the NBMP source.

11. The apparatus of claim 10 , wherein a workflow description document corresponding to the NBMP workflow is constructed by the NBMP source and instantiated by the NBMP workflow manager, and

wherein the session information includes address information of the NBMP workflow manager.

12. A non-transitory computer-readable medium storing instructions that, when executed by at least one processor of an apparatus for processing media content in Moving Picture Experts Group (MPEG) Network Based Media Processing (NBMP), cause the at least one processor to:

receive, by a first application operating on an application server, a live session request from a second application operating on a user device separate from the application server to start a Framework for Live Uplink Streaming (FLUS) session;

obtain a list of a plurality of FLUS sinks;

select a FLUS media sink operating on a sink device from among the plurality of FLUS sinks, wherein the sink device is separate from the application server and the user device, and wherein the sink device includes a FLUS control sink, an NBMP workflow manager, and at least one media processing entity;

send a workflow request to an NBMP source to start an NBMP workflow associated with the FLUS media sink; and

send a response to the second application including session information for establishing the FLUS session using the NBMP workflow and the FLUS media sink,

wherein the FLUS session comprises a live video streaming session.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 3, 2021
From: SODAGAR, IRAJ
To: TENCENT AMERICA LLC
Reel/Frame 056430/0672 →
Continuity (3)
Provisional Application 63066703 · Aug 17, 2020
Provisional Application 63050517 · Jul 10, 2020
Related Publication 20220014799A1 · Jan 13, 2022