Granted Patent B2

US 12,430,854 · App. 17/725,985 · Granted Sep 30, 2025

Inventor: Iraj Sodagar (Palo Alto, CA)

Assignee: TENCENT AMERICA LLC

G06T19/003G06T19/006G06V20/35H04L65/60H04L65/75H04L67/131H04L67/14H04L67/2866H04L67/34H04L67/50H04W4/06

Abstract

Claims (43)

1. A method for transmitting media content over a 5G media streaming (5GMS) network, the method comprising:

selecting, by a augmented reality (AR) scene manager on a standalone augmented reality (STAR) user device (UE), STAR UE supported media content comprising a full scene description;

creating, by the AR scene manager, an AR/mixed reality (MR) session for streaming the STAR UE supported media content,

wherein the AR scene manager and a media client on the STAR UE configure rendering and delivery media pipelines,

wherein the streaming of the STAR UE supported media content in the AR/mixed reality (MR) session comprises a double loop call flow, the double loop call flow comprising an outer AR media delivery pipeline and an inner media session loop that is nested within the outer AR media delivery pipeline,

wherein, the inner media session loop is configured to stream one or more media objects based on the full scene description, and

wherein the outer AR media delivery pipeline is configured to receive one or more updates to the scene, the updates comprising at least one media object from a new scene, and provide the at least one media object from the new scene to the inner media session loop, while the one or more media objects are being streamed to STAR UE by the inner media session loop; and obtaining in the outer AR media delivery pipeline, a number of required transport sessions for media acquisition based on the STAR UE supported media content, wherein the number of required transport sessions are determined based on delivery manifest information.

2. The method of claim 1 , wherein the updates to the scene comprise updated pose information.

3. The method of claim 2 , wherein the updates to the scene further comprises requesting, in the inner media session loop, immersive media based on the updated pose information.

4. The method of claim 3 , wherein the updates to the scene further comprises:

receiving, in the inner media session loop, the immersive media; and

registering, in the inner media session loop, AR content of the immersive media to the real world.

5. The method of claim 4 , wherein the updates to the scene further comprises decoding and processing, in the inner media session loop, the immersive media.

6. A device for transmitting media content over a 5G media streaming (5GMS) network, comprising:

at least one memory configured to store program code; and

at least one processor configured to read the program code and operate as instructed by the program code, the program code comprising:

first selecting code configured to cause the at least one processor to select by a augmented reality (AR) scene manager on a standalone augmented reality (STAR) user device (UE), STAR UE supported media content comprising a full scene description;

first creating code configured to cause the at least one processor to create, by the AR scene manager, an AR/mixed reality (MR) session for streaming the STAR UE supported media content,

wherein the AR scene manager and a media client on the STAR UE configure rendering and delivery media pipelines,

wherein the streaming of the STAR UE supported media content in the AR/mixed reality (MR) session comprises a double loop call flow, the double loop call flow comprising an outer AR media delivery pipeline and an inner media session loop that is nested within the outer AR media delivery pipeline,

wherein, the inner media session loop is configured to stream one or more media objects based on the full scene description, and

wherein the outer AR media delivery pipeline is configured to receive one or more updates to the scene, the updates comprising at least one media object from a new scene, and provide at least one media object from the new scene to the inner media session loop, while the one or more media objects are being streamed to the STAR UE by in the inner media session loop; and

first obtaining code configured to cause the at least one processor to obtain, in the outer AR media delivery pipeline, a number of required transport sessions for media acquisition based on the STAR UE supported media content, wherein the number of required transport sessions are determined based on delivery manifest information.

7. The device of claim 6 , wherein the updates to the scene comprise pose information to the inner media session loop.

8. The device of claim 7 , wherein the updates to the scene causes the at least one processor to request, in the inner media session loop, immersive media based on the updated pose information.

9. The device of claim 8 , wherein the updates to the scene causes the at least one processor to:

receive, in the inner media session loop, the immersive media; and

register, in the inner media session loop, AR content of the immersive media to the real world.

10. The device of claim 9 , wherein the updates to the scene causes the at least one processor to decode and process, in the inner media session loop, the immersive media.

11. A non-transitory computer-readable medium storing instructions for transmitting media content over a 5G media streaming (5GMS) network, the instructions comprising: one or more instructions that, when executed by one or more processors of a device, cause the one or more processors to:

select, by a augmented reality (AR) scene manager on a standalone augmented reality (STAR) user device (UE), STAR UE supported media content comprising a full scene description;

create, by the AR scene manager, an AR/mixed reality (MR) session for streaming the STAR UE supported media content,

wherein the AR scene manager and a media client on the STAR UE configure rendering and delivery media pipelines,

wherein the streaming of the STAR UE supported media content in the AR/mixed reality (MR) session comprises a double loop call flow, the double loop call flow comprising an outer AR media delivery pipeline and an inner media session loop that is nested within the outer AR media delivery pipeline,

wherein, the inner media session loop is configured to stream one or more media objects based on the full scene description, and

wherein the outer AR media delivery pipeline is configured to receive one or more updates to the scene, the updates comprising at least one media object from a new scene, and provide the at least one media object from the new scene to the inner media session loop, while the one or more media objects are being streamed to STAR UE by the inner media session loop; and

obtain, in the outer AR media delivery pipeline, a number of required transport sessions for media acquisition based on the STAR UE supported media content, wherein the number of required transport sessions are determined based on delivery manifest information.

12. The non-transitory computer-readable medium of claim 11 , wherein the updates to the scene comprise updated pose information.

13. The non-transitory computer-readable medium of claim 12 , wherein the updates to the scene cause the one or more processors to update the scene by requesting, in the inner media session loop, immersive media based on the updated pose information.

14. The non-transitory computer-readable medium of claim 13 , wherein the updates to the scene cause the one or more processors to update the scene by:

receiving, in the inner media session loop, the immersive media; and

registering, in the inner media session loop, AR content of the immersive media to the real world.

15. The non-transitory computer-readable medium of claim 14 , wherein the updates to the scene cause the one or more processors to update the scene by decoding and processing, in the inner media session loop, the immersive media.

Assignments (1)

Continuity (2)

References Cited (34)