IP Library › Granted Patent US 12,641,137
Granted Patent B2
US 12,641,137 · App. 17/726,067 · Granted May 26, 2026

Procedures for providing AR/MR applications to 5G devices by running AR/MR processing on 5G edge servers/cloud including dynamic scene updates

Inventor: Iraj Sodagar (Palo Alto, CA)
Assignee: TENCENT AMERICA LLC
H04L65/75G06T11/00G06T2200/16G06T2210/61
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,641,137
App. No.
17/726,067
Granted
May 26, 2026
Kind
B2
Abstract

A method is provided. The method includes selecting, with an augmented reality (AR)/mixed reality (MR) application, media content for playback, discovering, with the AR/MR application, at least one 5 th Generation media streaming downlink (5GMSd) application server (AS) with edge capabilities suitable for playback of the selected media content, selecting, with the AR/MR application, the at least one 5GMSd AS for playback of the selected media content, and requesting, with the AR/MR application, playback of the selected media content by the selected at least one 5GMSd AS.

Claims (54)

1 . A method, comprising:

selecting, with an augmented reality (AR)/mixed reality (MR) application, media content for playback;

initiating, by the AR/MR application with a media session handler (MSH), playback of the media content;

discovering, with the AR/MR application, at least one 5th Generation media streaming downlink (5GMSd) application server (AS) with edge capabilities suitable for playback of the selected media content, wherein the MSH receives a list of available 5GMSd AS/edge application servers (EAS);

selecting, with the AR/MR application and the MSH, the at least one 5GMSd AS for playback of the selected media content;

providing, through a scene manager, initial scene parameters to the selected 5GMSd AS;

receiving, after providing the initial scene parameters from the selected 5GMSd AS, an entry point to a simplified scene;

requesting, by the AR/MR application, the scene manager to play the entry point to the simplified scene;

requesting, with the AR/MR application, playback of the selected media content by the selected at least one 5GMSd AS;

updating the simplified scene based on a full scene update and determining the simplified scene is updatable.

2 . The method of claim 1 , further comprising requesting, with the AR/MR application, a full scene graph of the selected media content.

3 . The method of claim 2 , further comprising selecting, with the AR/MR application, initial scene components based on the full scene graph.

4 . The method of claim 1 , further comprising receiving, with the selected at least one 5GMSd AS, the full scene update from an AR/MR application provider.

5 . The method of claim 1 , further comprising, based on determining that the simplified scene of the selected media content is updatable, providing, with the selected at least one 5GMSd AS, a simplified scene update based on the full scene update.

6 . The method of claim 1 , further comprising, based on determining that the simplified scene of the selected media content is not updatable:

providing, with the selected at least one 5GMSd AS, the full scene update to the AR/MR application;

selecting, with the AR/MR application, initial scene components;

providing, with the selected at least one 5GMSd AS, the selected initial scene components to the selected at least one 5GMSd AS; and

returning, with the selected at least one 5GMSd AS, an updated simplified scene graph to a scene manager.

7 . A device, comprising:

at least one memory configured to store program code; and

at least one processor configured to read the program code and operate as instructed by the program code, the program code including:

initiating code configured to cause the at least one processor to initiate, by the AR/MR application with a media session handler (MSH), playback of the media content;

first selecting code configured to cause the at least one processor to select, with an augmented reality (AR)/mixed reality (MR) application, media content for playback;

first discovering code configured to cause the at least one processor to discover, with the AR/MR application, at least one 5th Generation media streaming downlink (5GMSd) application server (AS) with edge capabilities suitable for playback of the selected media content, wherein the MSH receives a list of available 5GMSd AS/edge application servers (EAS);

second selecting code configured to cause the at least one processor to select, with the AR/MR application and the MSH, the at least one 5GMSd AS for playback of the selected media content;

providing code configured to cause the at least one processor to provide, through a scene manager, initial scene parameters to the selected 5GMSd AS;

receiving code configured to cause the at least one processor to receive, after providing the initial scene parameters from the selected 5GMSd AS, an entry point to a simplified scene;

first requesting code configured to cause the at least one processor request, by the AR/MR application, the scene manager to play the entry point to the simplified scene;

second requesting code configured to cause the at least one processor to request, with the AR/MR application, playback of the selected media content by the selected at least one 5GMSd AS; and

updating code configured to cause the at least one processor to update the simplified scene based on a full scene update and determining the simplified scene is updatable.

8 . The device of claim 7 , wherein the program code further comprises second requesting code configured to cause the at least one processor to request, with the AR/MR application, a full scene graph of the selected media content.

9 . The device of claim 8 , wherein the program code further comprises third selecting code configured to cause the at least one processor to select, with the AR/MR application, initial scene components based on the full scene graph.

10 . The device of claim 7 , wherein the program code further comprises first receiving code configured to cause the at least one processor to receive, with the selected at least one 5GMSd AS, the full scene update from an AR/MR application provider.

11 . The device of claim 7 , wherein the program code further comprises first providing code configured to cause the at least one processor to, based on determining that the simplified scene of the selected media content is updatable, provide, with the selected at least one 5GMSd AS, a simplified scene update based on the full scene update.

12 . The device of claim 7 , wherein, based on determining that the simplified scene of the selected media content is not updatable, the program code further comprises:

second providing code configured to cause the at least one processor to provide, with the selected at least one 5GMSd AS, the full scene update to the AR/MR application;

fourth selecting code configured to cause the at least one processor to select, with the AR/MR application, initial scene components;

third providing code configured to cause the at least one processor to provide, with the selected at least one 5GMSd AS, the selected initial scene components to the selected at least one 5GMSd AS; and

first returning code configured to cause the at least one processor to return, with the selected at least one 5GMSd AS, an updated simplified scene graph to a scene manager.

13 . A non-transitory computer-readable medium storing instructions, the instructions comprising: one or more instructions that, when executed by one or more processors of a device, cause the one or more processors to:

initiate, by the AR/MR application with a media session handler (MSH), playback of the media content;

select, with an augmented reality (AR)/mixed reality (MR) application, media content for playback;

discover, with the AR/MR application, at least one 5th Generation media streaming downlink (5GMSd) application server (AS) with edge capabilities suitable for playback of the selected media content, wherein the MSH receives a list of available 5GMSd AS/edge application servers (EAS);

select, with the AR/MR application and the MSH, the at least one 5GMSd AS for playback of the selected media content;

providing, through a scene manager, initial scene parameters to the selected 5GMSd AS;

receiving, after providing the initial scene parameters from the selected 5GMSd AS, an entry point to a simplified scene;

requesting, by the AR/MR application, the scene manager to play the entry point to the simplified scene;

request, with the AR/MR application, playback of the selected media content by the selected at least one 5GMSd AS; and

update the simplified scene based on a full scene update and determining the simplified scene is update.

14 . The non-transitory computer-readable medium of claim 13 , wherein the instructions, when executed by the one or more processors, further cause the one or more processors to request, with the AR/MR application, a full scene graph of the selected media content.

15 . The non-transitory computer-readable medium of claim 14 , wherein the instructions, when executed by the one or more processors, further cause the one or more processors to select, with the AR/MR application, initial scene components based on the full scene graph.

16 . The non-transitory computer-readable medium of claim 13 , wherein the instructions, when executed by the one or more processors, further cause the one or more processors to receive, with the selected at least one 5GMSd AS, the full scene update from an AR/MR application provider.

17 . The non-transitory computer-readable medium of claim 13 , wherein the instructions, when executed by the one or more processors, further cause the one or more processors to, based on determining that the simplified scene of the selected media content is updatable, provide, with the selected at least one 5GMSd AS, a simplified scene update based on the full scene update.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 21, 2022
From: SODAGAR, IRAJ
To: TENCENT AMERICA LLC
Reel/Frame 059669/0185 →
Continuity (3)
Provisional Application 63232540 · Aug 12, 2021
Provisional Application 63232544 · Aug 12, 2021
Related Publication 20230050360A1 · Feb 16, 2023
References Cited (17)
US 20170372138A1 · Subbian et al. · 2017 [cited by applicant]
US 20180070113A1 · Phillips et al. · 2018 [cited by applicant]
US 20190385376A1 · Kim et al. · 2019 [cited by applicant]
US 20190391855A1 · Bernat et al. · 2019 [cited by applicant]
US 20200084488A1 · Christie et al. · 2020 [cited by applicant]
US 20200326831A1 · Marr · 2020 [cited by applicant]
US 20220337919A1 · Yip · 2022 [cited by examiner]
WO WO2022241119A1 · 2022 [cited by examiner]
“3rd Generation Partnership Project; Technical Specification Group Services and System Aspects; 5G Media Streaming (5GMS); General description and architecture (Release 16)”, 3GPP TS 26.501v16.8.0 (Jun. 2021), 79 pages. [cited by applicant]
International Search Report dated Aug. 2, 2022 in International Application No. PCT/US22/27428. [cited by applicant]
Written Opinion of the International Searching Authority dated Aug. 2, 2022 in International Application No. PCT/US22/27428. [cited by applicant]
“3rd Generation Partnership Project; Technical Specification Group Services and System Aspects; Study on 5G Media Streaming Extensions for Edge Processing (Release 17),” 3GPP TR 26.803v1.2.0, Apr. 2021, XP51996465A, pp.… [cited by applicant]
“3rd Generation Partnership Project; Technical Specification Group SA WG4; Support of 5G Glass-type Augmented Reality/Mixed Reality (AR/MR) devices (Release 17),” 3GPP TR 26.998v0.9.0, Aug. 2021, XP52031765A, pp. 1-65 (… [cited by applicant]
“[FS_5GSTAR] EDGAR-based media streaming update,” Tencent, 3GPP SA4#115-e, Psuedo Change Request, 26.998 CR v0.9.0, Aug. 18-27, 2021, S4-211122, XP 52064348A, pp. 1-10 (10 pages total). [cited by applicant]
Extended European Search Report issued Dec. 15, 2023 in Application No. 22856362.3. [cited by applicant]
3rd Generation Partnership Project; Technical Specification Group SA, WG4, “Support of 5G Glass-type Augmented Reality / Mixed Reality (AR/MR) devices; (Release 17)”, 3GPP TR 26.998 V0.9.0, Aug. 2021 (9 pages total). [cited by applicant]
Communication issued Jan. 4, 2026 in Chinese Application No. APP No. 202280006647.8. [cited by applicant]