Procedures for providing AR/MR applications to 5G devices by running AR/MR processing on 5G edge servers/cloud including dynamic scene updates
A method is provided. The method includes selecting, with an augmented reality (AR)/mixed reality (MR) application, media content for playback, discovering, with the AR/MR application, at least one 5 th Generation media streaming downlink (5GMSd) application server (AS) with edge capabilities suitable for playback of the selected media content, selecting, with the AR/MR application, the at least one 5GMSd AS for playback of the selected media content, and requesting, with the AR/MR application, playback of the selected media content by the selected at least one 5GMSd AS.
1 . A method, comprising:
selecting, with an augmented reality (AR)/mixed reality (MR) application, media content for playback;
initiating, by the AR/MR application with a media session handler (MSH), playback of the media content;
discovering, with the AR/MR application, at least one 5th Generation media streaming downlink (5GMSd) application server (AS) with edge capabilities suitable for playback of the selected media content, wherein the MSH receives a list of available 5GMSd AS/edge application servers (EAS);
selecting, with the AR/MR application and the MSH, the at least one 5GMSd AS for playback of the selected media content;
providing, through a scene manager, initial scene parameters to the selected 5GMSd AS;
receiving, after providing the initial scene parameters from the selected 5GMSd AS, an entry point to a simplified scene;
requesting, by the AR/MR application, the scene manager to play the entry point to the simplified scene;
requesting, with the AR/MR application, playback of the selected media content by the selected at least one 5GMSd AS;
updating the simplified scene based on a full scene update and determining the simplified scene is updatable.
2 . The method of claim 1 , further comprising requesting, with the AR/MR application, a full scene graph of the selected media content.
3 . The method of claim 2 , further comprising selecting, with the AR/MR application, initial scene components based on the full scene graph.
4 . The method of claim 1 , further comprising receiving, with the selected at least one 5GMSd AS, the full scene update from an AR/MR application provider.
5 . The method of claim 1 , further comprising, based on determining that the simplified scene of the selected media content is updatable, providing, with the selected at least one 5GMSd AS, a simplified scene update based on the full scene update.
6 . The method of claim 1 , further comprising, based on determining that the simplified scene of the selected media content is not updatable:
providing, with the selected at least one 5GMSd AS, the full scene update to the AR/MR application;
selecting, with the AR/MR application, initial scene components;
providing, with the selected at least one 5GMSd AS, the selected initial scene components to the selected at least one 5GMSd AS; and
returning, with the selected at least one 5GMSd AS, an updated simplified scene graph to a scene manager.
7 . A device, comprising:
at least one memory configured to store program code; and
at least one processor configured to read the program code and operate as instructed by the program code, the program code including:
initiating code configured to cause the at least one processor to initiate, by the AR/MR application with a media session handler (MSH), playback of the media content;
first selecting code configured to cause the at least one processor to select, with an augmented reality (AR)/mixed reality (MR) application, media content for playback;
first discovering code configured to cause the at least one processor to discover, with the AR/MR application, at least one 5th Generation media streaming downlink (5GMSd) application server (AS) with edge capabilities suitable for playback of the selected media content, wherein the MSH receives a list of available 5GMSd AS/edge application servers (EAS);
second selecting code configured to cause the at least one processor to select, with the AR/MR application and the MSH, the at least one 5GMSd AS for playback of the selected media content;
providing code configured to cause the at least one processor to provide, through a scene manager, initial scene parameters to the selected 5GMSd AS;
receiving code configured to cause the at least one processor to receive, after providing the initial scene parameters from the selected 5GMSd AS, an entry point to a simplified scene;
first requesting code configured to cause the at least one processor request, by the AR/MR application, the scene manager to play the entry point to the simplified scene;
second requesting code configured to cause the at least one processor to request, with the AR/MR application, playback of the selected media content by the selected at least one 5GMSd AS; and
updating code configured to cause the at least one processor to update the simplified scene based on a full scene update and determining the simplified scene is updatable.
8 . The device of claim 7 , wherein the program code further comprises second requesting code configured to cause the at least one processor to request, with the AR/MR application, a full scene graph of the selected media content.
9 . The device of claim 8 , wherein the program code further comprises third selecting code configured to cause the at least one processor to select, with the AR/MR application, initial scene components based on the full scene graph.
10 . The device of claim 7 , wherein the program code further comprises first receiving code configured to cause the at least one processor to receive, with the selected at least one 5GMSd AS, the full scene update from an AR/MR application provider.
11 . The device of claim 7 , wherein the program code further comprises first providing code configured to cause the at least one processor to, based on determining that the simplified scene of the selected media content is updatable, provide, with the selected at least one 5GMSd AS, a simplified scene update based on the full scene update.
12 . The device of claim 7 , wherein, based on determining that the simplified scene of the selected media content is not updatable, the program code further comprises:
second providing code configured to cause the at least one processor to provide, with the selected at least one 5GMSd AS, the full scene update to the AR/MR application;
fourth selecting code configured to cause the at least one processor to select, with the AR/MR application, initial scene components;
third providing code configured to cause the at least one processor to provide, with the selected at least one 5GMSd AS, the selected initial scene components to the selected at least one 5GMSd AS; and
first returning code configured to cause the at least one processor to return, with the selected at least one 5GMSd AS, an updated simplified scene graph to a scene manager.
13 . A non-transitory computer-readable medium storing instructions, the instructions comprising: one or more instructions that, when executed by one or more processors of a device, cause the one or more processors to:
initiate, by the AR/MR application with a media session handler (MSH), playback of the media content;
select, with an augmented reality (AR)/mixed reality (MR) application, media content for playback;
discover, with the AR/MR application, at least one 5th Generation media streaming downlink (5GMSd) application server (AS) with edge capabilities suitable for playback of the selected media content, wherein the MSH receives a list of available 5GMSd AS/edge application servers (EAS);
select, with the AR/MR application and the MSH, the at least one 5GMSd AS for playback of the selected media content;
providing, through a scene manager, initial scene parameters to the selected 5GMSd AS;
receiving, after providing the initial scene parameters from the selected 5GMSd AS, an entry point to a simplified scene;
requesting, by the AR/MR application, the scene manager to play the entry point to the simplified scene;
request, with the AR/MR application, playback of the selected media content by the selected at least one 5GMSd AS; and
update the simplified scene based on a full scene update and determining the simplified scene is update.
14 . The non-transitory computer-readable medium of claim 13 , wherein the instructions, when executed by the one or more processors, further cause the one or more processors to request, with the AR/MR application, a full scene graph of the selected media content.
15 . The non-transitory computer-readable medium of claim 14 , wherein the instructions, when executed by the one or more processors, further cause the one or more processors to select, with the AR/MR application, initial scene components based on the full scene graph.
16 . The non-transitory computer-readable medium of claim 13 , wherein the instructions, when executed by the one or more processors, further cause the one or more processors to receive, with the selected at least one 5GMSd AS, the full scene update from an AR/MR application provider.
17 . The non-transitory computer-readable medium of claim 13 , wherein the instructions, when executed by the one or more processors, further cause the one or more processors to, based on determining that the simplified scene of the selected media content is updatable, provide, with the selected at least one 5GMSd AS, a simplified scene update based on the full scene update.