System and method for extended reality processing in a local wireless environment with reduced latency

1 . A computerized method comprising:

receiving, via a local network that is generated by a mobile edge computing device, a first request from a local device to initiate an XR experience, wherein the first request includes a first position captured by a sensor of the local device;

receiving, from a remote application via a telecommunications network, content for rendering a plurality of frames within a first viewing angle for the XR experience, wherein the first position is within the first viewing angle;

generating an XR rendering comprising a first set of frames, using a first portion of the content that corresponds to the first position within the first viewing angle;

communicating, via the local network, the XR rendering to the local device for the XR experience;

receiving, via the local network, a second request from the local device for content, wherein the second request includes a second position captured by the sensor of the local device;

determining whether the second position is within the first viewing angle;

when the second position is determined to be within the first viewing angle:

without receiving additional content from the telecommunication network, using a second portion of the content previously received from the telecommunication network, generating, by the local network, an updated XR rendering comprising a second set of frames that corresponds to the second position within the first viewing angle; and

communicating via the local network, the updated XR rendering to the local device, wherein the local device provides the updated XR rendering to a user.

2 . The method of claim 1 , wherein when the second position is determined to be outside of the first viewing angle:

communicate, via the telecommunications network, the second position to the remote application;

receive, from the remote application via the telecommunications network, another plurality of frames that correspond to a second viewing angle, wherein the second position is within the second viewing angle;

using the other plurality of frames that correspond to the second viewing angle, locally generate the updated XR rendering that corresponds to the second position within the second viewing angle; and

communicate, via the local network, the updated XR rendering to the local device, wherein the local device provides the updated XR rendering to the user.

3 . The method of claim 1 , further comprising:

receive, via the local network, a third request from the local device for content, wherein the third request includes a third position captured by the sensor of the local device;

determine whether the third position is within the first viewing angle;

when the third position is determined to be within the first viewing angle:

using the plurality of frames, locally generate another updated XR rendering that corresponds to the third position within the first viewing angle; and

communicate, via the local network, the other updated XR rendering to the local device, wherein the local device provides the other updated XR rendering to the user.

4 . The method of claim 1 , wherein the first position and the second position each comprise data specifying a user position in six degrees of freedom within a three-dimensional space, and wherein the six degrees of freedom include one or more of a rotational movement or a translational movement.

5 . The method of claim 4 , wherein the XR rendering is generated using the portion of frames in the plurality of frames that correspond to the user position specified in the six degrees of freedom within the three-dimensional space for the first position.

6 . The method of claim 4 , wherein the updated XR rendering is generated using the other plurality of frames that correspond to the user position specified in the six degrees of freedom within the three-dimensional space for the second position.

7 . The method of claim 1 , wherein the method is performed by a mobile edge device having a processor, a memory, and an antenna configured for communications with the telecommunications network and the local network.

8 . One or more non-transitory computer-readable media storing instructions that when executed via one or more processors performs a computerized method, the media comprising:

via one or more processors:

receive, via a local network that is generated by a mobile edge computing device, a first request from a local device to initiate an XR experience, wherein the first request includes a first position captured by a sensor of the local device;

receive, from a remote application via a telecommunications network, content for rendering a plurality of frames within a first viewing angle for the XR experience, wherein the first position is within the first viewing angle;

generate an XR rendering comprising a first set of frames using a first portion of the content that corresponds to the first position within the first viewing angle;

communicate, via the local network, the XR rendering to the local device for the XR experience;

receive, via the local network, a second request from the local device for content, wherein the second request includes a second position captured by the sensor of the local device;

determine whether the second position is within the first viewing angle;

when the second position is determined to be within the first viewing angle:

without receiving additional content from the telecommunication network, using a second portion of the content previously received from the telecommunication network, generating, by the local network, an updated XR rendering comprising a second set of frames that corresponds to the second position within the first viewing angle; and

communicate, via the local network, the updated XR rendering to the local device, wherein the local device provides the updated XR rendering to a user.

9 . The media of claim 8 , wherein when the second position is determined to be outside of the first viewing angle:

communicate, via the telecommunications network, the second position to the remote application;

receive, from the remote application via the telecommunications network, another plurality of frames that correspond to a second viewing angle, wherein the second position is within the second viewing angle;

using the other plurality of frames that correspond to the second viewing angle, locally generate the updated XR rendering the corresponds to the second position within the second viewing angle; and

communicate, via the local network, the updated XR rendering to the local device, wherein the local device provides the updated XR rendering to the user.

10 . The media of claim 8 , further comprising:

receive, via the local network, a third request from the local device for content, wherein the third request includes a third position captured by the sensor of the local device;

determine whether the third position is within the first viewing angle;

when the third position is determined to be within the first viewing angle:

using the plurality of frames, locally generate another updated XR rendering the corresponds to the third position within the first viewing angle; and

communicate, via the local network, the other updated XR rendering to the local device, wherein the local device provides the other updated XR rendering to the user.

11 . The media of claim 8 , wherein the first position and the second position each comprise data specifying a user position in six degrees of freedom within a three-dimensional space, and wherein the six degrees of freedom include one or more of a rotational movement or a translational movement.

12 . The media of claim 11 , wherein the XR rendering is generated using the portion of frames in the plurality of frames that correspond to the user position specified in the six degrees of freedom within the three-dimensional space for the first position.

13 . The media of claim 11 , wherein the updated XR rendering is generated using the other plurality of frames that correspond to the user position specified in the six degrees of freedom within the three-dimensional space for the second position.

14 . The media of claim 11 , wherein the second position is determined to be within the first viewing angle when the data encoding the user position in the six degrees of freedom within the three-dimensional space further specifies that the user position is located within one or more of the plurality of frames within the first viewing angle.

15 . A system comprising:

a mobile edge device having a processor, a memory, an antenna configured for communications with a telecommunications network and a local network, wherein the mobile edge device:

receives, via the local network that is generate by the mobile edge computing device, a first request from a local device to initiate an XR experience, wherein the first request includes a first position captured by a sensor of the local device;

receives, from a remote application via the telecommunications network, content for rendering a plurality of frames within a first viewing angle for the XR experience, wherein the first position is within the first viewing angle;

generates an XR rendering comprising a first set of frames using a first portion of the content that corresponds to the first position within the first viewing angle;

communicates, via the local network, the XR rendering to the local device for the XR experience;

receives, via the local network, a second request from the local device for content, wherein the second request includes a second position captured by the sensor of the local device;

determines whether the second position is within the first viewing angle;

when the mobile edge device determines the second position is within the first viewing angle:

without receiving additional content from the telecommunication network, using a second portion of the content previously received from the telecommunication network, generates, by the local network, an updated XR rendering comprising a second set of frames that corresponds to the second position within the first viewing angle; and

communicates, via the local network, the updated XR rendering to the local device, wherein the local device provides the updated XR rendering to a user.

16 . The system of claim 15 , wherein the mobile edge device:

when the mobile edge device determines the second position is outside of the first viewing angle:

communicates, via the telecommunications network, the second position to the remote application;

receives, from the remote application via the telecommunications network, another plurality of frames that correspond to a second viewing angle, wherein the second position is within the second viewing angle;

using the other plurality of frames that correspond to the second viewing angle, locally generates the updated XR rendering that corresponds to the second position within the second viewing angle; and

communicates, via the local network, the updated XR rendering to the local device, wherein the local device provides the updated XR rendering to the user.

17 . The system of claim 15 , wherein the mobile edge device:

receives, via the local network, a third request from the local device for content, wherein the third request includes a third position captured by the sensor of the local device;

determines whether the third position is within the first viewing angle;

when the mobile edge device determines the third position is within the first viewing angle:

using the plurality of frames, locally generates another updated XR rendering that corresponds to the third position within the first viewing angle; and

communicates, via the local network, the other updated XR rendering to the local device, wherein the local device provides the other updated XR rendering to the user.

18 . The system of claim 15 , wherein the first position and the second position each comprise data specifying a user position in six degrees of freedom within a three-dimensional space, and wherein the six degrees of freedom include one or more of a rotational movement or a translational movement.

19 . The system of claim 18 , wherein the XR rendering is generated using the portion of frames in the plurality of frames that correspond to the user position specified in the six degrees of freedom within the three-dimensional space for the first position.

20 . The system of claim 18 , wherein the updated XR rendering is generated using the other plurality of frames that correspond to the user position specified in the six degrees of freedom within the three-dimensional space for the second position.