Systems and methods for pass-through extended reality (XR) content

1 . An apparatus for extended reality (XR) management, the apparatus comprising:

at least one memory; and

at least one processor coupled to the at least one memory, the at least one processor configured to:

receive compressed sensor data from an XR interface device having at least one sensor;

generate, based on receipt of the compressed sensor data from the XR interface device and without decompressing the compressed sensor data, processing instructions for an XR processing device to process the compressed sensor data;

send the compressed sensor data and the processing instructions to the XR processing device without decompressing the compressed sensor data;

receive compressed XR content from the XR processing device, the compressed XR content generated by the XR processing device based on decompression and processing of the compressed sensor data according to the processing instructions at the XR processing device;

generate layer content corresponding to the compressed XR content without decompressing the compressed XR content; and

send the compressed XR content and the layer content to the XR interface device without decompressing the compressed XR content to cause the XR interface device to output a decompressed variant of the compressed XR content and the layer content in a layered arrangement.

2 . The apparatus of claim 1 , wherein the XR interface device is a headset that is coupled to the apparatus using a local communication interface.

3 . The apparatus of claim 1 , wherein the XR interface device is a mobile device that is coupled to the apparatus using a local communication interface.

4 . The apparatus of claim 1 , wherein the apparatus is a mobile device that is coupled to the XR interface device using a local communication interface.

5 . The apparatus of claim 1 , wherein the XR processing device includes a server.

6 . The apparatus of claim 1 , wherein the XR processing device includes an edge node.

7 . The apparatus of claim 1 , wherein the compressed sensor data received from the XR interface device and sent to the XR processing device includes compressed image data.

8 . The apparatus of claim 1 , wherein the at least one processor is configured to:

receive uncompressed data from the XR interface device;

compress the uncompressed data to generate additional compressed data; and

send the additional compressed data to the XR processing device before receiving the compressed XR content from the XR processing device.

9 . The apparatus of claim 1 , wherein, to generate the processing instructions based on the receipt of the compressed sensor data from the XR interface device, the at least one processor is configured to:

generate the processing instructions based on the compressed sensor data and uncompressed data received from the XR interface device.

10 . The apparatus of claim 1 , wherein, to generate the processing instructions based on the receipt of the compressed sensor data from the XR interface device, the at least one processor is configured to:

generate at least a subset of the processing instructions based on at least one characteristic of a local communication interface between the apparatus and the XR interface device over which the compressed sensor data is received from the XR interface device, wherein the at least one characteristic includes at least one of a bandwidth, a bitrate, a baud rate, a transfer speed, a transfer protocol, an encryption scheme, a connection quality, or a security scheme.

11 . The apparatus of claim 1 , wherein, to generate the processing instructions based on the receipt of the compressed sensor data from the XR interface device, the at least one processor is configured to:

generate at least a subset of the processing instructions based on at least one characteristic of the compressed sensor data as received from the XR interface device, wherein the at least one characteristic includes at least one of a file size, an image size, an image resolution, a frame rate, an amount of channels, an encoding scheme, or an encryption scheme.

12 . The apparatus of claim 1 , wherein, to generate the processing instructions based on the receipt of the compressed sensor data from the XR interface device, the at least one processor is configured to:

generate at least a subset of the processing instructions based on at least one characteristic of the XR interface device, wherein the at least one characteristic includes at least one of an image capture resolution, an image capture size, an image capture color space, an image display resolution, an image display size, an image display color space, a pose, a location, an orientation, a bandwidth, a bit rate, a baud rate, a transfer speed, a transfer protocol, an encryption scheme, a security scheme, a temperature, or a battery level.

13 . The apparatus of claim 1 , wherein, to generate the processing instructions based on the receipt of the compressed sensor data from the XR interface device, the at least one processor is configured to:

generate at least a subset of the processing instructions based on at least one characteristic of the XR processing device, wherein the at least one characteristic includes at least one of a capability, a capacity, a processing power, a bandwidth, a bit rate, a baud rate, a transfer speed, a transfer protocol, an encryption scheme, or a security scheme.

14 . The apparatus of claim 1 , wherein the processing instructions are indicative of at least a pose of virtual content to be rendered as part of the decompressed variant of the compressed XR content, wherein the virtual content is associated with a video game.

15 . The apparatus of claim 1 , wherein a portion of the layer content is configured to be overlaid over at least a portion of the decompressed variant of the compressed XR content according to the layered arrangement.

16 . The apparatus of claim 1 , wherein at least a portion of the decompressed variant of the compressed XR content is configured to be overlaid over at least a portion of the layer content according to the layered arrangement.

17 . The apparatus of claim 1 , wherein the at least one processor is configured to:

manage an application programming interface (API), wherein the receipt of the compressed sensor data from the XR interface device is associated with a first API call to the API, and wherein the receipt of the compressed XR content from the XR processing device is associated with a second API call to the API.

18 . A method for extended reality (XR) management, the method comprising:

receiving compressed sensor data from an XR interface device having at least one sensor;

generating, based on receipt of the compressed sensor data from the XR interface device and without decompressing the compressed sensor data, processing instructions for an XR processing device to process the compressed sensor data;

sending the compressed sensor data and the processing instructions to the XR processing device without decompressing the compressed sensor data;

receiving compressed XR content from the XR processing device, the compressed XR content generated by the XR processing device based on decompression and processing of the compressed sensor data according to the processing instructions at the XR processing device;

generating layer content corresponding to the compressed XR content without decompressing the compressed XR content; and

sending the compressed XR content and the layer content to the XR interface device without decompressing the compressed XR content to cause the XR interface device to output a decompressed variant of the compressed XR content and the layer content in a layered arrangement.

19 . The method of claim 18 , wherein generating the processing instructions includes generating the processing instructions based on the compressed sensor data and uncompressed data received from the XR interface device.

20 . The method of claim 18 , wherein receiving the compressed sensor data from the XR interface device includes receiving the compressed sensor data from the XR interface device over a local communication interface, wherein sending the compressed XR content and the layer content to the XR interface device includes sending the compressed XR content and the layer content to the XR interface device over the local communication interface, and wherein generating the processing instructions includes generating at least a subset of the processing instructions based on at least one characteristic of the local communication interface, wherein the at least one characteristic includes at least one of a bandwidth, a bitrate, a baud rate, a transfer speed, a transfer protocol, an encryption scheme, a connection quality, or a security scheme.