Backchannel encoding for virtual, augmented, or mixed reality (xR) applications in connectivity-constrained environments
Embodiments of systems and methods for backchannel encoding in virtual, augmented, or mixed reality (xR) applications in connectivity-constrained environments are described. In some embodiments, an Head-Mounted Device (HMD) may include a processor; and a memory coupled to the processor, the memory having program instructions stored thereon that, upon execution by the processor, cause the HMD to: encode each of a plurality of Simultaneous Localization and Mapping (SLAM) landmarks, in part, based upon the SLAM landmark's distance to the HMD; and transmit the encoded SLAM landmarks to an Information Handling System (IHS) coupled to the HMD.
1. A Head-Mounted Device (HMD), comprising:
a processor; and
a memory coupled to the processor, the memory having program instructions stored thereon that, upon execution by the processor, cause the HMD to:
receive a Look-Up Table (LUT) from an Information Handling System (IHS) coupled to the HMD, wherein the LUT comprises: a threshold distance, a first parameter, and a second parameter;
encode a first Simultaneous Localization and Mapping (SLAM) landmark using the first parameter in response to a first distance between the first SLAM landmark and the HMD being smaller than the threshold distance;
encode a second SLAM landmark using the second parameter in response to a second distance between the second SLAM landmark and the HMD being greater than the threshold distance; and
transmit the encoded SLAM landmarks to the IHS.
2. The HMD of claim 1 , further comprising an Infra-Red (IR) or Near-IR (NIR) camera configured to provide IR or NIR image frames to the processor.
3. The HMD of claim 1 , wherein the plurality of SLAM landmarks are selected to have a Kalman Gain above a threshold value.
4. The HMD of claim 1 , wherein the first parameter provides a first level of compression, and wherein the second parameter provides a second level of compression higher than the first level.
5. The HMD of claim 1 , wherein the first parameter provides a first level of compression, and wherein the second parameter provides a second level of compression lower than the first level.
6. The HMD of claim 1 wherein the IHS is configured to transmit another LUT to the HMD, or modify the LUT, periodically or based upon context information.
7. The HMD of claim 6 , wherein the context information comprises a type of xR application being executed.
8. The HMD of claim 6 , wherein the context information comprises a gaze vector.
9. The HMD of claim 6 , wherein the context information comprises data loss statistics.
10. The HMD of claim 6 , wherein the context information comprises detection of a safety event at a distance smaller or greater than the threshold distance.
11. The HMD of claim 1 , wherein the IHS is configured to:
decode the encoded SLAM landmarks in part, based upon the SLAM landmark's distance to the HMD; and
produce a map using the decoded SLAM landmarks.
12. A method, comprising:
providing a Look-Up Table (LUT) to a Head-Mounted Device (HMD), wherein the LUT comprises: a threshold distance, a first parameter, and a second parameter;
receiving encoded Simultaneous Localization and Mapping (SLAM) landmarks from the HMD, wherein each SLAM landmark is encoded in part, based upon the SLAM landmark's distance to the HMD;
decoding a first SLAM landmark using the first parameter in response to a first distance between the first SLAM landmark and the HMD being smaller than the threshold distance;
decoding a second SLAM landmark using the second parameter in response to a second distance between the second SLAM landmark and the HMD being greater than the threshold distance; and
producing a map using the decoded SLAM landmarks.
13. The method of claim 12 , further comprising selecting the LUT among a plurality of LUTs based upon at least one of: a type of xR application, a gaze vector, or detection of a safety event.
14. The method of claim 12 , further comprising selecting the LUT among a plurality of LUTs based upon a data loss metric.
15. A hardware memory of a Head-Mounted Device (HMD) wearable by a user, the hardware memory having program instructions stored thereon that, upon execution by a processor, cause the HMD to:
receive a Look-Up Table (LUT) from an Information Handling System (IHS) coupled to the HMD, wherein the LUT comprises: a threshold distance, a first parameter, and a second parameter;
encode a first Simultaneous Localization and Mapping (SLAM) landmark using the first parameter in response to a first distance between the first SLAM landmark and the HMD being smaller than the threshold distance;
encode a second SLAM landmark using the second parameter in response to a second distance between the second SLAM landmark and the HMD being greater than the threshold distance; and
transmit the encoded SLAM landmarks to the HIS.
16. The hardware memory of claim 15 , wherein one of the first or second parameters provides lossless compression, and the other of the first or second parameters provides lossy compression.