IP Library Granted Patent US 10,852,138
Granted Patent B2
US 10,852,138 · App. 16/008,727 · Granted Dec 1, 2020

Scalabale simultaneous localization and mapping (SLAM) in virtual, augmented, and mixed reality (xR) applications

Inventors: Vivek Viswanathan Iyer (Austin, TX); Ryan Nicholas Comer (Austin, TX)
Assignee: Dell Products, L.P.
G01C21/005G02B27/017G06F16/29G06T19/006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,852,138
App. No.
16/008,727
Granted
Dec 1, 2020
Kind
B2
Abstract

Systems and methods for scalable Simultaneous Localization and Mapping (SLAM) in virtual, augmented, and mixed reality (xR) applications are described. In some embodiments, an Information Handling System (IHS) may include: a host processor; and a memory coupled to the host processor, the memory having program instructions stored thereon that, upon execution, cause the IHS to: select a subset of landmarks comprising fewer than all landmarks detected in a physical environment; and manage utilization of an IHS resource during execution of a virtual, augmented, or mixed reality application using the subset of landmarks to the exclusion of other landmarks.

Claims (31)

1. An Information Handling System (IHS), comprising:

a host processor; and

a memory coupled to the host processor, the memory having program instructions stored thereon that, upon execution, cause the IHS to:

select a subset of landmarks comprising fewer than all landmarks detected in a physical environment;

manage utilization of an IHS resource during execution of a virtual, augmented, or mixed reality application using the subset of landmarks to the exclusion of other landmarks; and

at least one of:

(a) identify an increase in the utilization of the IHS resource and reduce the number of landmarks in the subset of landmarks to avoid reaching a maximum IHS resource utilization level; or

(b) identify a decrease in the utilization of the IHS resource and increase the number of landmarks in the subset of landmarks without reaching the maximum IHS resource utilization level.

2. The IHS of claim 1 , wherein to select the subset of landmarks, the program instructions, upon execution, further cause the IHS to rank a plurality of landmarks using a confidence level associated with each landmark.

3. The IHS of claim 2 , wherein the program instructions, upon execution, further cause the IHS to calculate the confidence level of each landmark using a Kalman filter.

4. The IHS of claim 3 , wherein the subset of landmarks comprises a number of landmarks selected to maintain the utilization of the IHS resource below a predetermined amount.

5. The IHS of claim 4 , wherein the number of landmarks is selected based upon a calibration curve that associates a change in number of used landmarks with a corresponding change in utilization of the IHS resource.

6. The IHS of claim 1 , wherein the IHS resource comprises the host processor.

7. The IHS of claim 1 , wherein the IHS resource comprises the memory.

8. The IHS of claim 1 , wherein the landmarks are detected via a Head-Mounted Device (HMD) in communications with the IHS.

9. The IHS of claim 8 , wherein the subset of landmarks is usable during execution of the virtual, augmented, or mixed reality application to locate the HMD in the physical environment.

10. A method, comprising:

selecting a subset of landmarks usable by a Simultaneous Localization and Mapping (SLAM) system to locate a Head-Mounted Device (HMD) in a physical environment, wherein subset of landmarks includes a number of landmarks fewer than all detected landmarks;

controlling utilization of a hardware resource by changing the number of landmarks in the subset; and

at least one of:

(a) identifying an increase in the utilization of the hardware processor and reducing the number of landmarks in the subset of landmarks; or

(b) identifying a decrease in the utilization of the hardware processor and increasing the number of landmarks in the subset of landmarks.

11. The method of claim 10 , further comprising ranking the detected landmarks using a confidence level associated with each landmark.

12. The method of claim 10 , wherein the number of landmarks is selected based upon a calibration curve that associates a change in number of landmarks with a corresponding change in utilization of the IHS resource.

13. A hardware memory device having program instructions stored thereon that, upon execution by a hardware processor, cause the hardware processor to:

select a subset of landmarks usable to locate a Head-Mounted Device (HMD) in space, wherein the subset of landmarks comprises fewer than a total number of landmarks available;

control utilization of the hardware processor by dynamically changing a number of landmarks in the subset during execution of a virtual, augmented, or mixed reality applications; and

at least one of:

(a) identify an increase in the utilization of the hardware processor and reduce the number of landmarks in the subset of landmarks; or

(b) identify a decrease in the utilization of the hardware processor and increase the number of landmarks in the subset of landmarks.

14. The hardware memory device of claim 13 , wherein to select the subset of landmarks, the program instructions, upon execution, further cause the hardware processor to rank each of the landmarks detected by the HMD using a confidence level associated with each landmark.

Assignments (8)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053546/0001) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC IP HOLDING COMPANY LLC
Reel/Frame 071642/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (047648/0422) Recorded May 20, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
Reel/Frame 060160/0862 →
RELEASE OF SECURITY INTEREST AT REEL 047648 FRAME 0346 Recorded Nov 2, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
Reel/Frame 058298/0510 →
SECURITY AGREEMENT Recorded Apr 22, 2020
From: CREDANT TECHNOLOGIES INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 053546/0001 →
SECURITY AGREEMENT Recorded Mar 21, 2019
From: CREDANT TECHNOLOGIES, INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 049452/0223 →
PATENT SECURITY AGREEMENT (CREDIT) Recorded Oct 12, 2018
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
Reel/Frame 047648/0346 →
PATENT SECURITY AGREEMENT (NOTES) Recorded Oct 12, 2018
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 047648/0422 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 14, 2018
From: IYER, VIVEK VISWANATHAN; COMER, RYAN NICHOLAS
To: DELL PRODUCTS, L.P.
Reel/Frame 046091/0886 →
Continuity (1)
Related Publication 20190383615A1 · Dec 19, 2019