IP Library Granted Patent US 10,592,002
Granted Patent B2
US 10,592,002 · App. 16/009,087 · Granted Mar 17, 2020

Gesture sequence recognition using simultaneous localization and mapping (SLAM) components in virtual, augmented, and mixed reality (xR) applications

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,592,002
App. No.
16/009,087
Granted
Mar 17, 2020
Kind
B2
Abstract

Systems and methods for gesture sequence recognition using Simultaneous Localization and Mapping (SLAM) components in virtual, augmented, and mixed reality (xR) applications are described. In an illustrative, non-limiting embodiment, an Information Handling System (IHS) may include: a processor; and a memory coupled to the processor, the memory having program instructions stored thereon that, upon execution, cause the IHS to: detect a gesture performed by a user wearing a Head-Mounted Device (HMD) using a first image capture device and a second image capture device concurrently; evaluate the first and second image capture devices; identify the gesture based upon the evaluation; and execute a command associated with the gesture.

Claims (31)

1. An Information Handling System (IHS), comprising:

a processor; and

a memory coupled to the processor, the memory having program instructions stored thereon that, upon execution, cause the IHS to:

detect a gesture performed by a user wearing a Head-Mounted Device (HMD) using a first image capture device and a second image capture device concurrently;

at least one of: (i) select the first image capture device as a primary gesture recognition source and the second image capture device as a secondary gesture recognition source in response to an Ambient Light Sensor (ALS) reading being above a first threshold, or (ii) select the second image capture device as the primary gesture recognition source and disregard the first image capture device as a gesture recognition source in response to the ALS reading being below a second threshold;

identify the gesture using the selection; and

execute a command associated with the gesture.

2. The IHS of claim 1 , wherein the first image capture device is part of an outside-in tracking (OIT) camera system comprising a plurality of lighthouses.

3. The IHS of claim 2 , wherein to evaluate the first and second image capture devices, the program instructions, upon execution, further cause the IHS to determine that the HMD is located within a selected distance from a given lighthouse.

4. The IHS of claim 2 , wherein the second image capture device is part of an inside-out tracking (IOT) camera system.

5. The IHS of claim 1 , wherein the program instructions, upon execution, cause the IHS to further select the first image capture device as the primary gesture recognition source and the second image capture device as the secondary gesture recognition source in response to a first resolution multiplied by a first number of frames per second of the first image capture device being greater than a second resolution multiplied by a second number of frames per second of the second image capture device.

6. The IHS of claim 1 , wherein the first image capture device is a gesture camera, and wherein the second image capture device is part of an inside-out tracking (IOT) camera system.

7. The IHS of claim 1 , wherein the second image capture device is configured to capture images in an infrared (IR) spectrum.

8. The IHS of claim 1 , wherein the program instructions, upon execution, further cause the IHS to receive a first plurality of video frames captured using, as the primary gesture recognition source, a selected one of the first or second image capture devices.

9. The IHS of claim 8 , wherein to identify the gesture, the program instructions, upon execution, further cause the IHS to:

in response to detecting a most frequent gesture and a second most frequent gesture in the first plurality of video frames, wherein a number of video frames with the most frequent gesture is greater than a number of video frames with the second most frequent gesture by a selected amount, identify the gesture as matching the most frequent gesture.

10. The IHS of claim 9 , wherein to identify the gesture, the program instructions, upon execution, further cause the IHS to receive a second plurality of video frames captured using, as the secondary gesture recognition source, another selected one of the first or second image capture devices.

11. The IHS of claim 10 , wherein to identify the gesture, the program instructions, upon execution, further cause the IHS to, in response to detecting another most frequent gesture in the second plurality of video frames, identify the gesture as matching the other most frequent gesture.

12. The IHS of claim 11 , wherein the program instructions, upon execution, further cause the IHS to detect the gesture using a third image capture device concurrently with the first image capture device and a second image capture device.

13. A method, comprising:

detecting a gesture performed by a user wearing a Head-Mounted Device (HMD) using a first image capture device and a second image capture device concurrently;

selecting the first image capture device as a primary gesture recognition source in response to an Ambient Light Sensor (ALS) reading being above a threshold or selecting the second image capture device as the primary gesture recognition source in response to the ALS reading being below a threshold;

identifying the gesture using the selection; and

executing a command associated with the gesture.

14. The method of claim 13 , further comprising receiving a first plurality of video frames captured using, as the primary gesture recognition source, a selected one of the first image capture device or the second image capture device.

15. The method of claim 13 , further comprising selecting the first image capture device as the primary gesture recognition source in response to a first resolution multiplied by a first number of frames per second of the first image capture device being greater than a second resolution multiplied by a second number of frames per second of the second image capture device.

16. A hardware memory device of an Information Handling System (IHS) having program instructions stored thereon that, upon execution by a hardware processor, cause the IHS to:

detect a gesture performed by a user wearing a Head-Mounted Device (HMD) using a first image capture device and a second image capture device concurrently;

select the first image capture device as a primary gesture recognition source in response to an Ambient Light Sensor (ALS) reading being above a threshold or select the second image capture device as the primary gesture recognition source in response to the ALS reading being below a threshold;

identify the gesture using the selection; and

execute a command associated with the gesture.

Assignments (8)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053546/0001) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC IP HOLDING COMPANY LLC
Reel/Frame 071642/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (047648/0422) Recorded May 20, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
Reel/Frame 060160/0862 →
RELEASE OF SECURITY INTEREST AT REEL 047648 FRAME 0346 Recorded Nov 2, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
Reel/Frame 058298/0510 →
SECURITY AGREEMENT Recorded Apr 22, 2020
From: CREDANT TECHNOLOGIES INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 053546/0001 →
SECURITY AGREEMENT Recorded Mar 21, 2019
From: CREDANT TECHNOLOGIES, INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 049452/0223 →
PATENT SECURITY AGREEMENT (CREDIT) Recorded Oct 12, 2018
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
Reel/Frame 047648/0346 →
PATENT SECURITY AGREEMENT (NOTES) Recorded Oct 12, 2018
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 047648/0422 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 14, 2018
From: IYER, VIVEK VISWANATHAN; SMITH, HANA SCHUSTER
To: DELL PRODUCTS, L.P.
Reel/Frame 046094/0960 →