IP Library Granted Patent US 9,990,043
Granted Patent B2
US 9,990,043 · App. 14/789,788 · Granted Jun 5, 2018

Gesture recognition systems and devices for low and no light conditions

Inventors: Ryan Fink (Vancouver, WA); Ryan Phelps (Portland, OR); Gary Peck (Portland, OR)
Assignee: Atheer Labs, Inc.
G06F3/017G06F3/012
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,990,043
App. No.
14/789,788
Granted
Jun 5, 2018
Kind
B2
Abstract

Gesture recognition systems for detecting gesture commands in light conditions and in dark conditions including a computing system having a processor and a thermographic camera configured to detect infrared radiation from a gesture made by a user and communicate gesture image information to the processor for carrying out a computer-readable gesture command are shown and described. In some examples, the computing system and the thermographic camera are supported on an eyewear article frame. In some other examples, the computing system and the thermographic camera are components of a mobile device. In even other examples, the computing system and the thermographic camera are components of a desk top computer or a laptop computer.

Claims (58)

1. A system, comprising:

a thermographic camera having a first field of view, the thermographic camera to capture an infrared image within the first field of view;

an optical camera having a second field of view, the optical camera to detect an optical image, wherein the first field of view and the second field of view are substantially the same; and

a processor coupled to the thermographic camera, the processor to:

receive the infrared image from the thermographic camera;

receive the optical image from the optical camera;

determine whether a light condition of the optical image is a normal light condition, a low light condition, or a no light condition;

in response to the low light condition or the no light condition:

detect infrared radiation in the infrared image;

define a first readable zone within the infrared image, wherein the first readable zone is a portion of the first field of view that includes an image of a body part of a user;

identify a first gesture made by the user based on the infrared radiation within the first readable zone to obtain first gesture information; and

execute a first gesture recognition command associated with the first gesture information; and

in response to the normal light condition:

define a second readable zone within the optical image associated, wherein the second readable zone is a portion of the second field of view that includes the image of the body part of the user;

identify a second gesture made by the user within the second readable zone using optical recognition to obtain second gesture information; and

execute a second gesture recognition command associated with the second gesture information.

2. The system of claim 1 , wherein the processor, the thermographic camera, and the optical camera are supported on an eyewear article frame.

3. The system of claim 2 , wherein the eyewear article frame further comprises an image generator operable to display an augmented reality image to the user.

4. The system of claim 1 , wherein the processor, the thermographic camera, and the optical camera are components of a mobile device.

5. The system of claim 4 , wherein the mobile device is a smart phone.

6. The system of claim 1 , wherein the processor, the thermographic camera, and the optical camera are components of a desktop computer or a laptop computer.

7. The system of claim 1 , wherein the first gesture or the second gesture is a hand gesture.

8. The system of claim 7 , wherein the hand gesture is at least one of an open hand gesture, a closed hand gesture, a swipe right, a swipe left, a swipe forward, or a swipe backward.

9. The system of claim 1 , wherein the first gesture or the second gesture is a head gesture.

10. The system of claim 9 , wherein the head gesture is at least one of a single-eye wink, a two-eye blink, an upward head movement, a downward head movement, a rightward head movement, or a leftward head movement.

11. A system, comprising:

a processor to:

receive an infrared image from a thermographic camera;

receive an optical image from an optical camera;

determine whether a light condition of the optical image is a normal light condition, a low light condition, or a no light condition;

in response to the low light condition or the no light condition:

detect infrared radiation in the infrared image;

define a first readable zone within the infrared image, wherein the first readable zone is a portion of a first field of view that includes an image of a body part of a user;

identify a first gesture made by the user based on the infrared radiation within the first readable zone to obtain first gesture information; and

execute a first gesture recognition command associated with the first gesture information; and

in response to the normal light condition:

define a second readable zone within the optical image associated, wherein the second readable zone is a portion of a second field of view that includes the image of the body part of the user;

identify a second gesture made by the user within the second readable zone using optical recognition to obtain second gesture information; and

execute a second gesture recognition command associated with the second gesture information.

12. The system of claim 11 , wherein the processor, the thermographic camera, and the optical camera are supported on an eyewear article frame, the eyewear article frame further comprising an image generator operable to display an augmented reality image to the user.

13. The system of claim 11 , wherein the processor, the thermographic camera, and the optical camera are components of a mobile device.

14. The system of claim 11 , wherein the processor, the thermographic camera, and the optical camera are components of a desktop computer or a laptop computer.

15. The system of claim 11 , wherein the gesture is a hand gesture, the hand gesture being at least one of an open hand gesture, a closed hand gesture, a swipe right, a swipe left, a swipe forward, or a swipe backward.

16. The system of claim 11 , wherein the gesture is a head gesture, the head gesture being at least one of a single-eye wink, a two-eye blink, an upward head movement, a downward head movement, a rightward head movement, or a leftward head movement.

17. A non-transitory computer-readable medium storing instructions to cause a processing device to:

receive an infrared image from a thermographic camera;

receive an optical image from an optical camera;

determine whether a light condition of the optical image is a normal light condition, a low light condition, or a no light condition;

in response to the low light condition or the no light condition:

detect infrared radiation in the infrared image;

define a first readable zone within the infrared image, wherein the first readable zone is a portion of a field of view that includes an image of a body part of a user;

identify a first gesture made by the user based on the infrared radiation within the first readable zone to obtain first gesture information; and

execute a first gesture recognition command associated with the first gesture information; and

in response to the normal light condition:

define a second readable zone within the optical image associated, wherein the second readable zone is a portion of a second field of view that includes the image of the body part of the user;

identify a second gesture made by the user within the second readable zone using optical recognition to obtain second gesture information; and

execute a second gesture recognition command associated with the second gesture information.

18. The non-transitory computer-readable medium of claim 17 , wherein the processing device, the thermographic camera, and the optical camera are supported on an eyewear article frame, the eyewear article frame further comprising an image generator operable to display an augmented reality image to the user.

Assignments (7)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 7, 2022
From: ATHEER, INC.
To: WEST TEXAS TECHNOLOGY PARTNERS, LLC
Reel/Frame 058962/0067 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE NAME PREVIOUSLY RECORDED ON REEL 039569 FRAME 0554. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jan 12, 2022
From: FINK, RYAN
To: ATHEER, INC.
Reel/Frame 058707/0125 →
CORRECTIVE ASSIGNMENT TO CORRECT THE SPELLING OF ASSIGNEE'S NAME PREVIOUSLY RECORDED ON REEL 052857 FRAME 0107. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jun 9, 2020
From: FINK, RYAN; PHELPS, RYAN
To: ATHEER, INC.
Reel/Frame 052888/0704 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 8, 2020
From: PECK, GARY
To: ATHEER, INC.
Reel/Frame 052869/0899 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 5, 2020
From: FINK, RYAN; PHELPS, RYAN
To: ATHHER, INC.
Reel/Frame 052857/0107 →
SECURITY INTEREST Recorded Nov 20, 2018
From: ATHEER, INC.
To: COTA CAPITAL MASTER FUND, L.P., AS COLLATERAL AGENT
Reel/Frame 048154/0759 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 29, 2016
From: FINK, RYAN
To: ATHEER LABS, INC.
Reel/Frame 039569/0554 →
Continuity (2)
Provisional Application 62022384 · Jul 9, 2014
Related Publication 20160011669A1 · Jan 14, 2016