IP Library Granted Patent US 11,726,577
Granted Patent B2
US 11,726,577 · App. 17/669,546 · Granted Aug 15, 2023

Systems and methods for triggering actions based on touch-free gesture detection

Inventor: Itay Katz (Tel Aviv, IL)
Assignee: eyeSight Mobile Technologies, Ltd.
G06F3/017G06F3/011G06F3/0304G06F3/0482G06F3/0484G06F3/167B60K2370/1464
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,726,577
App. No.
17/669,546
Filed
Feb 11, 2022
Granted
Aug 15, 2023
Kind
B2
Examiner
SHENG, TOM V
Art Unit
2628
USPC
345/156
Abstract

Systems, methods and non-transitory computer-readable media for triggering actions based on touch-free gesture detection are disclosed. The disclosed systems may include at least one processor. A processor may be configured to receive image information from an image sensor, detect in the image information a gesture performed by a user, detect a location of the gesture in the image information, access information associated with at least one control boundary, the control boundary relating to a physical dimension of a device in a field of view of the user, or a physical dimension of a body of the user as perceived by the image sensor, and cause an action associated with the detected gesture, the detected gesture location, and a relationship between the detected gesture location and the control boundary.

Claims (36)

1. A touch-free gesture recognition system, comprising:

at least one processor configured to:

receive image information from an image sensor;

detect in the image information a gesture performed by a user;

detect a location of the gesture in the image information;

access information associated with at least one control boundary, the control boundary relating to a physical dimension of a device in a field of view of the user, or a physical dimension of a body of the user as perceived by the image sensor; and

cause an action associated with the detected gesture, the detected gesture location, and a relationship between the detected gesture location and the control boundary.

2. The system of claim 1 , wherein the processor is further configured to generate information associated with at least one control boundary prior to accessing the information.

3. The system of claim 1 , wherein the processor is further configured to determine the control boundary based, at least in part, on a dimension of the device as is expected to be perceived by the user.

4. The system of claim 3 , wherein the control boundary is determined based, at least in part, on at least one of an edge or corner of the device as is expected to be perceived by the user.

5. The system of claim 1 , wherein the processor is further configured to distinguish between a plurality of predefined gestures to cause a plurality of actions, each associated with a differing predefined gesture.

6. The system of claim 1 , wherein the processor is further configured to generate a plurality of actions, each associated with a differing relative position of the gesture location to the control boundary.

7. The system of claim 1 , wherein the processor is further configured to determine the control boundary by detecting a portion of a body of the user, other than the user's hand, and to define the control boundary based on the detected body portion, and wherein the processor is further configured to generate the action based, at least in part, on an identity of the gesture, and a relative location of the gesture to the control boundary.

8. The system of claim 1 , wherein the processor is further configured to determine the control boundary based on a contour of at least a portion of a body of the user in the image information.

9. The system of claim 1 , wherein the device includes a display, and wherein the processor is further configured to determine the control boundary based on dimensions of the display.

10. The system of claim 9 , wherein processor is further configured to determine the control boundary based on at least one of an edge or corner of a display associated with the device.

11. The system of claim 9 , wherein the processor is further configured to activate a toolbar associated with a particular edge based, at least in part, on the gesture location.

12. The system of claim 1 , wherein the action is related to a number of times at least one of an edge or corner of the control boundary is crossed by a path of the gesture.

13. The system of claim 1 , wherein the action is associated with a predefined motion path associated with the gesture location and the control boundary.

14. The system of claim 1 , wherein the action is associated with a predefined motion path associated with particular edges or corners crossed by the gesture location.

15. The system of claim 1 , wherein the processor is further configured to detect a hand in predefined location relating to the control boundary and initiate detection of the gesture based on the detection of the hand at the predefined location.

16. The system of claim 1 , wherein the processor is further configured to cause at least one of a visual or audio indication when the control boundary is crossed.

17. The system of claim 1 , wherein the control boundary is determined, at least in part, based on a distance between the user and the image sensor.

18. The system of claim 1 , wherein the control boundary is determined, at least in part, based on a location of the user in relation to the device.

19. A method for a touch-free gesture recognition system, comprising:

receiving image information from an image sensor;

detecting in the image information a gesture performed by a user;

detecting a location of the gesture in the image information;

accessing information associated with at least one control boundary, the control boundary relating to a physical dimension of a device in a field of view of the user, or a physical dimension of a body of the user as perceived by the image sensor; and

causing an action associated with the detected gesture, the detected gesture location, and a relationship between the detected gesture location and the control boundary.

20. A non-transitory computer-readable medium storing instructions which, when executed, configure at least one processor to perform operations for touch-free gesture recognition, the operations comprising:

receiving image information associated with a user from an image sensor;

accessing information associated with a control boundary relating to a physical dimension of a device in a field of view of the user, or a physical dimension of a body of the user as perceived by the image sensor;

detecting in the image information a gesture performed by a user in relation to the control boundary;

identifying a user behavior based on the detected gesture; and

generating a message or a command based on the identified user behavior.

Assignments (2)
CONFIRMATORY ASSIGNMENT Recorded Aug 29, 2025
From: CIPIA VISION LTD.
To: RED BEND LTD.
Reel/Frame 073587/0375 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 11, 2022
From: KATZ, ITAY
To: EYESIGHT MOBILE TECHNOLOGIES, LTD.
Reel/Frame 058988/0068 →
Continuity (7)
Continuation 16725030 · Dec 23, 2019
Continuation 16703759 · Dec 4, 2019
Continuation 16272292 · Feb 11, 2019
Continuation 15055958 · Feb 29, 2016
Continuation 14078636 · Nov 13, 2013
Provisional Application 61725559 · Dec 13, 2012
Related Publication 20220164035A1 · May 26, 2022
Cited By (35)
US 12,272,005 US 12,299,251 US 12,315,091 US 12,321,563 US 12,321,666 US 12,353,672 US 12,394,167 US 12,405,704 US 12,443,273 US 12,443,286 US 12,456,271 US 12,461,641 US 12,475,635 US 12,511,009 US 12,511,847 US 12,524,142 US 12,524,977 US 12,535,931 US 12,541,280 US 12,566,532 US 12,596,472 US 12,608,115 US 12,608,877 US 12,608,890 US 12,620,187 US 12,625,608 US 12,632,170 US 12,657,958 US 12,663,853 US 12,663,875 US 12,663,907 US 12,675,958 US 12,681,587 US 12,687,922 US 12,688,660