IP Library Granted Patent US 11,249,555
Granted Patent B2
US 11,249,555 · App. 16/725,030 · Granted Feb 15, 2022

Systems and methods to detect a user behavior within a vehicle

Inventor: Itay Katz (Tel Aviv, IL)
Assignee: Eyesight Mobile Technologies, Ltd.
G06F3/017G06F3/011G06F3/0304G06F3/0482G06F3/0484G06F3/167
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,249,555
App. No.
16/725,030
Granted
Feb 15, 2022
Kind
B2
Abstract

Systems, methods and non-transitory computer-readable media for triggering actions based on touch-free gesture detection are disclosed. The disclosed systems may include at least one processor. A processor may be configured to receive image information from an image sensor, detect in the image information a gesture performed by a user, detect a location of the gesture in the image information, access information associated with at least one control boundary, the control boundary relating to a physical dimension of a device in a field of view of the user, or a physical dimension of a body of the user as perceived by the image sensor, and cause an action associated with the detected gesture, the detected gesture location, and a relationship between the detected gesture location and the control boundary.

Claims (47)

1. A touch-free gesture recognition system, comprising:

at least one processor configured to:

receive image information associated with a user from an image sensor;

access information associated with a control boundary relating to a physical dimension of a device in a field of view of the user, or a physical dimension of a body of the user as perceived by the image sensor;

detect in the image information a gesture performed by a user in relation to the control boundary;

identify a user behavior based on the detected gesture, the identified user behavior including one or more activities the user performs; and

generate a message or a command based on the identified user behavior.

2. The system of claim 1 , wherein the at least one processor is further configured to detect the gesture by detecting a movement of at least one of a device, an object, or a body part relative to a body of the user.

3. The system of claim 2 , wherein the at least one processor is further configured to determine at least one of a level of attentiveness of the user or a gaze direction of the user based on the detected movement of at least one of the device, the object, or the body part relative to the body of the user.

4. The system of claim 2 , wherein the at least one processor is further configured to improve an accuracy in detecting at least one of: determining parameters related to driver attentiveness, determining driver gaze direction or determining parameters related driver gaze direction, determining parameters related driver head pose or the gesture performed by the user, based on the detected movement of at least one of the device, the object, or the body part relative to the body of the user.

5. The system of claim 2 , wherein the detected gesture performed by the user is associated with an interaction with a face of the user.

6. The system of claim 5 , wherein the interaction comprises placing an object on the face of the user, or touching the face of the user.

7. The system of claim 1 , wherein the at least one processor is further configured to predict one or more activities the user performs.

8. The system of claim 7 , wherein the predicted one or more activities the user performs includes reaching for a mobile device, operate a mobile device, operate an application, controlling a multimedia device in the vehicle.

9. The system of claim 1 , wherein the at least one processor is further configured to:

detect, in the image information, an object in a boundary associated with at least a part of a body of the user;

ignore the detected object in the image information; and

detect, based on the image information other than the ignored detected object, at least one of the gesture performed by the user, the user behavior, a gaze of the user, or an activity of the user.

10. The system of claim 9 , wherein the detected object comprises a finger or a hand of the user.

11. The system of claim 1 , wherein the at least one processor is further configured to:

detect a hand of the user in a boundary associated with a part of a body of the user;

detect an object in the hand of the user;

detect an object, wherein the object is moving with the hand toward a second part of the body of the user; and

identify the user behavior based on the detected hand and the detected object in the boundary associated with the second part of the body of the user.

12. The system of claim 11 , wherein the hand of the user is detected in a boundary associated with a part of a body of the user.

13. The system of claim 11 , wherein the detected object is detected in the hand of the user.

14. The system of claim 11 , wherein the at least one processor is further configured to:

determine that the user behavior performed by the user is eating.

15. The system of claim 1 , wherein the at least one processor is further configured to:

detect a hand of the user in a boundary associated with a part of a body of the user;

detect an object in a boundary associated with a part of a body of the user;

detect that the detected hand of the user and the detected object moving away from the boundary associated with the part of the body of the user after a predetermined period of time; and

identify the user behavior based on the detected hand and the detected object.

16. The system of claim 1 , wherein the at least one processor is further configured to:

determine that the gesture performed by the user is an eating gesture by determining that the gesture is a repeated gesture in a lower portion of the user's face, in which the lower portion of the user's face moves up and down, left and right, or a combination thereof.

17. A computerized touch-free gesture recognition method, comprising:

receiving image information associated with a user from an image sensor;

accessing information associated with a control boundary relating to a physical dimension of a device in a field of view of the user, or a physical dimension of a body of the user as perceived by the image sensor;

detecting in the image information a gesture performed by a user in relation to the control boundary;

identifying a user behavior based on the detected gesture, the identified user behavior including one or more activities the user performs; and

generating a message or a command based on the identified user behavior.

18. A non-transitory computer-readable medium storing instructions which, when executed, configure at least one processor to perform operations for touch-free gesture recognition, the operations comprising:

receiving image information associated with a user from an image sensor;

accessing information associated with a control boundary relating to a physical dimension of a device in a field of view of the user, or a physical dimension of a body of the user as perceived by the image sensor;

detecting in the image information a gesture performed by a user in relation to the control boundary;

identifying a user behavior based on the detected gesture, the identified user behavior including one or more activities the user performs; and

generating a message or a command based on the identified user behavior.

Assignments (2)
CONFIRMATORY ASSIGNMENT Recorded Aug 29, 2025
From: CIPIA VISION LTD.
To: RED BEND LTD.
Reel/Frame 073587/0375 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 22, 2021
From: KATZ, ITAY
To: EYESIGHT MOBILE TECHNOLOGIES, LTD.
Reel/Frame 057562/0772 →
Continuity (6)
Continuation 16703759 · Dec 4, 2019
Continuation In Part 16272292 · Feb 11, 2019
Continuation 15055958 · Feb 29, 2016
Continuation 14078636 · Nov 13, 2013
Provisional Application 61725559 · Dec 13, 2012
Related Publication 20200142499A1 · May 7, 2020