IP Library Granted Patent US 10,156,906
Granted Patent B2
US 10,156,906 · App. 14/874,178 · Granted Dec 18, 2018

Systems and methods for distinguishing gestures

Inventors: Stuart Yamamoto (La Mirada, CA); Tarek El Dokor (Phoenix, AZ); Graeme Asher (Seattle, WA); Jordan Cluster (Tempe, AZ); Matt Conway (Seattle, WA); Josh King (Mesa, AZ); James E. Holmes (Mesa, AZ); Matt McElvogue (Seattle, WA); Churu Yun (Seattle, WA)
Assignees: Honda Motor Co., Ltd.; Edge 3 Technologies, Inc.
G06F3/017G06F3/04883G06K9/00335G06K9/00832
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,156,906
App. No.
14/874,178
Granted
Dec 18, 2018
Kind
B2
Abstract

A gesture control system includes a processor, the processor in communication with a plurality of sensors. The processor is configured to perform the steps of detecting, using the plurality of sensors, a gesture in a volume occupied by a plurality of occupants, analyzing a prior knowledge to associate the gesture with one of the plurality of occupants, and generating an output, the output being determined by the gesture and the one of the plurality of occupants.

Claims (40)

1. A gesture control system, comprising:

a processor, the processor in communication with a plurality of sensors;

the processor being configured to perform the steps of:

detecting, using the plurality of sensors, a gesture in a volume occupied by a plurality of occupants;

analyzing a prior knowledge to associate the gesture with one of the plurality of occupants;

associating a permission level with at least one of the plurality of occupants, wherein the permission level for the gesture is assigned based on whether the at least one of the plurality of occupants is identified using facial recognition as a recognized occupant; and

generating an output, the output being determined by the gesture, the associated permission level, and the one of the plurality of occupants,

wherein the output is an alternate operation provided to the one of the plurality of occupants when the permission level associated with the at least one of the plurality of occupants is not sufficient to perform an action associated with the gesture,

the alternate operation including an access to at least one of a message received via a mobile device, an infotainment control, a climate control, and a navigation control.

2. The system of claim 1 , wherein the plurality of sensors include visual sensors.

3. The system of claim 1 , wherein the plurality of sensors include audio sensors.

4. The system of claim 1 , wherein the processor is further configured to perform the step of extracting a plurality of features associated with each of the plurality of occupants before detecting the gesture.

5. The system of claim 4 , wherein one of the plurality of features is a limb of one of the plurality of occupants.

6. The system of claim 5 , wherein the prior knowledge is a known trajectory of one of the plurality of features associated with the gesture.

7. The system of claim 1 , wherein the permission level is determined based on whether a vehicle is in motion.

8. The system of claim 1 , wherein the output is at least partially determined by the permission level associated with the one of the plurality of occupants.

9. A method of transferring control in a gesture control system, comprising:

determining a presence of a first occupant within a space using a plurality of sensors;

detecting a gesture performed by the first occupant, the gesture corresponding to a request to transfer control of an operation to at least a second occupant;

determining the presence of the at least second occupant;

transferring the control of the operation to the at least second occupant when the presence of the at least second occupant has been determined and based on the at least second occupant being associated with one or more properties meeting one or more predefined rules; and

returning the control of the operation to the first occupant upon detecting a second gesture performed by the second occupant without detecting a gesture corresponding to a request to return the control of the operation, wherein the second gesture is an action required to respond to an event.

10. The method of claim 9 , wherein the event includes a message or a prompt for an input.

11. The method of claim 9 , further comprising alerting the first occupant when the presence of the at least second occupant is not determined.

12. The method of claim 9 , further comprising determining the position of the at least second occupant.

13. A method, comprising:

determining a location of a plurality of occupants within a space using a plurality of sensors;

defining one or more gesture control zones associated with each of the plurality of occupants, each of the one or more gesture control zones having an associated zone permission level;

adjusting the one or more gesture control zones based on a number of occupants within the space;

detecting a gesture command within one of the one or more gesture control zones;

determining a required permission associated with the detected gesture command and the one of the one or more gesture control zones;

associating a permission level with at least one of the plurality of occupants associated with the detected gesture command, wherein the permission level is assigned based on whether the at least one of the plurality of occupants is identified using facial recognition as a recognized occupant; and

initiating an output associated with the detected gesture command when the zone permission level and the permission level permits execution of the detected gesture command.

14. The method of claim 13 , wherein the one or more gesture control zones are three-dimensional.

15. The method of claim 13 , wherein the plurality of sensors includes a visual sensor.

16. The method of claim 13 , wherein the one or more gesture control zones are defined based on the location of the plurality of occupants within the space.

17. The method of claim 13 , wherein the one or more gesture control zones are pre-defined.

18. The method of claim 13 , wherein the one or more gesture control zones are adjusted based upon the location of the plurality of occupants within the space.

19. The method of claim 13 , wherein at least a portion of the one or more gesture control zones overlap.

20. The method of claim 9 , wherein transferring the control of the operation to the at least second occupant is further determined by the location of the at least second occupant.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 4, 2015
From: YAMAMOTO, STUART; CONWAY, MATT; ASHER, GRAEME; MCELVOGUE, MATT; YUN, CHURU
To: HONDA MOTOR CO., LTD.
Reel/Frame 036957/0377 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 4, 2015
From: EL DOKOR, TAREK A.; KING, JOSH; HOLMES, JAMES; CLUSTER, JORDAN
To: EDGE 3 TECHNOLOGIES, LLC
Reel/Frame 036957/0557 →
Continuity (2)
Provisional Application 62063341 · Oct 13, 2014
Related Publication 20160103499A1 · Apr 14, 2016