IP Library › Granted Patent US 11,873,000
Granted Patent B2
US 11,873,000 · App. 16/794,214 · Granted Jan 16, 2024

Gesture detection for transport control

Inventors: Sachin J. Ahire (Frisco, TX); Manoj Kalamkar (McKinney, TX); Christopher J. Risberg (Flower Mound, TX)
Assignee: TOYOTA MOTOR NORTH AMERICA, INC.
B60W50/10B60W40/08B60W40/10G06F3/017G06F16/2315B60W2540/223B60W2540/229
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,873,000
App. No.
16/794,214
Granted
Jan 16, 2024
Kind
B2
Abstract

An example operation includes one or more of detecting a movement in a transport, determining whether the movement includes a gesture definition, when the movement includes a gesture definition, identifying a gesture associated with the gesture definition, and performing an action, via the transport, corresponding to the identified gesture.

Claims (49)

1. A method, comprising:

detecting a gesture has occurred based on a gesture movement input by a user in an autonomous transport via a hardware sensor installed within an interior of the transport;

identifying a type of gesture and a gesture definition that corresponds to the gesture movement based on a pattern of the gesture movement;

determining a gesture score associated with the type of gesture;

determining whether to permit or deny the gesture based on a numerical maximum transport level score being increased by the gesture score, wherein the determination to permit the gesture is based on a sum of the gesture score and a current transport score being less than the maximum transport level score, and wherein the current transport score is based on a sum of currently engaged transport operations each having an assigned numerical value;

identifying a transport action that corresponds to the gesture definition; and

changing an operating status of the autonomous transport based on the identified transport action.

2. The method of claim 1 , wherein the gesture movement comprises at least one of a hand, arm, foot, leg, head and eye movement performed by one or more transport occupants.

3. The method of claim 1 , wherein the gesture definition includes a plurality of gesture requirements comprising a range of motion requirement, a detection space requirement, and a repetition requirement.

4. The method of claim 3 , wherein the range of motion requirement comprises at least one of a distance vector and a direction vector requirement, wherein the detection space requirement comprises a voluminous area where the movement is detected, and wherein the repetition requirement comprises a minimum number of repetitive movements.

5. The method of claim 1 , further comprising:

disqualifying an additional movement as a potential gesture when at least one of the additional movement fails to comprise the gesture definition, one or more disqualifying actions are detected, and a degree of distraction has exceeded a threshold degree of distraction.

6. The method of claim 5 , wherein the disqualifying actions comprise one or more of the detected additional movement being performed outside of a voluminous area where it is required to occur, one or more hands are identified as holding a steering wheel, and one or more hands are identified as holding a mobile device.

7. The method of claim 1 , comprising:

identifying the gesture definition from a memory;

confirming the gesture definition is valid;

creating a blockchain transaction comprising the gesture and the action; and

storing the blockchain transaction in a distributed ledger.

8. A system, comprising:

a processor configured to:

detect a gesture has occurred based on a gesture movement input by a user in an autonomous transport via a hardware sensor installed within an interior of the transport;

identify a type of gesture and a gesture definition that corresponds to the gesture movement based on a pattern of the gesture movement;

determine a gesture score associated with the type of gesture;

determine whether to permit or deny the gesture based on a numerical maximum transport level score being increased by the gesture score, wherein the determination to permit the gesture is based on a sum of the gesture score and a current transport score being less than the maximum transport level score, and wherein the current transport score is based on a sum of currently engaged transport operations each having an assigned numerical value;

identify a transport action that corresponds to the gesture definition; and

change an operating status of the autonomous transport based on the identified transport action.

9. The system of claim 8 , wherein the gesture movement comprises at least one of a hand, arm, foot, leg, head and eye movement performed by one or more transport occupants.

10. The system of claim 8 , wherein the gesture definition includes a plurality of gesture requirements comprising a range of motion requirement, a detection space requirement, and a repetition requirement.

11. The system of claim 10 , wherein the range of motion requirement comprises at least one of a distance vector and a direction vector requirement, wherein the detection space requirement comprises a voluminous area where the movement is detected, and wherein the repetition requirement comprises a minimum number of repetitive movements.

12. The system of claim 8 , wherein the processor is further configured to disqualify an additional movement as a potential gesture when at least one of the additional movement fails to comprise the gesture definition, one or more actions that disqualify are detected, and a degree of distraction has exceeded a threshold degree of distraction.

13. The system of claim 12 , wherein the disqualifying actions comprise one or more of the detected additional movement being performed outside of a voluminous area where its required to occur, one or more hands are identified as holding a steering wheel, and one or more hands are identified as holding a mobile device.

14. The system of claim 8 , wherein the processor is further configured to:

identify the gesture definition from a memory;

confirm the gesture definition is valid;

create a blockchain transaction comprising the gesture and the action; and

store the blockchain transaction in a distributed ledger.

15. A non-transitory computer readable storage medium, that when read by a processor, causes the process to perform:

detecting a gesture has occurred based on a gesture movement input by a user in an autonomous transport via a hardware sensor installed within an interior of the transport;

identifying a type of gesture and a gesture definition that corresponds to the gesture movement based on a pattern of the gesture movement;

determining a gesture score associated with the type of gesture;

determining whether to permit or deny the gesture based on a numerical maximum transport level score being increased by the gesture score, wherein the determination to permit the gesture is based on a sum of the gesture score and a current transport score being less than the maximum transport level score, and wherein the current transport score is based on a sum of currently engaged transport operations each having an assigned numerical value;

identifying a transport action that corresponds to the gesture definition; and

changing an operating status of the autonomous transport based on the identified transport action.

16. The non-transitory computer readable storage medium of claim 15 , wherein the gesture movement comprises at least one of a hand, arm, foot, leg, head and eye movement performed by one or more transport occupants.

17. The non-transitory computer readable storage medium of claim 15 , wherein the gesture definition includes a plurality of gesture requirements comprising a range of motion requirement, a detection space requirement, and a repetition requirement.

18. The non-transitory computer readable storage medium of claim 17 , wherein the range of motion requirement comprises at least one of a distance vector and a direction vector requirement, wherein the detection space requirement comprises a voluminous area where the movement is detected, and wherein the repetition requirement comprises a minimum number of repetitive movements.

19. The non-transitory computer readable storage medium of claim 15 , wherein the processor is further configured to perform:

disqualifying an additional movement as a potential gesture when at least one of the additional movement fails to comprise the gesture definition, one or more disqualifying actions are detected, and a degree of distraction has exceeded a threshold degree of distraction.

20. The non-transitory computer readable storage medium of claim 19 , wherein the disqualifying actions comprise one or more of the detected additional movement being performed outside of a voluminous area where it is required to occur, one or more hands are identified as holding a steering wheel, and one or more hands are identified as holding a mobile device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 19, 2020
From: AHIRE, SACHIN J.; KALAMKAR, MANOJ; RISBERG, CHRISTOPHER J.
To: TOYOTA MOTOR NORTH AMERICA, INC.
Reel/Frame 051851/0727 →
Continuity (1)
Related Publication 20210253120A1 · Aug 19, 2021
Cited By (2)
US 12,430,889 US 12,441,351