IP Library Granted Patent US 9,898,652
Granted Patent B2
US 9,898,652 · App. 14/822,759 · Granted Feb 20, 2018

Vehicle, method for controlling the same and gesture recognition apparatus therein

Inventor: Seona Kim (Seoul, KR)
Assignee: HYUNDAI MOTOR COMPANY
G06K9/00382G06F3/017G06F3/0304G06F21/32G06K9/00832B60K2350/1052G06K2009/00932
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,898,652
App. No.
14/822,759
Granted
Feb 20, 2018
Kind
B2
Abstract

Provided is a vehicle including a storage unit that stores a vein pattern lookup table including a plurality of reference vein pattern images according to a rotation angle of a driver's hand. The vehicle also includes an image acquisition unit that acquires a driver's image including an image of the driver's hand. The vehicle also includes a controller that extracts a vein pattern image of the driver's hand from the driver's image, authenticates the driver by comparing the vein pattern image with the vein pattern lookup table, and determines a gesture of the driver including at least one of a position of the driver's hand, a direction directed by the driver's hand and a rotation angle of the driver's hand based on the vein pattern image.

Claims (54)

1. A gesture recognition apparatus for a vehicle, comprising:

a storage unit to store a vein pattern lookup table including a plurality of reference vein pattern images according to a rotation angle of a driver's hand;

an image acquisition unit to acquire a driver's image comprising an image of the driver's hand; and

a controller to:

extract a vein pattern image of the driver's hand from the driver's image;

authenticate the driver by comparing the extracted vein pattern image with the vein pattern lookup table; and

determine a gesture of the driver comprising at least one of a position of the driver's hand, a direction directed by the driver's hand and the rotation angle of the driver's hand based on the extracted vein pattern image,

wherein the controller searches for a reference vein pattern image matched to the extracted vein pattern image among the plurality of reference vein pattern images and determines the rotation angle of the driver's hand based on the reference vein pattern image matched to the extracted vein pattern image.

2. The gesture recognition apparatus of claim 1 , further comprising a audio video navigation (AVN) device to display a reference gesture image according to the rotation angle of the driver's hand.

3. The gesture recognition apparatus of claim 2 , wherein, when the reference gesture image is displayed, the controller acquires a reference driver's image corresponding to the reference gesture image.

4. The gesture recognition apparatus of claim 3 , wherein the controller binarizes the reference driver's image and extracts the reference vein pattern image from the binarized reference driver's image.

5. The gesture recognition apparatus of claim 4 , wherein the controller generates the vein pattern lookup table based on the reference vein pattern image.

6. The gesture recognition apparatus of claim 1 , wherein the controller is configured to determine a position of the driver's hand based on a position of the extracted vein pattern image.

7. The gesture recognition apparatus of claim 1 , wherein the controller is configured to rotation-transform the extracted vein pattern image based on the plurality of reference vein pattern images and determines a direction directed by the driver's hand based on a rotation angle of the extracted vein pattern image.

8. The gesture recognition apparatus of claim 1 , wherein the controller is configured to transform size of the extracted vein pattern image based on the plurality of reference vein pattern images and is configured to determine a height of the driver's hand based on a size transformation ratio of the extracted vein pattern image.

9. The gesture recognition apparatus of claim 1 , wherein the controller determines a continuous driver gesture by processing a plurality of driver's images continuously acquired by the image acquisition unit and determines the driver's movement based on the continuous driver gesture by performing a stopping gesture determination function.

10. The gesture recognition apparatus of claim 9 , wherein the controller determines control instructions of the driver, based on the driver's movement based on the result of image processing.

11. The gesture recognition apparatus of claim 1 , wherein, when a plurality of vein pattern images are extracted from the driver's image, the controller distinguishes a plurality of drivers by comparing the plurality of vein pattern images with the vein pattern lookup table and authenticates the plurality of drivers distinguished based on the vein pattern images.

12. A method for controlling a vehicle, the method comprising:

storing a vein pattern lookup table including a plurality of reference vein pattern images according to a rotation angle of a driver's hand;

acquiring a driver's image including an image of the driver's hand;

extracting a vein pattern image of the driver's hand from the driver's image;

authenticating the driver by comparing the extracted vein pattern image with the vein pattern lookup table; and

determining a gesture of the driver including at least one of a position of the driver's hand, a direction directed by the driver's hand and the rotation angle of the driver's hand based on the extracted vein pattern image,

wherein the determining of the driver's gesture based on the extracted vein pattern image comprises:

searching for a reference vein pattern image matched to extracted the vein pattern image among the plurality of reference vein pattern images; and

determining the rotation angle of the driver's hand based on the reference vein pattern image matched to the extracted vein pattern image.

13. The method for claim 12 , wherein the storing of the vein pattern lookup table comprises:

displaying a reference gesture image according to the rotation angle of the driver's hand;

acquiring a reference driver's image corresponding to the reference gesture image;

extracting the reference vein pattern image from the reference driver's image; and

generating the vein pattern lookup table based on the reference vein pattern image.

14. The method for claim 12 , wherein the determining of the driver's gesture based on the extracted vein pattern image comprises:

rotation-transforming the extracted vein pattern image based on the plurality of reference vein pattern images; and

determining a direction directed by the driver's hand based on a rotation angle of the vein pattern.

15. The method for claim 12 , wherein the determining of the driver's gesture based on the extracted vein pattern image comprises:

transforming size of the extracted vein pattern image based on the plurality of reference vein pattern images; and

determining a height of the driver's hand based on a size transformation ratio of the extracted vein pattern image.

16. The method for claim 12 , further comprising:

determining a continuous driver gesture by processing a plurality of driver's images continuously acquired by an image acquisition unit;

determining the driver's movement based on the continuous driver gesture; and

determining the driver's control instructions based on the driver's movement.

17. The method for claim 12 , wherein the authenticating of the driver comprises:

when a plurality of vein pattern images are extracted from the driver's image, distinguishing a plurality of drivers by comparing the plurality of vein pattern images with the vein pattern lookup table; and

authenticating the plurality of drivers distinguished based on the vein pattern images.

18. A gesture recognition apparatus comprising:

a memory to store a vein pattern lookup table including a plurality of reference vain pattern images according to a rotation angle of a driver's hand;

a camera module to acquire a driver's image including an image of the driver's hand;

a graphic processor to extract a vein pattern image of the driver's hand from the driver's image and compare the extracted vein pattern image with the vein pattern lookup table; and

a main processor to determine the driver's gesture including at least one of a position of the driver's hand, a direction directed by the driver's hand and the rotation angle of the driver's hand based on the extracted vein pattern image,

wherein the graphic processor searches for a reference vein pattern image matched to the extracted vein pattern image among the plurality of reference vein pattern images, and the main processor determines the rotation angle of the driver's hand based on the reference vein pattern image matched to the extracted vein pattern image.

19. The gesture recognition apparatus of claim 18 , wherein the main processor determines a position of the driver's hand based on a position of the extracted vein pattern image.

20. The gesture recognition apparatus of claim 18 , wherein the graphic processor rotation-transforms the extracted vein pattern image based on the plurality of reference vein pattern images, and the main processor determines a direction directed by the driver's hand based on a rotation angle of the extracted vein pattern image.

21. The gesture recognition apparatus of claim 18 , wherein the graphic processor transforms size of the extracted vein pattern image based on the plurality of reference vein pattern images, and the main processor determines a height of the driver's hand based on a size transformation ratio of the extracted vein pattern image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 10, 2015
From: KIM, SEONA
To: HYUNDAI MOTOR COMPANY
Reel/Frame 036293/0388 →
Priority Claims (1)
KR 10-2015-0009823 · Jan 21, 2015 · national
Continuity (1)
Related Publication 20160210504A1 · Jul 21, 2016