User interface device, vehicle having the user interface device and method for controlling the vehicle

1 . A user interface apparatus which receives a user instruction for controlling at least one electronic device, the user interface apparatus comprising:

a camera configured to obtain an image of a user; and

at least one processor configured to divide the obtained image into a plurality of regions, to determine an area occupied by the user's hand in each of the divided regions, and to recognize gesture of the user based on the area occupied by the user's hand,

wherein the at least one processor is configured to determine a direction in which the user's wrist faces based on the obtained image, and to divide the obtained image into the plurality of regions based on the direction of the user's wrist,

wherein the at least one processor is configured to set a second value for a ratio of the area occupied by the user's hand required to recognize a direction of the gesture in a second region among the plurality of regions to be smaller than a first value for a ratio of the area occupied by the user's hand required to recognize the direction of the gesture in a first region among the plurality of regions.

2 . The user interface apparatus of claim 1 , wherein the at least one processor is further configured to divide the obtained image into quadrants based on the direction of the user's wrist to determine the area occupied by the user's hand in each of the quadrants.

3 . The user interface apparatus of claim 1 , wherein the at least one processor is further configured to determine a change amount in the area of the user's hand based on the obtained image, and to switch a state of gesture recognition from an inactive state into an active state based on the determined change amount.

4 . The user interface apparatus of claim 3 , wherein the at least one processor is further configured to switch the state of the gesture recognition into the active state when the change amount in the area of the user's hand determined based on the obtained image is greater than or equal to a first set value.

5 . The user interface apparatus of claim 3 , wherein the at least one processor is further configured to switch the state of the gesture recognition from the active state into the inactive state upon concluding that there is no movement of the user recognized through the camera for more than a first time period.

6 . The user interface apparatus of claim 4 , wherein the at least one processor is further configured to reset the change amount in the area of the user's hand required for activating the gesture recognition when the change amount in the area of the user's hand determined based on the obtained image is less than the first set value, and the change amount in the area of the user's hand less than the first set value is recognized again within a second time period.

7 . The user interface apparatus of claim 4 , wherein the at least one processor is further configured to maintain the gesture recognition in the inactive state when the change amount in the area of the user's hand determined based on the obtained image is greater than or equal to a second set value which is greater than the first set value.

8 . The user interface apparatus of claim 1 , further including a database configured to store information related to the user,

wherein the at least one processor is further configured to determine a shape and movement pattern of the user's hand based on the obtained image and compare the determined shape and movement pattern of the user's hand with the information stored in the database, and recognize the gesture based on the information stored in the database when the determined shape and movement pattern of the user's hand matches the information stored in the database.

9 . A vehicle comprising:

a camera configured to obtain an image of a user; and

at least one processor configured to divide the obtained image into a plurality of regions, to determine an area occupied by the user's hand in each of the divided regions, and to recognize gesture of the user based on the area occupied by the user's hand,

wherein the at least one processor is further configured to determine a direction in which the user's wrist faces based on the obtained image, and to divide the obtained image into the plurality of regions based on the direction of the user's wrist, and

wherein the at least one processor is configured to set a second value for a ratio of the area occupied by the user's hand required to recognize a direction of the gesture in a second region among the plurality of regions to be smaller than a first value for a ratio of the area occupied by the user's hand required to recognize the direction of the gesture in a first region among the plurality of regions.

10 . The vehicle of claim 9 , wherein the at least one processor is further configured to divide the obtained image into quadrants based on the direction of the user's wrist to determine the area occupied by the user's hand in each of the quadrants.

11 . The vehicle of claim 9 , wherein the at least one processor is further configured to determine a change amount in the area of the user's hand based on the obtained image, and to switch a state of gesture recognition from an inactive state into an active state based on the determined change amount.

12 . The vehicle of claim 11 , wherein the at least one processor is further configured to switch the state of the gesture recognition into the active state when the change amount in the area of the user's hand determined based on the obtained image is greater than or equal to a first set value.

13 . The vehicle of claim 11 , wherein the at least one processor is further configured to switch the state of the gesture recognition from the active state into the inactive state upon concluding that there is no movement of the user recognized through the camera for more than a first time period.

14 . The vehicle of claim 12 , wherein the at least one processor is further configured to reset the change amount in the area of the user's hand required for activating the gesture recognition when the change amount in the area of the user's hand determined based on the obtained image is less than the first set value, and the change amount in the area of the user's hand less than the first set value is recognized again within a second time period.

15 . The vehicle of claim 12 , wherein the at least one processor is configured to maintain the gesture recognition in the inactive state when the change amount in the area of the user's hand determined based on the obtained image is greater than or equal to a second set value which is greater than the first set value.

16 . The vehicle of claim 9 , further including a database configured to store information related to the user,

wherein the at least one processor is further configured to determine a shape and movement pattern of the user's hand based on the obtained image and to compare the determined shape and movement pattern of the user's hand with the information stored in the database, and to recognize the gesture based on the information stored in the database when the determined shape and movement pattern of the user's hand matches the information stored in the database.

17 . A method of controlling a vehicle, the method comprising:

obtaining an image of a user through a camera;

determining, by at least one processor, a direction in which the user's wrist faces based on the obtained image;

adaptively dividing, by the at least one processor, the obtained image into a plurality of regions based on the direction of the user's wrist;

determining, by the at least one processor, an area occupied by the user's hand in each of the divided regions; and

recognizing, by the at least one processor, gesture of the user based on the area occupied by the user's hand,

wherein the dividing the obtained image into a plurality of regions comprises setting a second value for a ratio of the area occupied by the user's hand required to recognize a direction of the gesture in a second region among the plurality of regions to be smaller than a first value for a ratio of the area occupied by the user's hand required to recognize the direction of the gesture in a first region among the plurality of regions.

18 . The method of claim 17 , further including:

determining, by the at least one processor, a change amount in the area of the user's hand based on the obtained image; and

switching, by the at least one processor, a state of gesture recognition from an inactive state into an active state based on the determined change amount in the area of the user's hand.

19 . The method of claim 18 , further including switching, by the at least one processor, the state of the gesture recognition from the active state into the inactive state upon concluding that there is no movement of the user recognized through the camera for more than a first time period.

20 . The method of claim 17 , wherein the recognizing the gesture includes:

determining a shape and movement pattern of the user's hand based on the obtained image;

comparing the determined shape and movement pattern of the user's hand with user information stored in a database; and

recognizing the gesture based on the information stored in the database when the determined shape and movement pattern of the user's hand matches the information stored in the database.