IP Library Granted Patent US 9,436,290
Granted Patent B2
US 9,436,290 · App. 14/457,951 · Granted Sep 6, 2016

Display device and operating method thereof

Inventors: Sangkyu Kang (Seoul, KR); Wooseok Ahn (Seoul, KR); Eunyul Lee (Seoul, KR); Sewon Park (Seoul, KR); Dongheon Shin (Seoul, KR)
Assignee: LG ELECTRONICS INC.
G06F3/017G06K9/00355
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,436,290
App. No.
14/457,951
Granted
Sep 6, 2016
Kind
B2
Abstract

A method of controlling a display device, and which includes obtaining, via camera of the display device, a user's image; recognizing, via a controller of the display device, a user's hand gesture from the obtained user's image; and when the recognized user's hand gesture does not match a pre-stored gesture, displaying, via a display of the display device, a function guide including different hand gestures different than the recognized user's hand gesture for guiding a user's selection for performing a function of the display device.

Claims (74)

1. A method of controlling a display device, the method comprising:

obtaining, via a camera of the display device, a user's image;

recognizing, via a controller of the display device, a user's hand gesture from the obtained user's image; and

if the recognized user's hand gesture does not match a pre-stored gesture, displaying, via a display of the display device, a function guide including different hand gestures different than the recognized user's hand gesture for guiding a user's selection for performing a function of the display device,

wherein the different hand gestures include a plurality of similar hand gestures representing a gesture pattern similar to the recognized user's hand gesture,

wherein the function guide comprises:

an image of the recognized user's hand gesture; and

a plurality of images of the different hand gestures,

wherein the images of the different hand gestures are disposed around the image of the recognized user's hand gesture,

wherein the method further comprises:

recognizing, by using the obtained user's image, that the user's hand is moved toward a direction where one image corresponding to a different hand gesture among the plurality of images of the different hand gestures is disposed,

selecting the image of a different hand gesture corresponding to the direction based on a recognition result, and

performing a function of the display device corresponding to the selected image of the different hand gesture, and

wherein the function of the display device represents a function related to an edition or a play of a media content.

2. The method according to claim 1 , wherein each of the images of the different hand gestures is disposed at the top, bottom, left, and right of the image of the recognized user's hand gesture.

3. The method according to claim 2 , wherein the function guide further comprises a plurality of function inducers disposed between the image of the recognized hand gesture and the images of each of the different hand gestures and inducing a user's selection to perform a function corresponding to each of the different hand gestures.

4. The method according to claim 3 , wherein the function guide further comprises a plurality of similarity indicators representing a degree of similarity between each of the different hand gestures and the recognized user's hand gesture.

5. The method according to claim 4 , further comprising:

obtaining an input for selecting a specific different hand gesture from the different hand gestures; and

performing a function of the display device corresponding to the selected specific different hand gesture.

6. The method according to claim 5 , wherein the obtaining of the input for selecting the specific different hand gesture comprises obtaining an input for selecting the specific different hand gesture by detecting a movement direction of the user's hand.

7. The method according to claim 1 , wherein the function guide comprises:

images of a plurality of basic hand gestures representing a basic gesture pattern pre-specified or predetermined by the user; and

text disposed at one side of each image of the basic hand gestures and representing a function of each of the plurality of basic hand gestures, and

wherein each image of the basic hand gestures is disposed around the image of the recognized user's hand gesture.

8. The method according to claim 1 , further comprising recognizing the user's face from the obtained user's image,

wherein the displaying of the function guide comprises, when the recognized user's hand gesture is not the pre-stored gesture, displaying the function guide based on a position relationship of the recognized user's face and the recognized user's hand gesture.

9. The method according to claim 8 , wherein when the recognized user's hand gesture is not the pre-stored gesture, the displaying of the function guide based on the position relationship of the recognized user's face and the recognized user's hand gesture comprises:

detecting whether the recognized user's hand gesture is disposed at the right or left based on the user's face; and

displaying the function guide based on a detection result,

wherein the function guide comprises:

images of a plurality of similar hand gestures representing a gesture pattern similar to the recognized user's hand gesture; and

text disposed at one side of each image of the plurality of similar hand gestures and representing a function of each of the plurality of similar hand gestures, and

wherein each image of the plurality of similar hand gestures is disposed around the recognized user's hand gesture.

10. The method according to claim 8 , wherein when the recognized user's hand gesture is not the pre-stored gesture, the displaying of the function guide based on the position relationship of the recognized user's face and the recognized user's hand gesture comprises:

detecting whether the recognized user's hand gesture is disposed at the right or left based on the user's face; and

displaying the function guide based on a detection result,

wherein the function guide comprises:

images of a plurality of basic hand gestures representing a basic gesture pattern; and

text disposed at one side of each of the plurality of basic hand gestures and representing a function of each of the plurality of basic hand gestures,

wherein each image of the plurality of basic hand gestures is disposed around the recognized user's hand gesture.

11. A display device, comprising:

a display;

a memory configured to store gestures;

a camera configured to obtain a user's image; and

a controller configured to:

recognize a user's hand gesture from the obtained user's image, and

if the recognized user's hand gesture does not match a pre-stored gesture, display on the display a function guide including different hand gestures different than the recognized user's hand gesture for guiding a user's selection for performing a function of the display device,

wherein the different hand gestures include a plurality of similar hand gestures representing a gesture pattern similar to the recognized user's hand gesture,

wherein the function guide comprises:

an image of the recognized user's hand gesture; and

a plurality of images of the different hand gestures,

wherein the images of the different hand gestures are disposed around the image of the recognized user's hand gesture,

wherein the controller is further configured to:

recognize, by using the obtained user's image, that the user's hand is moved toward a direction where one image corresponding to a different hand gesture among the plurality of images of the different hand gestures is disposed,

select the image of a different hand gesture corresponding to the direction based on a recognition result, and

perform a function of the display device corresponding to the selected image of the different hand gesture, and

wherein the function of the display device represents a function related to an edition or a play of a media content.

12. The display device according to claim 11 , wherein each of the images of the different hand gestures is disposed at the top, bottom, left, and right of the image of the recognized user's hand gesture.

13. The display device according to claim 12 , wherein the function guide further comprises a plurality of function inducers disposed between the image of the recognized hand gesture and the images of each of the different hand gestures and inducing a user's selection to perform a function corresponding to each of the different hand gestures.

14. The display device according to claim 13 , wherein the function guide further comprises a plurality of similarity indicators representing a degree of similarity between each of the different hand gestures and the recognized user's hand gesture.

15. The display device according to claim 14 , wherein the controller is further configured to:

obtain an input for selecting a specific different hand gesture from the different hand gestures, and

perform a function of the display device corresponding to the selected specific different hand gesture.

16. The display device according to claim 15 , wherein the controller is further configured to obtain the input for selecting the specific different hand gesture by detecting a movement direction of the user's hand.

17. The display device according to claim 11 , wherein the function guide comprises:

images of a plurality of basic hand gestures representing a basic gesture pattern pre-specified or predetermined by the user; and

text disposed at one side of each image of the basic hand gestures and representing a function of each of the plurality of basic hand gestures, and

wherein each image of the basic hand gestures is disposed around the image of the recognized user's hand gesture.

18. The display device according to claim 11 , wherein the controller is further configured to:

recognize the user's face from the obtained user's image, and

when the recognized user's hand gesture is not the pre-stored gesture, display on the display the function guide based on a position relationship of the recognized user's face and the recognized user's hand gesture.

19. The method according to claim 1 , wherein the plurality of similar hand gestures are displayed on the function guide if a similarity between the recognized gesture and each of a plurality of gestures stored in the memory is less than a reference similarity.

20. The display device according to claim 11 , wherein the plurality of similar hand gestures are displayed on the function guide if a similarity between the recognized gesture and each of a plurality of gestures stored in the memory is less than a reference similarity.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 26, 2014
From: KANG, SANGKYU; AHN, WOOSEOK; LEE, EUNYUL; PARK, SEWON; SHIN, DONGHEON
To: LG ELECTRONICS INC.
Reel/Frame 033607/0071 →
Priority Claims (2)
KR 10-2014-0043359 · Apr 11, 2014 · national
KR 10-2014-0051318 · Apr 29, 2014 · national
Continuity (2)
Provisional Application 61970923 · Mar 27, 2014
Related Publication 20150277573A1 · Oct 1, 2015