Granted Patent B2

US 11,416,080 · App. 17/250,813 · Granted Aug 16, 2022

Inventors: Changryong Heo (Suwon-si, KR); Kihuk Lee (Suwon-si, KR); Chihyun Cho (Suwon-si, KR)

Assignee: Samsung Electronics Co., Ltd.

G06F3/017G06V40/20

Abstract

Claims (52)

1. An electronic device comprising:

one or more sensors;

a memory; and

a processor, wherein the processor is configured to:

check a distance between the electronic device and a user using the one or more sensors;

detect a gesture of the user by operating in a first gesture mode based on the checked distance satisfying a designated range, using the one or more sensors;

detect a gesture of the user by operating in a second gesture mode based on the checked distance deviating from the designated range;

determine, based on a location related to the user, a first area within a first distance from the location and a second area within a second distance larger than the first distance from the location and not including the first area;

modify the first area and the second area by performing a machine learning on pattern of gestures that the user performs;

detect an external object within a designated distance from an area in which a gesture of the external object is detected;

determine, based on a location of the external object, a third area of the external object including a peripheral space within a third distance of the external object from the location of the external object and a fourth area of the external object including a peripheral space within a fourth distance of the external object larger than the third distance of the external object from the location of the external object and not including the third area of the external object;

determine a gesture of the user detected in the second area or a gesture of the external object detected in the fourth area as a valid gesture; and

perform an operation corresponding to the valid gesture based on the gesture being determined as the valid gesture.

2. The electronic device of claim 1 , wherein the processor is configured to adjust the determined second area based on a state of the user.

3. The electronic device of claim 1 , wherein the processor is configured to:

receive a user input checking an intention of the user in response to detecting the gesture of the user, and

change the first area and the second area based on the received user input.

4. The electronic device of claim 1 , further comprising:

a communication circuit,

wherein the processor is configured, as a part of the detecting the gesture of the user by operating in the second gesture mode, to:

transmit a signal for communication connection with an external device to the external device through the communication circuit when a gesture of the user controlling the external device is recognized,

receive information on content being executed from the external device, and

determine an area in which the gesture of the user is detected based on the received information on the content.

5. The electronic device of claim 4 , wherein the area in which the gesture of the user is detected is determined in consideration of physical characteristics of the user.

6. The electronic device of claim 1 , wherein the processor is configured, as a part of the detecting the gesture of the user by operating in the second gesture mode, to:

configure a reference axis based on a location related to the user,

determine a fifth area located in a first direction perpendicular to the reference axis from the reference axis and a sixth area located in a second direction opposite the first direction from the reference axis, and

recognize only a gesture in the first direction among gestures detected in the fifth area as the valid gesture, and recognize only a gesture in the second direction among gestures detected in the sixth area as the valid gesture.

7. The electronic device of claim 1 , wherein the processor is configured to:

determine the first area and the second area, and then recognize a gesture detected in the first area as the valid gesture when speed of the gesture of the user exceeds a predetermined reference value, and

recognize a gesture detected in the second area as a valid gesture when the speed of the gesture of the user is less than or equal to the predetermined reference value.

8. The electronic device of claim 1 , wherein the processor is configured to:

configure a reference point based on the location of the user, and

determine whether the detected gesture of the user is valid based on an area in which the reference point is located.

9. A method of operating an electronic device, comprising:

checking a distance between the electronic device and a user using one or more sensors;

detecting a gesture of the user by operating in a first gesture mode based on the checked distance satisfying a designated range using the one or more sensors;

detecting a gesture of the user by operating in a second gesture mode based on the checked distance deviating from the designated range;

determining, based on a location related to the user, a first area within a first distance from the location and a second area within a second distance larger than the first distance from the location and not including the first area;

modifying the first area and the second area by performing a machine learning on pattern of gestures that the user performs;

detecting an external object within a designated distance from an area in which a gesture of external object is detected;

determining, based on a location of the external object, a third area of the external object including a peripheral space within a third distance of the external object from the location of the external object and a fourth area of the external object including a peripheral space within a fourth distance of the external object larger than the third distance of the external object from the location of the external object and not including the third area of the external object;

determining a gesture of the user of the detected in the second area or a gesture of the external object detected in the fourth area as a valid gesture; and

performing an operation corresponding to the valid gesture based on the gesture being determined as the valid gesture.

10. The method of claim 9 , wherein the determined second area can be adjusted based on a state of the user.

11. The method of claim 9 , further comprising:

receiving a user input checking an intention of the user in response to detecting the gesture of the user; and

changing the first area and the second area based on the received user input.

12. The method of claim 9 , wherein the detecting the gesture by operating in the second gesture mode includes:

transmitting a signal for communication connection with an external device to the external device through a communication circuit when a gesture of the user controlling the external device is recognized,

receiving information on content being executed from the external device, and

determining an area in which the gesture of the user is detected based on the received information on the content.

Assignments (1)

Priority Claims (1)

Continuity (1)

Cited By (37)

US 12,236,515 US 12,236,546 US 12,242,706 US 12,283,020 US 12,287,921 US 12,288,285 US 12,307,580 US 12,333,083 US 12,437,494 US 12,443,273 US 12,456,271 US 12,461,641 US 12,475,635 US 12,511,847 US 12,524,142 US 12,524,956 US 12,524,977 US 12,535,931 US 12,536,762 US 12,541,280 US 12,566,532 US 12,596,472 US 12,608,115 US 12,608,877 US 12,608,890 US 12,620,187 US 12,625,608 US 12,632,157 US 12,632,170 US 12,633,044 US 12,645,302 US 12,663,907 US 12,675,958 US 12,681,587 US 12,687,922 US 12,688,660 US 12,737,093