Granted Patent B2

US 12,524,065 · App. 17/940,761 · Granted Jan 13, 2026

Inventors: Artem Shcherbina (Kyiv, UA); Ivan Bondarets (Kyiv, UA); Oleksandr Trunov (Kyiv, UA); Viacheslav Olshevskyi (Kyiv, UA); Volodymyr Savin (Kyiv, UA)

Assignee: SAMSUNG ELECTRONICS CO., LTD.

G06F3/011G06F3/017G06T7/50G06T19/006

Abstract

Claims (48)

1 . An electronic apparatus providing augmented reality (AR) content, comprising:

a display;

a camera; and

a processor configured to:

provide augmented reality (AR) content or an object through the display,

detect a hand of a user based on an image obtained through the camera,

identify a first interaction of the hand with the object provided through the display,

obtain a size of the hand based on information about the object provided through the display, and

identify a second interaction of the hand with the AR content based on the size of the hand.

2 . The electronic apparatus of claim 1 , wherein the processor is further configured to:

set the size of the detected hand to a preset value,

identify whether the first interaction of the hand occurs for the object provided through the display based on the set size,

based on identifying that the first interaction occurs, identify the size of the hand based on the information about the object, and

identify the second interaction of the hand for the AR content based on the identified size of the hand.

3 . The electronic apparatus of claim 1 , wherein the object comprises at least one of a first type object included in the image obtained through the camera and a second type object included in the AR content displayed on the display.

4 . The electronic apparatus of claim 3 , further comprising:

a memory storing feature information about a reference object,

wherein the processor is further configured to:

based on the first type object and the hand of the user being detected from the image obtained through the camera, identify whether the first type object is the reference object based on the feature information stored in the memory and feature information of the detected first type object, and

based on identifying that the first type object is the reference object, identify the size of the hand based on a size of the reference object.

5 . The electronic apparatus of claim 4 , wherein the processor is further configured to:

based on identifying that the first type object is not the reference object, identify the size of the first type object included in consecutive image frames by using the consecutive image frames obtained through the camera, and

identify the size of the hand based on the size of the first type object.

6 . The electronic apparatus of claim 3 , wherein the processor is further configured to:

set the size of the hand to a preset value,

identify whether the first interaction of the hand occurs with the second type object through the display based on the set size, and

identify the size of the hand based on a depth of the second type object in which the first interaction of the hand is identified.

7 . A method of controlling an electronic apparatus providing augmented reality (AR) content, the method comprising:

providing augmented reality (AR) content or an object on the display;

detecting a hand of a user based on image obtained through a camera;

identifying a first interaction of the hand with the object provided through the display;

obtaining a size of the hand based on information about the object provided through the display; and

identifying a second interaction of the hand with the AR content based on the size of the hand.

8 . The method of claim 7 , further comprising:

setting the size of the detected hand to a preset value;

identifying whether the first interaction of the hand occurs for the object provided through the display based on the set size; and

based on identifying that the first interaction occurs, identifying the size of the hand based on the information about the object.

9 . The method of claim 7 , wherein the object comprises at least one of a first type object included in the image obtained through the camera and a second type object included in the AR content displayed on the display.

10 . The method of claim 9 , further comprising:

based on the first type object and the hand of the user being detected from the image obtained through the camera, identifying whether the first type object is a reference object based on feature information stored in the electronic apparatus and feature information of the detected first type object; and

based on identifying that the first type object is the reference object, identifying the size of the hand based on a size of the reference object.

11 . The method of claim 10 , further comprising:

based on identifying that the first type object is not the reference object, identifying the size of the first type object included in consecutive image frames by using the consecutive image frames obtained through the camera; and

identifying the size of the hand based on the size of the first type object.

12 . The method of claim 9 , further comprising:

setting the size of the hand to a preset value;

identifying whether the first interaction of the hand occurs with the second type object through the display based on the set size; and

identifying the size of the hand based on a depth of the second type object in which the first interaction of the hand is identified.

Assignments (1)

Priority Claims (1)

Continuity (2)

References Cited (26)