Granted Patent B2

US 12,445,583 · App. 18/220,631 · Granted Oct 14, 2025

Inventors: Indon Ju (Suwon-si, KR); Donghee Kang (Suwon-si, KR)

Assignee: SAMSUNG ELECTRONICS CO., LTD.

H04N9/3194G06F3/017H04N9/3185H04N9/3188

Abstract

Claims (80)

1. An electronic apparatus comprising:

sensor circuitry to obtain sensing data;

projection circuitry; and

at least one processor configured to:

based on a preset gesture of a user being identified based on the sensing data comprising an image of the preset gesture, identify a first position corresponding to a first part of the user included in the image and a second position corresponding to a second part of the user included in the image, the first position and the second position indicating the preset gesture in the image,

obtain direction information corresponding to the preset gesture based on the first position and the second position,

obtain a projection position corresponding to the preset gesture based on a position of a projection surface and the direction information, and

control the projection circuitry to project a projection image based on the projection position.

2. The electronic apparatus of claim 1 , wherein the first position denotes a start position of a direction indicated by the preset gesture in the image, and wherein the second position denotes an end position of a direction indicated by the preset gesture in the image.

3. The electronic apparatus of claim 1 , wherein the at least one processor is further configured to:

identify the position of the projection surface, the first position, and the second position based on distance data included in the sensing data.

4. The electronic apparatus of claim 3 , wherein the at least one processor is further configured to:

obtain a first vector representing a direction from a position of the electronic apparatus to the first position,

obtain a first distance between the electronic apparatus and the projection surface based on a position of the electronic apparatus and a position of the projection surface, and

obtain the projection position based on the first vector, the first distance, the first position, and the direction information.

5. The electronic apparatus of claim 4 , wherein the direction information comprises a sub-vector,

wherein the at least one processor is further configured to:

obtain a second distance between the first position and the projection surface based on the first distance and the first position,

obtain the sub-vector corresponding to the preset gesture based on the first position and the second position, and

obtain the projection position based on the first vector, the sub-vector, the first position, the second position, and the second distance.

6. The electronic apparatus of claim 5 , wherein the at least one processor is further configured to:

obtain an expansion ratio based on the first position, the second position, and the second distance,

obtain a second vector indicating a direction from the first position to the projection position based on the sub-vector and the expansion ratio, and

obtain the projection position based on the first vector and the second vector.

7. The electronic apparatus of claim 4 , wherein the projection position is a first projection position,

wherein the at least one processor is further configured to:

based on the projection position being not included in a plane corresponding to the projection surface, update the first distance based on the position of the electronic apparatus, the position of the projection surface, and the first projection position, and

obtain a second projection position based on the first vector, the re-obtained first distance, the first position, and the direction information.

8. The electronic apparatus of claim 1 , further comprising:

a microphone; and

driving circuitry,

wherein the at least one processor is further configured to:

based on receiving a user voice including a preset user command through the microphone, identify a position of the user who uttered the user voice based on the sensing data, and

control the driving circuitry to move the electronic apparatus based on the position of the user.

9. The electronic apparatus of claim 1 , wherein the at least one processor is further configured to:

based on the first position and the second position not changing for a threshold time, control the projection circuitry to project the projection image based on the projection position.

10. The electronic apparatus of claim 1 , wherein the at least one processor is further configured to:

based on receiving a user command for a multi-view function for projecting a merged image including first content and second content, identify an edge of the projection surface,

based on the projection position being within a threshold distance from the edge, change the projection position to a position corresponding to the edge, and

control the projection circuitry to project the merged image based on the changed projection position.

11. A method of controlling an electronic apparatus, the method comprising:

based on a preset gesture of a user being identified based on the sensing data comprising an image of the preset gesture, identifying a first position corresponding to a first part of the user included in the image and a second position corresponding to a second part of the user included in the image, the first position and the second position indicating the preset gesture in the image;

obtaining direction information corresponding to the preset gesture based on the first position and the second position;

obtaining a projection position corresponding to the preset gesture based on a position of a projection surface and the direction information; and

projecting a projection image based on the projection position.

12. The method of claim 11 , wherein the first position denotes a start position of a direction indicated by the preset gesture in the image, and

wherein the second position denotes an end position of a direction indicated by the preset gesture in the image.

13. The method of claim 11 , wherein the identifying the first position and the second position comprises:

identifying the position of the projection surface, the first position, and the second position based on distance data included in the sensing data.

14. The method of claim 13 , wherein the obtaining the projection position comprises:

obtaining a first vector representing a direction from a position of the electronic apparatus to the first position,

obtaining a first distance between the electronic apparatus and the projection surface based on a position of the electronic apparatus and a position of the projection surface, and

obtaining the projection position based on the first vector, the first distance, the first position, and the direction information.

15. The method of claim 14 , wherein the direction information comprises a sub-vector,

wherein the obtaining the direction information comprises:

obtaining a second distance between the first position and the projection surface based on the first distance and the first position,

obtaining the sub-vector corresponding to the preset gesture based on the first position and the second position,

wherein the obtaining the projection position comprises obtaining the projection position based on the first vector, the sub-vector, the first position, the second position, and the second distance.

16. An electronic apparatus comprising:

projection circuitry;

at least one memory storing instructions; and

at least one processor configured to execute the instructions to:

identify a preset gesture of a user based on an image including the preset gesture;

identify, based on the identification of the preset gesture, a first position corresponding to a first part of the user included in the image and a second position corresponding to a second part of the user included in the image, the first position and the second position indicating the preset gesture in the image;

obtain direction information corresponding to the preset gesture based on the first position and the second position,

obtain a projection position corresponding to the preset gesture based on a position of a projection surface and the direction information, and

control the projection circuitry to project a projection image based on the projection position.

17. The electronic apparatus of claim 16 , wherein the first position denotes a start position of a direction indicated by the preset gesture in the image, and

wherein the second position denotes an end position of a direction indicated by the preset gesture in the image.

18. The electronic apparatus of claim 16 , wherein the at least one processor is further configured to execute the instructions to:

identify the position of the projection surface, the first position, and the second position based on distance data.

19. The electronic apparatus of claim 18 , wherein the at least one processor is further configured to execute the instructions to:

obtain a first vector representing a direction from a position of the electronic apparatus to the first position,

obtain a first distance between the electronic apparatus and the projection surface based on a position of the electronic apparatus and a position of the projection surface, and

obtain the projection position based on the first vector, the first distance, the first position, and the direction information.

20. The electronic apparatus of claim 19 , wherein the direction information comprises a sub-vector,

wherein the at least one processor is further configured to execute the instructions to:

obtain a second distance between the first position and the projection surface based on the first distance and the first position,

obtain the sub-vector corresponding to the preset gesture based on the first position and the second position, and

obtain the projection position based on the first vector, the sub-vector, the first position, the second position, and the second distance.

Assignments (1)

Priority Claims (1)

Continuity (2)

References Cited (95)