IP Library › Granted Patent US 12,387,438
Granted Patent B2
US 12,387,438 · App. 18/122,459 · Granted Aug 12, 2025

Electronic device for providing augmented reality content and operation method thereof

Inventors: Junwhon Uhm (Suwon-si, KR); Geonho Yoon (Suwon-si, KR); Jinchoul Lee (Suwon-si, KR); Heonjun Ha (Suwon-si, KR); Seungnyun Kim (Suwon-si, KR); Hyunsoo Kim (Suwon-si, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
G06T19/006G06F3/013G06V10/761G06V40/193G06V2201/07
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,387,438
App. No.
18/122,459
Granted
Aug 12, 2025
Kind
B2
Abstract

An electronic device includes a first camera module; a display for displaying an augmented reality content; a processor operatively connected to the first camera module and the display; and a memory operatively connected to the at least one processor and storing instructions and dominant eye correction information. The processor performs a dominant eye determination operation of a user of the electronic device identifying a first position of a first object during the dominant eye determination operation; identifies a second position of the first object by using the first camera module; recognizes, as a selected point, a point moved, by a first correction value determined on the basis of the dominant eye correction information, from a first reference point displayed on the augmented reality content during the dominant determination operation; and selects a second object on the augmented reality content corresponding to the selected point.

Claims (49)

1. An electronic device comprising:

a first camera;

a display configured to display an augmented reality content;

at least one processor operatively connected to the first camera and the display; and

a memory operatively connected to the at least one processor and configured to store instructions and dominant eye correction information, wherein the at least one processor is configured to execute the instructions to:

control the display to display a first reference point on the augmented reality content;

identify a first position of a first object pointing to the first reference point using the first camera;

determine a dominant eye of a user of the electronic device based on the first position;

identify a second position of the first object moved from the first position, by using the first camera;

recognize a selected point moved by a first correction value from the first reference point, the first correction value being determined based on the dominant eye of the user and the dominant eye correction information; and

select a second object on the augmented reality content corresponding to the selected point.

2. The electronic device of claim 1 , wherein the at least one processor is further configured to execute the instructions to determine the first correction value further based on a distance from the first position to the second position.

3. The electronic device of claim 2 , wherein the at least one processor is further configured to execute the instructions to determine the first correction value further based on a depth of the second object.

4. The electronic device of claim 3 , further comprising a second camera,

wherein the at least one processor is further configured to execute the instructions to determine the depth of the second object based on a size of a pupil of the user of the electronic device, the size of the pupil being detected by the second camera.

5. The electronic device of claim 1 , wherein the first object is a finger of the user of the electronic device.

6. The electronic device of claim 1 , wherein the at least one processor is further configured to execute the instructions to identify at least one of the first position and the second position of the first object using a center of the display of the electronic device as a reference point.

7. The electronic device of claim 1 , wherein the at least one processor is further configured to execute the instructions to:

identify a density of at least one object on the augmented reality content; and

selectively recognize, as the selected point, based on the identified density, one of:

a first selected point moved from the first reference point by the first correction value, and

a second selected point on an extension line passing from a second reference point to the second position.

8. The electronic device of claim 7 , wherein the at least one processor is further configured to execute the instructions to:

recognize the first selected point as the selected point based on the identified density being greater than or equal to a threshold value; and

recognize the second selected point as the selected point based on the identified density being less than the threshold value.

9. The electronic device of claim 7 , wherein the at least one processor is further configured to execute the instructions to:

control the display to display a first user interface (UI) according to selection of the second object, based on the identified density being greater than or equal to a threshold value; and

control the display to display a second UI larger than the first UI according to selection of the second object, based on the identified density being less than the threshold value.

10. A operation method of an electronic device for providing augmented reality content, comprising:

displaying a first reference point on the augmented reality content on a display;

identifying a first position of a first object pointing to the first reference point using a first camera;

determining a dominant eye of a user of the electronic device based on the first position;

identifying a second position of the first object moved from the first position, by using the first camera;

recognizing a selected point moved by a first correction value from the first reference point, the first correction value being determined based on the dominant eye of the user and dominant eye correction information stored in a memory; and

selecting a second object on the augmented reality content corresponding to the selected point.

11. The operation method of claim 10 , further comprising determining the first correction value,

wherein the first correction value is determined further based on a distance from the first position to the second position.

12. The operation method of claim 11 , wherein the first correction value is determined further based on a depth of the second object.

13. The operation method of claim 12 , wherein the determining of the first correction value includes determining the depth of the second object based on a size of a pupil of the user of the electronic device detected by a second camera.

14. The operation method of claim 10 , wherein the first object is a finger of the user of the electronic device.

15. The operation method of claim 10 , wherein at least one of the first position and the second position of the first object is identified using a center of the display of the electronic device as a reference point.

16. The operation method of claim 10 , further comprising identifying a density of at least one object on the augmented reality content,

wherein the selected point is selectively recognized, based on the identified density, as one of a first selected point moved from the first reference point by the first correction value, and a second selected point on an extension line passing from a second reference point to the second position.

17. The operation method of claim 16 ,

wherein the first selected point is recognized as the selected point based on the identified density being greater than or equal to a threshold value, and

wherein the second selected point is recognized as the selected point based on the identified density being less than the threshold value.

18. The operation method of claim 16 , further comprising:

displaying a first user interface (UI) according to selection of the second object, based on the identified density being greater than or equal to a threshold value on the display; and

display a second UI larger than the first UI according to selection of the second object, based on the identified density being less than the threshold value on the display.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 16, 2023
From: UHM, JUNWHON; YOON, GEONHO; LEE, JINCHOUL; HA, HEONJUN; KIM, SEUNGNYUN; KIM, HYUNSOO
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 063005/0480 →
Priority Claims (1)
KR 10-2020-0119179 · Sep 16, 2020 · national
Continuity (2)
Continuation PCTKR2021011665 · Aug 31, 2021
Related Publication 20230222744A1 · Jul 13, 2023
References Cited (40)
US 7946707B1 · McDonald, II · 2011 [cited by examiner]
US 9723982B2 · Haddadi · 2017 [cited by examiner]
US 9940518B1 · Klingström · 2018 [cited by examiner]
US 20120027267A1 · Kim et al. · 2012 [cited by applicant]
US 20120092369A1 · Kim et al. · 2012 [cited by applicant]
US 20140191927A1 · Cho · 2014 [cited by applicant]
US 20140362446A1 · Bickerstaff et al. · 2014 [cited by applicant]
US 20150128064A1 · Fleming · 2015 [cited by examiner]
US 20160170603A1 · Bastien · 2016 [cited by examiner]
US 20160284129A1 · Nishizawa · 2016 [cited by examiner]
US 20170068387A1 · Bathiche · 2017 [cited by examiner]
US 20170160550A1 · Kobayashi et al. · 2017 [cited by applicant]
US 20180035097A1 · Ohishi · 2018 [cited by examiner]
US 20180081429A1 · Akenine-Moller · 2018 [cited by examiner]
US 20200026362A1 · Kim et al. · 2020 [cited by applicant]
US 20200228791A1 · Kusafuka · 2020 [cited by examiner]
US 20210084278A1 · Harviainen · 2021 [cited by examiner]
US 20210089121A1 · Rönngren · 2021 [cited by examiner]
US 20210090337A1 · Ravasz · 2021 [cited by examiner]
US 20210096368A1 · Carlsson · 2021 [cited by examiner]
US 20210263308A1 · Watabe · 2021 [cited by examiner]
US 20220192487A1 · Kim · 2022 [cited by examiner]
JP 2013250882A · 2013 [cited by applicant]
JP 201767876A · 2017 [cited by applicant]
KR 1020120032062A · 2012 [cited by applicant]
KR 1020120040407A · 2012 [cited by applicant]
KR 1020140090968A · 2014 [cited by applicant]
KR 1020160019964A · 2016 [cited by applicant]
KR 1020160024487A · 2016 [cited by applicant]
KR 1020160123346A · 2016 [cited by applicant]
KR 1020170031223A · 2017 [cited by applicant]
KR 101947372B1 · 2019 [cited by applicant]
KR 1020190106939A · 2019 [cited by applicant]
KR 102194816B1 · 2020 [cited by applicant]
KR 1020220030806A · 2022 [cited by applicant]
Green, D. G., Powers, M. K., & Banks, M. S. (1980). Depth of focus, eye size and visual acuity. Vision research, 20(10), 827-835. [cited by examiner]
International Search Report (PCT/ISA/210) dated Dec. 10, 2021 issued by the International Searching Authority in International Application No. PCT/KR2021/011665. [cited by applicant]
Written Opinion (PCT/ISA/237) dated Dec. 10, 2021 issued by the International Searching Authority in International Application No. PCT/KR2021/011665. [cited by applicant]
Communication issued Jun. 16, 2025 by the Korean Intellectual Property Office in Korean Patent Application No. 10-2020-0119179. [cited by applicant]
Green, Daniel G. et al., “Depth of Focus, Eye Size and Visual Acuity”, Vision Research, vol. 20, Issue 10, 1980, pp. 827-835. (9 pages total). [cited by applicant]