IP Library Granted Patent US 12,518,556
Granted Patent B2
US 12,518,556 · App. 18/763,768 · Granted Jan 6, 2026

Augmented reality device and operating method of the same

Inventors: Eunjeong Go (Suwon-si, KR); Taehyuk Kwon (Suwon-si, KR); Seowon Ji (Suwon-si, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
G06V40/11G06F3/011G06V10/26G06V20/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,518,556
App. No.
18/763,768
Granted
Jan 6, 2026
Kind
B2
Abstract

A method for operating an augmented reality (AR) device includes identifying a first object from an image of the first object obtained through a camera, identifying a grip position at which a user grips the first object, and performing an operation based on the grip position.

Claims (41)

1 . A method of operating an augmented reality (AR) device, the method comprising:

identifying a first object from an image of the first object obtained through a camera;

identifying a grip position at which a user grips the first object;

identifying a rotation of the first object; and

performing an operation based on the grip position and the rotation of the first object.

2 . The method of claim 1 , wherein the identifying the grip position comprises:

identifying at least one feature point from the image;

identifying a hand of the user based on the at least one feature point; and

identifying the grip position based on a position of the hand of the user and a position of the first object.

3 . The method of claim 1 , wherein a lengthwise area of the first object is divided into sections that respectively correspond to different operations of the AR device, and the sections represent a percentage of area of the lengthwise area of the first object.

4 . The method of claim 1 , wherein the first object is divided into sections that respectively correspond to different operations of the AR device.

5 . The method of claim 1 , further comprising providing the user with a virtual image of a guide to operation types respectively corresponding to different grip positions.

6 . The method of claim 1 , further comprising:

in case that the user contacts the first object at a plurality of contact areas, identifying a priority of each of the plurality of contact areas based on a preset rule; and

determining the grip position as a contact area having a highest priority.

7 . The method of claim 1 , wherein the identifying the rotation of the first object comprises:

identifying a first time point at which the rotation of the first object starts;

determining an accumulated amount of movement from the first time point up to a current time point; and

determining the rotation based on the accumulated amount of movement.

8 . The method of claim 7 , wherein the first time point is an earliest time point from among consecutive time points at which an amount of movement during a period of time is equal to or greater than a preset threshold.

9 . The method of claim 1 , wherein the first object comprises at least one of a touch sensor or a rotation sensing sensor, and

wherein the identifying the rotation of the first object comprises:

obtaining sensing information from the first object via the at least one of the touch sensor or the rotation sensing sensor; and

determining the rotation based on the obtained sensing information.

10 . The method of claim 1 , further comprising displaying a user interface (UI) corresponding to the operation being performed.

11 . An augmented reality (AR) device comprising:

a camera configured to obtain an image;

a display;

a memory storing at least one program comprising at least one instruction; and

at least one processor configured to execute the at least one instruction to:

identify a first object from the image;

identify a grip position at which a user grips the first object;

identify a rotation of the first object; and

perform an operation based on the grip position and the rotation of the first object.

12 . The AR device of claim 11 , wherein the at least one processor is further configured to execute the at least one instruction to:

identify at least one feature point from the image;

identify a hand of the user based on the detected at least one feature point; and

identify the grip position based on a position of the hand of the user and a position of the first object.

13 . The AR device of claim 11 , wherein the at least one processor is further configured to execute the at least one instruction to:

in a case that the user contacts the first object at a plurality of contact areas, identify priority of each of the plurality of contact areas based on a preset rule; and

determine the grip position as a contact area having a highest priority.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 3, 2024
From: GO, EUNJEONG; KWON, TAEHYUK; JI, SEOWON
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 067910/0642 →
Priority Claims (2)
KR 10-2023-0071852 · Jun 2, 2023 · national
KR 10-2023-0170030 · Nov 29, 2023 · national
Continuity (2)
Continuation PCTKR2024007349 · May 29, 2024
Related Publication 20240404313A1 · Dec 5, 2024
References Cited (39)
US 6897854B2 · Cho et al. · 2005 [cited by applicant]
US 10719143B2 · Connellan et al. · 2020 [cited by applicant]
US 11340716B2 · Marshall et al. · 2022 [cited by applicant]
US 11409364B2 · Zhou et al. · 2022 [cited by applicant]
US 11907446B2 · Bernstein et al. · 2024 [cited by applicant]
US 20170354864A1 · Rogers · 2017 [cited by examiner]
US 20170358139A1 · Balan · 2017 [cited by examiner]
US 20180025248A1 · Shan et al. · 2018 [cited by applicant]
US 20180260025A1 · Messingher et al. · 2018 [cited by applicant]
US 20190369752A1 · Ikeda et al. · 2019 [cited by applicant]
US 20200310561A1 · Connellan · 2020 [cited by examiner]
US 20200410222A1 · Chang et al. · 2020 [cited by applicant]
US 20210333875A1 · Horii · 2021 [cited by examiner]
US 20230041294A1 · Tokubo · 2023 [cited by examiner]
US 20230055819A1 · Stumm · 2023 [cited by examiner]
US 20230058340A1 · Jeong et al. · 2023 [cited by applicant]
US 20230067456A1 · Lee et al. · 2023 [cited by applicant]
US 20250155992A1 · Zhao et al. · 2025 [cited by applicant]
CN 107368183B · 2020 [cited by applicant]
CN 114690900A · 2022 [cited by applicant]
CN 113238649B · 2022 [cited by applicant]
JP 201791336A · 2017 [cited by applicant]
KR 100408518B1 · 2003 [cited by applicant]
KR 1020140099599A · 2014 [cited by applicant]
KR 1020160016260A · 2016 [cited by applicant]
KR 1020160072306A · 2016 [cited by applicant]
KR 1020160081855A · 2016 [cited by applicant]
KR 1020160099497A · 2016 [cited by applicant]
KR 1020180000009A · 2018 [cited by applicant]
KR 1020210020135A · 2021 [cited by applicant]
KR 102242154B1 · 2021 [cited by applicant]
KR 1020210117540A · 2021 [cited by applicant]
KR 102316389B1 · 2021 [cited by applicant]
KR 1020220046906A · 2022 [cited by applicant]
KR 102460737B1 · 2022 [cited by applicant]
KR 1020230034461A · 2023 [cited by applicant]
KR 1020230044551A · 2023 [cited by applicant]
International Search Report dated Sep. 4, 2024, issued by the International Searching Authority in International Application No. PCT/KR2024/007349. [cited by applicant]
Extended European Search Report issued Sep. 9, 2025 by the European Patent Office for EP Patent Application No. 24815861.0. [cited by applicant]