IP Library Granted Patent US 12,374,057
Granted Patent B2
US 12,374,057 · App. 17/982,997 · Granted Jul 29, 2025

Electronic device for providing augmented reality service, and operating method therefor

Inventors: Jieun Kim (Suwon-si, KR); Jongwoo Jung (Suwon-si, KR); Inyoung Choi (Suwon-si, KR)
Assignee: Samsung Electronics Co., Ltd.
G06T19/006G06F21/32G06T19/20G06V10/56G06T2219/2004G06V2201/07
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,374,057
App. No.
17/982,997
Granted
Jul 29, 2025
Kind
B2
Abstract

An electronic device may include one or more of: a sensor module; a first communication circuit for supporting a first communication scheme; a low-power processor; and a processor operatively connected to the sensor module, the first communication circuit, and the lower-power processor, wherein the first communication circuit can transmit, to the low-power processor, a request signal related to the state of the electronic device based on information related to a distance measurement provided from the processor, receive information related to the state of the electronic device from the low-power processor in response to the request signal, and measure the distance to an external electronic device based on the information related to the state of the electronic device. Other embodiments are possible.

Claims (41)

1. A first electronic device comprising:

communication circuitry;

at least one processor comprising processing circuitry and operatively connected to the communication circuitry; and

memory storing instructions,

wherein the instructions which, when executed by the at least one processor individually and/or collectively, cause the first electronic device to:

establish a communication connection with a second electronic device via the communication circuitry;

transmit information related to a first virtual object for display on the second electronic device based on a location of the first electronic device to the second electronic device via the established communication connection, based on a determination that a user wearing the second electronic device uses the first electronic device regardless of whether the first electronic device is located in a real space corresponding to a field of view (FOV) of the user; and

change a reference for displaying the first virtual object, based on an input related to the first virtual object.

2. The first electronic device of claim 1 , wherein the memory storing instructions which, when executed by the at least one processor individually and/or collectively, cause the first electronic device to:

detect an external object located in the real space corresponding to the FOV of the user of the second electronic device, based on image information received from the second electronic device through the communication circuitry;

acquire a second virtual object corresponding to the external object; and

transmit information regarding the second virtual object to the second electronic device via the established communication connection.

3. The first electronic device of claim 2 , wherein the memory storing instructions which, when executed by the at least one processor individually and/or collectively, cause the first electronic device to, based on a determination that the user of the second electronic device uses the first electronic device, transmit information related to hiding of the second virtual object to the second electronic device via the established communication connection.

4. The first electronic device of claim 1 , wherein the first virtual object comprises at least one virtual object related to an application program executed in the first electronic device.

5. The first electronic device of claim 1 , further comprising a display,

wherein the memory storing instructions which, when executed by the at least one processor individually and/or collectively, cause the first electronic device to determine whether the user uses the first electronic device, based on at least one of: whether the display is activated, execution information of an application program, whether information related to the first electronic device is included in an area corresponding to the FOV of the user of the second electronic device, or location information of the first electronic device and the second electronic device.

6. The first electronic device of claim 1 , wherein the information related to the first virtual object comprises at least one of: information related to coordinates for displaying the first virtual object in a coordinate system based on the location of the first electronic device, or a relative direction and/or a relative separation distance for displaying the first virtual object based on the location of the first electronic device.

7. The first electronic device of claim 1 , wherein the instructions which, when executed by the at least one processor individually and/or collectively, cause the first electronic device to:

identify the input related to the first virtual object, based on image information received from the second electronic device via the established communication connection; and

based on a determination that the location of the first virtual object is changed within an area corresponding to the FOV of the user of the second electronic device, and based on the input related to the first virtual object, change the reference for displaying the first virtual object, based on the changed location of the first virtual object.

8. The first electronic device of claim 1 , wherein the reference for displaying the first virtual object comprises at least one of: the first electronic device, coordinates of the real space, an external object located within an area corresponding to the FOV of the user wearing the second electronic device, the user, or a third electronic device.

9. The first electronic device of claim 1 , wherein the memory storing instructions which, when executed by the at least one processor individually and/or collectively, cause the first electronic device to perform user authentication based on the established communication connection with the second electronic device.

10. The first electronic device of claim 1 , wherein the information related to the first virtual object includes at least one of a form, a size, a color, or a location of the first virtual object.

11. A method of operating a first electronic device, the method comprising:

establishing a communication connection with a second electronic device;

transmitting information related to a first virtual object for display on the second electronic device based on a location of the first electronic device to the second electronic device via the established communication connection, based on a determination that a user wearing the second electronic device uses the first electronic device regardless of whether the first electronic device is located in a real space corresponding to a field of view (FOV) of the user; and

changing a reference for displaying the first virtual object, based on an input related to the first virtual object.

12. The method of claim 11 , further comprising:

detecting an external object located in the real space corresponding to the FOV of the user wearing the second electronic device, based on image information received from the second electronic device;

acquiring a second virtual object corresponding to the external object; and

transmitting information on the second virtual object to the second electronic device via the established communication connection.

13. The method of claim 12 , further comprising, based on a determination that the user of the second electronic device uses the first electronic device, transmitting information related to hiding of the second virtual object to the second electronic device via the established communication connection.

14. The method of claim 11 , further comprising determining whether the user uses the first electronic device, based on at least one of whether a display operatively connected to the electronic device is activated, execution information of an application program, whether information related to the first electronic device is included in an area corresponding to the FOV of the user of the second electronic device, or location information of the first electronic device and the second electronic device.

15. The method of claim 11 , wherein the information related to the first virtual object comprises at least one of information related to coordinates for displaying the first virtual object in a coordinate system based on the location of the first electronic device or a relative direction and/or a relative separation distance for displaying the first virtual object based on the location of the first electronic device.

16. The method of claim 11 , wherein the changing of the reference comprises:

identifying the input related to the first virtual object, based on image information received from the second electronic device via the established communication connection; and

based on a determination that the location of the first virtual object is changed within an area corresponding to the FOV of the user of the second electronic device, and based on the input related to the first virtual object, change the reference for displaying the first virtual object, based on the changed location of the first virtual object.

17. The method of claim 11 , wherein the reference for displaying the first virtual object comprises at least one of the first electronic device, coordinates of the real space, an external object located within an area corresponding to the FOV of the user wearing the second electronic device, the user, or a third electronic device.

18. The method of claim 11 , further comprising performing user authentication based on the established communication connection with the second electronic device.

19. The method of claim 18 , wherein the transmitting information related to a first virtual object comprises transmitting information related to a second virtual object to the second electronic device via the established communication connection based on success in the user authentication.

20. The method of claim 11 , wherein the information related to the first virtual object includes at least one of a form, a size, a color, or a location of the first virtual object.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 8, 2022
From: KIM, JIEUN; JUNG, JONGWOO; CHOI, INYOUNG
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 061694/0439 →
Priority Claims (1)
KR 10-2020-0055217 · May 8, 2020 · national
Continuity (2)
Continuation PCTKR2021005475 · Apr 29, 2021
Related Publication 20230061776A1 · Mar 2, 2023
References Cited (24)
US 9361732B2 · Ebstyne et al. · 2016 [cited by applicant]
US 9367136B2 · Latta et al. · 2016 [cited by applicant]
US 10147243B2 · Yamamoto et al. · 2018 [cited by applicant]
US 11036284B2 · Himane · 2021 [cited by applicant]
US 11231827B2 · Brems et al. · 2022 [cited by applicant]
US 20140192085A1 · Kim · 2014 [cited by applicant]
US 20170322622A1 · Hong et al. · 2017 [cited by applicant]
US 20180046264A1 · Hong · 2018 [cited by examiner]
US 20180081448A1 · Woo et al. · 2018 [cited by applicant]
US 20190179406A1 · Manda et al. · 2019 [cited by applicant]
US 20190362560A1 · Choi et al. · 2019 [cited by applicant]
US 20200005026A1 · Andersen et al. · 2020 [cited by applicant]
US 20200286449A1 · Yang · 2020 [cited by examiner]
US 20210097776A1 · Faulkner et al. · 2021 [cited by applicant]
US 20210241537A1 · Ahn · 2021 [cited by applicant]
CN 107506037 · 2017 [cited by applicant]
JP 2019105678 · 2019 [cited by applicant]
KR 1020140089184 · 2014 [cited by applicant]
KR 1020190125567 · 2019 [cited by applicant]
KR 1020200027153 · 2020 [cited by applicant]
KR 102099834 · 2020 [cited by applicant]
International Search Report for PCT/KR2021/005475 dated Aug. 17, 2021, 5 pages with English Translation. [cited by applicant]
Written Opinion for the ISA for PCT/KR2021/005475 dated Aug. 17, 2021, 8 pages with English Translation. [cited by applicant]
Korean Office Action dated Dec. 14, 2023 for KR Application No. 10-2020-0055217. [cited by applicant]