IP Library Granted Patent US 12,499,645
Granted Patent B2
US 12,499,645 · App. 18/458,522 · Granted Dec 16, 2025

Electronic device for displaying visual object based on location of external electronic device and method thereof

Inventors: Sungoh Kim (Suwon-si, KR); Kihwan Kim (Suwon-si, KR); Harksang Kim (Suwon-si, KR); Donghyun Yeom (Suwon-si, KR); Hyuntaek Woo (Suwon-si, KR); Sanghun Lee (Suwon-si, KR); Jungjik Lee (Suwon-si, KR); Sungsoo Choi (Suwon-si, KR); Daehee Kim (Suwon-si, KR); Beomsu Kim (Suwon-si, KR)
Assignee: Samsung Electronics Co., Ltd.
G06T19/20G06T7/73G06T19/006G06V20/20G06V40/20H04B10/1149H04N7/22G06T2207/30244G06T2219/2021
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,499,645
App. No.
18/458,522
Granted
Dec 16, 2025
Kind
B2
Abstract

According to an embodiment, a processor of a wearable device is configured to identify, based on an image output from a camera, an external electronic device. The processor, based on the identification, is configured to request outputting of an optical signal to the external electronic device through a communication circuit. The processor is configured to identify, in a portion of the image where the external electronic device is displayed, a position of the optical signal output from the external electronic device. The processor is configured to control a display to display a visual object having an extended shape based on the identified position in the display.

Claims (84)

1 . A wearable device, comprising:

a camera;

communication circuitry;

a display;

at least one processor comprising processing circuitry; and

memory comprising one or more storage media storing instructions, when executed individually and/or collectively by the at least one processor, cause the wearable device to:

identify, based on an image obtained from the camera, an external electronic device;

identify a state of the external electronic device among a first state in which a first light emitting component disposed on a first side of the external electronic device is exposed to the wearable device and a second state in which a second light emitting component disposed on a second side of the external electronic device, opposite to the first side of the external electronic device, is exposed to the wearable device;

based on the state of the external electronic device being the first state:

transmit, to the external electronic device, a first signal for activating the first light emitting component, and

in response to identifying a position of a first optical signal output from the first the light emitting component, display a first visual object representing the external electronic device, and a second visual object extending from the first visual object to indicate a direction according to an orientation of the external electronic device; and

based on the state of the external electronic device being the second state,

transmit, to the external electronic device, a second signal for activating the second light emitting component, and

in response to identifying a position of a second optical signal output from the second light emitting component, display a third visual object representing the external electronic device, and a fourth visual object extending from the third visual object to indicate the direction according to the orientation of the external electronic device.

2 . A wearable device of claim 1 , further comprising a sensor;

wherein a wavelength band of the first optical signal is different from a wavelength band of the second optical signal;

wherein the first optical signal is identified using the sensor; and

wherein the second optical signal is identified using the camera.

3 . The wearable device of claim 1 ,

wherein the external electronic device is a foldable device; and

wherein the instructions, when executed by the at least one processor, cause the wearable device to:

receive, via the communication circuitry, state information associated a form of the external electronic device; and

identify, based on the state information, the state of the external electronic device.

4 . The wearable device of claim 3 , comprising a first housing and a second housing;

wherein the state information includes information on whether the external electronic device is folded, and information on an angle between the first housing and the second housing.

5 . The wearable device of claim 4 , wherein the instructions, when executed by the at least one processor individually or collectively, cause the wearable device to:

based on identifying the external electronic device being folded, identify the state of the external electronic device being the first state; and

based on identifying the external electronic device being unfolded, identify the state of the external electronic device being the second state.

6 . The wearable device of claim 3 , wherein the first visual object and the third visual object are obtained based on the state information.

7 . The wearable device of claim 1 , wherein the instructions, when executed individually and/or collectively by the at least one processor, cause the wearable device to:

receive, from the external electronic device, motion data representing a motion of the external electronic device; and

change, based on the motion data, a representation of one of a first virtual object and a second virtual object,

wherein the first virtual object includes the first visual object and the second visual object, and

wherein the second virtual object includes the third visual object and the fourth visual object.

8 . The wearable device of claim 1 , wherein the second visual object is obtained based on the first visual object, and

wherein the fourth visual object is obtained based on the third visual object.

9 . A method executed by a wearable device, comprising:

identifying, based on an image obtained from a camera, an external electronic device;

identifying a state of the external electronic device among a first state in which a first light emitting component disposed on a first side of the external electronic device is exposed to the wearable device and a second state in which a second light emitting component disposed on a second side of the external electronic device, opposite to the first side of the external electronic device, is exposed to the wearable device;

based on the state of the external electronic device being the first state:

transmitting, to the external electronic device, a first signal for activating the first light emitting component, and

in response to identifying a position of a first optical signal output from the first the light emitting component, displaying a first visual object representing the external electronic device, and a second visual object extending from the first visual object to indicate a direction according to an orientation of the external electronic device; and

based on the state of the external electronic device being the second state,

transmitting, to the external electronic device, a second signal for activating the second light emitting component, and

in response to identifying a position of a second optical signal output from the second light emitting component, displaying a third visual object representing the external electronic device, and a fourth visual object extending from the third visual object to indicate the direction according to the orientation of the external electronic device.

10 . The method of claim 9 , wherein a wavelength band of the first optical signal is different from a wavelength band of the second optical signal;

wherein the first optical signal is identified using the sensor; and

wherein the second optical signal is identified using the camera.

11 . The method of claim 9 ,

wherein the external electronic device is a foldable device; and

wherein the method comprises:

receiving, via the communication circuitry, state information associated a form of the external electronic device; and

identifying, based on the state information, the state of the external electronic device.

12 . The method of claim 11 , wherein the state information includes information on whether the external electronic device is folded, information on an angle between the first housing and the second housing.

13 . The method of claim 12 , comprising:

based on identifying the external electronic device being folded, identifying the state of the external electronic device being the first state; and

based on identifying the external electronic device being unfolded, identifying the state of the external electronic device being the second state.

14 . The method of claim 11 , wherein the first visual object and the third visual object are obtained based on the state information.

15 . The method of claim 9 , comprising:

receiving, from the external electronic device, motion data representing a motion of the external electronic device; and

changing, based on the motion data, a representation of one of a first virtual object and a second virtual object,

wherein the first virtual object includes the first visual object and the second visual object, and

wherein the second virtual object includes the third visual object and the fourth visual object.

16 . The method of claim 9 , wherein the second visual object is obtained based on the first visual object, and

wherein the fourth visual object is obtained based on the third visual object.

17 . A non-transitory computer readable storage medium storing one or more programs, wherein the one or more programs include instructions which, when executed individually and/or collectively by at least one processor of a wearable device with a camera, communication circuitry, and a display, cause the wearable device to:

identify, based on an image obtained from the camera, an external electronic device;

identify a state of the external electronic device among a first state in which a first light emitting component disposed on a first side of the external electronic device is exposed to the wearable device and a second state in which a second light emitting component disposed on a second side of the external electronic device, opposite to the first side of the external electronic device, is exposed to the wearable device;

based on the state of the external electronic device being the first state:

transmit, to the external electronic device, a first signal for activating the first light emitting component, and

in response to identifying a position of a first optical signal output from the first the light emitting component, display a first visual object representing the external electronic device, and a second visual object extending from the first visual object to indicate a direction according to an orientation of the external electronic device; and

based on the state of the external electronic device being the second state,

transmit, to the external electronic device, a second signal for activating the second light emitting component, and

in response to identifying a position of a second optical signal output from the second light emitting component, display a third visual object representing the external electronic device, and a fourth visual object extending from the third visual object to indicate the direction according to the orientation of the external electronic device.

18 . The non-transitory computer readable storage medium of claim 17 , wherein the one or more programs, wherein the wearable device comprises a sensor,

and wherein the one or more programs include the instructions which, when executed by the at least one processor, cause the wearable device to:

wherein the first optical signal is identified using the sensor; and

wherein the second optical signal is identified using the camera.

19 . The non-transitory computer readable storage medium of claim 17 , wherein the external electronic device is a foldable device; and

wherein the one or more programs include the instructions which, when executed by the at least one processor, cause the wearable device to:

receive, via the communication circuitry, state information associated a form of the external electronic device; and

identify, based on the state information, the state of the external electronic device.

20 . The non-transitory computer readable storage medium of claim 17 , wherein the wearable device comprises a first housing and a second housing; and

wherein the state information includes information on whether the external electronic device is folded, information on an angle between the first housing and the second housing.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 30, 2023
From: KIM, SUNGOH; KIM, KIHWAN; KIM, HARKSANG; YEOM, DONGHYUN; WOO, HYUNTAEK; LEE, SANGHUN; LEE, JUNGJIK; CHOI, SUNGSOO; KIM, DAEHEE; KIM, BEOMSU
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 064754/0196 →
Priority Claims (2)
KR 10-2022-0171645 · Dec 9, 2022 · national
KR 10-2022-0191216 · Dec 30, 2022 · national
Continuity (2)
Continuation PCTKR2023012691 · Aug 25, 2023
Related Publication 20240193889A1 · Jun 13, 2024
References Cited (23)
US 10083544B2 · Chen et al. · 2018 [cited by applicant]
US 10334076B2 · Mckenzie · 2019 [cited by examiner]
US 10444865B2 · Kirmani et al. · 2019 [cited by applicant]
US 10948992B1 · Bai · 2021 [cited by applicant]
US 11697068B2 · Bar-Zeev · 2023 [cited by examiner]
US 20170011553A1 · Chen · 2017 [cited by examiner]
US 20180232066A1 · Jeon · 2018 [cited by examiner]
US 20180314346A1 · Kirmani · 2018 [cited by examiner]
US 20190385372A1 · Cartwright · 2019 [cited by examiner]
US 20200366897A1 · Trepte · 2020 [cited by applicant]
US 20220244899A1 · Yasuda · 2022 [cited by examiner]
US 20220308658A1 · Hashimoto · 2022 [cited by applicant]
US 20230305788A1 · Kulshrestha · 2023 [cited by examiner]
US 20230398433A1 · Ye · 2023 [cited by examiner]
JP 2017107293A · 2017 [cited by applicant]
KR 1020170130580 · 2017 [cited by applicant]
KR 20180122797A · 2018 [cited by applicant]
KR 20190021747A · 2019 [cited by applicant]
KR 1020190136057 · 2019 [cited by applicant]
KR 102215112B1 · 2021 [cited by applicant]
KR 1020210102210 · 2021 [cited by applicant]
KR 102353669 · 2022 [cited by applicant]
Search Report and Written Opinion dated Dec. 5, 2023 issued in International Patent Application No. PCT/KR2023/012691. [cited by applicant]