IP Library › Granted Patent US 12,321,526
Granted Patent B2
US 12,321,526 · App. 17/988,451 · Granted Jun 3, 2025

Wearable electronic device for displaying virtual object and method of controlling the same

Inventors: Kyunghwa Kim (Suwon-si, KR); Shinjae Jung (Suwon-si, KR); Wonjun Lee (Suwon-si, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
G06F3/017G02B27/0172G06F3/011G06T3/40G02B2027/0138
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,321,526
App. No.
17/988,451
Filed
Nov 16, 2022
Granted
Jun 3, 2025
Kind
B2
Examiner
XU, XIAOLAN
Art Unit
2488
USPC
348/53
Abstract

A wearable electronic device, including a display, a camera, at least one sensor, memory, and at least one processor configured to: based on receiving, through the camera, a first user input for executing the workspace corresponding to a first space, stored in the memory, in a second space different from the first space, obtain spatial information about the second space using the at least one sensor, wherein the workspace includes at least one virtual objects, and display the at least one virtual object on the display, based on the spatial information about the second space.

Claims (35)

1. A wearable electronic device comprising:

a display;

a camera;

at least one sensor;

at least one processor; and

memory storing instructions that, when executed by the at least one processor individually or collectively, cause the wearable electronic device to:

based on receiving, through the camera, a first user input selecting a workspace corresponding to a first space to be executed in a second space different from the first space, obtain spatial information about the second space using the at least one sensor, wherein the workspace is stored in the memory and includes at least one virtual object having a first spatial relationship with a first real object that is included in the first space and is not included in the second space, wherein the at least one virtual object includes an execution screen of a first application,

detect a second real object that is included in the second space and is not included in the first space,

determine a second spatial relationship between the at least one virtual object and the second real object based on the spatial information about the second space and information about the first spatial relationship,

determine whether the at least one virtual object is displayable in the second space, and

when the at least one virtual object is not displayable in the second space, display the at least one virtual object including an execution screen of a second application different from the first application or a widget screen stored in the memory, instead of the execution screen of the first application, on the display, based on the determined second spatial relationship.

2. The wearable electronic device of claim 1 , wherein the workspace is obtained based on a second user input for positioning the at least one virtual object in the first space, the at least one virtual object corresponding to at least one application, and

wherein the second user input includes at least one of a gesture input received through the camera or a user input received through an external electronic device connected to the wearable electronic device.

3. The wearable electronic device of claim 1 , wherein the spatial information about the second space includes information about a space available to a user, and

wherein the instructions, when executed by the at least one processor individually or collectively, cause the wearable electronic device to, obtain the information about the space available to the user based on at least one of distances to a plurality of objects included in the second space or sizes of at least some of the plurality of objects.

4. The wearable electronic device of claim 3 , wherein the instructions, when executed by the at least one processor individually or collectively, cause the wearable electronic device to, based on a size of the space available to the user being less than a specified value based on the information about the space available to the user, change at least one of a size, a shape, or a position of a virtual object included in the workspace, and display the changed virtual object on the display.

5. The wearable electronic device of claim 1 , wherein the instructions, when executed by the at least one processor individually or collectively, cause the wearable electronic device to, based on receiving a third user input for selecting an object from among a plurality of objects included in the second space as a reference object for executing the workspace, position the at least one virtual object based on the reference object.

6. The wearable electronic device of claim 1 , wherein the instructions, when executed by the at least one processor individually or collectively, cause the wearable electronic device to, based on a first function of an application executed in the workspace being mapped to the first space, and a second function of the application being mapped to the second space, display a virtual object related to the second function instead of a virtual object related to the first function.

7. The wearable electronic device of claim 1 , wherein the instructions, when executed by the at least one processor individually or collectively, cause the wearable electronic device to, change at least one of a size or a shape of the at least one virtual object based on the spatial information about the second space, and display the changed virtual object on the display.

8. The wearable electronic device of claim 1 , wherein the instructions, when executed by the at least one processor individually or collectively, cause the wearable electronic device to, change a position the at least one virtual object based on the spatial information about the second space, and display the at least one virtual object at the changed position on the display.

9. A non-transitory storage medium storing one or more programs, the one or more programs comprising computer-executable instructions which, when executed by at least one processor of a wearable electronic device, cause the wearable electronic device to:

based on receiving, through a camera, a first user input selecting a workspace corresponding to a first space to be executed in a second space different from the first space, the workspace being stored in a memory and including at least one virtual object having a first spatial relationship with a real object that is included in the first space and is not included in the second space, obtain spatial information about the second space using at least one sensor, wherein the at least one virtual object includes an execution screen of a first application;

detect a second real object that is included in the second space and is not included in the first space;

determine a second spatial relationship between the at least one virtual object and the second real object based on the spatial information about the second space and information about the first spatial relationship; and

determine whether the at least one virtual object is displayable in the second space,

when the at least one virtual object is not displayable in the second space, display the at least one virtual object including an execution screen of a second application different from the first application or a widget screen in the memory of the wearable electronic device, instead of the execution screen of the first application, on a display of the wearable electronic device, based on the determined second spatial relationships.

10. The method of claim 9 , wherein the workspace is obtained based on a second user input for positioning the at least one virtual object in the first space, the at least one virtual object corresponding to at least one application, and

wherein the second user input includes at least one of a gesture input received through the camera or a user input received through an external electronic device connected to the wearable electronic device.

11. The method of claim 9 , wherein the spatial information about the second space includes information about a space available to a user, and

wherein the method further comprises obtaining the information about the space available to the user based on at least one of distances to a plurality of objects included in the second space or sizes of at least some of the plurality of objects.

12. The method of claim 11 , wherein the instructions, when executed by the at least one processor of the wearable device, cause the wearable electronic device to, based on a size of the space available to the user being less than a specified value based on the information about the space available to the user, change at least one of a size, a shape, or a position of a virtual object included in the workspace, and displaying the changed virtual object on the display.

13. The method of claim 9 , wherein the instructions, when executed by the at least one processor of the wearable device, cause the wearable electronic device to, based on receiving a third user input for selecting an object from among a plurality of objects included in the second space as a reference object for executing the workspace, position the at least one virtual object based on the reference object.

14. The method of claim 9 , wherein the instructions, when executed by the at least one processor of the wearable device, cause the wearable electronic device to, based on a first function of an application executed in the workspace being mapped to the first space, and a second function of the application being mapped to the second space, display a virtual object related to the second function instead of a virtual object related to the first function.

15. The method of claim 9 , wherein the instructions, when executed by the at least one processor of the wearable device, cause the wearable electronic device to change at least one of a size or a shape of the at least one virtual object based on the spatial information about the second space, and displaying the changed virtual object on the display.

16. The method of claim 9 , wherein the instructions, when executed by the at least one processor of the wearable device, cause the wearable electronic device to change a position of the at least one virtual object based on the spatial information about the second space, and displaying the at least one virtual object at the changed position on the display.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 16, 2022
From: KIM, KYUNGHWA; LEE, WONJUN
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 061798/0009 →
Priority Claims (2)
KR 10-2021-0158032 · Nov 16, 2021 · national
KR 10-2022-0002895 · Jan 7, 2022 · national
Continuity (2)
Continuation PCTKR2022016844 · Oct 31, 2022
Related Publication 20230152900A1 · May 18, 2023
References Cited (26)
US 9497501B2 · Mount et al. · 2016 [cited by applicant]
US 9898844B2 · Mullins · 2018 [cited by applicant]
US 10740971B2 · Ramsby et al. · 2020 [cited by applicant]
US 11348327B1 · Ha et al. · 2022 [cited by applicant]
US 20110140994A1 · Noma · 2011 [cited by applicant]
US 20120113092A1 · Bar-Zeev et al. · 2012 [cited by applicant]
US 20120194541A1 · Kim et al. · 2012 [cited by applicant]
US 20140306866A1 · Miller et al. · 2014 [cited by applicant]
US 20150187108A1 · Mullins · 2015 [cited by examiner]
US 20150358614A1 · Jin · 2015 [cited by applicant]
US 20190362557A1 · Lacey · 2019 [cited by examiner]
US 20200167970A1 · Kim et al. · 2020 [cited by applicant]
US 20210133448A1 · Kim et al. · 2021 [cited by applicant]
JP 2011128220A · 2011 [cited by applicant]
JP 6227732B1 · 2017 [cited by applicant]
KR 1020120087024A · 2012 [cited by applicant]
KR 1020130139280A · 2013 [cited by applicant]
KR 1020150126938A · 2015 [cited by applicant]
KR 1020170125618A · 2017 [cited by applicant]
KR 1020200142385A · 2020 [cited by applicant]
KR 1020210051469A · 2021 [cited by applicant]
KR 102282739B1 · 2021 [cited by applicant]
KR 102303115B1 · 2021 [cited by applicant]
KR 102581146B1 · 2023 [cited by applicant]
International Search Report (PCT/ISA/210) issued by the International Searching Authority on Jan. 27, 2023 in International Application No. PCT/KR2022/016844. [cited by applicant]
Written Opinion (PCT/ISA/237) issued by the International Searching Authority on Jan. 27, 2023 in International Application No. PCT/KR2022/016844. [cited by applicant]