IP Library Granted Patent US 12,309,341
Granted Patent B2
US 12,309,341 · App. 17/988,765 · Granted May 20, 2025

Wearable device and control method thereof

Inventor: Yun-Ting Wang (Taoyuan, TW)
Assignee: HTC Corporation
H04N13/117G02B27/017G06V20/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,309,341
App. No.
17/988,765
Granted
May 20, 2025
Kind
B2
Abstract

A wearable device is provided. The wearable device includes a processor. The processor is configured to: receive a user instruction, wherein the user instruction comprises a first virtual point and a second virtual point in a virtual world; obtain a first real point and a second real point in a real world respectively based on the first virtual point and the second virtual point according to an environment map around the wearable device; and determine a real distance between the first real point and the second real point.

Claims (59)

1. A wearable device, comprising:

a processor, configured to:

establish an environment map of a real world around the wearable device based on simultaneous localization and mapping algorithm;

receive a user instruction, wherein the user instruction comprises a first virtual point and a second virtual point of a virtual object in a virtual world, wherein the virtual object is design by a user in the virtual world;

obtain a plurality of first feature points and a plurality of second feature points around the wearable device based the first virtual point and the second virtual point, wherein in response to the user pointing to the first virtual point in the virtual world, the plurality of first features points around where the user points in the real world are obtained, and in response to the user pointing to the second virtual point in the virtual world, the plurality of second features points around where the user points in the real world are obtained;

convert the first virtual point and the second virtual point to a first real point and a second real point in the real world respectively according to the environment map, the plurality of first feature points, and the plurality of second feature points; and

determine a real distance between the first real point and the second real point.

2. The wearable device according to claim 1 , further comprising:

a display, coupled to the processor and configured to display the real distance in the virtual world.

3. The wearable device according to claim 1 , further comprising:

a camera, coupled to the processor and configured to capture a plurality of user photos of a user, wherein

the processor is configured to obtain the user instruction from the plurality of user photos.

4. The wearable device according to claim 1 , wherein the processor is further configured to:

obtain the environment map around the wearable device, wherein the environment map comprises a first map point and a second map point, the first map point indicates the first real point in the environment map, and the second map point indicates the second real point in the environment map; and

determine the real distance based on the first map point and the second map point.

5. The wearable device according to claim 4 , wherein the processor is further configured to:

obtain the first map point based on the plurality of first feature points; and

obtain the second map point based on the plurality of second feature points.

6. The wearable device according to claim 4 , wherein the environment map is established based on simultaneous localization and mapping algorithm.

7. The wearable device according to claim 4 , wherein the environment map comprises point cloud data.

8. The wearable device according to claim 1 , wherein the processor is further configured to:

obtain a displacement from the first real point to the second real point; and

determine the real distance based on the displacement.

9. The wearable device according to claim 1 , wherein the user instruction further comprises a third virtual point in the virtual world and the processor is further configured to:

obtain a third real point in the real world based on the third virtual point; and

determine a real area based on the first real point, the second real point, and the third real point.

10. The wearable device according to claim 1 , wherein the user instruction further comprises a third virtual point and a fourth virtual in the virtual world and the processor is further configured to:

obtain a third real point in the real world based on the third virtual point;

obtain a fourth real point in the real world based on the fourth virtual point; and

determine a real volume based on the first real point, the second real point, the third real point, and the fourth real point.

11. A control method of a wearable device, comprising:

establishing an environment map of a real world around the wearable device based on simultaneous localization and mapping algorithm;

receiving a user instruction, wherein the user instruction comprises a first virtual point and a second virtual point of a virtual object in a virtual world, wherein the virtual object is design by a user in the virtual world;

obtaining a plurality of first feature points and a plurality of second feature points around the wearable device based the first virtual point and the second virtual point, wherein in response to the user pointing to the first virtual point in the virtual world, the plurality of first features points around where the user points in the real world are obtained, and in response to the user pointing to the second virtual point in the virtual world, the plurality of second features points around where the user points in the real world are obtained;

converting the first virtual point and the second virtual point to a first real point and a second real point in the real world respectively according to the environment map, the plurality of first feature points, and the plurality of second feature points; and

determining a real distance between the first real point and the second real point.

12. The control method according to claim 11 , further comprising:

displaying the real distance in the virtual world.

13. The control method according to claim 11 , further comprising:

obtaining a plurality of user photos of a user; and

obtaining the user instruction from the plurality of user photos.

14. The control method according to claim 11 , further comprising:

obtaining the environment map around the wearable device, wherein the environment map comprises a first map point and a second map point, the first map point indicates the first real point in the environment map, and the second map point indicates the second real point in the environment map; and

determining the real distance based on the first map point and the second map point.

15. The control method according to claim 14 , further comprising:

obtaining the first map point based on the plurality of first feature points; and

obtaining the second map point based on the plurality of second feature points.

16. The control method according to claim 14 , wherein the environment map is established based on simultaneous localization and mapping algorithm.

17. The control method according to claim 14 , wherein the environment map comprises point cloud data.

18. The control method according to claim 11 , further comprising:

obtaining a displacement from the first real point to the second real point; and

determining the real distance based on the displacement.

19. The control method according to claim 11 , wherein the user instruction further comprises a third virtual point in the virtual world and the control method further comprises:

obtaining a third real point in the real world based on the third virtual point; and

determining a real area based on the first real point, the second real point, and the third real point.

20. The control method according to claim 11 , wherein the user instruction further comprises a third virtual point and a fourth virtual point in the virtual world and the control method further comprises:

obtaining a third real point in the real world based on the third virtual point;

obtaining a fourth real point in the real world based on the fourth virtual point; and

determining a real volume based on the first real point, the second real point, the third real point, and the fourth real point.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 29, 2022
From: WANG, YUN-TING
To: HTC CORPORATION
Reel/Frame 061897/0868 →
Continuity (2)
Provisional Application 63321110 · Mar 18, 2022
Related Publication 20230300310A1 · Sep 21, 2023
References Cited (40)
US 9558584B1 · Lo · 2017 [cited by examiner]
US 11017611B1 · Mount · 2021 [cited by examiner]
US 11442591B2 · Vathauer · 2022 [cited by examiner]
US 20160147408A1 · Bevis et al. · 2016 [cited by applicant]
US 20170102778A1 · McGrath et al. · 2017 [cited by applicant]
US 20190094981A1 · Bradski · 2019 [cited by examiner]
US 20190324550A1 · Liao et al. · 2019 [cited by applicant]
US 20200111256A1 · Bleyer · 2020 [cited by examiner]
US 20200126298A1 · Wei et al. · 2020 [cited by applicant]
US 20200151965A1 · Forbes · 2020 [cited by examiner]
US 20210118160A1 · Farås et al. · 2021 [cited by applicant]
US 20210218947A1 · Oh · 2021 [cited by examiner]
US 20210319220A1 · Ichim et al. · 2021 [cited by applicant]
US 20210347053A1 · Lee · 2021 [cited by examiner]
US 20220004253A1 · Cappello · 2022 [cited by examiner]
US 20220130046A1 · Schreckenberg · 2022 [cited by examiner]
US 20220165026A1 · Bieser et al. · 2022 [cited by applicant]
US 20220261085A1 · Bazin · 2022 [cited by examiner]
US 20220350399A1 · Uberti · 2022 [cited by applicant]
US 20220358715A1 · Tanner et al. · 2022 [cited by applicant]
US 20230215090A1 · Ye · 2023 [cited by examiner]
US 20230260223A1 · Chan · 2023 [cited by examiner]
US 20230419513A1 · Dutta Choudhury · 2023 [cited by examiner]
US 20240038084A1 · Marggraff · 2024 [cited by examiner]
US 20240112399A1 · Ramani · 2024 [cited by examiner]
US 20240350913A1 · Lu · 2024 [cited by examiner]
CN 102226880 · 2011 [cited by applicant]
CN 107145237 · 2017 [cited by applicant]
CN 107516336 · 2017 [cited by applicant]
CN 108633307 · 2018 [cited by applicant]
CN 110634182 · 2019 [cited by applicant]
CN 111443802 · 2020 [cited by applicant]
CN 115346054 · 2022 [cited by applicant]
TW 201814592 · 2018 [cited by applicant]
TW 202144983 · 2021 [cited by applicant]
TW 202203156 · 2022 [cited by applicant]
WO 2021123619 · 2021 [cited by applicant]
WO 2021142451 · 2021 [cited by applicant]
“Office Action of Taiwan Counterpart Application”, issued on Sep. 5, 2023, p. 1-p. 9. [cited by applicant]
“Office Action of Taiwan Counterpart Application”, issued on Dec. 11, 2024, p. 1-p. 11. [cited by applicant]