IP Library Granted Patent US 12,229,899
Granted Patent B2
US 12,229,899 · App. 17/817,355 · Granted Feb 18, 2025

Tracking device, head-mounted display device, and virtual reality system

Inventor: Sheng-Hui Tao (Taoyuan, TW)
Assignee: HTC Corporation
G06T19/006G02B27/0101G02B2027/014G02B27/017
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,229,899
App. No.
17/817,355
Granted
Feb 18, 2025
Kind
B2
Abstract

A tracking device, communicatively connected to a HMD device (head-mounted display device), is disclosed. The tracking device includes a client processor and a client memory. The client processor is configured to obtain an initial map from the HMD device. The client memory is configured to store the initial map. The client processor is further configured to update the initial map stored in the client memory to generate a client map according to a host bundle adjustment data sent by the HMD device.

Claims (47)

1. A tracking device, communicatively connected to an HMD device (head-mounted display device), comprising:

a client processor, configured to obtain an initial map from the HMD device; and

a client memory, configured to store the initial map;

wherein the client processor is further configured to update the initial map stored in the client memory to generate a client map according to a host bundle adjustment data sent by the HMD device;

wherein the client processor is further configured to maintain a consistency between a host map and the client map according to the host bundle adjustment data;

wherein the host map is generated by updating the initial map according to the host bundle adjustment data.

2. The tracking device of claim 1 , wherein the host bundle adjustment data is generated according to a plurality of host key frames of the HMD device.

3. The tracking device of claim 2 , wherein the client memory is further configured to store the plurality of host key frames and the host bundle adjustment data.

4. The tracking device of claim 1 , wherein the client processor is further configured to not to modify the host bundle adjustment data sent from the HMD device.

5. The tracking device of claim 1 , wherein the client processor is further configured to obtain a plurality of client key frames, and wherein the plurality of client key frames are sent from the client processor to the HMD device.

6. The tracking device of claim 5 , wherein the host bundle adjustment data is generated according to a plurality of host key frames obtained by the HMD device and the plurality of client key frames.

7. An HMD device, communicatively connected to a tracking device, comprising:

a host memory, configured to store a SLAM module; and

a host processor, configured to:

obtain an initial map with the SLAM module;

send the initial map to the tracking device;

obtain a plurality of host key frames;

perform a bundle adjustment process according to the plurality of host key frames to generate a host bundle adjustment data;

update the initial map to generate a host map according to the host bundle adjustment data; and

send the host map to the tracking device for the tracking device to generate a client map by updating the initial map according to the host bundle adjustment data;

wherein a client processor of the tracking device maintains a consistency between the host map and the client map according to the host bundle adjustment data.

8. The HMD device of claim 7 , wherein the host processor is further configured to send the plurality of host key frames to the tracking device.

9. The HMD device of claim 7 , wherein the plurality of host key frames comprise a plurality of features of an environment surrounding the HMD device.

10. The HMD device of claim 7 , wherein the host processor is further configured to maintain the consistency between the host map and the client map with the host bundle adjustment data.

11. The HMD device of claim 7 , wherein the host processor is further configured to receive a plurality of client key frames from the tracking device.

12. The HMD device of claim 11 , wherein the host processor is further configured to perform the bundle adjustment process according to the plurality of host key frames and the plurality of client key frames to generate the host bundle adjustment data.

13. A virtual reality system, comprising:

a HMD device, comprising:

a host memory, configured to store a SLAM module; and

a host processor, configured to obtain an initial map with the SLAM module; and

a tracking device, communicatively connected to the HMD device, comprising:

a client processor, configured to obtain the initial map from the HMD device; and

a client memory, configured to store the initial map;

wherein the host processor is further configured to:

obtain a plurality of host key frames;

perform a bundle adjustment process according to the plurality of host key frames to generate a host bundle adjustment data;

update the initial map to generate a host map according to the host bundle adjustment data; and

send the host bundle adjustment data to the client processor;

wherein the client processor is further configured to:

update the initial map stored in the client memory to generate a client map according to the host bundle adjustment data; and

maintain a consistency between the host map and the client map according to the host bundle adjustment data.

14. The virtual reality system of claim 13 , wherein the host processor is further configured to send the plurality of host key frames to the tracking device.

15. The virtual reality system of claim 14 , wherein the client memory is further configured to store the plurality of host key frames.

16. The virtual reality system of claim 14 , wherein the client processor is further configured to not to modify the host bundle adjustment data sent from the HMD device.

17. The virtual reality system of claim 13 , wherein the plurality of host key frames comprise a plurality of features of an environment surrounding the virtual reality system.

18. The virtual reality system of claim 13 , wherein the host processor is further configured to maintain the consistency between the host map and the client map with the host bundle adjustment data.

19. The virtual reality system of claim 13 , wherein the host processor is further configured to perform the bundle adjustment process according to the plurality of host key frames and a plurality of client key frames to generate the host bundle adjustment data, wherein the plurality of client key frames are sent from the client processor to the host processor.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 8, 2022
From: TAO, SHENG-HUI
To: HTC CORPORATION
Reel/Frame 060739/0750 →
Continuity (2)
Provisional Application 63264956 · Dec 6, 2021
Related Publication 20230177780A1 · Jun 8, 2023
References Cited (21)
US 10152141B1 · Lohse et al. · 2018 [cited by applicant]
US 10185775B2 · Schmalstieg · 2019 [cited by examiner]
US 10565731B1 · Reddy · 2020 [cited by examiner]
US 11568562B1 · D'Amico · 2023 [cited by examiner]
US 20140267234A1 · Hook · 2014 [cited by examiner]
US 20150205135A1 · Border et al. · 2015 [cited by applicant]
US 20160179830A1 · Schmalstieg · 2016 [cited by examiner]
US 20170011555A1 · Li et al. · 2017 [cited by applicant]
US 20170161956A1 · Fu et al. · 2017 [cited by applicant]
US 20180365853A1 · Yang et al. · 2018 [cited by applicant]
US 20190244416A1 · Tamaoki et al. · 2019 [cited by applicant]
US 20190385370A1 · Boyapalle et al. · 2019 [cited by applicant]
US 20200027274A1 · Suzuki · 2020 [cited by examiner]
US 20200158517A1 · Tadi · 2020 [cited by examiner]
US 20200363867A1 · Azimi et al. · 2020 [cited by applicant]
TW 202009786A · 2020 [cited by applicant]
TW 202105133A · 2021 [cited by applicant]
The office action of the related U.S. Appl. No. 17/817,353 issued on Mar. 18, 2024. [cited by applicant]
The office action of the related U.S. Appl. No. 17/817,353 issued on Nov. 22, 2023. [cited by applicant]
The office action of the related Taiwanese application No. TW111144045 issued on Jul. 11, 2023. [cited by applicant]
Office Action of related U.S. Appl. No. 17/817,353 issued on Dec. 29, 2022. [cited by applicant]