IP Library › Granted Patent US 10,905,950
Granted Patent B2
US 10,905,950 · App. 16/162,330 · Granted Feb 2, 2021

Head-mounted display tracking

Inventor: Glenn T. Black (San Mateo, CA)
Assignee: Sony Interactive Entertainment Inc.
A63F13/25A63F13/211A63F13/213A63F13/323A63F13/428G02B27/017H04L67/38A63F13/212A63F13/34A63F13/5255A63F2300/8082G02B2027/014G02B2027/0178G02B2027/0187
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,905,950
App. No.
16/162,330
Granted
Feb 2, 2021
Kind
B2
Abstract

A virtual reality (VR) head-mounted display (HMD), a computer-implemented method, and a VR tracking system are described. Generally, a VR HMD includes an inertial measurement unit (IMU) and an optical sensor. When a second VR HMD is located in a same physical environment, the VR HMD can be operated to track a motion of the second VR HMD in the physical environment. For example, image data captured by the VR HMD in addition to inertial data of both VR HMDs are used to determine a three dimensional (3D) physical position of the second VR HMD and to track the 3D physical position over time. Three degrees of freedom (DOF) or six DOF for the motion are derived from the tracking.

Claims (35)

1. A computer-implemented method, comprising:

processing first inertial data by a computer of a first virtual reality head mounted display, the first inertial data produced by an inertial measurement unit coupled with the computer, the computer further processing image data of a physical environment that comprises the first virtual reality head-mounted display, the image data generated by an optical sensor of a second virtual reality head-mounted display that is in the physical environment;

determining, by the computer, a movement direction of the first virtual reality head-mounted display based on the first inertial data;

determining, by the computer, a change in position based on analysis of the image data that includes the first virtual reality head-mounted display;

determining, by the computer, a position of the first virtual reality head-mounted display in the physical environment based on the movement direction and the change in position, and wherein the position further being based on a calibration offset between second inertial data received from the second virtual reality head-mounted display and the first inertial data; and

presenting, by the computer of the first virtual reality head mounted display, virtual reality content that is updated based on the position of the first virtual reality head-mounted display in the physical environment.

2. The computer-implemented method of claim 1 , wherein the image data being received from the second virtual reality head-mounted display over one of a wireless network or a peer-to-peer data communication network.

3. The computer-implemented method of claim 1 , wherein the position of the first virtual reality head-mounted display is tracked over time based on updates to the first inertial data and the image data.

4. The computer-implemented method of claim 1 , wherein the first inertial data is generated by an inertial measurement unit rigidly connected with the first virtual reality head-mounted display.

5. The computer-implemented method of claim 1 , wherein the first virtual reality head-mounted display includes one or more tags that are identified in the image data and said one or more tags are configured to be analyzed to assist in at least part of tracking of the first virtual reality head-mounted display in the physical environment.

6. The computer-implemented method of claim 1 , further comprising:

sending, by the computer, the first inertial data of the first virtual reality head-mounted display to the second virtual reality head-mounted display.

7. The computer-implemented method of claim 1 , wherein each of the first and second virtual reality head-mounted displays include cameras.

8. A computer-implemented method for tracking a first virtual reality head mounted display, comprising:

receiving, by a computer of a second virtual reality head mounted display, first inertial data of the first virtual reality head mounted display;

capturing, by a camera of the second virtual reality head mounted display, image data of a physical environment in which the first and second virtual reality head mounted displays are present;

determining, by the computer, a movement direction of the first virtual reality head-mounted display based on the first inertial data;

determining, by the computer, a change in position based on analysis of the image data that includes the first virtual reality head-mounted display;

determining, by the computer, a position of the first virtual reality head-mounted display in the physical environment based on the movement direction and the change in position, and wherein the position further being based on a calibration offset between second inertial data received from the second virtual reality head-mounted display and the first inertial data; and

sending by the computer to the second virtual reality head mounted display, the position to cause an update to presentation of virtual reality content as viewed via the first virtual reality head mounted display.

9. The computer-implemented method of claim 8 , wherein the first and second virtual reality head-mounted displays communicate over one of a wireless network or a peer-to-peer data communication network.

10. The computer-implemented method of claim 8 , wherein the position of the first virtual reality head-mounted display is tracked over time based on updates to the first inertial data and the image data.

11. The computer-implemented method of claim 8 , wherein the first inertial data is generated by an inertial measurement unit rigidly connected with the first virtual reality head-mounted display.

12. The computer-implemented method of claim 8 , further comprising,

processing, by the computer of the second virtual reality head-mounted display, the second inertial data of the second virtual reality head-mounted display.

13. The computer-implemented method of claim 8 , wherein the first virtual reality head-mounted display includes one or more identifiers that are visually captured in the image data and said one or more identifiers are configured to be analyzed to assist in at least part of the tracking of the first virtual reality head-mounted display in the physical environment.

14. The computer-implemented method of claim 8 , wherein the second virtual reality head-mounted display is configured to track the position of the first virtual reality head-mounted display.

15. A computer-implemented method for tracking a first virtual reality head mounted display, comprising:

receiving, by a computer of a second virtual reality head mounted display, first inertial data of the first virtual reality head mounted display;

capturing, by a camera of the second virtual reality head mounted display, image data of a physical environment that includes the second virtual reality head mounted display;

determining, by the computer, a movement change of the first virtual reality head-mounted display based on the first inertial data;

determining, by the computer, a location change of the first virtual reality head-mounted display based on analysis of the image data that includes the first virtual reality head-mounted display;

determining, by the computer, a position of the first virtual reality head-mounted display in the physical environment based on the movement change and the location change, and wherein the position further being based on a calibration offset between second inertial data received from the second virtual reality head-mounted display and the first inertial data; and

sending, by the computer to the second virtual reality head mounted display, the position to enable updates in virtual reality content being presented via the first virtual reality head mounted display.

16. The computer-implemented method of claim 15 , wherein the first and second virtual reality head-mounted displays communicate over one of a wireless network or a peer-to-peer data communication network.

Continuity (2)
Division 15085887 · Mar 30, 2016
Related Publication 20190046873A1 · Feb 14, 2019