IP Library Granted Patent US 9,599,825
Granted Patent B1
US 9,599,825 · App. 14/870,871 · Granted Mar 21, 2017

Visual indicator for transparent display alignment

Inventors: Brian Mullins (Sierra Madre, CA); Ryan Ries (Los Angeles, CA)
Assignee: DAQRI, LLC
G02B27/0179G02B27/017G06F3/013G06T19/006G02B2027/0187G02B2027/0198
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,599,825
App. No.
14/870,871
Granted
Mar 21, 2017
Kind
B1
Abstract

A head mounted device includes a sensor, a transparent display, and a processor comprising an augmented reality application and an alignment module. The augmented reality application generates a virtual content based on data from the sensor, and displays the virtual content in the transparent display. The alignment module detects an initialization of the augmented reality application and causes a temporary display of an alignment indicator in the transparent display in response to detecting the initialization of the augmented reality application.

Claims (40)

1. A head-mounted device (HMD) comprising:

a sensor;

a transparent display; and

a processor comprising an augmented reality application and an alignment module, the augmented reality application configured to generate a virtual content based on data from the sensor, and to display the virtual content in the transparent display, the alignment module configured to detect an initialization of the augmented reality application and to cause a temporary display of an alignment indicator in the transparent display in response to detecting the initialization of the augmented reality application, the alignment indicator identifying a relative position between the HMD and a head of a user of the HMD,

wherein the alignment indicator comprises an augmented reality-based indicator that is based on a relative position between the transparent display and an eye of the user wearing the HMD as detected by the sensor, the alignment module configured to adjust the augmented reality-based indicator in response to a change in the relative position between the transparent display and the eye of the user wearing the HMD,

wherein the augmented reality-based indicator indicates a direction for the user to adjust the transparent display relative to the head of the user of the HMD.

2. The HMD of claim 1 , wherein the alignment indicator comprises a static alignment indicator that comprises at least one of an outline of a perimeter of the transparent display and a horizontal line.

3. The HMD of claim 1 , wherein the dynamic alignment indicator comprises a level-based indicator comprising a virtual horizon and a static horizontal line, the virtual horizon based on the sensor, the static horizontal line identifying a horizontal line centered in the transparent display.

4. The HMD of claim 1 , wherein the augmented reality-based indicator is displayed in the transparent display in a line of sight between the eye of the user and the physical object, the augmented reality-based indicator configured to match a shape of a target area located in a central region of the transparent display.

5. The HMD of claim 1 , wherein the dynamic alignment indicator comprises an eye gaze-based indicator based on an eye gaze of the user and the relative position between the transparent display and the eye gaze of the user, the augmented reality-based indicator identifying the direction for the user to adjust the transparent display relative to the head of the user of the HMD.

6. The HMD of claim 1 , wherein the alignment module is configured to detect that a relative position between the transparent display and an eye of the user is within a threshold position, and to remove the temporary display of the alignment indicator in the transparent display in response to detecting that the relative position between the transparent display and the eye of the user is within the threshold position.

7. The HMD of claim 6 , wherein the sensor comprises an inertial measurement unit and an eye gaze tracking sensor, the threshold position comprising a central region in the transparent display.

8. The HMD of claim 1 , wherein the alignment module is configured to detect the head-mounted device being put on a head of the user.

9. A computer-implemented method comprising:

detecting an initialization of an augmented reality application of a head-mounted device (HMD);

causing a temporary display of an alignment indicator in a transparent display in response to detecting the initialization of the augmented reality application, the alignment indicator identifying a relative position between the HMD and a head of a user of the HMD;

measuring a relative position between the transparent display and an eye of the user wearing the HMD as detected by the sensor, the alignment indicator comprising an augmented reality-based indicator that is based on the relative position; and

adjusting the augmented reality-based indicator in response to a change in the relative position between the transparent display and the eye of the user wearing the HMD, the augmented reality-based indicator indicates a direction for the user to adjust the transparent display relative to the head of the user of the HMD.

10. The computer-implemented method of claim 9 , wherein the alignment indicator comprises a static alignment indicator that comprises at least one of an outline of a perimeter of the transparent display and a horizontal line.

11. The computer-implemented method of claim 9 , further comprising:

generating a virtual horizon based on a sensor in the head-mounted device;

generating a static horizontal line identifying a horizontal line centered in the transparent display; and

causing a display of a level-based indicator comprising the virtual horizon and a static horizontal line.

12. The computer-implemented method of claim 9 , further comprising:

forming an augmented reality-based indicator to match a shape of a target area located in a central region of the transparent display; and

causing a display of the augmented reality-based indicator based on the relative position between the eye of the user and a physical object, the augmented reality-based indicator displayed in the transparent display in a line of sight between the eye of the user and the physical object.

13. The computer-implemented method of claim 9 , further comprising:

generating an eye gaze-based indicator based an eye gaze of the user and the relative position between the transparent display and the eye gaze of the user, the augmented reality-based indicator identifying the direction for the user to adjust the transparent display relative to the head of the user of the HMD.

14. The computer-implemented method of claim 9 , further comprising:

detecting that a relative position between the transparent display and an eye of the user is within a threshold position; and

removing the temporary display of the alignment indicator in the transparent display in response to detecting that the relative position between the transparent display and the eye of the user is within the threshold position.

15. The computer-implemented method of claim 14 , further comprising:

measuring a relative position and orientation of the head mounted device with an inertial measurement unit;

measuring a position of the eye of the user and the eye gaze of the user using an eye gaze tracking sensor in the head mounted device; and

generating the threshold position to include a central region in the transparent display.

16. A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a computer, cause the computer to:

detect an initialization of the augmented reality application of a head mounted device;

cause a temporary display of an alignment indicator in the transparent display in response to detecting the initialization of the augmented reality application, the alignment indicator identifying a relative position between the HMD and a head of a user of the HMD;

measure a relative position between the transparent display and an eye of the user wearing the HMD as detected by the sensor, the alignment indicator comprising an augmented reality-based indicator that is based on the relative position; and

adjust the augmented reality-based indicator in response to a change in the relative position between the transparent display and the eye of the user wearing the HMD, the augmented reality-based indicator indicates a direction for the user to adjust the transparent display relative to the head of the user of the HMD.

Assignments (12)
CHANGE OF NAME Recorded Aug 3, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060936/0494 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 2, 2021
From: RPX CORPORATION
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 056777/0588 →
RELEASE OF SECURITY INTEREST Recorded Oct 26, 2020
From: JEFFERIES FINANCE LLC
To: RPX CORPORATION
Reel/Frame 054486/0422 →
PATENT SECURITY AGREEMENT Recorded Oct 23, 2020
From: RPX CLEARINGHOUSE LLC; RPX CORPORATION
To: BARINGS FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 054198/0029 →
PATENT SECURITY AGREEMENT Recorded Oct 23, 2020
From: RPX CLEARINGHOUSE LLC; RPX CORPORATION
To: BARINGS FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 054244/0566 →
RELEASE OF SECURITY INTEREST Recorded Aug 14, 2020
From: AR HOLDINGS I, LLC
To: DAQRI, LLC
Reel/Frame 053498/0580 →
PATENT SECURITY AGREEMENT Recorded Aug 14, 2020
From: RPX CORPORATION
To: JEFFERIES FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 053498/0095 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 5, 2020
From: DAQRI, LLC
To: RPX CORPORATION
Reel/Frame 053413/0642 →
RELEASE OF SECURITY INTEREST Recorded Oct 23, 2019
From: SCHWEGMAN, LUNDBERG & WOESSNER, P.A.
To: DAQRI, LLC
Reel/Frame 050805/0606 →
LIEN Recorded Oct 8, 2019
From: DAQRI, LLC
To: SCHWEGMAN, LUNDBERG & WOESSNER, P.A.
Reel/Frame 050672/0601 →
SECURITY INTEREST Recorded Jun 26, 2019
From: DAQRI, LLC
To: AR HOLDINGS I LLC
Reel/Frame 049596/0965 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 3, 2016
From: MULLINS, BRIAN; RIES, RYAN
To: DAQRI, LLC
Reel/Frame 038801/0534 →