IP Library Granted Patent US 11,087,550
Granted Patent B2
US 11,087,550 · App. 16/679,260 · Granted Aug 10, 2021

Wearable electronic glasses with eye tracking

Inventor: Philip Scott Lyren (Hong Kong, CN)
G06T19/006G02B27/0093G02B27/017G02B27/0172G06F1/163G06F3/012G06F40/51G02B2027/014G02B2027/0138G02B2027/0141G02B2027/0178
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,087,550
App. No.
16/679,260
Granted
Aug 10, 2021
Kind
B2
Abstract

Wearable electronic glasses (WEG) include an eye tracker that tracks a direction of gaze of a user wearing the WEG. A display displays three-dimensional (3D) augmented reality (AR) instructions how to operate an electronic device in response to detecting the direction of gaze of the user is at the electronic device that is visible through the display of the WEG.

Claims (48)

1. A method comprising:

tracking, with wearable electronic glasses (WEG) worn on a head of a user, a direction of gaze of the user;

displaying, on a display of the WEG, three-dimensional (3D) virtual instructions how to operate an electronic device in response to detecting the direction of gaze of the user is at the electronic device that is visible through the display of the WEG; and

preventing the virtual instructions from moving outside a field of view of the WEG and being no longer visible to the user by moving the virtual instructions from being displayed at one location on the display to being displayed at another location on the display when movement of the WEG will cause the virtual instructions to move outside the field of view.

2. The method of claim 1 further comprising:

discontinuing the displaying of the 3D virtual instructions how to operate the electronic device in response to detecting the direction of gaze of the user is no longer at the electronic device.

3. The method of claim 1 further comprising:

playing audio instructions how to operate the electronic device in response to detecting the direction of gaze of the user is at the electronic device; and

discontinuing the playing of the audio instructions how to operate the electronic device in response to detecting the direction of gaze of the user is no longer at the electronic device, wherein the WEG simultaneously displays the 3D virtual instructions and plays the audio instructions while the direction of gaze of the user is at the electronic device.

4. The method of claim 1 further comprising:

displaying, on the display of the WEG, the 3D virtual instructions next to the electronic device while the direction of gaze of the user is at the electronic device and the electronic device appears in the field of view of the WEG.

5. The method of claim 1 further comprising:

setting a playback location that is a physical location where the user must be in order to activate the 3D virtual instructions; and

activating playing of the 3D virtual instructions when the user arrives at the playback location.

6. The method of claim 1 further comprising:

sensing, with the WEG, motion of a hand of the user that draws a shape in air around the electronic device; and

displaying, on a display of second WEG worn on a head of a second user, the shape as a 3D virtual image around the electronic device in response to detecting that a direction of gaze of the second user is at the electronic device.

7. The method of claim 1 further comprising:

activating, while the direction of gaze of the user is at the electronic device, a message mode that records a voice of the user; and

playing, with second WEG worn on a head of a second user, the voice of the user that was recorded in response to detecting that a direction of gaze of the second user is at the electronic device.

8. The method of claim 1 further comprising:

displaying, on the display of the WEG, a 3D virtual electronic device that emulates the electronic device in response to detecting the direction of gaze of the user is at the electronic device; and

discontinuing the displaying of the 3D virtual electronic device in response to detecting the direction of gaze of the user is no longer at the electronic device.

9. A non-transitory computer readable storage medium storing instructions that cause one or more electronic devices to execute a method comprising:

tracking, with wearable electronic glasses (WEG) worn on a head of a user, a direction of gaze of the user;

displaying, on a display of the WEG, three-dimensional (3D) augmented reality (AR) instructions how to operate an electronic device in response to detecting the direction of gaze of the user is at the electronic device that is visible through the display of the WEG; and

avoiding a collision between the 3D AR instructions and a perimeter of a field of view of the WEG by moving the 3D AR instructions to another location where more space exists in the field of view of the WEG.

10. The non-transitory computer readable storage medium storing instructions of claim 9 in which the method further comprises:

automatically displaying, on the display of the WEG, a 3D AR object that emulates the electronic device in response to detecting eyes of the user are focused on the electronic device that is visible through the display of the WEG; and

automatically removing, from the display of the WEG, the 3D AR object that emulates the electronic device in response to detecting the eyes of the user are not focused on the electronic device that is visible through the display of the WEG.

11. The non-transitory computer readable storage medium storing instructions of claim 9 in which the method further comprises:

automatically displaying, on the display of the WEG and in response to detecting eyes of the user are looking at the electronic device, a 3D virtual assistant that provides instructions to the user on how to operate the electronic device; and

automatically removing, from the display of the WEG, the 3D virtual assistant in response to detecting the eyes of the user are not looking at the electronic device that is visible through the display of the WEG.

12. The non-transitory computer readable storage medium storing instructions of claim 9 in which the method further comprises:

determining, by the WEG, a location of the 3D AR instructions; and

sharing, by the WEG, the location of the 3D AR instructions with a second WEG worn on a head of a second user to enable the second WEG to display the 3D AR instructions at the location.

13. The non-transitory computer readable storage medium storing instructions of claim 9 in which the method further comprises:

displaying on the display of the WEG, the 3D AR instructions on one side of the electronic device that is visible through the display of the WEG; and

automatically moving the 3D AR instructions to an opposite side of the electronic device in response to detecting that movement of the WEG will cause the field of view of the WEG to not include the 3D AR instructions.

14. The non-transitory computer readable storage medium storing instructions of claim 9 in which the method further comprises:

moving the 3D AR instructions closer to the electronic device in response to determining that a distance between the 3D AR instructions and the field of view of the WEG is decreasing.

15. Wearable electronic glasses (WEG), comprising:

an eye tracker that tracks a direction of gaze of a user wearing the WEG; and

a display that displays three-dimensional (3D) augmented reality (AR) instructions how to operate an electronic device in response to detecting the direction of gaze of the user is at the electronic device that is visible through the display of the WEG, wherein the display moves a location of the 3D AR instructions from one side of the electronic device that is visible through the display to an opposite side of the electronic device to avoid a collision of the 3D AR instructions with a perimeter of a field of view of the WEG when the WEG moves.

16. The WEG of claim 15 further comprising:

a sensor that senses hand gestures of hands of the user wearing the WEG, wherein the display displays AR hands that replicate movements of the hand gestures of the hands of the user.

17. The WEG of claim 15 , wherein the display simultaneously displays a 3D AR image that emulates the electronic device and the 3D AR instructions as virtual hands that move with respect to the 3D AR image in order to show the user how to operate the electronic device that is visible through the display of the WEG.

18. The WEG of claim 15 , wherein the display moves the location of the 3D AR instructions closer to the electronic device that is visible through the display in order to avoid the collision between the 3D AR instructions and the perimeter of the field of view of the WEG.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 31, 2022
From: LYREN, PHILIP SCOTT
To: ADVANCED AR SYSTEMS, LLC
Reel/Frame 061588/0975 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 9, 2021
From: LYREN, WILLIAM JAMES
To: LYREN, PHILIP SCOTT
Reel/Frame 056798/0214 →
Continuity (4)
Continuation 15423567 · Feb 2, 2017
Continuation 15017587 · Feb 6, 2016
Continuation 14044091 · Oct 2, 2013
Related Publication 20200074745A1 · Mar 5, 2020
Cited By (3)
US 12,229,383 US 12,423,972 US 12,450,662