IP Library Granted Patent US 10,539,787
Granted Patent B2
US 10,539,787 · App. 15/071,904 · Granted Jan 21, 2020

Head-worn adaptive display

Inventors: John D. Haddick (Mill Valley, CA); Ralph F. Osterhout (San Francisco, CA)
Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
G02B27/0093G02B27/017G02B27/0172G06F1/163G06F3/011G06F3/013G06F3/016G06F3/017G06F3/0304G06F3/03547G06F3/0428G02B2027/014G02B2027/0138G02B2027/0187G06F2203/0331G06F2203/0338G06K9/00255G06K9/00671
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,539,787
App. No.
15/071,904
Granted
Jan 21, 2020
Kind
B2
Abstract

This disclosure concerns an interactive head-mounted eyepiece with an integrated processor for handling content for display and an integrated image source for introducing the content to an optical assembly through which the user views a surrounding environment and the displayed content. The optical assembly includes absorptive polarizers or anti-reflective coatings to reduce stray light.

Claims (33)

1. A head-mounted display device, comprising:

an optical assembly through which at least a part of a surrounding environment and also displayed content are viewable;

an integrated sensor configured to acquire sensor data relating to the surrounding environment, the integrated sensor comprising an image sensor configured to acquire image data of the surrounding environment;

an integrated processor for handling the sensor data and content for presentation to a user, the integrated processor configured to recognize an environmental feature in the surrounding environment based on the image data acquired by the image sensor;

an image source configured to introduce content to the optical assembly; and

a communications facility configured to connect the head-mounted display device to a hand held remote control comprising a haptic interface and to send a request to the hand held remote control to output a haptic notification upon recognition of the environmental feature in the surrounding environment based on the image data acquired by the image sensor of the head-mounted display device, the hand held remote control further being configured to communicate with and control the head-mounted display device, and

the integrated processor being further configured to display virtual content providing information regarding the environmental feature via the image source and optical assembly upon recognition of the environmental feature.

2. The head-mounted display device of claim 1 , wherein the hand held remote control comprises one or more of a wrap, a ring, a pad, a glove, a bracelet, and a watch.

3. The head-mounted display device of claim 1 , wherein the request comprises a request to output one or more of a vibration, a force, a pressure, an electrical impulse, and a temperature output.

4. The head-mounted display device of claim 1 , wherein the head-mounted display device is configured to send the request to the haptic interface to output the haptic notification upon receipt of a message from a remote computing system.

5. The head-mounted display device of claim 1 , wherein the head-mounted display device comprises an object recognition application executable to recognize an object in the surrounding environment via the image data, and wherein the head-mounted display device is further configured to send the request to the haptic interface for the haptic notification upon recognition of the object.

6. The head-mounted display device of claim 5 , wherein the object recognition application comprises facial recognition software and is configured to recognize a face via the image data of the surrounding environment, and wherein the head-mounted display device is further configured to send the request to the haptic interface for the haptic notification upon recognition of the face.

7. The head-mounted display device of claim 5 , wherein the head-mounted display device is configured to send the request to the haptic interface for the haptic notification upon detecting that the user is approaching an object.

8. The head-mounted display device of claim 1 , wherein the haptic interface is further configured to accept control inputs from the user and send the control inputs to the head-mounted display device.

9. A head-mounted display device, comprising:

an optical assembly through which at least a part of a surrounding environment and also displayed content are viewable;

an integrated sensor configured to acquire sensor data relating to the surrounding environment, the integrated sensor comprising an image sensor configured to acquire image data of the surrounding environment;

an integrated processor for handling the sensor data and content for presentation to a user, the integrated processor being configured to recognize an environmental feature based on the image data of the surrounding environment;

an image source configured to introduce content to the optical assembly; and

a communications facility configured to connect the head-mounted display device to a hand held remote control comprising a haptic interface and to, upon recognition of the environmental feature based on the image data acquired by the image sensor of the head-mounted display device, send a request to the hand held remote control to output a haptic notification regarding the environmental feature, the hand held remote control further being configured to communicate with and control the head-mounted display device, and

the integrated processor being further configured to display virtual content providing information regarding the environmental feature via the image source and optical assembly upon recognition of the environmental feature.

10. The head-mounted display device of claim 9 , wherein the head-mounted display device is configured to send the request to the haptic interface by sending the request to a haptic output device located on one or more of a wrap, a ring, a pad, a glove, a bracelet, and a watch.

11. The head-mounted display device of claim 9 wherein the head-mounted display device is configured to send the request to the haptic interface by sending the request to a haptic output device located on a handheld device.

12. The head-mounted display device of claim 9 , wherein the request to the haptic interface comprises a request to output one or more of a vibration, a force, a pressure, an electrical impulse, and a temperature output.

13. The head-mounted display device of claim 9 , wherein the head-mounted display device is further configured to receive a message from a remote computing system, and send the message from the remote computing system to a haptic output device for display on the haptic output device.

14. The head-mounted display device of claim 9 , wherein the head-mounted display device comprises an object recognition application executable to recognize an object in the surrounding environment via the image data, and wherein the head-mounted display device is further configured to send the request to the hand held remote control for the haptic notification upon recognition of the object.

15. The head-mounted display device of claim 9 , wherein the object recognition application comprises facial recognition software and is configured to recognize a face via the image data of the surrounding environment, and wherein the head-mounted display device is further configured to send the request to the hand held remote control for the haptic notification upon recognition of the face.

16. The head-mounted display device of claim 9 , wherein the communications facility is configured to connect the head-mounted display device to a watch device.

17. A system, comprising:

a head-mounted display device comprising an optical assembly through which at least a part of a surrounding environment and also displayed content are viewable, one or more image sensors configured to acquire image data of the surrounding environment, an integrated processor for handling content for presentation to a user, and an image source configured to introduce content to the optical assembly; and

a hand held remote game controller comprising a haptic interface and configured to output a haptic notification upon recognition of an environmental feature in the surrounding environment based on the image data acquired by the image sensor of the head-mounted display device, the hand held remote game controller further being configured to communicate with and control the head-mounted display device, and

the integrated processor being configured to recognize the environmental feature in the surrounding environment based on the image data acquired by the image sensor, and the integrated processor being further configured to display virtual content providing information regarding the environmental feature via the image source and optical assembly upon recognition of the environmental feature.

18. The system of claim 17 , wherein the haptic interface is configured to output the haptic notification through one or more of vibration, force, pressure, electrical impulse, and temperature.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 16, 2016
From: MICROSOFT CORPORATION
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 038003/0831 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 16, 2016
From: HADDICK, JOHN D.; OSTERHOUT, RALPH F.
To: OSTERHOUT GROUP, INC.
Reel/Frame 038119/0542 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 16, 2016
From: OSTERHOUT GROUP, INC.
To: MICROSOFT CORPORATION
Reel/Frame 038121/0071 →
Continuity (18)
Continuation 13429721 · Mar 26, 2012
Continuation In Part 13341758 · Dec 30, 2011
Continuation In Part 13232930 · Sep 14, 2011
Continuation In Part 13037324 · Feb 28, 2011
Continuation In Part 13037335 · Feb 28, 2011
Provisional Application 61584029 · Jan 6, 2012
Provisional Application 61557289 · Nov 8, 2011
Provisional Application 61504513 · Jul 5, 2011
Provisional Application 61487371 · May 18, 2011
Provisional Application 61483400 · May 6, 2011
Provisional Application 61472491 · Apr 6, 2011
Provisional Application 61429445 · Jan 3, 2011
Provisional Application 61429447 · Jan 3, 2011
Provisional Application 61410983 · Nov 8, 2010
Provisional Application 61382578 · Sep 14, 2010
Provisional Application 61373791 · Aug 13, 2010
Provisional Application 61308973 · Feb 28, 2010
Related Publication 20160209648A1 · Jul 21, 2016
Cited By (18)
US 12,205,581 US 12,237,066 US 12,265,387 US 12,295,905 US 12,299,557 US 12,320,504 US 12,347,341 US 12,392,583 US 12,496,519 US 12,554,128 US 12,567,282 US 12,578,834 US 12,591,137 US 12,602,971 US 12,608,964 US 12,635,744 US 12,700,296 US 12,710,662