IP Library Granted Patent US 11,103,132
Granted Patent B2
US 11,103,132 · App. 16/443,773 · Granted Aug 31, 2021

Eye imaging in head worn computing

Inventors: John N. Border (Campbell, CA); John Haddick (Corte Madera, CA); Joseph Bietry (Chili, NY)
Assignee: Mentor Acquisition One, LLC
A61B3/14A61B3/0008A61B3/0025A61B3/0041A61B3/113A61B3/12A61B5/117A61B5/1171G02B27/017G02B27/0172G02C11/10G06F3/013G06F21/10G06F21/32G06K9/0061G06K9/00604G06K9/00617G02B2027/014G02B2027/0138G02B2027/0178G02B2027/0187
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,103,132
App. No.
16/443,773
Filed
Jun 17, 2019
Granted
Aug 31, 2021
Kind
B2
Art Unit
2872
USPC
726/28
Abstract

Head-worn computers with eye-imaging systems include a camera system positioned in a head-worn computer, wherein the camera system is further positioned to capture eye-image light that originates as reflections from a user's eye, wherein the camera system is further positioned to capture eye-image light as a reflection from a partially reflective surface that is positioned in front of an image display in the head-worn computer, wherein image light, from the image display, is transmitted through the partially reflective surface. A processor is adapted to cause the camera system to capture the eye-image light. The processor is further adapted to cause a comparison of the captured eye-image light with a pre-stored eye image of a known user of the head-worn computer. In the event the comparison confirms the identity of the known user, the user is granted permission to view content to be presented in a display of the head-worn computer.

Claims (66)

1. A system comprising:

one or more cameras configured for capturing images of one or more eyes of a user of a wearable head device, the wearable head device comprising the one or more cameras; and

one or more processors configured for monitoring the one or more eyes of the user for changes in eye performance based on the captured images, wherein the monitoring of the one or more eyes contributes to monitoring health of the user of the wearable head device,

wherein a selection of a timing or a rate of capture of the capturing of images of the one or more eyes of the user of the wearable head device is based on an indication of a selected use scenario from among multiple use scenarios, the selected use scenario associated with the images of the one or more eyes of the user, and

wherein the timing or the rate of capture of the capturing of images of the one or more eyes of the user of the wearable head device varies among the multiple use scenarios.

2. The system of claim 1 , wherein the wearable head device comprises the one or more processors.

3. The system of claim 1 , further comprising:

a communication structure configured for communicating data from the wearable head device, the wearable head device comprising the communication structure, wherein the communicated data is indicative of a monitored change in eye performance of the one or more eyes of the user of the wearable head device.

4. The system of claim 1 , wherein:

normal performance of the one or more eyes of the user of the wearable head device under various conditions is documented, and

the one or more processors are configured for monitoring the one or more eyes of the user for changes in eye performance from the documented normal performance of the one or more eyes.

5. The system of claim 1 , further comprising:

one or more sensors configured for detecting movements, the wearable head device comprising the one or more sensors,

wherein:

the selected use scenario is exercise,

the detected movements indicate that the user of the wearable head device is exercising,

the selection of the timing and or the rate of capture of the capturing of images of the one or more eyes of the user of the wearable head device is done automatically based on an indication of the selected use scenario being exercise, the selected use scenario associated with the images of the one or more eyes of the exercising use,

the wearable head device is configured to have the one or more cameras capture images of the one or more eyes of the exercising user in periodic intervals according to the selection of the timing or the rate of capture, and

the one or more processors are configured for monitoring the one or more eyes of the exercising user based on the images captured in the periodic intervals, wherein the monitoring of the one or more eyes contributes to monitoring health of the exercising user of the wearable head device.

6. The system of claim 1 , wherein a selection of a timing or a rate of capture of the capturing of images of the one or more eyes of the user of the wearable head device is adjusted automatically based on a mode of operation of the wearable head device.

7. The system of claim 1 , wherein a selection of a timing or a rate of capture of the capturing of images of the one or more eyes of the user of the wearable head device is in correspondence with an input characteristic associated with the user of the wearable head device.

8. The system of claim 7 , wherein the input characteristic associated with the user of the wearable head device includes age or health status.

9. The system of claim 1 , further comprising:

one or more sensors configured for sensing a physical condition of the user of the wearable head device,

wherein:

a selection of a timing or a rate of capture of the capturing of images of the one or more eyes of the user of the wearable head device is in correspondence with the sensed physical condition of the user of the wearable head device.

10. The system of claim 9 , wherein the sensed physical condition of the user of the wearable head device includes heart rate, chemical makeup of blood or eye blink rate.

11. The system of claim 10 , wherein the one or more cameras are included among the one or more sensors configured for sensing a physical condition of the user of the wearable head device.

12. A method comprising:

capturing, via one or more cameras, images of one or more eyes of a user of a wearable head device, the wearable head device comprising the one or more cameras; and

monitoring, via one or more processors, the one or more eyes of the user for changes in eye performance based on the captured images, wherein the monitoring of the one or more eyes contributes to monitoring health of the user of the wearable head device,

wherein a selection of a timing or a rate of capture of the capturing of images of the one or more eyes of the user of the wearable head device is based on an indication of a selected use scenario from among multiple use scenarios, the selected use scenario associated with the images of the one or more eyes of the user, and

wherein the timing or the rate of capture of the capturing of images of the one or more eyes of the user of the wearable head device varies among the multiple use scenarios.

13. The method of claim 12 , further comprising:

communicating, via a communication structure, data from the wearable head device, the wearable head device comprising the communication structure, wherein the communicated data is indicative of a monitored change in eye performance of the one or more eyes of the user of the wearable head device.

14. The method of claim 12 , further comprising:

detecting movements, via one or more sensors, the wearable head device comprising the one or more sensors,

wherein:

the selected use scenario is exercise,

the detected movements indicate that the user of the wearable head device is exercising,

the selection of the timing or the rate of capture of the capturing of images of the one or more eyes of the user of the wearable head device is done automatically based on an indication of the selected use scenario being exercise, the selected use scenario associated with the images of the one or more eyes of the exercising use,

the capturing, via the one or more cameras, images of one or more eyes of the user comprises capturing images of the one or more eyes of the exercising user in periodic intervals according to the selection of the timing or the rate of capture, and

the monitoring, via the one or more processors, the one or more eyes of the user comprises monitoring the one or more eyes of the exercising user based on the images captured in the periodic intervals, wherein the monitoring of the one or more eyes contributes to monitoring health of the exercising user of the wearable head device.

15. The method of claim 12 , further comprising:

sensing, via one or more sensors, a physical condition of the user of the wearable head device,

wherein:

a selection of a timing or a rate of capture of the capturing of images of the one or more eyes of the user of the wearable head device is in correspondence with the sensed physical condition of the user of the wearable head device.

16. A non-transitory computer-readable medium comprising instructions which, when executed, cause one or more processors to execute a method, the method comprising:

capturing, via one or more cameras, images of one or more eyes of a user of a wearable head device, the wearable head device comprising the one or more cameras; and

monitoring the one or more eyes of the user for changes in eye performance based on the captured images, wherein the monitoring of the one or more eyes contributes to monitoring health of the user of the wearable head device,

wherein a selection of a timing or a rate of capture of the capturing of images of the one or more eyes of the user of the wearable head device is based on an indication of a selected use scenario from among multiple use scenarios, the selected use scenario associated with the images of the one or more eyes of the user, and

wherein the timing or the rate of capture of the capturing of images of the one or more eyes of the user of the wearable head device varies among the multiple use scenarios.

17. The non-transitory computer-readable medium of claim 16 , the method further comprising:

communicating, via a communication structure, data from the wearable head device, the wearable head device comprising the communication structure, wherein the communicated data is indicative of a monitored change in eye performance of the one or more eyes of the user of the wearable head device.

18. The non-transitory computer-readable medium of claim 16 , the method further comprising:

detecting, via one or more sensors, movements, the wearable head device comprising the one or more sensors,

wherein:

the selected use scenario is exercise,

the detected movements indicate that the user of the wearable head device is exercising,

the selection of the timing or the rate of capture of the capturing of images of the one or more eyes of the user of the wearable head device is done automatically based on an indication of the selected use scenario being exercise, the selected use scenario associated with the images of the one or more eyes of the exercising use,

the capturing images of one or more eyes of the user comprises capturing images of the one or more eyes of the exercising user in periodic intervals according to the selection of the timing or the rate of capture, and

the monitoring the one or more eyes of the user comprises monitoring the one or more eyes of the exercising user based on the images captured in the periodic intervals, wherein the monitoring of the one or more eyes contributes to monitoring health of the exercising user of the wearable head device.

19. The non-transitory computer-readable medium of claim 16 , the method further comprising:

sensing, via one or more sensors, a physical condition of the user of the wearable head device,

wherein:

a selection of a timing or a rate of capture of the capturing of images of the one or more eyes of the user of the wearable head device is in correspondence with the sensed physical condition of the user of the wearable head device.

Assignments (4)
SECURED PARTY BILL OF SALE Recorded Nov 20, 2025
From: OSTERHOUT GROUP, INC.
To: JGB COLLATERAL, LLC
Reel/Frame 073641/0930 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 6, 2025
From: BORDER, JOHN N.; HADDICK, JOHN; BIETRY, JOSEPH
To: OSTERHOUT GROUP, INC.
Reel/Frame 072810/0876 →
ASSIGNMENT OF SECURITY INTEREST IN PATENTS Recorded Nov 7, 2019
From: JPMORGAN CHASE BANK, N.A.
To: CITIBANK, N.A.
Reel/Frame 050967/0138 →
PATENT SECURITY AGREEMENT Recorded Aug 22, 2019
From: MAGIC LEAP, INC.; MOLECULAR IMPRINTS, INC.; MENTOR ACQUISITION ONE, LLC
To: JP MORGAN CHASE BANK, N.A.
Reel/Frame 050138/0287 →