IP Library Granted Patent US 10,558,047
Granted Patent B2
US 10,558,047 · App. 15/713,420 · Granted Feb 11, 2020

Augmented reality spectroscopy

Inventors: Nicole Elizabeth Samec (Ft. Lauderdale, FL); Nastasja U. Robaina (Coconut Grove, FL); Adrian Kaehler (Los Angeles, CA); Mark Baerenrodt (Delray Beach, FL); Eric Baerenrodt (Milford, NH); Christopher M. Harrises (Nashua, NH); Tammy Sherri Powers (Coral Springs, FL)
Assignee: Magic Leap, Inc.
G02B27/0172G01J3/108G01J3/2823G01J3/427G01N21/359G01N33/483G02B6/0076G06F3/013G01J2003/106G01J2003/2826G01J2003/425G02B2027/014G02B2027/0125G02B2027/0138G06F3/012
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,558,047
App. No.
15/713,420
Granted
Feb 11, 2020
Kind
B2
Abstract

In some embodiments, a system comprises a head-mounted frame removably coupleable to the user's head; one or more light sources coupled to the head-mounted frame and configured to emit light with at least two different wavelengths toward a target object in an irradiation field of view of the light sources; one or more electromagnetic radiation detectors coupled to the head-mounted member and configured to receive light reflected after encountering the target object; and a controller operatively coupled to the one or more light sources and detectors and configured to determine and display an output indicating the identity or property of the target object as determined by the light properties measured by the detectors in relation to the light properties emitted by the light sources.

Claims (53)

1. A wearable spectroscopy system comprising:

a head-mounted display system removably coupleable to a user's head;

at least one eye tracking camera configured to detect a gaze of the user;

one or more light sources coupled to the head-mounted display system and configured to emit light with at least two different wavelengths in an irradiated field of view, wherein the spectroscopy system is configured to determine a gaze direction of the user and to direct light emission along substantially the same direction as the determined gaze direction;

one or more electromagnetic radiation detectors coupled to the head-mounted member and configured to receive reflected light from a target object within the irradiated field of view;

a controller operatively coupled to the one or more light sources and the one or more electromagnetic radiation detectors, the controller configured to cause the one or more light sources to emit pulses of light while also causing the one or more electromagnetic radiation detectors to detect levels of light absorption related to the emitted pulses of light and reflected light from the target object;

an absorption database of light absorption properties of at least one material; and

a graphics processor unit to display an output to the user

wherein the head-mounted display system comprises a waveguide stack configured to output light with selectively variable levels of wavefront divergence.

2. The system of claim 1 , wherein the waveguide stack comprises waveguides having optical power.

3. A wearable spectroscopy system comprising:

a head-mounted display system removably coupleable to a user's head;

at least one eye tracking camera configured to detect a gaze of the user;

one or more light sources coupled to the head-mounted display system and configured to emit light with at least two different wavelengths in an irradiated field of view substantially in the same direction as the detected gaze;

one or more electromagnetic radiation detectors coupled to the head-mounted member and configured to receive reflected light from a target object within the irradiated field of view;

a controller operatively coupled to the one or more light sources and the one or more electromagnetic radiation detectors, the controller configured to cause the one or more light sources to emit pulses of light while also causing the one or more electromagnetic radiation detectors to detect levels of light absorption related to the emitted pulses of light and reflected light from the target object;

an absorption database of light absorption properties of at least one material;

a graphics processor unit to display an output to the user; and

an inertial measurement unit positional system, wherein the inertial measurement systems determines a pose orientation of the user's head, and wherein the irradiated field of view is at least as wide as the pose orientation.

4. The system of claim 3 , wherein the head-mounted display system comprises a waveguide stack configured to output light with selectively variable levels of wavefront divergence.

5. A wearable spectroscopy system comprising:

a head-mounted display system removably coupleable to a user's head;

at least one eye tracking camera configured to detect a gaze of the user;

one or more light sources coupled to the head-mounted display system and configured to emit light with at least two different wavelengths in an irradiated field of view substantially in the same direction as the detected gaze;

one or more electromagnetic radiation detectors coupled to the head-mounted member and configured to receive reflected light from a target object within the irradiated field of view;

a controller operatively coupled to the one or more light sources and the one or more electromagnetic radiation detectors, the controller configured to cause the one or more light sources to emit pulses of light while also causing the one or more electromagnetic radiation detectors to detect levels of light absorption related to the emitted pulses of light and reflected light from the target object;

an absorption database of light absorption properties of at least one material; and

a graphics processor unit to display an output to the user,

wherein the head-mounted display system comprises a waveguide stack configured to output light with selectively variable levels of wavefront divergence.

6. The system of claim 5 , wherein the one or more light sources comprises a plurality of light emitting diodes.

7. The system of claim 5 , wherein the one or more light sources are configured to emit electromagnetic radiation at two or more predetermined wavelengths.

8. The system of claim 7 , wherein the one or more light sources are configured to emit electromagnetic radiation at a first wavelength of about 660 nanometers, and a second wavelength of about 940 nanometers.

9. The system of claim 7 , wherein the one or more light sources are configured to emit electromagnetic radiation at the two predetermined wavelengths sequentially.

10. The system of claim 7 , wherein the one or more light sources are configured to emit electromagnetic radiation at the two predetermined wavelengths simultaneously.

11. The system of claim 5 , wherein the controller is further configured to cause the one or more light sources to emit a cyclic pattern of a first wavelength on, then a second wavelength on, then both first and second wavelengths off, such that the one or more electromagnetic radiation detectors detect the first and second wavelengths separately.

12. The system of claim 5 , wherein the controller is configured to calculate a ratio of first wavelength light measurement to second wavelength light measurement, and wherein the system is configured to convert the ratio to a tissue property based on the absorption database.

13. The system of claim 12 , wherein the controller is operatively coupled to an optical element coupled to the head-mounted member and viewable by the user, wherein the system is configured to provide an output based on the tissue property, wherein the output is viewable by the user through the optical element.

14. The system of claim 5 , wherein the one or more electromagnetic radiation detectors comprises a device selected from the group consisting of: a photodiode, a photodetector.

15. The system of claim 5 , wherein the one or more electromagnetic radiation detectors comprises a digital image sensor.

16. The system of claim 15 , wherein the digital image sensor comprises a plurality of pixels, and wherein the controller is configured to automatically detect a subset of pixels which are receiving the light reflected after encountering a predetermined tissue property and to produce an output that displays the location of the subset of pixels indicating the predetermined tissue property.

17. The system of claim 5 , wherein the head-mounted member further comprises an inertial measurement unit positional system.

18. The system of claim 17 , wherein the inertial measurement systems determines a pose orientation of the user's head.

19. The system of claim 18 , wherein the irradiated field of view is at least as wide as the pose orientation.

20. The system of claim 5 , wherein the waveguide stack comprises waveguides having optical power.

21. A wearable spectroscopy system comprising:

a head-mounted display system removably coupleable to a user's head;

at least one eye tracking camera configured to detect a gaze of the user;

one or more light sources coupled to the head-mounted display system and configured to emit light with at least two different wavelengths in an irradiated field of view, wherein the spectroscopy system is configured to determine a gaze direction of the user and to direct light emission along substantially the same direction as the determined gaze direction;

one or more electromagnetic radiation detectors coupled to the head-mounted member and configured to receive reflected light from a target object within the irradiated field of view;

a controller operatively coupled to the one or more light sources and the one or more electromagnetic radiation detectors, the controller configured to cause the one or more light sources to emit pulses of light while also causing the one or more electromagnetic radiation detectors to detect levels of light absorption related to the emitted pulses of light and reflected light from the target object;

an absorption database of light absorption properties of at least one material;

a graphics processor unit to display an output to the user; and

an inertial measurement unit positional system, wherein the inertial measurement systems determines a pose orientation of the user's head, and wherein the irradiated field of view is at least as wide as the pose orientation.

Assignments (5)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 18, 2019
From: SAMEC, NICOLE ELIZABETH; ROBAINA, NASTASJA U.; BAERENRODT, MARK; BAERENRODT, ERIC; POWERS, TAMMY SHERRI
To: MAGIC LEAP, INC.
Reel/Frame 051320/0392 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 18, 2019
From: HARRISES, CHRISTOPHER M.
To: MAGIC LEAP, INC.
Reel/Frame 051320/0440 →
PROPRIETARY INFORMATION AND INVENTIONS AGREEMENT Recorded Dec 18, 2019
From: KAEHLER, ADRIAN
To: MAGIC LEAP, INC.
Reel/Frame 051365/0840 →
ASSIGNMENT OF SECURITY INTEREST IN PATENTS Recorded Nov 7, 2019
From: JPMORGAN CHASE BANK, N.A.
To: CITIBANK, N.A.
Reel/Frame 050967/0138 →
PATENT SECURITY AGREEMENT Recorded Aug 22, 2019
From: MAGIC LEAP, INC.; MOLECULAR IMPRINTS, INC.; MENTOR ACQUISITION ONE, LLC
To: JP MORGAN CHASE BANK, N.A.
Reel/Frame 050138/0287 →