IP Library Granted Patent US 11,480,467
Granted Patent B2
US 11,480,467 · App. 16/982,426 · Granted Oct 25, 2022

Augmented reality system and method for spectroscopic analysis

Inventors: Adrian Kaehler (Los Angeles, CA); Christopher M. Harrises (Nashua, NH); Eric Baerenrodt (Milford, NH); Mark Baerenrodt (Millbrae, CA); Nastasja U. Robaina (Coconut Grove, FL); Nicole Elizabeth Samec (Ft. Lauderdale, FL); Tammy Sherri Powers (Coral Springs, FL); Ivan Li Chuen Yeoh (Tampa, FL); Adam Carl Wright (Ft. Lauderdale, FL)
Assignee: MAGIC LEAP, INC.
G01J3/0262G01J3/42G01N21/255G01N21/27G02B6/0076G02B27/0172G06F3/013G09G5/37G01N2201/0221G02B2027/0134G09G2354/00G09G2360/144
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,480,467
App. No.
16/982,426
Granted
Oct 25, 2022
Kind
B2
Abstract

Wearable spectroscopy systems and methods for identifying one or more characteristics of a target object are described. Spectroscopy systems may include a light source configured to emit light in an irradiated field of view and an electromagnetic radiation detector configured to receive reflected light from a target object irradiated by the light source. One or more processors of the systems may identify a characteristic of the target object based on a determined level of light absorption by the target object. Some systems and methods may include one or more corrections for scattered and/or ambient light such as applying an ambient light correction, passing the reflected light through an anti-scatter grid, or using a time-dependent variation in the emitted light.

Claims (56)

1. A wearable spectroscopy system comprising:

a head-mounted display system removably mountable on a user's head;

one or more head-mounted light sources coupled to the head-mounted display system and configured to emit light in an irradiated field of view;

one or more head-mounted electromagnetic radiation detectors coupled to the head-mounted display system and configured to receive reflected light from a target object irradiated by the one or more light sources within the irradiated field of view;

one or more processors; and

one or more computer storage media storing instructions that, when executed by the one or more processors, cause the system to perform operations comprising:

causing the one or more light sources to emit light;

causing the one or more electromagnetic radiation detectors to detect light from the irradiated field of view including the target object;

determining an ambient light correction by detecting ambient light levels;

applying the ambient light correction to the detected light to determine levels of light absorption related to the emitted light and reflected light from the target object;

identifying, based on the levels of light absorption, a characteristic of the target object; and

displaying an output associated with the characteristic of the target object to the user on the head-mounted display system.

2. The system of claim 1 , further comprising an absorption database of light absorption properties of a plurality of materials.

3. The system of claim 1 , wherein the ambient light correction comprises one or more of: an ambient light intensity value, an average of a plurality of ambient light intensity values, a median of a plurality of ambient light intensity values, and a time-domain ambient light intensity function.

4. The system of claim 1 , further comprising at least one eye tracking camera configured to detect a gaze of the user, wherein the irradiated field of view is substantially in the same direction as the detected gaze.

5. The system of claim 1 , wherein the one or more electromagnetic radiation detectors are further configured to detect the ambient light levels.

6. The system of claim 1 , further comprising an ambient light detector coupled to the head-mounted display system and configured to capture ambient light not emitted by the one or more light sources, the ambient light including one or more wavelengths emitted by the one or more light sources.

7. The system of claim 6 , wherein the ambient light detector comprises at least one of a photodiode, a photodetector, and a digital camera sensor.

8. The system of claim 6 , wherein the instructions, when executed by the one or more processors, further cause system to perform operations comprising:

causing the ambient light detector to detect light while the one or more light sources are not emitting light; and

determining the ambient light correction based at least in part on the light detected by the ambient light detector.

9. The system of claim 1 , further comprising an anti-scatter grid coupled to the head-mounted display system between the target object and the one or more electromagnetic radiation detectors, the anti-scatter grid aligned to attenuate at least a portion of scattered light and ambient light incident upon the anti-scatter grid.

10. The system of claim 9 , wherein the anti-scatter grid is further disposed between the target object and a detector for detecting ambient light levels.

11. The system of claim 1 , wherein the one or more light sources are configured to emit the light in a series of time-separated pulses, and wherein the instructions, when executed by the one or more processors, further cause the system to perform operations comprising:

identifying time-separated pulses of reflected light corresponding to the time-separated pulses emitted by the one or more light sources; and

determining the ambient light correction based at least in part on an intensity of light detected at the one or more electromagnetic radiation detectors between the time-separated pulses of reflected light.

12. The system of claim 11 , wherein the time-separated pulses of reflected light are detected at the one or more electromagnetic radiation detectors.

13. The system of claim 1 , wherein the one or more electromagnetic radiation detectors comprises at least one of a photodiode and a photodetector.

14. The system of claim 1 , wherein the one or more electromagnetic radiation detectors comprises a digital image sensor.

15. The system of claim 1 , further comprising an inertial measurement unit positional system.

16. The system of claim 15 , wherein the inertial measurement unit positional system determines a pose orientation of the user's head.

17. The system of claim 16 , wherein the irradiated field of view is at least as wide as the pose orientation.

18. The system of claim 1 , wherein the head-mounted display system comprises a waveguide stack configured to output light with selectively variable levels of wavefront divergence.

19. A wearable spectroscopy system comprising:

a head-mounted display removably mountable on a user's head;

one or more head-mounted light sources coupled to the head-mounted display system and configured to emit light in an irradiated field of view;

one or more head-mounted electromagnetic radiation detectors coupled to the head-mounted display system and configured to receive reflected light from a target object irradiated by the one or more light sources within the irradiated field of view;

one or more processors; and

one or more computer storage media storing instructions that, when executed by the one or more processors, cause the system to perform operations comprising:

detecting ambient light of a first wavelength within the irradiated field of view;

emitting light of the first wavelength toward the target object;

detecting light of the first wavelength reflected by the target object;

subtracting an intensity of the detected ambient light of the first wavelength from an intensity of the detected light reflected by the target object to calculate a level of light absorption related to the emitted light and the reflected light from the target object;

identifying, based on an absorption database of light absorption properties of a plurality of materials, a material characteristic of the target object; and

displaying, to the user, an output associated with the material characteristic.

20. A wearable spectroscopy system comprising:

a head-mounted display removably mountable on a user's head;

one or more head-mounted light sources coupled to the head-mounted display system and configured to emit light in an irradiated field of view;

one or more head-mounted electromagnetic radiation detectors coupled to the head-mounted display system and configured to receive reflected light from a target object irradiated by the one or more light sources within the irradiated field of view;

one or more processors; and

one or more computer storage media storing instructions that, when executed by the one or more processors, cause the system to perform operations comprising:

emitting light of a first wavelength in an irradiated field of view, the light comprising a time-encoded variation;

detecting light of the first wavelength reflected from a target object within the irradiated field of view;

identifying, based at least in part on the detected light and the time-encoded variation, an ambient light component of the detected light and a reflected component of the detected light;

identifying, based at least in part on the reflected component and an absorption database of light absorption properties of at least one material, a material characteristic of the target object; and

displaying, to the user, an output associated with the material characteristic.

Assignments (4)
SECURITY INTEREST Recorded May 24, 2022
From: MOLECULAR IMPRINTS, INC.; MENTOR ACQUISITION ONE, LLC; MAGIC LEAP, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 060338/0665 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 13, 2021
From: HARRISES, CHRISTOPHER M.; TECHNICAL SOULTIONS, INC.
To: MAGIC LEAP, INC.
Reel/Frame 056842/0772 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 13, 2021
From: BAERENRODT, ERIC; BAERENRODT, MARK; ROBAINA, NASTASJA U.; SAMEC, NICOLE ELIZABETH; POWERS, TAMMY SHERRI; YEOH, IVAN LI CHUEN; WRIGHT, ADAM CARL
To: MAGIC LEAP, INC.
Reel/Frame 056842/0846 →
PROPRIETARY INFORMATION AND INVENTIONS AGREEMENT Recorded Jul 13, 2021
From: KAEHLER, ADRIAN
To: MAGIC LEAP, INC.
Reel/Frame 056861/0416 →
Continuity (2)
Provisional Application 62646262 · Mar 21, 2018
Related Publication 20210080321A1 · Mar 18, 2021
Cited By (1)
US 12,585,114