IP Library Granted Patent US 9,844,119
Granted Patent B2
US 9,844,119 · App. 15/019,031 · Granted Dec 12, 2017

Dynamic lighting for head mounted device

Inventors: Brian Mullins (Sierra Madre, CA); Matthew Kammerait (West Hollywood, CA)
Assignee: DAQRI, LLC
H05B37/0218G02B27/017H05B33/0869H05B33/0872G02B2027/014G02B2027/0118G02B2027/0138G02B2027/0187Y02B20/46
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,844,119
App. No.
15/019,031
Granted
Dec 12, 2017
Kind
B2
Abstract

A head mounted device includes a helmet, an ambient light sensor, a pupil dimension sensor, a lighting element, and a dynamic lighting system. The ambient light sensor is disposed in an outside surface of the helmet and measures ambient light outside the helmet. The pupil dimension sensor is disposed in a housing of the helmet and measures a size of a pupil of a wearer of the helmet. The lighting element is disposed in the outside surface of the helmet. The dynamic lighting system controls the lighting element and adjusts an intensity of the lighting element based on the ambient light and the pupil size of the wearer of the helmet.

Claims (48)

1. A head mounted device comprising:

a helmet;

an ambient light sensor disposed in an outside surface of the helmet and configured to measure ambient light outside the helmet;

a pupil dimension sensor disposed in a housing of the helmet and configured to measure a size of a pupil of a wearer of the helmet;

a lighting element disposed in the outside surface of the helmet and directed away from the pupil of the wearer of the helmet, the lighting element being configured to illuminate a physical object external to the head mounted device; and

a dynamic lighting system configured to control the lighting element and adjust an intensity of the lighting element based on the ambient light and the pupil size of the wearer of the helmet.

2. The head mounted device of claim 1 , wherein the pupil dimension sensor comprises an infrared camera pointed towards an eye of the wearer of the helmet to capture an image of the pupil of the wearer, and to measure the size of the pupil based on the image of the pupil.

3. The head mounted device of claim 1 , wherein the dynamic lighting system is configured to increase the intensity of the lighting element in response to the pupil size exceeding a pupil size threshold.

4. The head mounted device of claim 1 , wherein the dynamic lighting system is configured to decrease the intensity of the lighting element in response to the pupil size falling below a pupil size threshold.

5. The head mounted device of claim 1 , wherein the dynamic lighting system is configured to adjust the intensity of the lighting element to maintain the size of the pupil within a predefined pupil size range.

6. The head mounted device of claim 1 , further comprising:

an eye gaze sensor configured to determine a position of the pupil relative to an eye of the wearer of the helmet,

wherein the dynamic lighting system is configured to adjust a position of the lighting element to direct an output of the lighting element in a direction corresponding to the position of the pupil.

7. The head mounted device of claim 1 , further comprising:

a camera embedded in the outside surface of the helmet;

a hardware processor of a machine comprising an augmented reality application configured to generate augmented reality content based on images captured with the camera; and

a transparent display lens mounted to a frame connected to the housing of the helmet, the transparent display lens configured to display the augmented reality content.

8. The head mounted device of claim 7 , wherein the pupil dimension sensor is embedded in the transparent display lens.

9. The head mounted device of claim 7 , wherein the dynamic lighting system is further configured to adjust a brightness of the augmented reality content in the transparent display lens in conjunction with the intensity of the lighting element based on the pupil size of the wearer of the helmet.

10. The head mounted device of claim 7 , wherein the augmented reality application is configured to identify an object in an image captured with the camera, to retrieve a three-dimensional model of a virtual object from the augmented reality content based on the identified object, to render the three-dimensional model of the virtual object in the transparent display lens, the virtual object perceived as an overlay on the object.

11. A method comprising:

measuring ambient light outside a head mounted device comprising a helmet, an ambient light sensor disposed in an outside surface of the helmet;

measuring a size of a pupil of a wearer of the helmet with a pupil dimension sensor disposed in a housing of the helmet; and

adjusting an intensity of a lighting element based on the ambient light and the pupil size of the wearer of the helmet, the lighting element being disposed in the outside surface of the helmet and being directed away from the pupil of the wearer of the helmet, the lighting element being configured to illuminate a physical object external to the head mounted device.

12. The method of claim 11 , further comprising:

measuring the size of the pupil of the wearer with an infrared camera pointed towards an eye of the wearer of the helmet to capture an image of the pupil of the wearer.

13. The method of claim 11 , further comprising:

increasing the intensity of the lighting element in response to the pupil size exceeding a pupil size threshold.

14. The method of claim 11 , further comprising:

decreasing the intensity of the lighting element in response to the pupil size falling below a pupil size threshold.

15. The method of claim 11 , further comprising:

adjusting the intensity of the lighting element to maintain the size of the pupil within a predefined pupil size range.

16. The method of claim 11 , further comprising:

determining a position of the pupil relative to the eye of the wearer of the helmet; and

adjusting a position of the lighting element to direct an output of the lighting element in a direction corresponding to the position of the pupil.

17. The method of claim 11 , further comprising:

generating augmented reality content based on images captured with a camera in the helmet; and

displaying augmented reality content in a transparent display lens of the helmet.

18. The method of claim 17 , further comprising:

adjusting a brightness of the augmented reality content in the transparent display lens in conjunction with the intensity of the lighting element based on the pupil size of the wearer of the helmet.

19. The method of claim 17 , further comprising:

identifying an object in an image captured with the camera;

retrieving a three-dimensional model of a virtual object from the augmented reality content based on the identified object; and

rendering the three-dimensional model of the virtual object in the transparent display lens, the virtual object perceived as an overlay on the object.

20. A non-transitory machine-readable medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

measuring ambient light outside a head mounted device comprising a helmet, an ambient light sensor disposed in an outside surface of the helmet;

measuring a size of a pupil of a wearer of the helmet with a pupil dimension sensor disposed in a housing of the helmet; and

adjusting an intensity of a lighting element based on the ambient light and the pupil size of the wearer of the helmet, the lighting element being disposed in the outside surface of the helmet and being directed away from the pupil of the wearer of the helmet, the lighting element being configured to illuminate a physical object external to the head mounted device.

Assignments (12)
CHANGE OF NAME Recorded Aug 3, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060936/0494 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 2, 2021
From: RPX CORPORATION
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 056777/0588 →
RELEASE OF SECURITY INTEREST Recorded Oct 26, 2020
From: JEFFERIES FINANCE LLC
To: RPX CORPORATION
Reel/Frame 054486/0422 →
PATENT SECURITY AGREEMENT Recorded Oct 23, 2020
From: RPX CLEARINGHOUSE LLC; RPX CORPORATION
To: BARINGS FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 054198/0029 →
PATENT SECURITY AGREEMENT Recorded Oct 23, 2020
From: RPX CLEARINGHOUSE LLC; RPX CORPORATION
To: BARINGS FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 054244/0566 →
RELEASE OF SECURITY INTEREST Recorded Aug 14, 2020
From: AR HOLDINGS I, LLC
To: DAQRI, LLC
Reel/Frame 053498/0580 →
PATENT SECURITY AGREEMENT Recorded Aug 14, 2020
From: RPX CORPORATION
To: JEFFERIES FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 053498/0095 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 5, 2020
From: DAQRI, LLC
To: RPX CORPORATION
Reel/Frame 053413/0642 →
RELEASE OF SECURITY INTEREST Recorded Oct 23, 2019
From: SCHWEGMAN, LUNDBERG & WOESSNER, P.A.
To: DAQRI, LLC
Reel/Frame 050805/0606 →
LIEN Recorded Oct 8, 2019
From: DAQRI, LLC
To: SCHWEGMAN, LUNDBERG & WOESSNER, P.A.
Reel/Frame 050672/0601 →
SECURITY INTEREST Recorded Jun 26, 2019
From: DAQRI, LLC
To: AR HOLDINGS I LLC
Reel/Frame 049596/0965 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 5, 2016
From: MULLINS, BRIAN; KAMMERAIT, MATTHEW
To: DAQRI, LLC
Reel/Frame 039357/0291 →
Continuity (2)
Provisional Application 62114195 · Feb 10, 2015
Related Publication 20160231573A1 · Aug 11, 2016