IP Library › Granted Patent US 12,206,994
Granted Patent B2
US 12,206,994 · App. 17/903,810 · Granted Jan 21, 2025

Image capture systems utilizing adjustable illumination

Inventors: Roei Remez (Tel Aviv, IL); Refael Della Pergola (Jerusalem, IL); Dror Leshem (Maale Efraim, IL); Yuval Tsur (Tel Aviv, IL)
Assignee: Apple Inc.
H04N23/74G06T7/50G06T7/70G06T2207/10048G06T2207/30201
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,206,994
App. No.
17/903,810
Granted
Jan 21, 2025
Kind
B2
Abstract

Various embodiments disclosed herein include devices, systems, and methods for spatially controlling illumination provided by a flash module. The flash module includes a flash controller that controls light emitters of an emitter array according to an illumination profile. The illumination profile is selected to reduce a relative brightness to a target region of the flash module's field of illumination. The target region is associated with a portion of a target object identified in the field of illumination. In some instances, the target region corresponds to a portion of a user's eye that is positioned within the field of illumination. In other instances, the flash module is incorporated into a device, and the target region corresponds to a reflected image of a portion of the device that is positioned within the field of illumination.

Claims (64)

1. A device for illuminating a field of illumination, the device comprising:

a flash module comprising:

an emitter array comprising a plurality of light emitters;

a lens assembly positioned to image the emitter array onto the field of illumination; and

a flash controller configured to control the plurality of light emitters to generate light, wherein the flash controller is configured to:

determine that a portion of a face of a user including an eye of the user is positioned within the field of illumination;

select a first set of light emitters of the plurality of light emitters associated with a portion of the eye;

select a second set of light emitters of the plurality of light emitters associated with a region surrounding the portion of the eye;

control the first set of light emitters to emit light at a first set of brightness levels; and

control the second set of light emitters to emit light at a second set of brightness levels greater than the first set of brightness levels.

2. The device of claim 1 , further comprising a camera, wherein:

the camera captures an image while the flash controller controls the first set of light emitters to emit light at the first set of brightness levels and control the second set of light emitters to emit light at the second set of brightness levels greater than the first set of brightness levels.

3. The device of claim 1 , wherein the region surrounding the portion of the eye includes an additional portion of the eye.

4. The device of claim 1 , further comprising a depth sensor, wherein:

the flash controller determines a distance to the face using depth information obtained by the depth sensor; and

the flash controller selects the first set of brightness levels based on the determined distance.

5. The device of claim 1 , wherein the flash module comprises a diffractive element positioned to diffract light exiting the lens assembly.

6. The device of claim 1 , wherein the flash module comprises a microlens array positioned over the emitter array.

7. The device of claim 1 , wherein the emitter array comprises a display array.

8. A device for illuminating a field of illumination, the device comprising:

a flash module comprising:

an emitter array comprising a plurality of light emitters;

a lens assembly positioned to image the emitter array onto the field of illumination; and

a flash controller configured to control the plurality of light emitters to generate light, wherein the flash controller is configured to:

determine that a reflected image of the device including the flash module is positioned within the field of illumination;

select a first set of light emitters of the plurality of light emitters associated with a first portion of the reflected image that includes the flash module;

select a second set of light emitters of the plurality of light emitters associated with a region surrounding the first portion of the reflected image;

control the first set of light emitters to emit light at a first set of brightness levels; and

control the second set of light emitters to emit light at a second set of brightness levels greater than the first set of brightness levels.

9. The device of claim 8 , further comprising a camera, wherein:

the camera captures an image while the flash controller controls the first set of light emitters to emit light at the first set of brightness levels and controls the second set of light emitters to emit light at the second set of brightness levels greater than the first set of brightness levels.

10. The device of claim 8 , wherein the region surrounding the first portion of the reflected image includes a second portion of the reflected image.

11. The device of claim 8 , further comprising a depth sensor, wherein:

the flash controller determines a distance to the reflected image using depth information obtained by the depth sensor; and

the flash controller selects the first set of brightness levels based on the determined distance.

12. The device of claim 8 , wherein the flash module comprises a diffractive element positioned to diffract light exiting the lens assembly.

13. The device of claim 8 , wherein the flash module comprises a microlens array positioned over the emitter array.

14. The device of claim 8 , wherein the emitter array comprises a display array.

15. A method of illuminating a field of illumination using a flash module comprising a plurality of light emitters, the method comprising:

detecting an object positioned within the field of illumination;

identifying a first region of the field of illumination corresponding to a first portion of the detected object;

identifying a second region of the field of illumination corresponding to a second portion of the detected object; and

illuminating the field of illumination using the flash module, wherein:

the flash module illuminates the first region at a first set of illumination levels and the second region at a second set of illumination levels; and

the second set of illumination levels is greater than the first set of illumination levels.

16. The method of claim 15 , comprising:

capturing an image while illuminating the field of illumination using the flash module.

17. The method of claim 15 , comprising:

selecting an illumination profile, the illumination profile having a plurality of brightness levels, wherein:

each brightness level of the plurality of brightness levels is associated with a corresponding light emitter of the plurality of light emitters; and

illuminating the field of illumination comprises controlling each light emitter of the plurality of light emitters to generate light with the brightness level associated with the corresponding light emitter.

18. The method of claim 17 , wherein:

the plurality of light emitters comprises a first set of light emitters associated with the first region and a second set of light emitters associated with the second region; and

illuminating the field of illumination comprises:

controlling the first set of light emitters to generate light at a first set of brightness levels; and

controlling the second set of light emitters to generate light at a second set of brightness levels greater than the first set of brightness levels.

19. The method of claim 18 , wherein:

the first set of light emitters includes a first subset of light emitters and a second subset of light emitters;

the first set of brightness levels includes a first brightness level and a second brightness levels greater than the first subset of brightness level; and

controlling the first set of light emitters to generate light at a first set of brightness levels comprises:

controlling the first subset of light emitters to generate light at the first brightness level; and

controlling the second subset of light emitters to generate light at the second brightness level.

20. The method of claim 18 , wherein:

the first set of brightness levels is selected using a depth calculated between the object and the flash module.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 7, 2022
From: REMEZ, ROEI; PERGOLA, REFAEL DELLA; LESHEM, DROR; TSUR, YUVAL
To: APPLE INC.
Reel/Frame 061015/0973 →
Continuity (1)
Related Publication 20240080569A1 · Mar 7, 2024
References Cited (76)
US 7452087B2 · Imade · 2008 [cited by applicant]
US 7524097B2 · Turnbull et al. · 2009 [cited by applicant]
US 7530709B2 · Kikuchi et al. · 2009 [cited by applicant]
US 7637639B2 · Epstein · 2009 [cited by applicant]
US 8021006B2 · Shyu et al. · 2011 [cited by applicant]
US 8388190B2 · Li et al. · 2013 [cited by applicant]
US 8564004B2 · Tarsa et al. · 2013 [cited by applicant]
US 8761594B1 · Gross · 2014 [cited by examiner]
US 8786207B2 · Huang et al. · 2014 [cited by applicant]
US 9046634B2 · Shchekin et al. · 2015 [cited by applicant]
US 9109781B2 · Holder · 2015 [cited by applicant]
US 9470406B2 · Catalano · 2016 [cited by applicant]
US 9699377B2 · You · 2017 [cited by examiner]
US 9798070B2 · Van Bommel et al. · 2017 [cited by applicant]
US 9946055B2 · Krijn et al. · 2018 [cited by applicant]
US 9964283B2 · Kataoka · 2018 [cited by applicant]
US 10009527B2 · Jagt et al. · 2018 [cited by applicant]
US 10142554B2 · Ryu · 2018 [cited by examiner]
US 10222540B2 · Hikmet et al. · 2019 [cited by applicant]
US 10420177B2 · Stopa et al. · 2019 [cited by applicant]
US 10423050B2 · Yoshida · 2019 [cited by applicant]
US 10690986B2 · Firka et al. · 2020 [cited by applicant]
US 10837619B2 · Jiang · 2020 [cited by applicant]
US 10871268B2 · Jagt et al. · 2020 [cited by applicant]
US 10924686B2 · Antretter et al. · 2021 [cited by applicant]
US 11013079B2 · Jurik et al. · 2021 [cited by applicant]
US 11016192B2 · Pacala · 2021 [cited by examiner]
US 11022297B2 · Shum · 2021 [cited by applicant]
US 11131438B2 · Potter et al. · 2021 [cited by applicant]
US 11251347B2 · Streppel et al. · 2022 [cited by applicant]
US 11287727B2 · Weaver et al. · 2022 [cited by applicant]
US 11333953B2 · Song et al. · 2022 [cited by applicant]
US 11361460B2 · Schrama · 2022 [cited by examiner]
US 11435044B2 · Owoc et al. · 2022 [cited by applicant]
US 11627262B2 · Stec · 2023 [cited by examiner]
US 20040091255A1 · Chase et al. · 2004 [cited by applicant]
US 20080123350A1 · Choe et al. · 2008 [cited by applicant]
US 20090116210A1 · Cutler et al. · 2009 [cited by applicant]
US 20090278979A1 · Bayerl et al. · 2009 [cited by applicant]
US 20130335821A1 · Robinson et al. · 2013 [cited by applicant]
US 20150227025A1 · Park · 2015 [cited by examiner]
US 20180091710A1 · Huang et al. · 2018 [cited by applicant]
US 20210136298A1 · Stec · 2021 [cited by examiner]
US 20220217252A1 · Kang · 2022 [cited by examiner]
US 20220415863A1 · Masui · 2022 [cited by examiner]
US 20230086557A1 · Alaimo et al. · 2023 [cited by applicant]
US 20230359274A1 · Krukowski · 2023 [cited by examiner]
CN 205507328 · 2016 [cited by applicant]
CN 206162029 · 2017 [cited by applicant]
CN 207006046 · 2018 [cited by applicant]
CN 108253339 · 2018 [cited by applicant]
CN 209592076 · 2019 [cited by applicant]
CN 105785691 · 2020 [cited by applicant]
CN 112466859 · 2021 [cited by applicant]
CN 113824895 · 2021 [cited by applicant]
DE 102009034841 · 2011 [cited by applicant]
DE 102009047788 · 2011 [cited by applicant]
DE 102010014289 · 2011 [cited by applicant]
DE 102016111600 · 2016 [cited by applicant]
DE 102017112112 · 2018 [cited by applicant]
JP S63168902 · 1998 [cited by applicant]
JP 2004252469 · 2004 [cited by applicant]
JP 2005215634 · 2005 [cited by applicant]
JP 2008102199 · 2008 [cited by applicant]
JP 2008545123 · 2008 [cited by applicant]
JP 2011192494 · 2011 [cited by applicant]
JP 2011257163 · 2011 [cited by applicant]
JP 2020181027 · 2020 [cited by applicant]
KR 102153824 · 2020 [cited by applicant]
WO WO03087928 · 2003 [cited by applicant]
WO WO06010790 · 2006 [cited by applicant]
WO WO15197832 · 2015 [cited by applicant]
WO WO18185218 · 2018 [cited by applicant]
WO WO21005601 · 2021 [cited by applicant]
WO WO21084919 · 2021 [cited by applicant]
U.S. Appl. No. 17/851,294, filed Jun. 28, 2022, Alaimo, et al. [cited by applicant]