IP Library › Granted Patent US 12,568,320
Granted Patent B2
US 12,568,320 · App. 18/312,369 · Granted Mar 3, 2026

Reducing auto-exposure latency

Inventors: Erik Daniel Kim (Sunnyvale, CA); Nirav Shailesh kumar Dharia (Milpitas, CA)
Assignee: Waymo LLC
H04N25/50
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,568,320
App. No.
18/312,369
Granted
Mar 3, 2026
Kind
B2
Abstract

Example embodiments relate to reducing auto-exposure latency. An example embodiment includes a method of reducing auto-exposure latency. The method includes determining, by a processor, a first setting of an exposure parameter for a first frame to be captured by an image sensor. The first setting of the exposure parameter is determined based at least in part on characteristics of a previous frame captured by the image sensor. The first setting of the exposure parameter is determined during a first frame period associated with capturing the first frame. The method also includes initiating, by the processor, a first frame exposure operation based on the first setting of the exposure parameter. During the first frame exposure operation, the image sensor captures the first frame during the first frame period.

Claims (33)

1 . A system comprising:

an image sensor;

a processor coupled to the image sensor, wherein the processor is configured to:

receive a first pre-exposure frame from the image sensor during a first frame period associated with capturing a first frame; and

determine a first setting of an exposure parameter for the first frame to be captured by the image sensor, wherein the first setting of the exposure parameter is determined based at least in part on characteristics of the first pre-exposure frame, wherein the first setting of the exposure parameter is determined during the first frame period, wherein the first frame period begins directly after a capture of a previous frame and ends directly after a capture of the first frame, and wherein a length of time of the first frame period corresponds to an inverse of a frame rate associated with the image sensor,

wherein the image sensor is configured to perform a first frame exposure operation based on the first setting of the exposure parameter, and

wherein, during the first frame exposure operation, the image sensor captures the first frame during the first frame period.

2 . The system of claim 1 , wherein the first pre-exposure frame is captured by the image sensor during the first frame period.

3 . The system of claim 1 , wherein the first pre-exposure frame is generated in response to sampling a subset of image pixels on the image sensor.

4 . The system of claim 3 , wherein the subset of image pixels are associated with a region of interest on the image sensor.

5 . The system of claim 4 , wherein the region of interest corresponds to a rectangular region proximate to a center section of the image sensor.

6 . The system of claim 4 , wherein the region of interest corresponds to one or more rows, one or more columns, or both.

7 . The system of claim 3 , wherein the subset of image pixels are distributed across the image sensor.

8 . The system of claim 1 , wherein the exposure parameter corresponds to an aperture size, an exposure time, an analog gain, or a digital gain.

9 . The system of claim 1 , wherein the processor is further configured to determine the first setting of the exposure parameter based on an external input.

10 . A method comprising:

receiving, by a processor, a first pre-exposure frame from an image sensor during a first frame period associated with capturing a first frame;

determining, by the processor, a first setting of an exposure parameter for the first frame to be captured by the image sensor, wherein the first setting of the exposure parameter is determined based at least in part on characteristics of the first pre-exposure frame, and wherein the first setting of the exposure parameter is determined during the first frame period, wherein the first frame period begins directly after a capture of a previous frame and ends directly after a capture of the first frame, and wherein a length of time of the first frame period corresponds to an inverse of a frame rate associated with the image sensor; and

initiating, by the processor, a first frame exposure operation based on the first setting of the exposure parameter, wherein, during the first frame exposure operation, the image sensor captures the first frame during the first frame period.

11 . The method of claim 10 , wherein the first pre-exposure frame is captured by the image sensor during the first frame period.

12 . The method of claim 10 , wherein the first pre-exposure frame is generated in response to sampling a subset of image pixels on the image sensor.

13 . The method of claim 12 , wherein the subset of image pixels are associated with a region of interest on the image sensor.

14 . The method of claim 13 , wherein the region of interest corresponds to a rectangular region proximate to a center section of the image sensor.

15 . The method of claim 13 , wherein the region of interest corresponds to one or more rows, one or more columns, or both.

16 . The method of claim 12 , wherein the subset of image pixels are distributed across the image sensor.

17 . The method of claim 10 , wherein the exposure parameter corresponds to an aperture size, an exposure time, an analog gain, or a digital gain.

18 . A non-transitory computer-readable medium comprising instructions that, when executed by processor, cause the processor to perform operations comprising:

receiving a first pre-exposure frame from an image sensor during a first frame period associated with capturing a first frame;

determining a first setting of an exposure parameter for the first frame to be captured by the image sensor, wherein the first setting of the exposure parameter is determined based at least in part on characteristics of the first pre-exposure frame, wherein the first setting of the exposure parameter is determined during the first frame period, and wherein the first frame period begins directly after a capture of a previous frame and ends directly after a capture of the first frame, and wherein a length of time of the first frame period corresponds to an inverse of a frame rate associated with the image sensor; and

initiating a first frame exposure operation based on the first setting of the exposure parameter, wherein, during the first frame exposure operation, the image sensor captures the first frame during the first frame period.

19 . The non-transitory computer-readable medium of claim 18 , wherein the first pre-exposure frame is captured by the image sensor during the first frame period.

20 . The non-transitory computer-readable medium of claim 18 , wherein the first pre-exposure frame is generated in response to sampling a subset of image pixels on the image sensor.

21 . The non-transitory computer-readable medium of claim 20 , wherein the subset of image pixels are associated with a region of interest on the image sensor.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 4, 2023
From: KIM, ERIK DANIEL; DHARIA, NIRAV SHAILESH KUMAR
To: WAYMO LLC
Reel/Frame 063540/0867 →
Continuity (1)
Related Publication 20240373142A1 · Nov 7, 2024
References Cited (26)
US 8040415B2 · Urisaka · 2011 [cited by applicant]
US 8558944B2 · Makii · 2013 [cited by applicant]
US 11482159B2 · Nagao et al. · 2022 [cited by applicant]
US 20050185075A1 · Neter · 2005 [cited by examiner]
US 20080309792A1 · Takagi · 2008 [cited by examiner]
US 20090147086A1 · Uchida · 2009 [cited by examiner]
US 20100214429A1 · Usui · 2010 [cited by examiner]
US 20130008964A1 · Hawyley et al. · 2013 [cited by applicant]
US 20140078341A1 · Havens et al. · 2014 [cited by applicant]
US 20150156388A1 · Neglur · 2015 [cited by applicant]
US 20180152662A1 · Takahashi · 2018 [cited by examiner]
US 20180278823A1 · Horesh · 2018 [cited by applicant]
US 20180295309A1 · Kuriyama et al. · 2018 [cited by applicant]
US 20180359410A1 · Ain-Kedem et al. · 2018 [cited by applicant]
US 20200068121A1 · Wang · 2020 [cited by applicant]
US 20210109585A1 · Fleming et al. · 2021 [cited by applicant]
US 20220006940A1 · Gao et al. · 2022 [cited by applicant]
US 20220261951A1 · Renschler et al. · 2022 [cited by applicant]
US 20220392250A1 · Qing et al. · 2022 [cited by applicant]
CN 110708475A · 2021 [cited by applicant]
CN 115297269A · 2022 [cited by applicant]
JP 2008022485A · 2008 [cited by applicant]
KR 2020047389A · 2020 [cited by applicant]
WO 2023015992A1 · 2023 [cited by applicant]
Emmanuel Onzon, Fahim Mannan, and Felix Heide, “Neural Auto-Exposure for High-Dynamic Range Object Detection”, The Computer Vision Foundation, Nov. 2, 2021, pp. 7710-7720. [cited by applicant]
Yang Ni, “QLog Solar-Cell Mode Photodiode logarithmic CMOS Pixel Using Charge Compression and Readout”, Sensors, Feb. 14, 2018, pp. 1-12. [cited by applicant]