Power budgeting for zonal adaptive illumination
Systems and methods are provided for managing illumination during image capture by a camera device through adjusting illumination on a per-frame basis in one or more sub-portions of an area. The camera device may be associated with a controllable illumination device configured to cause illumination adjustments to an area based on independent illumination attributes associated with at least two sub-portions of the area. Adjustments may be made dynamically as the area changes on a per-frame basis. The illumination device can include independently controllable illumination units can include a light emitting diode (LED) array in which individual LEDs in the LED array are independently controllable. Power allocations to individual LEDs may dynamically update as illumination is changed such that the power drawn by all LEDs in the array remains within a pre-determined power budget.
1 . A camera device comprising:
a first light emitting diode (LED);
a second LED;
a camera having a field of view (FOV);
one or more processors;
one or more non-transitory computer readable media storing processor-executable instructions which, when executed by the one or more processors, cause the camera device to perform operations comprising:
storing first thermal maximum data indicating a thermal maximum power budget for the first LED;
storing second thermal maximum data indicating a thermal maximum power budget for the second LED;
storing power budget data indicating a shared LED power budget;
determining a luma target value,
determining, based on first image data generated by the camera that corresponds to a first portion of the FOV of the camera, a first luma estimate value for a first channel associated with the first portion of the FOV of the camera,
determining, based on the luma target value and the first luma estimate value for the first channel, a first brightness adjustment value for the first channel,
determining, based on the first image data generated by the camera that corresponds to a second portion of the FOV of the camera, a second luma estimate value for a second channel associated with the second portion of the FOV of the camera,
determining, based on the luma target value and the second luma estimate value for the second channel, a second brightness adjustment value for the second channel,
determining first estimated power draw data for an adjustment to a first LED associated with the first channel based on the first brightness adjustment value;
determining second estimated power draw data for an adjustment to a second LED associated with the second channel based on the second brightness adjustment value;
determining, using the first estimated power draw data and the second estimated power draw data, estimated total power draw data;
determining, based on the estimated total power draw data and the power budget data indicating a shared LED power budget, that an estimated total power draw for planned adjustment of LEDs of the camera device is within the shared LED power budget;
based on the determining that the estimated total power draw for planned adjustment of LEDs of the camera device is within the shared LED power budget,
modifying an amount of current provided to the first LED associated with the first channel based on the second brightness adjustment value,
modifying an amount of current provided to the second LED associated with the second channel based on a fourth brightness adjustment value.
2 . The camera device of claim 1 , wherein the one or more non-transitory computer readable media store processor-executable instructions which, when executed by the one or more processors, cause the camera device to perform operations comprising
determining, based on the first estimated power draw data and the first thermal maximum data, whether a proposed adjustment to a first LED associated with the first channel based on the first brightness adjustment value would cause the first LED to exceed the thermal maximum power budget for the first LED.
3 . The camera device of claim 1 , wherein the camera device is a video doorbell device.
4 . A camera device comprising:
a first light emitting diode (LED);
a second LED;
a camera having a field of view (FOV);
one or more processors;
one or more non-transitory computer readable media storing processor-executable instructions which, when executed by the one or more processors, cause the camera device to perform operations comprising
storing power budget data indicating a shared LED power budget;
determining, based on a luma target value and on first image data generated by the camera that corresponds to a first portion of the FOV of the camera, a first brightness adjustment value for a first channel associated with the first portion of the FOV of the camera, the first portion of the FOV being less than an entirety of the FOV of the camera;
determining first power draw data for a first LED associated with the first channel indicating an estimated power draw for adjustment of the first LED based on the first brightness adjustment value;
determining second power draw data for a second LED associated with a second channel that is associated with a second portion of the FOV of the camera;
determining, using the first power draw data and the second power draw data, estimated total power draw data indicating an estimated total power draw for planned adjustment of one or more LEDs of the camera device;
determining, based on the estimated total power draw data and the power budget data indicating a shared LED power budget, that the estimated total power draw is within the shared LED power budget;
based on the determining that the estimated total power draw is within the shared LED power budget,
modifying an amount of current provided to the first LED associated with the first channel based on the first brightness adjustment value.
5 . The camera device of claim 4 , wherein the second power draw data is estimated power draw data.
6 . The camera device of claim 4 , wherein the second power draw data is estimated power draw data indicating an estimated power draw for adjustment of the second LED based on a second brightness adjustment value.
7 . The camera device of claim 4 , wherein the second power draw data is current power draw data for the second LED.
8 . The camera device of claim 4 , wherein the one or more non-transitory computer readable media store processor-executable instructions which, when executed by the one or more processors, cause the camera device to perform operations comprising
storing first thermal maximum data indicating a thermal maximum power budget for the first LED;
storing second thermal maximum data indicating a thermal maximum power budget for the second LED.
9 . The camera device of claim 4 , wherein the one or more non-transitory computer readable media store processor-executable instructions which, when executed by the one or more processors, cause the camera device to perform operations comprising
determining a luma target value,
determining, based on first image data generated by the camera that corresponds to the first portion of the FOV of the camera, a first luma estimate value for the first channel associated with the first portion of the FOV of the camera,
determining, based on the luma target value and the first luma estimate value for the first channel, the first brightness adjustment value for the first channel.
10 . The camera device of claim 4 , wherein the camera device is a video doorbell device.
11 . The camera device of claim 4 , wherein the camera device comprises a passive infrared sensor.
12 . The camera device of claim 4 , wherein the camera device comprises a radar sensor.
13 . The camera device of claim 4 , wherein the first LED second LED are both visible-light LEDs.
14 . The camera device of claim 4 , wherein the first LED second LED are both white LEDs.
15 . The camera device of claim 4 , wherein the first LED second LED are both infrared LEDs.
16 . A camera device comprising:
a first light emitting diode (LED);
a second LED;
a camera having a field of view (FOV);
one or more processors;
one or more non-transitory computer readable media storing processor-executable instructions which, when executed by the one or more processors, cause the camera device to perform operations comprising
storing power budget data indicating a shared LED power budget;
determining, based on a luma target value and on first image data generated by the camera that corresponds to a first portion of the FOV of the camera, a first brightness adjustment value for a first channel associated with the first portion of the FOV of the camera;
determining, based on a target value and on second image data generated by the camera that corresponds to a second portion of the FOV of the camera, a second brightness adjustment value for a second channel associated with the second portion of the FOV of the camera;
determining, based on the first brightness adjustment value, the second brightness adjustment value, and the power budget data,
a third brightness adjustment value for the first channel associated with the first portion of the FOV of the camera, and
a fourth brightness adjustment value for the second channel associated with the second portion of the FOV of the camera;
modifying an amount of current provided to a first LED associated with the first channel based on the third brightness adjustment value,
modifying an amount of current provided to a second LED associated with the second channel based on the fourth brightness adjustment value.
17 . The camera device of claim 16 , wherein the camera device is a video doorbell device.
18 . The camera device of claim 16 , wherein the first LED second LED are both white LEDs.
19 . The camera device of claim 4 , wherein modifying the amount of current provided to the first LED associated with the first channel is further based on at least one of: a smoothing value, an automatic exposure control luma target value, an automatic exposure control sensor gain value, or an updated electrical current value.
20 . The camera device of claim 16 , wherein modifying the amount of current provided to the first LED is further based on at least one of: a smoothing value, an automatic exposure control luma target value, an automatic exposure control sensor gain value, or an updated electrical current value.