Systems and methods of eliminating video flicker caused by LED duty cycling to maintain brightness and control power consumption
A video camera system includes a video capture device and a camera controller. The video capture device includes a sensor that receives light, a shutter that selectively permits the light to be received at the sensor based on a shutter speed, and a frame processor that generates a plurality of video frames based on the light. The camera controller includes a frame parameter calculator that calculates a luminance parameter of the plurality of frames, a frequency domain analyzer that executes a frequency domain analysis based on the luminance parameter to generate a plurality of luminance amplitude values mapped to a plurality of frequencies, and a control signal generator that generates a target shutter speed based on the plurality of luminance amplitude values mapped to the plurality of frequencies, and transmits a control signal based on the target shutter speed to cause the shutter to operate at the target shutter speed.
1. A video camera system, comprising:
a video capture device to generate a plurality of frames, the video capture device comprising a shutter to selectively permit light to be received for generating the plurality of frames based on a shutter speed; and
one or more processors to:
determine a first luminance of a first frame of the plurality of frames and a second luminance of a second frame of the plurality of frames;
compare the first luminance of the first frame with the second luminance of the second frame to determine a highest expected luminance;
determine a target shutter speed for the shutter based on a frequency corresponding to the highest expected luminance;
cause the shutter to operate at the target shutter speed;
determine that a change in luminance between consecutive frames of the plurality of frames is greater than a threshold change in luminance;
compare the target shutter speed to a minimum shutter speed;
adjust the target shutter speed to determine an adjusted target shutter speed responsive to determining that the change in luminance is greater than the threshold change in luminance and to be equal to the minimum shutter speed responsive to the target shutter speed being less than the minimum shutter speed; and
cause the shutter to operate at the adjusted target shutter speed.
2. The video camera system of claim 1 , comprising:
the one or more processors are to adjust the target shutter speed to reduce the change in luminance to be less than the threshold change in luminance.
3. The video camera system of claim 1 , comprising:
the first luminance is an average luminance of the first frame and the second luminance is an average luminance of the second frame.
4. The video camera system of claim 1 , comprising:
the one or more processors are to determine at least one of a periodicity or a frequency of a flicker in the plurality of frames.
5. The video camera system of claim 1 , comprising:
the one or more processors are to iteratively adjust the target shutter speed.
6. The video camera system of claim 1 , comprising:
the one or more processors are to determine, for each frame of the plurality of frames, a luminance amplitude value for a plurality of frequencies.
7. The video camera system of claim 1 , comprising:
the one or more processors are to determine an initial target shutter speed based on frequency analysis of the first luminance of the first frame.
8. The video camera system of claim 1 , comprising:
the plurality of frames are based on light from a plurality of luminaires having differing flicker frequencies or pulse width modulation (PWM) control schemes.
9. A method, comprising:
generating, by a video capture device, a plurality of frames, the video capture device comprising a shutter to selectively permit light to be received for generating the plurality of frames based on a shutter speed;
determining, by one or more processors, a first luminance of a first frame of the plurality of frames and a second luminance of a second frame of the plurality of frames;
comparing, by the one or more processors, the first luminance of the first frame with the second luminance of the second frame to determine a highest expected luminance;
determining, by the one or more processors, a target shutter speed for the shutter based on a frequency corresponding to the highest expected luminance;
causing, by the one or more processors, the shutter to operate at a target shutter speed responsive to the at least one luminance parameter;
determining, by the one or more processors, that a change in luminance between consecutive frames of the plurality of frames is greater than a threshold change in luminance;
comparing, by the one or more processors, the target shutter speed to a minimum shutter speed;
adjusting, by the one or more processors, the target shutter speed to determine an adjusted target shutter speed responsive to determining that the change in luminance is greater than the threshold change in luminance and to be equal to the minimum shutter speed responsive to the target shutter speed being less than the minimum shutter speed; and
causing, by the one or more processors, the shutter to operate at the adjusted target shutter speed.
10. The method of claim 9 , comprising:
adjusting, by the one or more processors, the target shutter speed to reduce the change in luminance to be less than the threshold change in luminance.
11. The method of claim 9 , comprising:
determining, by the one or more processors, the first luminance as an average luminance of the first frame and the second luminance as an average luminance of the second frame.
12. The method of claim 9 , comprising:
determining, by the one or more processors, at least one of a periodicity or a frequency of a flicker in the plurality of frames.
13. The method of claim 9 , comprising:
iteratively adjusting, by the one or more processors, the target shutter speed.
14. The method of claim 9 , comprising:
determining, by the one or more processors for each frame of the plurality of frames, a luminance amplitude value for a plurality of frequencies.
15. The method of claim 9 , comprising:
determining, by the one or more processors, an initial target shutter speed based on frequency analysis of the first luminance of the first frame.
16. The method of claim 9 , comprising:
the plurality of frames are based on light from a plurality of luminaires having differing flicker frequencies or pulse width modulation (PWM) control schemes.