Driving dual modulation display systems using key frames
Methods and systems process image data made up of a series of frames for displaying on a dual modulation display system having a first modulator disposed to illuminate a second modulator. A first modulation signal and a luminance map are not calculated for every frame. Instead, certain frames referred to as “key frames” are used to provide the first modulation signal and the luminance map for at least some other frames.
1. Apparatus for driving a display to display a sequence of video frames, the display comprising a first modulator disposed to illuminate a second modulator, the apparatus comprising:
a processor configured to:
for each of the video frames output a first modulator driving signal for controlling the first modulator to emit light and output a second modulator driving signal for controlling the second modulator to modulate light emitted by the first modulator to display an image defined by image data for the video frame;
wherein the processor is configured to:
in response to key frame image data for a key video frame of the video frames, generate and output a first modulator driving signal for the key frame;
generate a key frame luminance map based on the first modulator driving signal for the key frame;
generate and output a second modulator driving signal for the key frame based at least on the key frame luminance map and the key frame image data;
for one or more additional frames subsequent to the key frame, output the first modulator driving signal for the key frame and generate and output a second modulator driving signal based at least on the key frame luminance map and image data for the one or more additional frames.
2. Apparatus according to claim 1 wherein, for the key frame and for each of the N frames following the key frame, the processor is configured to output the first modulator driving signal for the key frame.
3. Apparatus according to claim 2 wherein the processor is configured to designate every N+1 th frame of the sequence of video frames as a key frame.
4. Apparatus according to claim 1 wherein, for each frame, the processor is configured to output the first modulator driving signal for the key frame and the processor is configured to designate a new key frame upon determining that the second modulator driving signal for a frame fails to satisfy an acceptability criterion.
5. Apparatus according to claim 4 wherein determining that the second modulator driving signal for a frame fails to satisfy the acceptability criterion comprises determining that a number of the second modulator driving signal specifies more than a threshold number of pixel values that are outside of a range of suitable values.
6. A display comprising:
a first modulator comprising a plurality of elements having individually-controllable light outputs and arranged in a two-dimensional array;
a second modulator disposed to modulate light emitted by the first modulator to display an image;
a processor configured to:
for each of the video frames output a first modulator driving signal for controlling the first modulator to emit light and output a second modulator driving signal for controlling the second modulator to modulate light emitted by the first modulator to display an image defined by image data for the video frame;
wherein the processor is configured to:
in response to key frame image data for a key video frame of the video frames, generate and output a first modulator driving signal for the key frame;
generate a key frame luminance map based on the first modulator driving signal for the key frame;
generate and output a second modulator driving signal for the key frame based at least on the key frame luminance map and the key frame image data; and,
for one or more additional frames subsequent to the key frame, output the first modulator driving signal for the key frame and generate and output a second modulator driving signal based at least on the key frame luminance map and image data for the one or more additional frames;
a first driving circuit connected to drive the second modulator in response to the second modulator driving signal; and,
a second driving circuit connected to the first modulator in response to the second modulator driving signal.
7. A display according to claim 6 wherein the light emitters comprise light-emitting diodes.
8. A display according to claim 6 wherein the first modulator comprises a projector.
9. A display according to claim 6 wherein the second modulator comprises a liquid crystal display (LCD) panel.
10. A method for processing a series of frames of a video sequence for display on a display comprising a first modulator disposed to illuminate a second modulator, the method comprising:
processing a frame to provide corresponding first and second modulator driving signals,
designating at least one frame subsequent in the video sequence to the frame as a key frame and for the key frame generating a first modulator driving signal and a luminance map based on the first modulator driving signal, and,
if the luminance map for the key frame matches the frame, setting the first modulator driving signal for the frame to be the same as the first modulator driving signal for the key frame and generating a second modulator driving signal for the frame based on the luminance map for the key frame.
11. A method according to claim 10 comprising simultaneously processing a plurality of frames wherein the frame is one of the plurality of frames and the method comprises determining whether the luminance map for the key frame matches one or more of the plurality of frames.
12. A method according to claim 10 wherein comprises dividing a frame image for the one of the frames by the luminance map for the key frame.