Frame rate up-conversion
View Patent ↗Content comprising a sequence of original frames at a first frame rate is up-converted to a second, higher, frame rate. Intermediate frames are calculated for temporal positions spaced between temporal positions of the original frames. An output sequence at the second frame rate comprises a repeating pattern of frames and, within each repetition of the pattern, there is: at least one original frame; at least one intermediate frame which is repeated; and at least one frame which is not repeated. The method is suitable for applications where an up-conversion factor is required in the frame rate, such as an up-conversion factor of five to up-convert from the 24 Hz frame rate used for film-based content to the 120 Hz frame rate used by displays. The output sequence can use all of the original frames to reduce detail flicker.
1. A method of increasing the frame rate of content, the content comprising a sequence of original frames, including a first original frame, a second original frame, a third original frame, and a fourth original frame, at a first frame rate, the method comprising:
receiving the original frames;
calculating intermediate frames for temporal positions spaced between the temporal positions of the original frames;
outputting a sequence of frames at a second frame rate, higher than the first frame rate, wherein the output sequence comprises a repeating pattern of frames and, within each repetition of the pattern, there is:
at least one original frame;
at least a first intermediate frame calculated from at least two consecutive original frames, the first intermediate frame being repeated by at least a second intermediate frame that is identical to the first intermediate frame; and
at least a second intermediate frame that is not repeated.
2. A method according to claim 1 wherein the second frame rate is an odd integer multiple of the first frame rate.
3. A method according to claim 2 wherein the second frame rate is five times higher than the first frame rate.
4. A method according to claim 3 wherein the first frame rate is 24 Hz and the second frame rate is 120 Hz.
5. A method according to claim 1 wherein the outputting the sequence of frames comprises outputting all of the original frames.
6. A method of increasing the frame rate of content, the content comprising a sequence of original frames, including a first original frame, a second original frame, a third original frame, and a fourth original frame, at a first frame rate, the method comprising:
receiving the original frames;
calculating intermediate frames for temporal positions spaced between the temporal positions of the original frames;
outputting a sequence of frames at a second frame rate, higher than the first frame rate, wherein the output sequence comprises a repeating pattern of frames and, within each repetition of the pattern, there is:
at least one original frame; and
at least one intermediate frame calculated from at least two consecutive original frames, each intermediate frame being repeated by at least a second intermediate frame that is identical to the first intermediate frame.
7. A method according to claim 1 wherein the step of outputting the sequence of frames comprises an alternating sequence of repeating a frame and outputting the next frame only once.
8. A method according to claim 7 wherein for each intermediate frame that is repeated, the intermediate frame is calculated for a temporal position at which at least one occurrence of the intermediate frame will be output.
9. A method according to claim 1 further comprising receiving a sequence of frames at a frame rate higher than the first frame rate and extracting the original frames at the first frame rate.
10. A method according to claim 9 wherein the sequence of frames at a frame rate higher than the first frame rate comprise a sequence of frames which have been up-converted using a 3:2 pull down process.
11. A method according to claim 6 wherein the second frame rate is five times higher than the first frame rate, the step of calculating intermediate frames calculates two intermediate frames between each adjacent pair of original frames, and the step of outputting the sequence of frames comprises repeating each intermediate frame and outputting each original frame only once.