Image processing methods and systems for frame rate conversion
View Patent ↗An image processing method for frame rate conversion, comprising: receiving a stream of input pictures at an input frame rate, at least some of the input pictures being new pictures, the new pictures appearing within the stream of input pictures at an underlying new picture rate; generating interpolated pictures from certain ones of the input pictures; outputting a stream of output pictures at an output frame rate, the stream of output pictures including a blend of the new pictures and the interpolated pictures, the interpolated pictures appearing in the stream of output pictures at an average interpolated picture rate; and causing a variation in the average interpolated picture rate in response to detection of a variation in the underlying new picture rate.
1. An image processing method for frame rate conversion, comprising:
receiving a stream of input pictures at an input frame rate, at least some of the input pictures being new pictures, the new pictures appearing within the stream of input pictures at an underlying new picture rate;
generating interpolated pictures from certain ones of the input pictures;
outputting, at an output frame rate, an output stream including a blend of the new pictures and the interpolated pictures to maintain a particular average interpolated picture rate at which the interpolated pictures appear in the output stream; and
causing a variation in the average interpolated picture rate in response to detection of a variation in the underlying new picture rate.
2. The image processing method defined in claim 1 , further comprising determining the underlying new picture rate on an ongoing basis and detecting variations therein.
3. The image processing method defined in claim 1 , further comprising determining the underlying new picture rate.
4. The image processing method defined in claim 3 , further comprising generating the interpolated pictures from the new pictures.
5. The image processing method defined in claim 4 , wherein generating the interpolated pictures from the new pictures comprises generating, for each of the new pictures, a corresponding subset of R interpolated pictures, where R is an integer greater than or equal to one.
6. The image processing method defined in claim 5 , wherein causing the variation in the average interpolated picture rate comprises varying R in accordance with the detected variation in the underlying new picture rate.
7. The image processing method defined in claim 5 , wherein causing the variation in the average interpolated picture rate comprises varying the output frame rate in accordance with the detected variation in the underlying new picture rate.
8. The image processing method defined in claim 5 , wherein causing the variation in the average interpolated picture rate comprises varying R without varying the output frame rate.
9. The image processing method defined in claim 5 , wherein causing the variation in the average interpolated picture rate comprises varying the output frame rate without varying R.
10. The image processing method defined in claim 5 , wherein causing the variation in the average interpolated picture rate comprises varying R and varying the output frame rate.
11. The image processing method defined in claim 5 , wherein the output stream includes PN copies of each of the new pictures blended with PI copies of each of the interpolated pictures in the corresponding subset of R interpolated pictures, wherein PN and PI are integers greater than or equal to one.
12. The image processing method defined in claim 11 , wherein causing the variation in the average interpolated picture rate comprises varying at least one of PN and PI.
13. The image processing method defined in claim 11 , wherein causing the variation in the average interpolated picture rate comprises varying R in accordance with the detected variation in the underlying new picture rate.
14. The image processing method defined in claim 11 , wherein causing the variation in the average interpolated picture rate comprises varying the output frame rate in accordance with the detected variation in the underlying new picture rate.
15. The image processing method defined in claim 11 , wherein causing the variation in the average interpolated picture rate comprises varying at least one of PN, PI and R without varying the output frame rate.
16. The image processing method defined in claim 11 , wherein causing the variation in the average interpolated picture rate comprises varying at least one of PN, PI and the output frame rate without varying R.
17. The image processing method defined in claim 1 , wherein the underlying new picture rate is identical to the input frame rate.
18. The image processing method defined in claim 1 , wherein the underlying new picture rate is different from the input frame rate.
19. The image processing method defined in claim 1 , further comprising rendering the output pictures on a display.
20. The image processing method defined in claim 19 , wherein the average interpolated picture rate is the rate at which the interpolated pictures are perceived by a viewer of the display.
21. A non-transitory computer-readable storage medium comprising computer-readable instruction for instructing a computing device to:
receive a stream of input pictures at an input frame rate, at least some of the input pictures being new pictures, the new pictures appearing within the stream of input pictures at an underlying new picture rate that is distinct from the input frame rate;
generate interpolated pictures from certain ones of the input pictures;
output, at an output frame rate, an output stream including a blend of the new pictures and the interpolated pictures to maintain at an average interpolated picture rate at which the interpolated pictures appear in the output stream; and
cause a variation in the average interpolated picture rate in response to detection of a variation in the underlying new picture rate.
22. A non-transitory computer-readable storage medium comprising computer-readable instructions which when processed are used to generate a processor/apparatus adapted to:
process a stream of input pictures appearing at an input frame rate, a first portion of the input pictures being new pictures and a second portion of the pictures being repeat pictures, the new pictures appearing within the stream of input pictures at an underlying new picture rate;
generate interpolated pictures from certain ones of the input pictures;
output, at an output frame rate, an output stream including a blend of the new pictures and the interpolated pictures, the interpolated pictures appearing in the stream of output pictures at an average interpolated picture rate; and
cause a variation in the average interpolated picture rate in response to detection of a variation in the underlying new picture rate.
23. An image processing engine adapted to implement a frame rate conversion process that comprises:
circuitry operable to:
receive a stream of input pictures at an input frame rate, at least some of the input pictures being new pictures, the new pictures appearing within the stream of input pictures at an underlying new picture rate;
generate interpolated pictures from certain ones of the input pictures;
output, at an output frame rate, an output stream including a blend of the new pictures and the interpolated pictures, the interpolated pictures appearing in the stream of output pictures at an average interpolated picture rate; and
cause a variation in the average interpolated picture rate in response to detection of a variation in the underlying new picture rate.