Frame rate conversion apparatus and method
View Patent ↗Correlation detectors 21 and 22 employ two different correlation detecting methods to determine correlations. Correlation comparators 23 and 24 output correlation values DF 1 and DF 2 , and motion vectors MV 1 and MV 2 in directions representing largest correlation values. A correlation comparator 25 selects one of the motion vectors larger in correlation, as a motion vector MV 3 , to output an interpolation control signal FS 1 to determine an interpolation method at an interpolator 3 . The interpolator 3 is operative in accordance with the interpolation control signal FS 1 , to select any one out of two different one-side interpolations and a both-side interpolation, to generate interpolation pixel data fp 0.
1. A frame rate conversion system comprising:
a first correlation detector configured to detect respective correlation values between a first pixel data being a pixel data residing on a first frame, in an identical position to an interpolation pixel data on an interpolation frame to be interpolated between the first frame and a second frame previous to the first frame, and plural pixel data on the second frame;
a first correlation comparator configured to be operative among correlation values output from the first correlation detector, to output combination of a first largest correlation value largest in correlation thereamong and a direction representing the first largest correlation value, as a first motion vector;
a second correlation detector configured to detect respective correlation values between a second pixel data being a pixel data residing on the second frame, in an identical position to the interpolation pixel data, and plural pixel data on the first frame;
a second correlation comparator configured to be operative among correlation values output from the second correlation detector, to output combination of a second largest correlation value largest in correlation thereamong and a direction representing the second largest correlation value, as a second motion vector;
a third correlation comparator configured to be operative between the first motion vector and the second motion vector, to output one of the motion vectors greater in correlation between the first largest correlation value and the second largest correlation value, as a final third motion vector;
a first pixel data selector configured to be operative on basis of the third motion vector, to select from among plural pixel data on the first frame a third pixel data to be output as necessary for generation of the interpolation pixel data;
a second pixel data selector configured to be operative on basis of the third motion vector, to select from among plural pixel data on the second frame a fourth pixel data to be output as necessary for generation of the interpolation pixel data;
an interpolation pixel data generator configured to select any one of a one-side interpolation simply using the third pixel data, a one-side interpolation simply using the fourth pixel data, and a both-side interpolation using the third and the fourth pixel data, to generate and output the interpolation pixel data; and
a frame rate converter configured for use of the interpolation pixel data to generate the interpolation frame, to interpolate between the first frame and the second frame, to implement a conversion of frame rate.
2. The frame rate conversion system according to claim 1 , wherein
the third correlation comparator is configured to be operative when meeting a first condition that the first motion vector and the second motion vector have a difference in between within a prescribed range, to output a signal on determination to have the both-side interpolation as an interpolation at the interpolation pixel data generator, and
the interpolation pixel data generator is configured to be operative with the signal on determination input thereto, to average the third and the fourth pixel data, to generate the interpolation pixel data.
3. The frame rate conversion system according to claim 1 , wherein
the third correlation comparator is configured to be operative when meeting a second condition that the first motion vector and the second motion vector have a difference in between within a prescribed range, and the first largest correlation value and the second largest correlation value have a difference in between smaller in absolute value than a first threshold, to output a signal on determination to have the both-side interpolation as an interpolation at the interpolation pixel data generator, and
the interpolation pixel data generator is configured to be operative with the signal on determination input thereto, to average the third and the fourth pixel data, to generate the interpolation pixel data.
4. The frame rate conversion system according to claim 3 , wherein
the third correlation comparator is configured to be operative also when meeting, besides the second condition, a third condition that the first largest correlation value and the second largest correlation value have a difference in between smaller in absolute value than a second threshold being a smaller value than the first threshold, to output a signal on determination to have the both-side interpolation as an interpolation at the interpolation pixel data generator.
5. A frame rate conversion method comprising:
a first correlation detecting step of detecting respective correlation values between a first pixel data being a pixel data residing on a first frame, in an identical position to an interpolation pixel data on an interpolation frame to be interpolated between the first frame and a second frame previous to the first frame, and plural pixel data on the second frame;
a first correlation comparing step of operating among correlation values detected at the first correlation detecting step, to output combination of a first largest correlation value largest in correlation thereamong and a direction representing the first largest correlation value, as a first motion vector;
a second correlation detecting step of detecting respective correlation values between a second pixel data being a pixel data residing on the second frame, in an identical position to the interpolation pixel data, and plural pixel data on the first frame;
a second correlation comparing step of operating among correlation values detected at the second correlation detecting step, to output combination of a second largest correlation value largest in correlation thereamong and a direction representing the second largest correlation value, as a second motion vector;
a third correlation comparing step of operating between the first motion vector and the second motion vector, to output one of the motion vectors greater in correlation between the first largest correlation value and the second largest correlation value, as a final third motion vector;
a first pixel data selecting step of operating on basis of the third motion vector, to select from among plural pixel data on the first frame a third pixel data to be output as necessary for generation of the interpolation pixel data;
a second pixel data selecting step of operating on basis of the third motion vector, to select from among plural pixel data on the second frame a fourth pixel data to be output as necessary for generation of the interpolation pixel data;
an interpolation pixel data generating step of selecting any one of a one-side interpolation simply using the third pixel data, a one-side interpolation simply using the fourth pixel data, and a both-side interpolation using the third and the fourth pixel data, to generate and output the interpolation pixel data; and
a frame rate converting step of using the interpolation pixel data to generate the interpolation frame, to interpolate between the first frame and the second frame, to implement a conversion of frame rate.
6. The frame rate conversion method according to claim 5 , wherein
the third correlation comparing step comprises operating when meeting a first condition that the first motion vector and the second motion vector have a difference in between within a prescribed range, to output a signal on determination to have the both-side interpolation as an interpolation at the interpolation pixel data generating step, and
the interpolation pixel data generating step comprises operating with the signal on determination input thereto, to average the third and the fourth pixel data, to generate the interpolation pixel data.
7. The frame rate conversion method according to claim 5 , wherein
the third correlation comparing step comprises operating when meeting a second condition that the first motion vector and the second motion vector have a difference in between within a prescribed range, and the first largest correlation value and the second largest correlation value have a difference in between smaller in absolute value than a first threshold, to output a signal on determination to have the both-side interpolation as an interpolation at the interpolation pixel data generating step, and
the interpolation pixel data generating step comprises operating with the signal on determination input thereto, to average the third and the fourth pixel data, to generate the interpolation pixel data.
8. The frame rate conversion method according to claim 7 , wherein
the third correlation comparing step comprises operating also when meeting, besides the second condition, a third condition that the first largest correlation value and the second largest correlation value have a difference in between smaller in absolute value than a second threshold being a smaller value than the first threshold, to output a signal on determination to have the both-side interpolation as an interpolation at the interpolation pixel data generating step.