Systems and methods of motion and edge adaptive processing including motion compensation features
View Patent ↗Systems and methods of processing pixel information associated with video image deinterlacing are disclosed. In one exemplary implementation, the method may include performing an edge adaptive interpolation process on a present field so as to determine whether an edge passes through a pixel, wherein the edge adaptive interpolation process provides edge data including a first intensity estimate for the pixel, receiving motion data associated with motion compensation processing, including an estimated motion vector for at least one pixel proximate to the pixel in at least one reference field, determining a second intensity estimate for the pixel as a function of the edge data and the motion data, and performing an intensity-calculation procedure, wherein an interpolated intensity of the pixel is calculated as a function of the first intensity estimate and the second intensity estimate.
1. A method of processing pixel information associated with video image deinterlacing, the method comprising:
performing an edge adaptive interpolation process on a present field so as to determine whether an edge passes through a pixel, wherein the edge adaptive interpolation process outputs edge data, including a first intensity estimate for the pixel;
processing motion data associated with motion compensation processing, wherein the motion data includes a first estimated motion vector for a pixel in a reference field prior to the present field and a second estimated motion vector for a pixel in a reference field subsequent to the present field;
determining a second intensity estimate for the pixel as a function of the edge data and the motion data; and
performing a blending process wherein final edge/motion data of the pixel, including an interpolated intensity of the pixel, is calculated as a function of the first intensity estimate and the second intensity estimate.
2. The method of claim 1 , wherein the second intensity estimate is obtained as a function of a median filter process of the edge data and the motion data.
3. The method of claim 2 , wherein edge data used by the median filter process includes the first intensity estimate.
4. The method of claim 1 , wherein the motion data includes the pixel's projected pixel along a motion vector direction in a previous field.
5. The method of claim 1 , wherein the motion data includes the pixel's projected pixel along a motion vector direction in a next field.
6. The method of claim 1 , wherein the motion data comprises estimated motion vector data.
7. The method of claim 1 , wherein the motion compensation process further includes determining a value reflecting the reliability of said estimated motion vector, and wherein said intensity-calculation procedure further comprises weighting the interpolated intensity of the pixel according to said value.
8. The method of claim 7 , wherein the interpolated intensity of the pixel is equal to the first intensity estimate if said value is below a threshold.
9. The method of claim 1 , wherein the interpolated intensity of the pixel is a value representing the luminance of the pixel.
10. The method of claim 1 , wherein the interpolated intensity of the pixel is a value representing the chrominance of the pixel.
11. A system that processes pixel information associated with a deinterlacing process, the apparatus comprising:
an edge adaptive interpolation component, wherein the edge adaptive interpolation component determines whether an edge passes through a pixel in a present field, and wherein the edge adaptive interpolation component provides edge data, including a first intensity estimate for the pixel;
a motion processing component that processes motion data associated with motion compensation processing, wherein the motion data includes a first estimated motion vector for a pixel in a reference field prior to the present field and a second estimated motion vector for a pixel in a reference field subsequent to the present field, and wherein the motion processing component determines a second intensity estimate for the pixel as a function of the edge data and the motion data; and
a blending component that calculates final edge/motion data of the pixel, including an interpolated intensity of the pixel, as a function of the first intensity estimate, the second intensity estimate, and motion reliability data characterizing reliability of the motion data.
12. The system of claim 11 , wherein said at least one reference field is a prior field relative to the present field.
13. The system of claim 11 , wherein said at least one reference field is a subsequent field relative to the present field.
14. The system of claim 11 , wherein said at least one reference field includes a first and second reference field, wherein said first reference field is a subsequent field relative to the present field, and wherein said second reference field is a prior field relative to the present field.
15. The system of claim 11 , wherein the interpolated intensity of the pixel is a value representing the luminance of the pixel.
16. The system of claim 11 , wherein the interpolated intensity of the pixel is a value representing the chrominance of the pixel.
17. The system of claim 11 , wherein the motion processing component further determines a value reflecting the reliability of said estimated motion vector, and wherein said intensity-calculation component weights the interpolated intensity of the pixel according to said value.
18. The system of claim 17 , wherein the interpolated intensity of the pixel is equal to the first intensity estimate if said value is below a threshold.
19. A method of processing pixel information based on received motion and edge data, the method comprising:
processing edge data from edge-adaptive interpolation processing, including a first intensity estimate for the pixel as well as data pertaining to one or more pixels that neighbor the pixel;
processing motion data associated with motion compensation processing, wherein the motion data includes a first estimated motion vector for a pixel in a reference field prior to the present field and a second estimated motion vector for a pixel in a reference field subsequent to the present field;
determining a second intensity estimate for the pixel as a function of the edge data and the motion data; and
performing a blending process wherein final edge/motion data of the pixel, including an interpolated intensity of the pixel, is calculated as a function of the first intensity estimate, the second intensity estimate, and motion reliability data characterizing reliability of the motion data.
20. The method of claim 19 , wherein the motion compensation process further includes determining a value reflecting the reliability of said estimated motion vector, and wherein said intensity-calculation procedure further comprises weighting the interpolated intensity of the pixel according to said value.
21. The method of claim 20 , wherein the interpolated intensity of the pixel is equal to the first intensity estimate if said value is below a threshold.
22. The method of claim 19 , wherein the second intensity estimate is obtained as a function of a median filter process of the edge data and the motion data.
23. The method of claim 19 wherein the interpolated intensity of the pixel is a value representing the luminance of the pixel.
24. The method of claim 19 wherein the interpolated intensity of the pixel is a value representing the chrominance of the pixel.
25. A system for determining the intensity of a pixel in a present field during the deinterlacing of a video signal, the video signal further comprising a plurality of successive fields, the present field and each of said plurality of successive fields having interlaced scan lines, comprising:
a first component for providing a first intensity estimate for the pixel, wherein said first intensity estimate is equal to the intensity of the pixel in the field immediately following the present field;
a second component for providing a second intensity estimate for the pixel as a function of the edge data and the motion data, wherein the edge data includes data pertaining to one or more pixels that neighbor the pixel and the motion data includes a first estimated motion vector for a pixel in a reference field prior to the present field and a second estimated motion vector for a pixel in a reference field subsequent to the present field, wherein said second intensity estimate is equal to the output of an edge adaptive interpolation component, and wherein said edge adaptive interpolation component determines whether an edge passes through the pixel in the present field;
a third component for providing a third intensity estimate for the pixel, wherein said third intensity estimate is calculated as a function of the second intensity estimate and a fourth intensity estimate obtained as a function of motion compensation data;
a fourth component for assigning a motion value to the pixel, wherein said motion value is proportional to motion detected in a group of pixels proximate to the pixel; and
a fifth component that calculates final edge/motion data of the pixel including determining the intensity of the pixel, wherein the determined intensity of the pixel is a function of the motion value, the first intensity estimate, and the third intensity estimate.
26. The system of claim 25 , wherein a field prior to the present field and a field subsequent to the present field are utilized as reference fields.
27. The system of claim 25 , wherein the third component determines the third intensity estimate for the pixel as a function of a value reflecting the reliability of the estimated motion vector.
28. The system of claim 27 , wherein the third intensity estimate for the pixel is equal to the second intensity estimate if the value is below a threshold.