Adaptive sub-pixel accuracy system for motion and disparities estimation
Display 105 is capable of rendering, or otherwise displaying, one or more of a standard definition (SD) image, a two-dimensional (2D), a three-dimensional image (3D) and a high definition (HD) image 110.
1. An image processing apparatus, comprising:
a memory configured to receive and store a video image frame, the video image frame comprising a video image; and
a motion estimator configured to:
identify at least one object in the video image frame, and
adaptively apply a refined motion estimation on slow-moving objects in the video image without affecting vector convergence on scenes with fast motions by selectively modulating magnitudes of a set of candidate motion vectors in alternate frames.
2. The apparatus of claim 1 , wherein the refined motion estimation comprises a motion histogram analysis.
3. An imaging system, comprising:
a memory configured to receive and store a video image frame, the video image frame comprising a video image;
a display configured to display the video image frame; and
processing circuitry configured to render the video image frame on the display, the processing circuitry comprising:
a motion estimator configured to:
identify at least one object in the video image frame; and
adaptively apply a refined motion estimation on slow-moving objects in the video image without affecting vector convergence on scenes with fast motions by selectively modulating magnitudes of a set of candidate motion vectors in alternate frames.
4. The imaging system of claim 3 , wherein the refined motion estimation comprises a motion histogram analysis.
5. A method for image rendering, the method comprising:
receiving and storing a video image frame, the video image frame comprising a video image;
identifying at least one object in the video image frame; and
adaptively applying a refined motion estimation on slow-moving objects in the video image without affecting vector convergence on scenes with fast motions by selectively modulating magnitudes of a set of candidate motion vectors in alternate frames.
6. The method of claim 5 , wherein the refined motion estimation comprises a motion histogram analysis.
7. An image processing apparatus, comprising:
a memory configured to receive and store a video image frame, the video image frame comprising a video image; and
a motion estimator configured to:
identify at least one object in the video image frame, and
adaptively apply a refined motion estimation on slow-moving objects in the video image without affecting the performance on scenes with fast and mixed motions,
wherein the motion estimator is configured to selectively update a set of candidate motion vectors,
wherein the refined motion estimation comprises a motion histogram analysis, and
wherein the motion histogram analysis comprises:
building a two-dimensional histogram;
identifying clusters in the two-dimensional histogram, wherein the clusters correspond to a plurality of objects in the video image frame; and
determining whether a norm each of the clusters is above a threshold.
8. The apparatus of claim 7 , wherein the motion histogram analysis comprises modulating the video image frame when the mod of all clusters is below the threshold.
9. The apparatus of claim 7 , wherein the refined motion estimation comprises a frame-by-frame alternation.
10. An imaging system, comprising:
a memory configured to receive and store a video image frame, the video image frame comprising a video image;
a display configured to display the video image frame; and
processing circuitry configured to render the video image frame on the display, the processing circuitry comprising:
a motion estimator configured to:
identify at least one object in the video image frame, and
adaptively apply a refined motion estimation on slow-moving objects in the video image without affecting the performance on scenes with fast and mixed motions, wherein the motion estimator is configured to selectively update a set of candidate motion vectors, wherein the refined motion estimation comprises a motion histogram analysis,
wherein the motion histogram analysis comprises:
building a two-dimensional histogram,
identifying clusters in the two-dimensional histogram, wherein the clusters correspond to a plurality of objects in the video image frame, and
determining whether a norm each of the clusters is above a threshold.
11. The imaging system of claim 10 , wherein the motion histogram analysis comprises modulating the video image frame when the mod of all clusters is below the threshold.
12. The imaging system of claim 10 , wherein the refined motion estimation comprises a frame-by-frame alternation.
13. A method for image rendering, comprising:
receiving and storing a video image frame, the video image frame comprising a video image;
identifying at least one object in the video image frame; and
adaptively applying a refined motion estimation on slow-moving objects in the video image without affecting the performance on scenes with fast and mixed motions, wherein the refined motion estimation comprises selectively updating a set of candidate motion vectors,
wherein the refined motion estimation comprises a motion histogram analysis, and
wherein the motion histogram analysis comprises:
building a two-dimensional histogram,
identifying clusters in the two-dimensional histogram, wherein the clusters correspond to a plurality of objects in the video image frame,
determining whether a mode each of the clusters is above a threshold, and
modulating the vector updates when the norm of all clusters is below the threshold.
14. The method of claim 13 , wherein the refined motion estimation comprises a frame-by-frame alternation.
15. An image processing apparatus, comprising:
a memory configured to receive and store a video image frame, the video image frame comprising a video image; and
a motion estimator configured to:
identify at least one object in the video image frame, and
adaptively apply a refined motion estimation on slow-moving objects in the video image without affecting the performance on scenes with fast and mixed motions,
wherein the motion estimator is configured to selectively update a set of candidate motion vectors,
wherein the refined motion estimation comprises a motion histogram analysis,
wherein the refined motion estimation comprises a frame-by-frame alternation, and
wherein the frame-by-frame alternation comprises a dynamic update process and a static update process.
16. An imaging system, comprising:
a memory configured to receive and store a video image frame, the video image frame comprising a video image;
a display configured to display the video image frame; and
processing circuitry configured to render the video image frame on the display, the processing circuitry comprising:
a motion estimator configured to:
identify at least one object in the video image frame, and
adaptively apply a refined motion estimation on slow-moving objects in the video image without affecting the performance on scenes with fast and mixed motions, wherein the motion estimator is configured to selectively update a set of candidate motion vectors, wherein the refined motion estimation comprises a motion histogram analysis,
wherein the refined motion estimation comprises a frame-by-frame alternation, and
wherein the frame-by-frame alternation comprises a dynamic update process and a static update process.
17. A method for image rendering, comprising:
receiving and storing a video image frame, the video image frame comprising a video image;
identifying at least one object in the video image frame; and
adaptively applying a refined motion estimation on slow-moving objects in the video image without affecting the performance on scenes with fast and mixed motions, wherein the refined motion estimation comprises selectively updating a set of candidate motion vectors,
wherein the refined motion estimation comprises a motion histogram analysis,
wherein the refined motion estimation comprises a frame-by-frame alternation, and
wherein the frame-by-frame alternation comprises a dynamic update process and a static update process.
18. An image processing apparatus, comprising:
a memory configured to receive and store a video image frame, the video image frame comprising a video image; and
a motion estimator configured to:
identify at least one object in the video image frame, and
adaptively apply a refined motion estimation on slow-moving objects in the video image without affecting the performance on scenes with fast and mixed motions,
wherein the motion estimator is configured to selectively update a set of candidate motion vectors,
wherein the refined motion estimation comprises a motion histogram analysis,
wherein the refined motion estimation comprises a frame-by-frame alternation, and
wherein the frame-by-frame alternation comprises modulating every other frame based on a speed of the objects in the video image frame and according to:
main
updates
=
main
updates
Denominator
,
wherein the denominator is determined according to the results from the motion histogram analysis.
19. An imaging system, comprising:
a memory configured to receive and store a video image frame, the video image frame comprising a video image;
a display configured to display the video image frame; and
processing circuitry configured to render the video image frame on the display, the processing circuitry comprising:
a motion estimator configured to:
identify at least one object in the video image frame, and
adaptively apply a refined motion estimation on slow-moving objects in the video image without affecting the performance on scenes with fast and mixed motions, wherein the motion estimator is configured to selectively update a set of candidate motion vectors, wherein the refined motion estimation comprises a motion histogram analysis,
wherein the refined motion estimation comprises a frame-by-frame alternation, and
wherein the frame-by-frame alternation comprises modulating every other frame based on a speed of the objects in the video image frame and according to:
main
updates
=
main
updates
Denominator
,
wherein the denominator is determined according to the results from the motion histogram analysis.
20. A method for image rendering, comprising:
receiving and storing a video image frame, the video image frame comprising a video image;
identifying at least one object in the video image frame; and
adaptively applying a refined motion estimation on slow-moving objects in the video image without affecting the performance on scenes with fast and mixed motions, wherein the refined motion estimation comprises selectively updating a set of candidate motion vectors,
wherein the refined motion estimation comprises a motion histogram analysis,
wherein the refined motion estimation comprises a frame-by-frame alternation, and
wherein the frame-by-frame alternation comprises modulating every other frame based on a speed of the objects in the video image frame and according to:
main
updates
=
main
updates
Denominator
,
wherein the denominator is determined according to the results from the motion histogram analysis.