Method, apparatus, and computer program product for providing motion estimation for video encoding
View Patent ↗An apparatus for providing motion estimation for video encoding includes a selection element and a processing element. The selection element is configured to select a subset including less than all of candidate pixel locations from among a plurality of candidate pixel locations used for motion vector determination based on a relationship between a best candidate pixel location of a first level of accuracy and a best candidate pixel location of a second level of accuracy. The processing element is configured to process an input video sequence to determine a motion vector at the first level of accuracy, to refine the motion vector at the second level of accuracy, and to determine the motion vector at a third level of accuracy using only the subset of candidate pixel locations.
1. A method comprising:
processing an input video sequence to determine a motion vector at a first level of accuracy;
refining the motion vector at a second level of accuracy;
selecting, with a selection element, a subset including less than all of candidate pixel locations at least partially based on whether a best candidate pixel location of the second level of accuracy is the same as a best candidate pixel location of the first level of accuracy; and
determining the motion vector at a third level of accuracy based on the subset of candidate pixel locations,
wherein when the best candidate pixel location of the second level of accuracy is the same as the best candidate pixel location of the first level of accuracy and a second best candidate pixel location of the second level of accuracy is known, selecting the subset of candidate pixel locations comprises selecting candidate pixel locations proximate to the best candidate pixel location of the first level of accuracy that are between the best candidate pixel location of the first level of accuracy and the second best candidate pixel location of the second level of accuracy.
2. The method according to claim 1 , wherein when the best candidate pixel location of the second level of accuracy is not the same as the best candidate pixel location of the first level of accuracy, selecting the subset of candidate pixel locations comprises selecting candidate pixel locations proximate to the best candidate pixel location of the second level of accuracy that are between the best candidate pixel location of the second level of accuracy and the best candidate pixel location of the first level of accuracy.
3. The method according to claim 1 , wherein processing the input video sequence to determine the motion vector at the first level of accuracy comprises determining the best candidate pixel location of the first level of accuracy corresponding to a candidate block in a reference frame that most closely matches an original block at the first level of accuracy.
4. The method according to claim 1 , wherein refining the motion vector at the second level of accuracy comprises determining the best candidate pixel location of the second level of accuracy corresponding to a candidate block in a reference frame that most closely matches an original block at the second level of accuracy.
5. The method according to claim 1 , wherein determining the motion vector at the third level of accuracy comprises determining the best candidate pixel location of the third level of accuracy corresponding to a candidate block in a reference frame that most closely matches an original block at the third level of accuracy.
6. The method according to claim 1 , wherein selecting the subset of candidate pixel locations comprises selecting less than half of a total number of candidate pixel locations.
7. A computer program product comprising at least one non-transitory computer-readable storage medium having computer-readable program code portions stored therein, the computer-readable program code portions comprising:
a first executable portion for processing an input video sequence to determine a motion vector at a first level of accuracy;
a second executable portion for refining the motion vector at a second level of accuracy;
a third executable portion for selecting a subset including less than all of candidate pixel locations at least partially based on whether a best candidate pixel location of the second level of accuracy is the same as a best candidate pixel location of the first level of accuracy; and
a fourth executable portion for determining the motion vector at a third level of accuracy based on the subset of candidate pixel locations,
wherein when the best candidate pixel location of the second level of accuracy is the same as the best candidate pixel location of the first level of accuracy and a second best candidate pixel location of the second level of accuracy is known, selecting the subset of candidate pixel locations comprises selecting candidate pixel locations proximate to the best candidate pixel location of the first level of accuracy that are between the best candidate pixel location of the first level of accuracy and the second best candidate pixel location of the second level of accuracy.
8. The computer program product according to claim 7 , wherein when the best candidate pixel location of the second level of accuracy is not the same as the best candidate pixel location of the first level of accuracy, the third executable portion includes instructions for selecting candidate pixel locations proximate to the best candidate pixel location of the second level of accuracy that are between the best candidate pixel location of the second level of accuracy and the best candidate pixel location of the first level of accuracy.
9. The computer program product according to claim 7 , wherein the first executable portion includes instructions for determining the best candidate pixel location of the first level of accuracy corresponding to a candidate block in a reference frame that most closely matches an original block at the second level of accuracy.
10. The computer Program product according to claim 7 , wherein the second executable portion includes instructions for determining the best candidate pixel location of the second level of accuracy corresponding to a candidate block in a reference frame that most closely matches an original block at the second level of accuracy.
11. The computer program product according to claim 7 , wherein the fourth executable portion includes instructions for determining the best candidate pixel location of the second level of accuracy corresponding to a candidate block in a reference frame that most closely matches an original block at the second level of accuracy.
12. The computer program product according to claim 7 , wherein the third executable portion includes instructions for selecting less than half of a total number of candidate pixel locations.
13. An apparatus comprising:
a selection element configured to select a subset including less than all of candidate pixel locations from among a plurality of candidate pixel locations used for motion vector determination at least partially based on whether a best candidate pixel location of a first level of accuracy is the same as a best candidate pixel location of a second level of accuracy; and
a processing element configured to:
process an input video sequence to determine a motion vector at the first level of accuracy,
refine the motion vector at the second level of accuracy, and
determine the motion vector at a third level of accuracy based on the subset of candidate pixel locations,
wherein when the best candidate pixel location of the second level of accuracy is the same as the best candidate pixel location of the first level of accuracy and a second best candidate pixel location of the second level of accuracy is known, selecting the subset of candidate pixel locations comprises selecting candidate pixel locations proximate to the best candidate pixel location of the first level of accuracy that are between the best candidate pixel location of the first level of accuracy and the second best candidate pixel location of the second level of accuracy.
14. The apparatus according to claim 13 , wherein when the best candidate pixel location of the second level of accuracy is not the same as the best candidate pixel location of the first level of accuracy, the selection element is configured to select the subset of candidate pixel locations by selecting candidate pixel locations proximate to the best candidate pixel location of the second level of accuracy that are between the best candidate pixel location of the second level of accuracy and the best candidate pixel location of the first level of accuracy.
15. The apparatus according to claim 13 , wherein the processing element is configured to determine the best candidate pixel location of the first level of accuracy corresponding to a candidate block in a reference frame that most closely matches an original block at the first level of accuracy.
16. The apparatus according to claim 15 , wherein the processing element is configured to determine the best candidate pixel location of the second level of accuracy corresponding to a candidate block in a reference frame that most closely matches an original block at the second level of accuracy.
17. The apparatus according to claim 16 , wherein the processing element is configured to determine the best candidate pixel location of the third level of accuracy corresponding to a candidate block in a reference frame that most closely matches an original block in a reference frame at the third level of accuracy.
18. The apparatus according to claim 17 , wherein the first level of accuracy corresponds to an integer pixel level, the second level of accuracy corresponds to a half pixel level and the third level of accuracy corresponds to a quarter pixel level.
19. The apparatus according to claim 13 , wherein the selection element is configured to select less than half of a total number of candidate pixel locations.
20. The apparatus according to claim 13 , wherein the apparatus is embodied in a mobile terminal.
21. An encoder that utilizes motion estimation, the encoder comprising:
a motion estimator configured to process an input video sequence to determine a motion vector at a first level of accuracy, refine the motion vector at a second level of accuracy, select a subset including less than all of candidate pixel locations at least partially based on whether a best candidate pixel location of the second level of accuracy is the same as a best candidate pixel location of the first level of accuracy, and determine the motion vector at a third level of accuracy using only the subset of candidate pixel locations; and
a motion compensated prediction block configured to apply the motion vector determined at the third level of accuracy to a reference frame in order to generate a prediction macroblock that is motion compensated,
wherein when the best candidate pixel location of the second level of accuracy is the same as the best candidate pixel location of the first level of accuracy and a second best candidate pixel location of the second level of accuracy is known, selecting the subset of candidate pixel locations comprises selecting candidate pixel locations proximate to the best candidate pixel location of the first level of accuracy that are between the best candidate pixel location of the first level of accuracy and the second best candidate pixel location of the second level of accuracy.
22. The method according to claim 1 , wherein the method is carried out within an image processing chain and responsive to one of predetermined settings and user selection.