Motion estimation and compensation in video compression
View Patent ↗A method of video motion estimation is described for determining the dominant motion in a video image. The dominant motion is defined by a parametric transform, for example a similarity transform. In the preferred embodiment, selected pairs of blocks in one frame are traced by a block matching algorithm into a subsequent frame, and their change in position determined. From that information, an individual parameter estimate is determined. The process is repeated for many pairs of blocks, to create a large number of parameter estimates. These estimates are then sorted into an ordered list, the list is preferably differentiated, and the best global value for the parameter is determined from the differentiated list. One approach is to take the minimum value of the differentiated list, selected from the longest run of values which fall below a threshold value. Alternatively, the ordered list may be examined for flat areas, without explicit differentiation. The technique is particularly suited to low complexity, low bit rate multimedia applications, where reasonable fidelity is required without the computational overhead of full motion compensation.
1. A method of video motion estimation for determining the dominant motion in a video image, said dominant motion being defined by a parametric transform which maps the movement of an image block from a first frame of the video to a second frame; the method comprising:
(a) selecting a plurality of blocks in the first frame, and matching said blocks with their respective block positions in the second frame;
(b) from the measured movements of the blocks between the first and second frames, calculating a plurality of estimates for a parameter of the transform;
(c) sorting the parameter estimates into an ordered list; and
(d) determining a best global value for the parameter by examining the ordered list wherein the best global value is determined by differentiating the ordered list to create an output list, and selecting a minimum value of the output list and wherein the determination of the best global value includes the step of selecting the longest run of values in the output list below a threshold value.
2. A method of video motion estimation for determining the dominant motion in a video image, said dominant motion being defined by a parametric transform which maps the movement of an image block from a first frame of the video to a second frame; the method comprising:
(a) selecting a plurality of blocks in the first frame, and matching said blocks with their respective block positions in the second frame;
(b) from the measured movements of the blocks between the first and second frames, calculating a plurality of estimates for a parameter of the transform;
(c) sorting the parameter estimates into an ordered list; and
(d) determining a best global value for the parameter by examining the ordered list wherein the best global value is determined by differentiating the ordered list to create an output list, and selecting a minimum value of the output list in which the determination of the best global value includes the step of selecting the longest run of values in the output list below a threshold value, and selecting a mid-point of the said longest run.
3. A method of video motion estimation for determining the dominant motion in a video image, said dominant motion being defined by a parametric transform which maps the movement of an image block from a first frame of the video to a second frame; the method comprising:
(a) selecting a plurality of blocks in the first frame, and matching said blocks with their respective block positions in the second frame;
(b) from the measured movements of the blocks between the first and second frames, calculating a plurality of estimates for a parameter of the transform;
(c) sorting the parameter estimates into an ordered list; and
(d) determining a best global value for the parameter by examining the ordered list, in which the transform is a similarity transform and in which an estimate of M cos θ where M sin θrepresents zoom and θ represents rotation is calculated for each pair of selected blocks in the first frame; and in which the best global values of M cos θ and M sin θ are determined from respective ordered lists.
4. A method of video motion estimation for determining the dominant motion in a video image, said dominant motion being defined by a parametric transform which maps the movement of an image block from a first frame of the video to a second frame; the method comprising:
(a) selecting a plurality of blocks in the first frame, and matching said blocks with their respective block positions in the second frame;
(b) from the measured movements of the blocks between the first and second frames, calculating a plurality of estimates for a parameter of the transform;
(c) sorting the parameter estimates into an ordered list; and
(d) determining a best global value for the parameter by examining the ordered list in which the transform is a similarity transform and in which an estimate of zoom is calculated for each pair of selected blocks in the first frame, the best global zoom value being determined from a zoom values ordered list and in which the best global zoom value is fed back into the similarity transform to produce a plurality of estimates of translation parameters in x and y, the best global translation parameters in x and y being determined from respective ordered lists.
5. A method of video motion estimation for determining the dominant motion in a video image, said dominant motion being defined by a parametric transform which maps the movement of an image block from a first frame of the video to a second frame; the method comprising:
(a) selecting a plurality of blocks in the first frame, and matching said blocks with their respective block positions in the second frame;
(b) from the measured movements of the blocks between the first and second frames, calculating a plurality of estimates for a parameter of the transform;
(c) sorting the parameter estimates into an ordered list; and
(d) determining a best global value for the parameter by examining the ordered list in which the transform is a similarity transform and in which an estimate of zoom and rotation is calculated for each pair of selected blocks in the first frame, the best global zoom and rotation value being determined from respective zoom and rotation value ordered lists and in which the said best global estimates are fed back into the similarity transform to produce a plurality of estimates of translation parameters in x and y, the best global translation parameters in x and y being determined from respective ordered lists.
6. A method of video motion estimation for determining the dominant motion in a video image, said dominant motion being defined by a parametric transform which maps the movement of an image block from a first frame of the video to a second frame; the method comprising:
(a) selecting a plurality of blocks in the first frame, and matching said blocks with their respective block positions in the second frame;
(b) from the measured movements of the blocks between the first and second frames, calculating a plurality of estimates for a parameter of the transform;
(c) sorting the parameter estimates into an ordered list; and
(d) determining a best global value for the parameter by examining the ordered list in which the transform is a similarity transform and in which two estimates of zoom are calculated for each pair of selected blocks in the first frame, the two estimates being sorted into a single consolidated ordered list, and the best global zoom value being determined by examining the consolidated ordered list and in which the best global zoom value is fed back into the similarity transform to produce a plurality of estimates of translation parameters in x and y, the best global translation parameters in x and y being determined from respective ordered lists.
7. A method of video motion estimation for determining the dominant motion in a video image, said dominant motion being defined by a parametric transform which maps the movement of an image block from a first frame of the video to a second frame; the method comprising:
(a) selecting a plurality of blocks in the first frame, and matching said blocks with their respective block positions in the second frame;
(b) from the measured movements of the blocks between the first and second frames, calculating a plurality of estimates for a parameter of the transform;
(c) sorting the parameter estimates into an ordered list; and
(d) determining a best global value for the parameter by examining the ordered list in which the transform is a similarity transform and in which an estimate of M cos θ where M sin θ represents zoom and θ represents rotation is calculated for each pair of selected blocks in the first frame; and in which the best global values of M cos θ and M sin θ are determined from respective ordered lists, and in which the said best global estimates are fed back into the similarity transform to produce a plurality of estimates of translation parameters in x and y, the best global translation parameters in x and y being determined from respective ordered lists.