IP Library Granted Patent US 9,691,160
Granted Patent B2
US 9,691,160 · App. 14/797,249 · Granted Jun 27, 2017

Device and method for motion estimation and compensation

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,691,160
App. No.
14/797,249
Granted
Jun 27, 2017
Kind
B2
Abstract

A device for motion estimation in video image data is provided. The device comprises a motion estimation unit ( 11, 21 ) for estimating a current motion vector for an area of a current image by determining a set of temporal and/or spatial candidate motion vectors and selecting a best motion vector from the set of candidate motion vectors. The motion estimation unit ( 11, 21 ) is further adapted for substantially doubling one or more of the candidate motion vectors and for including the one or more substantially doubled candidate motion vectors in the set of candidate motion vectors.

Claims (36)

1. A system for motion estimation, comprising:

a memory for storing a plurality of candidate motion vectors associated with a temporal distance; and

a processor operable to:

detect of the current temporal distance between the current image and the previous image according to a temporal distance history;

estimate a current motion vector and a current temporal distance according to a current image and a previous image;

increase the magnitude of a candidate motion vector in the plurality candidate motion vectors by a scale factor to produce a scaled candidate motion vector, the scale factor being a non-integer determined according a comparison between the temporal distance and the estimated current temporal distance;

select an updated motion vector according to a match error between the scaled candidate motion vector and the estimated current motion vector; and

decrease the magnitude of the updated motion vector by the scale factor, and store the updated motion vector with a decreased magnitude as a candidate motion vector in the plurality of candidate motion vectors.

2. The system of claim 1 , wherein the temporal distance detection unit is operable to analyze a number of scaled candidate motion vectors that are selected as the updated motion vector for a respective area of the current image.

3. The system of claim 1 , wherein the motion estimation unit is operable to select the scaled candidate motion vector as the updated motion vector according to the estimated current temporal distance.

4. The system of claim 1 , wherein the temporal distance detection unit is operable to estimate the current temporal distance according to a comparison of a length of the current motion vector for a respective area of the current image with one or more lengths of previous motion vectors for related areas of the previous image.

5. The system of claim 4 , wherein the motion estimation unit is operable to select the scaled candidate motion vector as the updated motion vector according to the estimated current temporal distance.

6. The system of claim 1 , wherein the processor comprises a motion compensation unit operable to compensate for motion between an area of the current image and a corresponding area of the previous image using the scaled candidate motion vector according to the temporal distance.

7. The system of claim 1 , wherein the temporal distance corresponds to a missing image between the current image and the previous image.

8. The system of claim 1 , wherein the scale factor is between 1.7 and 2.

9. A method for motion estimation, the method comprising:

storing a plurality of candidate motion vectors associated with a temporal distance;

detecting the current temporal distance between the current image and the previous image according to a temporal distance history;

estimating a current motion vector and a current temporal distance according to a current image and a previous image;

increasing the magnitude of a candidate motion vector in the plurality of candidate motion vectors by a scale factor to produce a scaled candidate motion vector, the scale factor being a non-integer determined according a comparison between the temporal distance and the estimated current temporal distance;

selecting an updated motion vector according to a match error between the scaled candidate motion vector and the estimated current motion vector; and

decreasing the magnitude of the updated motion vector by the scale factor; and storing the updated motion vector with a decreased magnitude as a candidate motion vector in the plurality of candidate motion vectors.

10. The method of claim 9 , wherein the method comprises detecting whether one or more images between the current image and the previous image are missing.

11. The method of claim 9 , wherein estimating the current temporal distance comprises analyzing a number of scaled candidate motion vectors that are selected as the updated motion vector for a respective area of the current image.

12. The method of claim 9 , wherein selecting the updated motion vector comprises selecting the scaled candidate motion vector as the updated motion vector according to the estimated current temporal distance.

13. The method of claim 9 , wherein the method comprises estimating the current temporal distance according to a comparison of a length of the current motion vector for a respective area of the current image with one or more lengths of previous motion vectors for related areas of the previous image.

14. The method of claim 9 , wherein the method comprises compensating for motion between an area of the current image and a corresponding area of the previous image using the scaled candidate motion vector according to the temporal distance.

15. The method of claim 9 , wherein the temporal distance corresponds to a missing image between the current image and the previous image.

16. The method of claim 2 , wherein the scale factor is between 1.7 and 2.

17. A computer program stored on a non-transitory, computer-readable memory device, that when executed by a processor, the computer program enabling a method comprising:

storing a plurality of candidate motion vectors associated with a temporal distance;

detecting the current temporal distance between the current image and the previous image according to a temporal distance history;

estimating a current motion vector and a current temporal distance according to a current image and a previous image;

increasing the magnitude of a candidate motion vector in the plurality of candidate motion vectors by a scale factor to produce a scaled candidate motion vector, the scale factor being a non-integer determined according a comparison between the temporal distance and the estimated current temporal distance;

selecting an updated motion vector according to a match error between the scaled candidate motion vector and the estimated current motion vector; and

decreasing the magnitude of the updated motion vector by the scale factor; and storing the updated motion vector with a decreased magnitude as a candidate motion vector in the plurality of candidate motion vectors.

Assignments (4)
SECURITY AGREEMENT Recorded Jul 9, 2021
From: MAXLINEAR, INC.; MAXLINEAR COMMUNICATIONS, LLC; EXAR CORPORATION
To: WELLS FARGO BANK, NATIONAL ASSOCIATION
Reel/Frame 056816/0089 →
RELEASE OF SECURITY INTEREST Recorded Jun 23, 2021
From: MUFG UNION BANK, N.A.
To: MAXLINEAR, INC.; EXAR CORPORATION; MAXLINEAR COMMUNICATIONS LLC
Reel/Frame 056656/0204 →
SUCCESSION OF AGENCY (REEL 042453 / FRAME 0001) Recorded Jul 1, 2020
From: JPMORGAN CHASE BANK, N.A.
To: MUFG UNION BANK, N.A.
Reel/Frame 053115/0842 →
SECURITY AGREEMENT Recorded May 12, 2017
From: MAXLINEAR, INC.; ENTROPIC COMMUNICATIONS, LLC (F/K/A ENTROPIC COMMUNICATIONS, INC.); EXAR CORPORATION
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 042453/0001 →