IP Library Granted Patent US 9,906,814
Granted Patent B1
US 9,906,814 · App. 14/667,950 · Granted Feb 27, 2018

Temporal filtering based on motion detection on areas of different sizes

Inventors: Elliot N. Linzer (Bergenfield, NY); Leslie D. Kohn (Saratoga, CA)
Assignee: Ambarella, Inc.
H04N19/82H04N19/521
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,906,814
App. No.
14/667,950
Granted
Feb 27, 2018
Kind
B1
Abstract

A method for temporal filtering based on motion detection on areas of different sizes is disclosed. Step (A) may compute a first motion score of a first area in a target picture by motion detection of the first area between the target picture and a reference picture. Step (B) may compute a second motion score of a second area in the target picture by motion detection of the second area between the target picture and the reference picture. The first area and the second area are generally of different sizes. Step (C) may temporal filter the target picture with the reference picture based on the first motion score and the second motion score to generate a filtered picture. At least one of the first motion score, the second motion score and the filtered picture may be based on one or more gain settings in a circuit.

Claims (37)

1. A method for temporal filtering based on motion detection on areas of different sizes, comprising the steps of:

computing a first motion score of a first area in a target picture in a sequence of pictures by motion detection of said first area between said target picture and a reference picture in said sequence of pictures;

computing a second motion score of a second area in said target picture by motion detection of said second area between said target picture and said reference picture, wherein said first area and said second area are of different sizes; and

temporal filtering said first area of said target picture with said reference picture based on said first motion score and said second motion score to generate a filtered area in a filtered picture, wherein at least one of said first motion score, said second motion score and said filtered picture is based on one or more gain settings in a circuit.

2. The method according to claim 1 , further comprising the step of:

computing a combined motion score by a combination of said first motion score and said second motion score, wherein said filtered area is based on said combined motion score.

3. The method according to claim 2 , where (i) said combined motion score is controlled by one or more parameters and (ii) at least one of said parameters depends on at least one of said gain settings.

4. The method according to claim 1 , further comprising the steps of:

multiplying said second motion score by said first motion score to generate an index value; and

reading a combined motion score from a lookup table indexed by said index value.

5. The method according to claim 1 , further comprising the steps of:

offsetting said second motion score with said first motion score to generate an index value; and

reading a combined motion score from a lookup table indexed by said index value.

6. The method according to claim 1 , further comprising the step of:

transforming said second motion score based on said first motion score to generate a transformed motion score, wherein a strength of said temporal filter is based on said transformed motion score.

7. The method according to claim 1 , further comprising the step of:

computing a third motion score by motion detection of said first area between said target picture and another reference picture in said sequence of pictures, wherein said filtered area is based on said first motion score, said second motion score and said third motion score.

8. The method according to claim 1 , further comprising the step of:

computing a third motion score by motion detection of said first area between said reference picture and another reference picture in said sequence of pictures, wherein said filtered area is based on said first motion score, said second motion score and said third motion score.

9. The method according to claim 8 , further comprising the step of:

computing a combined motion score by a combination of said first motion score and said third motion score, wherein said filtered area is based on said second motion score and said combined motion score.

10. The method according to claim 1 , wherein said circuit is part of a digital camera.

11. An apparatus comprising:

an interface configured to receive a sequence of pictures; and

a circuit configured to (i) compute a first motion score of a first area in a target picture in said sequence of pictures by motion detection of said first area between said target picture and a reference picture in said sequence of pictures, (ii) compute a second motion score of a second area in said target picture by motion detection of said second area between said target picture and said reference picture and (iii) temporal filter said first area in said target picture with said reference picture based on said first motion score and said second motion score to generate a filtered area in a filtered picture, wherein (a) said first area and said second area are of different sizes and (b) at least one of said first motion score, said second motion score and said filtered picture is based on one or more gain settings.

12. The apparatus according to claim 11 , wherein (i) said circuit is further configured to compute a combined motion score by a combination of said first motion score and said second motion score and (ii) said filtered area is based on said combined motion score.

13. The apparatus according to claim 12 , where (i) said circuit is further configured to control said combined motion score by one or more parameters and (ii) at least one of said parameters depends on at least one of said gain settings.

14. The apparatus according to claim 11 , wherein said circuit is further configured to (i) multiply said second motion score by said first motion score to generate an index value and (ii) read a combined motion score from a lookup table indexed by said index value.

15. The apparatus according to claim 11 , wherein said circuit is further configured to (i) said second motion score with said first motion score to generate an index value and (ii) read a combined motion score from a lookup table indexed by said index value.

16. The apparatus according to claim 11 , wherein said circuit is further configured to transform said second motion score based on said first motion score to generate a transformed motion score, wherein a strength of said temporal filter is based on said transformed motion score.

17. The apparatus according to claim 11 , wherein (i) said circuit is further configured to compute a third motion score by motion detection of said first area between said target picture and another reference picture in said sequence of pictures, and (ii) said filtered area is based on said first motion score, said second motion score and said third motion score.

18. The apparatus according to claim 11 , wherein (i) said circuit is further configured to compute a third motion score by motion detection of said first area between said reference picture and another reference picture in said sequence of pictures, and (ii) said filtered area is based on said first motion score, said second motion score and said third motion score.

19. The apparatus according to claim 18 , wherein (i) said circuit is further configured to compute a combined motion score by a combination of said first motion score and said third motion score, and (ii) said filtered area is based on said second motion score and said combined motion score.

20. An apparatus comprising:

means for computing a first motion score of a first area in a target picture in a sequence of pictures by motion detection of said first area between said target picture and a reference picture in said sequence of pictures;

means for computing a second motion score of a second area in said target picture by motion detection of said second area between said target picture and said reference picture, wherein said first area and said second area are of different sizes; and

means for temporal filtering said first area in said target picture with said reference picture based on said first motion score and said second motion score to generate a filtered area in a filtered picture, wherein at least one of said first motion score, said second motion score and said filtered picture is based on one or more gain settings.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 5, 2020
From: AMBARELLA, INC.
To: AMBARELLA INTERNATIONAL LP
Reel/Frame 051831/0041 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 25, 2015
From: LINZER, ELLIOT N.; KOHN, LESLIE D.
To: AMBARELLA, INC.
Reel/Frame 035250/0496 →
Continuity (1)
Provisional Application 62097663 · Dec 30, 2014