IP Library Granted Patent US 10,469,749
Granted Patent B1
US 10,469,749 · App. 15/967,722 · Granted Nov 5, 2019

Temporal filter with criteria setting maximum amount of temporal blend

Inventor: Elliot N. Linzer (Bergenfield, NY)
Assignee: Ambarella, Inc.
H04N5/23254G06T5/00G06T5/50H04N5/23277H04N5/243G06T5/002G06T2207/20182
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,469,749
App. No.
15/967,722
Granted
Nov 5, 2019
Kind
B1
Abstract

An apparatus includes a processor circuit and a correction circuit. The processor circuit may be configured to receive a sequence of pictures. The correction circuit may be configured to (i) generate a motion score based upon target samples from a target picture and reference samples from one or more reference pictures of the sequence of pictures, (ii) generate a first weight value based upon the motion score and a first weight limit value, and (iii) generate a plurality of blended picture samples by combining the target samples and the reference samples based upon the first weight value.

Claims (36)

1. An apparatus comprising:

a processor circuit configured to receive a sequence of pictures; and

a correction circuit configured to (i) generate a motion score based upon target samples from a target picture and reference samples from one or more reference pictures of said sequence of pictures, (ii) generate a first weight value based upon said motion score and a first weight limit value, and (iii) generate a plurality of blended picture samples by combining said target samples and said reference samples based upon said first weight value, wherein said motion score is generated using a primary motion detection process and said first weight limit value is generated using a secondary motion detection process different from said primary motion detection process.

2. The apparatus according to claim 1 , wherein said first weight limit sets either a maximum value or a minimum value of said first weight value.

3. The apparatus according to claim 1 , wherein said plurality of blended picture samples are generated through temporal blending.

4. The apparatus according to claim 1 , wherein said correction circuit is further configured to:

generate a plurality of smoothed target samples by spatially smoothing a plurality of target samples selected from said target picture of said sequence of pictures;

generate a second weight value based upon said motion score and a second weight limit value; and

generate a plurality of final blended picture samples by combining said plurality of blended picture samples and said plurality of smoothed target samples based upon said second weight value.

5. The apparatus according to claim 4 , wherein said second weight limit sets either a maximum value or a minimum value of said second weight value.

6. The apparatus according to claim 4 , wherein said plurality of final blended picture samples are generated through spatial temporal blending.

7. The apparatus according to claim 1 , wherein said secondary motion detection process uses reference frames from a point further back in time than the reference frames used by the primary motion detection process.

8. The apparatus according to claim 1 , wherein said primary motion detection process is configured to perform local lighting correction and said secondary motion detection process is configured not to perform local lighting correction.

9. The apparatus according to claim 1 , wherein said primary motion detection process is configured to perform local lighting correction and said secondary motion detection process is configured (i) not to perform local lighting correction and (ii) to use reference frames from a point further back in time than the reference frames used by the primary motion detection process.

10. The apparatus according to claim 1 , wherein computing said motion score comprises one or more of (i) using tonal values, (ii) adjusting said target and said one or more reference pictures based on global brightness, (iii) combining multiple picture differences, (iv) using big and small areas, and (v) adjusting local lighting before computing said motion score.

11. The apparatus according to claim 1 , wherein said apparatus forms part of a digital camera.

12. An apparatus comprising:

a processor circuit configured to receive a sequence of pictures; and

a correction circuit configured to (i) generate a motion score based upon target samples from a target picture and reference samples from one or more reference pictures of said sequence of pictures, (ii) generate a first weight value based upon said motion score and a first weight limit value, and (iii) generate a plurality of blended picture samples by combining said target samples and said reference samples based upon said first weight value, wherein said first weight limit value is generated utilizing at least one of (i) noise level information for particular areas of said target picture, (ii) one or more of brightness or tone values, and (iii) position information corresponding to samples to be blended.

13. A method of temporal filtering comprising:

receiving a sequence of pictures;

generating a motion score based upon target samples from a target picture and reference samples from one or more reference pictures of said sequence of pictures;

generating a first weight value based upon said motion score and a first weight limit value; and

generating a plurality of blended picture samples by combining said target samples and said reference samples based upon said first weight value, wherein said motion score is generated using a primary motion detection process and said first weight limit value is generated using a secondary motion detection process different from said primary motion detection process.

14. The method according to claim 13 , wherein said first weight limit sets either a maximum value of said first weight value or a minimum value of said first weight value.

15. The method according to claim 13 , wherein said plurality of blended picture samples are generated through temporal blending.

16. The method according to claim 13 , further comprising:

generating a plurality of smoothed target samples by spatially smoothing a plurality of target samples selected from said target picture of said sequence of pictures;

generating a second weight value based upon said motion score and a second weight limit value; and

generating a plurality of final blended picture samples by combining said plurality of blended picture samples and said plurality of smoothed target samples based upon said second weight value.

17. The method according to claim 16 , wherein:

said second weight limit sets either a maximum value of said second weight value or a minimum value of said second weight value; and

said plurality of final blended picture samples are generated through spatial temporal blending.

18. The method according to claim 13 , wherein said secondary motion detection process uses reference frames from a point further back in time than the reference frames used by the primary motion detection process.

19. The method according to claim 13 , wherein said primary motion detection process is configured to perform local lighting correction and said secondary motion detection process is configured not to perform local lighting correction.

20. The method according to claim 13 , wherein said primary motion detection process is configured to perform local lighting correction and said secondary motion detection process is configured (i) not to perform local lighting correction and (ii) to use reference frames from a point further back in time than the reference frames used by the primary motion detection process.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 5, 2020
From: AMBARELLA, INC.
To: AMBARELLA INTERNATIONAL LP
Reel/Frame 051831/0041 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 1, 2018
From: LINZER, ELLIOT N.
To: AMBARELLA, INC.
Reel/Frame 045678/0887 →
Cited By (1)
US 12,355,957