IP Library Granted Patent US 8,068,697
Granted Patent B2
US 8,068,697 · App. 11/874,527 · Granted Nov 29, 2011

Real time video stabilizer

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,068,697
App. No.
11/874,527
Granted
Nov 29, 2011
Kind
B2
Abstract

A method of correcting a current image taken by a capturing device, the current image captured after a previous image, the method comprising the steps of: determining a noticeable pixel group, such as an edge of an object in the previous image; locating the noticeable pixel groups in the current image, by finding corresponding pixels whose values are most similar to the values of the noticeable pixels, determining the offset between the previous image and the current image, and correcting the current image using the offset. Optionally, multiple offsets are determined for multiple areas in the current image, and other areas in the image are optionally corrected according to interpolations between the determined offsets.

Claims (45)

1. A method for correcting a current image taken by a capturing device, the current image being captured after a previous image is captured, the method comprising:

determining at least one noticeable pixel group;

performing multiple comparisons between a pixel value of at least one noticeable pixel belonging to the at least one noticeable pixel group, and values of multiple pixels in the current image, each of the multiple pixels in the current image having an offset relative to the at least one noticeable pixel, yielding multiple comparison results, each comparison result being associated with the offset;

determining a minimum result between the multiple comparison results;

determining a correction of at least a portion of the current image as a function of the offset associated with the minimum result; and

applying an interpolation result of at least two corrections, to at least one pixel in the current image, the at least one pixel not belonging to pixels corresponding to the at least one noticeable pixel group.

2. The method of claim 1 wherein the noticeable pixel group comprises at least one pixel located in the vicinity of at least two regions having significantly different pixel values.

3. The method of claim 1 wherein the noticeable pixel group comprises at least two groups of pixels having no common corners.

4. The method of claim 1 wherein the multiple comparison results are stored in a matrix.

5. The method of claim 1 further comprising a step of correcting at least one portion of the current image using a result of applying a function to the determined correction.

6. The method of claim 1 wherein the correction is determined using a previous determined correction between at least one first previous image and at least one second previous image.

7. The method of claim 1 wherein the correction is performed for at least one pixel in the current image, having a location related to the at least one noticeable pixel group.

8. The method of claim 1 wherein each of at least two different corrections is applied to a different portion of the current image.

9. The method of claim 1 wherein determining the multiple comparison results takes into account one or more of the following: a weight of a pixel, a number of appearances in previous images, an influence of previous corrections, and a location.

10. The method of claim 1 wherein the capturing device comprises a CMOS sensor.

11. The method of claim 10 wherein the offset determined for at least one pixel belonging to an upper region of the current image is associated with an offset determined for at least one pixel belonging to a lower region of the previous image.

12. The method of claim 10 wherein the offset determined for at least one pixel belonging to a lower region of the current image is associated with an offset determined for at least one pixel belonging to an upper region of the previous image.

13. The method of claim 1 further comprising a step of storing the multiple comparison results in a matrix.

14. The method of claim 1 wherein determining the correction is done using at least one rule.

15. The method of claim 14 wherein the at least one rule relates to one or more of the following: a sensor used in the capturing device; a size of an image captured by the capturing device; resolution of an image captured by the capturing device; luminance or brightness conditions of the capturing device; number or location of important objects seen in the previous image; background color of the previous image or the current image; and size ratio between one or more objects seen in the previous image or the current image.

16. The method of claim 1 wherein the correction is determined before the current image is fully captured.

17. A method for correcting a current image taken by a capturing device, the current image being captured after a previous image is captured, the method comprising:

determining at least one noticeable pixel group;

performing multiple comparisons between a pixel value of at least one noticeable pixel belonging to the at least one noticeable pixel group, and values of multiple pixels in the current image, each of the multiple pixels in the current image having an offset relative to the at least one noticeable pixel, yielding multiple comparison results, each comparison result being associated with the offset;

determining a minimum result between the multiple comparison results;

determining a correction of at least a portion of the current image as a function of the offset associated with the minimum result;

storing the multiple comparison results in a matrix; and

applying a low-pass filter to the matrix.

18. The method of claim 17 further comprising a step of applying an impulse response filter to the comparison results.

19. A method for correcting a current image taken by a capturing device, the current image being captured after a previous image is captured, the method comprising:

determining at least one noticeable pixel group;

performing multiple comparisons between a pixel value of at least one noticeable pixel belonging to the at least one noticeable pixel group, and values of multiple pixels in the current image, each of the multiple pixels in the current image having an offset relative to the at least one noticeable pixel, yielding multiple comparison results, each comparison result being associated with the offset;

determining a minimum result between the multiple comparison results;

determining a correction of at least a portion of the current image as a function of the offset associated with the minimum result; and

applying an impulse response filter to the comparison results.

20. The method of claim 19 further comprising switching the impulse response filter between a fast impulse response filter and a slow impulse response filter.

21. The method of claim 19 further comprising a step of storing the multiple comparison results in a matrix.

22. A method for correcting a current image taken by a capturing device comprising a CMOS sensor, the current image being captured after a previous image is captured, the method comprising:

determining at least two pixel groups;

for each pixel group, performing multiple comparisons between a pixel value of at least one pixel belonging to the pixel group, and values of multiple pixels in the current image, each of the multiple pixels in the current image having an offset relative to the at least one pixel, and associating each comparison result with the offset;

for each pixel group, determining a minimum result among the comparison results;

for each pixel group determining a correction of at least a portion of the current image as a function of the offset associated with the minimum result; and

applying an interpolated correction to at least one pixel in the current group, the at least one pixel not corresponding to any of the pixel groups, the correction being determined using at least two corrections, each of the at least two corrections being associated with one pixel group.

23. The method of claim 22 wherein the offset determined for at least one pixel belonging to an upper region of the current image is determined using an offset determined for at least one pixel belonging to a lower region of the previous image.

24. The method of claim 22 wherein the offset determined for at least one pixel belonging to a lower region of the current image is determined using an offset determined for at least one pixel belonging to an upper region of the previous image.

Assignments (8)
CORRECTIVE ASSIGNMENT TO CORRECT THE PROPERTY NUMBERS PREVIOUSLY RECORDED AT REEL: 47630 FRAME: 344. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Mar 21, 2019
From: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
To: AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE. LIMITED
Reel/Frame 048883/0267 →
CORRECTIVE ASSIGNMENT TO CORRECT THE EFFECTIVE DATE OF MERGER TO 9/5/2018 PREVIOUSLY RECORDED AT REEL: 047196 FRAME: 0687. ASSIGNOR(S) HEREBY CONFIRMS THE MERGER. Recorded Oct 29, 2018
From: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
To: AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE. LIMITED
Reel/Frame 047630/0344 →
MERGER Recorded Oct 4, 2018
From: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
To: AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE. LIMITED
Reel/Frame 047196/0687 →
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS Recorded Feb 3, 2017
From: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
To: BROADCOM CORPORATION
Reel/Frame 041712/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 1, 2017
From: BROADCOM CORPORATION
To: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
Reel/Frame 041706/0001 →
PATENT SECURITY AGREEMENT Recorded Feb 11, 2016
From: BROADCOM CORPORATION
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 037806/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 31, 2011
From: SIGHTIC VISTA, LTD.
To: BROADCOM CORPORATION
Reel/Frame 026836/0013 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 18, 2007
From: VITSNUDEL, ILIA; OKS, EDUARD
To: SIGHTIC VISTA LTD.
Reel/Frame 019982/0406 →