IP Library › Granted Patent US 9,712,747
Granted Patent B2
US 9,712,747 · App. 15/132,843 · Granted Jul 18, 2017

Method and camera for producing an image stabilized video

Inventor: Björn Ardö (Lund, SE)
Assignee: AXIS AB
H04N5/23267H04N5/2328H04N5/23248H04N5/23258H04N5/3572H04N5/77G06T2210/22
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,712,747
App. No.
15/132,843
Granted
Jul 18, 2017
Kind
B2
Abstract

The present invention relates to a method for enabling an image stabilized video. The method comprises providing data defining a vignetting effect for digital image frames captured by a video camera; determining a dislocation value for a digital image frame captured by the video camera; determining, based on the dislocation value, a region of the digital image frame to be displayed in the image stabilized video; applying a vignetting removal process at least on pixels of the digital image frame corresponding to the region to be displayed in the image stabilized video, wherein said applying being based on the data defining the vignetting effect; and reintroducing vignetting on the region of the digital image frame to be displayed in the video based on the data defining the vignetting effect and the dislocation value.

Claims (26)

1. A method for enabling an image stabilized video, the method comprising:

providing data defining a vignetting effect for digital image frames captured by a video camera;

determining a dislocation value for a digital image frame captured by the video camera, wherein the dislocation value is a dislocation of the entire digital image frame or a dislocation of one or a few rows of the digital image frame, the dislocation being induced by camera movement;

applying a shift on the digital image frame in accordance with the determined dislocation value to compensate for movement of the video camera;

cropping the digital image frame based on the dislocation value forming a cropped image frame, wherein the cropped image frame corresponds to a region of the digital image frame to be displayed in the image stabilized video;

applying a vignetting removal process at least on pixels of the digital image frame corresponding to the region to be displayed in the image stabilized video, wherein said applying of the vignetting removal process is based on the data defining the vignetting effect;

reintroducing vignetting on the region of the digital image frame to be displayed in the video based on the data defining the vignetting effect and the dislocation value; and

displaying the region of the digital image frames to be displayed as part of the image stabilized video.

2. The method according to claim 1 , wherein the applying of the vignetting removal process and the reintroducing of the vignetting are performed in a common image processing step.

3. The method according to claim 1 , wherein the applying of the vignetting removal process comprises applying the vignetting removal process on pixels of the cropped image frame, wherein the applying is based on the data defining the vignetting effect, and wherein the reintroducing comprises reintroducing vignetting to the cropped image frame based on the data defining the vignetting effect.

4. The method according to claim 3 , wherein reintroducing vignetting to the cropped image frame is also based on the dislocation value.

5. The method according to claim 1 , wherein providing data defining the vignetting effect comprises providing a table defining how different pixels of an image sensor of the camera are affected by the vignetting effect.

6. The method according to claim 5 , wherein the table comprises data defining how all pixels of the image sensor of the camera are affected by the vignetting effect.

7. The method according to claim 5 , wherein the table comprises data defining how only a subset of pixels of the image sensor of the camera is affected by the vignetting effect.

8. The method according to claim 1 , wherein in case of using a rolling shutter for capturing the digital image frame the determining of a dislocation value comprises determining different dislocation values for at least two different rows of a sensor image frame.

9. The method according to claim 1 , wherein in case of using a global shutter for capturing the digital image frame the determining of a dislocation value comprises determining a single dislocation value for a sensor image frame.

10. A non-transitory computer-readable recording medium having recorded thereon a program for implementing the method according to claim 1 when executed on a device having processing capabilities.

11. An image processing device arranged to produce an image stabilized video comprising digital image frames captured by a video camera, the image processing device comprising:

a memory comprising data defining a vignetting effect for digital image frames captured by the video camera;

a dislocation value determining module arranged to determine a dislocation value for a digital image frame captured by the video camera, wherein the dislocation value is a dislocation of the entire digital image frame or a dislocation of one or a few rows of the digital image frame, the dislocation being induced by camera movement;

an image shift module arranged to, based on the dislocation value, apply a shift on the digital image frame in accordance with the determined dislocation value to compensate for movement of the video camera;

a cropping module arranged to crop the digital image frame based on the dislocation value forming a cropped image frame, wherein the cropped image frame corresponds to a region of the digital image frame to be displayed in the image stabilized video;

a vignetting removal module arranged to, based on the data defining the vignetting effect, remove vignetting from at least pixels of the digital image frame corresponding to the region to be displayed in the image stabilized video;

a vignetting reintroducing module arranged to, based on the data defining the vignetting effect and the dislocation value, reintroduce vignetting on the region of the digital image frame to be displayed in the video; and

a video module arranged to add consecutive digital image frames into the image stabilized video.

12. The device according to claim 11 , wherein the device is a video camera comprising a motion sensor arranged to sense movement of the video camera, wherein the dislocation value determining module is arranged to determine the dislocation value for a digital image frame captured by the video camera based on the sensed movement of the video camera.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 19, 2016
From: ARDÖ, BJÖRN
To: AXIS AB
Reel/Frame 038322/0128 →
Priority Claims (1)
EP 15167953 · May 18, 2015 · regional
Continuity (1)
Related Publication 20160344935A1 · Nov 24, 2016