IP Library Granted Patent US 10,515,439
Granted Patent B2
US 10,515,439 · App. 15/942,789 · Granted Dec 24, 2019

Method for correcting an acquired image

Inventor: Piotr Stec (Galway, IE)
Assignee: FotoNation Limited
G06T5/003G06T7/20H04N5/2329H04N5/23251H04N5/23254H04N5/23258H04N5/23267G06T2207/20201
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,515,439
App. No.
15/942,789
Granted
Dec 24, 2019
Kind
B2
Abstract

A method of correcting an image obtained by an image acquisition device includes obtaining successive measurements, G n , of device movement during exposure of each row of an image. An integration range, idx, is selected in proportion to an exposure time, t e , for each row of the image. Accumulated measurements, C n , of device movement for each row of an image are averaged across the integration range to provide successive filtered measurements, G , of device movement during exposure of each row of an image. The image is corrected for device movement using the filtered measurements G .

Claims (32)

1. A method of correcting an image obtained by an image acquisition device comprising:

obtaining a first measurement of device movement during exposure of a first row of an image and a second measurement of device movement during exposure of a second row of the image, G n ;

selecting an integration range, idx, based, at least in part, on an exposure time, t e , for the first row of the image and the second row of the image,

averaging accumulated measurements, C n , of device movement for the first row of the image and the second row of the image to provide a filtered measurement, G , of device movement during exposure of the first row of the image and the second row of the image, and

correcting the image for device movement using the filtered measurement G .

2. A method according to claim 1 , wherein the integration range, idx, is calculated based, at least in part, on a sampling frequency F for the first measurement of device movement and the second measurement of device movement and the exposure time t e as follows: idx=F*t e .

3. A method according to claim 1 , wherein the averaging comprises calculating the filtered measurement G as follows: G =(C n −C n -idx)/idx where C n is an accumulated value corresponding to measurement Gn and Cn-idx is an accumulated value corresponding to measurement G n -idx at the start of the integration range.

4. A method according to claim 1 , wherein the first measurement of device movement or the second measurement of device movement comprise one or more of: gyroscope, accelerometer or magnetometer measurements.

5. A method according to claim 1 , wherein the image comprises a still image or an image within a sequence of images.

6. A method according to claim 1 , wherein the first row of the image is acquired during a first exposure time and the second row of the image is acquired during a second exposure time.

7. A method according to claim 6 , wherein the first measurement of device movement corresponds to the first exposure time and the second measurement of device movement corresponds to the second exposure time.

8. A method according to claim 1 , wherein the image is acquired using a rolling shutter technique.

9. A method according to claim 1 , wherein the image is part of a video sequence and wherein the correcting the image for device movement using the filtered measurement comprises stabilizing multiple images of the video sequence.

10. A method according to claim 1 , wherein the correcting the image for device movement using the filtered measurement comprises correcting blur in at least a portion of the image to account for device motion during image capture.

11. A system comprising:

a processor; and

memory in communication with the processor;

an image processing pipeline configured to provide an image for correction, and in communication with the processor;

instructions, stored in the memory, which when executed by the processor configure the system to perform actions comprising:

obtaining a first measurement of device movement during exposure of a first row of an image and a second measurement of device movement during exposure of a second row of the image, G n ;

selecting an integration range, idx, based, at least in part, on an exposure time, t e , for the first row of the image and the second row of the image,

averaging accumulated measurements, C n , of device movement for the first row of the image and the second row of the image to provide a filtered measurement, G , of device movement during exposure of the first row of the image and the second row of the image, and

correcting the image for device movement using the filtered measurement G .

12. A system according to claim 11 , wherein the integration range, idx, is calculated based, at least in part, on a sampling frequency F for the first measurement of device movement and the second measurement of device movement and the exposure time t e as follows: idx=F*t e .

13. A system according to claim 11 , wherein the averaging comprises calculating the filtered measurement G as follows: G =(C n −C n -idx)/where C n is an accumulated value corresponding to measurement G n -idx is an accumulated value corresponding to measurement G n -idx at the start of the integration range.

14. A system according to claim 11 , wherein the first measurement of device movement or the second measurement of device movement comprise one or more of: gyroscope, accelerometer or magnetometer measurements.

15. A system according to claim 11 , wherein the image comprises a still image or an image within a sequence of images.

16. A system according to claim 11 , wherein the first row of the image is acquired during a first exposure time and the second row of the image is acquired during a second exposure time.

17. A system according to claim 16 , wherein the first measurement of device movement corresponds to the first exposure time and the second measurement of device movement corresponds to the second exposure time.

18. A system according to claim 11 , wherein the image is acquired using a rolling shutter technique.

19. A system according to claim 11 , further comprising an electronic image stabilisation component and wherein the instructions are further configured to perform actions comprising stabilizing the image based, at least in part, on the filtered measurement.

20. A system according to claim 11 , wherein the device movement corresponds to a vibration of a camera during image capture.

Assignments (6)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 12, 2025
From: TOBII TECHNOLOGIES LTD
To: ADEIA MEDIA HOLDINGS LLC
Reel/Frame 071572/0855 →
CONVERSION Recorded Jun 12, 2025
From: ADEIA MEDIA HOLDINGS LLC
To: ADEIA MEDIA HOLDINGS INC.
Reel/Frame 071577/0875 →
SECURITY INTEREST Recorded May 28, 2025
From: ADEIA INC. (F/K/A XPERI HOLDING CORPORATION); ADEIA HOLDINGS INC.; ADEIA MEDIA HOLDINGS INC.; ADEIA IMAGING LLC; ADEIA MEDIA LLC; ADEIA MEDIA SOLUTIONS INC.; ADEIA SEMICONDUCTOR BONDING TECHNOLOGIES INC.; ADEIA TECHNOLOGIES INC.; ADEIA GUIDES INC.; ADEIA SOLUTIONS LLC; ADEIA SEMICONDUCTOR ADVANCED TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR SOLUTIONS LLC; ADEIA SEMICONDUCTOR INTELLECTUAL PROPERTY LLC; ADEIA SEMICONDUCTOR TECHNOLOGIES LLC; ADEIA PUBLISHING INC.
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 071454/0343 →
CHANGE OF NAME Recorded Mar 31, 2025
From: FOTONATION LIMITED
To: TOBII TECHNOLOGIES LIMITED
Reel/Frame 070682/0207 →
CHANGE OF NAME Recorded Feb 17, 2025
From: FOTONATION LIMITED
To: TOBII TECHNOLOGY LIMITED
Reel/Frame 070238/0774 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 28, 2019
From: STEC, PIOTR
To: FOTONATION LIMITED
Reel/Frame 050199/0847 →
Continuity (2)
Continuation 15048224 · Feb 19, 2016
Related Publication 20180330478A1 · Nov 15, 2018