IP Library Granted Patent US 11,257,192
Granted Patent B2
US 11,257,192 · App. 16/724,877 · Granted Feb 22, 2022

Method for correcting an acquired image

Inventor: Piotr Stec (Galway, IE)
Assignee: FotoNation Limited
G06T5/003G06T7/20H04N5/2329H04N5/23251H04N5/23254H04N5/23258H04N5/23267G06T2207/20201
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,257,192
App. No.
16/724,877
Granted
Feb 22, 2022
Kind
B2
Abstract

A method of correcting an image obtained by an image acquisition device includes obtaining successive measurements, G n , of device movement during exposure of each row of an image. An integration range, idx, is selected in proportion to an exposure time, t e , for each row of the image. Accumulated measurements, C n , of device movement for each row of an image are averaged across the integration range to provide successive filtered measurements, G , of device movement during exposure of each row of an image. The image is corrected for device movement using the filtered measurements G .

Claims (36)

1. A method comprising:

receiving sensor data representing movement of a device, the sensor data comprising a set of measurements of device movement during exposure of a first row and a second row of an image;

determining an integration range based at least in part on an exposure time of the first row and the second row of the image;

determining an average measurement of device movement based at least in part on the set of measurements and the integration range; and

correcting the image for device movement based at least in part on the average measurement.

2. A method according to claim 1 , wherein determining the integration range is further based at least in part on a sampling frequency associated with the first row or the second row of the image.

3. A method according to claim 1 , wherein determining the integration range is further based at least in part on a first sampling frequency associated with the first row and a second sampling frequency associated with the second row.

4. A method according to claim 1 , wherein at least one of the set of measurements of device movement comprises a gyroscope measurement, an accelerometer measurement, or a magnetometer measurement.

5. A method according to claim 1 , wherein the set of measurements of device movement comprises a first measurement of device movement associated with a first sensor and a second measurement of device movement associated with a second sensor.

6. A method according to claim 1 , wherein the image is acquired using a rolling shutter technique.

7. A method according to claim 1 , wherein the image is part of a video sequence and wherein correcting the image for device movement using the average measurement comprises stabilizing multiple images of the video sequence.

8. A method according to claim 1 , wherein correcting the image for device movement using the average measurement comprises correcting blur in at least a portion of the image to account for device motion during image capture.

9. A system comprising:

one or more processors; and

memory storing processor-executable instructions that, when executed by the one or more processors, cause the system to perform actions comprising:

receiving sensor data representing movement of a device, the sensor data comprising a set of measurements of device movement during exposure of a first row and a second row of an image;

determining an integration range based at least in part on an exposure time of the first row and the second row of the image;

determining a measurement of device movement based at least in part on the set of measurements and the integration range; and

correcting the image for device movement based at least in part on the measurement.

10. A system according to claim 9 , wherein at least one of the set of measurements of device movement comprises a gyroscope measurement, an accelerometer measurement, or a magnetometer measurement.

11. A system according to claim 9 , wherein the set of measurements of device movement comprises a first measurement of device movement associated with a first sensor and a second measurement of device movement associated with a second sensor.

12. A system according to claim 9 , wherein determining the integration range is further based at least in part on a sampling frequency associated with the first row or the second row of the image.

13. A system according to claim 9 , wherein the image is acquired using a rolling shutter technique.

14. A system according to claim 9 , wherein the image is part of a video sequence and wherein correcting the image for device movement using the measurement comprises stabilizing multiple images of the video sequence.

15. A system according to claim 9 , wherein correcting the image for device movement using the measurement comprises correcting blur in at least a portion of the image to account for device motion during image capture.

16. An image acquisition device comprising:

a sensor to receive sensor data representing movement of a device, the sensor data comprising a set of measurements of device movement during exposure of a first row and a second row of an image;

one or more processors; and

memory storing processor-executable instructions that, when executed by the one or more processors, cause the image acquisition device to perform actions comprising:

determining an integration range based at least in part on an exposure time of the first row and the second row of the image;

determining an average measurement of device movement based at least in part on the set of measurements and the integration range; and

correcting the image for device movement based at least in part on the average measurement.

17. A image acquisition device according to claim 16 , wherein at least one of the set of measurements of device movement comprises a gyroscope measurement, an accelerometer measurement, or a magnetometer measurement.

18. A image acquisition device according to claim 16 , wherein the set of measurements of device movement comprises a first measurement of device movement associated with a first sensor and a second measurement of device movement associated with a second sensor.

19. A image acquisition device according to claim 16 , wherein the image is acquired using a rolling shutter technique.

20. A image acquisition device according to claim 16 , wherein the image is part of a video sequence and wherein correcting the image for device movement using the average measurement comprises stabilizing multiple images of the video sequence.

Assignments (7)
CONVERSION Recorded Jun 12, 2025
From: ADEIA MEDIA HOLDINGS LLC
To: ADEIA MEDIA HOLDINGS INC.
Reel/Frame 071577/0875 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 12, 2025
From: TOBII TECHNOLOGIES LTD
To: ADEIA MEDIA HOLDINGS LLC
Reel/Frame 071572/0855 →
SECURITY INTEREST Recorded May 28, 2025
From: ADEIA INC. (F/K/A XPERI HOLDING CORPORATION); ADEIA HOLDINGS INC.; ADEIA MEDIA HOLDINGS INC.; ADEIA IMAGING LLC; ADEIA MEDIA LLC; ADEIA MEDIA SOLUTIONS INC.; ADEIA SEMICONDUCTOR BONDING TECHNOLOGIES INC.; ADEIA TECHNOLOGIES INC.; ADEIA GUIDES INC.; ADEIA SOLUTIONS LLC; ADEIA SEMICONDUCTOR ADVANCED TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR SOLUTIONS LLC; ADEIA SEMICONDUCTOR INTELLECTUAL PROPERTY LLC; ADEIA SEMICONDUCTOR TECHNOLOGIES LLC; ADEIA PUBLISHING INC.
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 071454/0343 →
CHANGE OF NAME Recorded Mar 31, 2025
From: FOTONATION LIMITED
To: TOBII TECHNOLOGIES LIMITED
Reel/Frame 070682/0207 →
CHANGE OF NAME Recorded Feb 17, 2025
From: FOTONATION LIMITED
To: TOBII TECHNOLOGY LIMITED
Reel/Frame 070238/0774 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 16, 2020
From: STEC, PIOTR
To: FOTONATION LIMITED
Reel/Frame 052126/0546 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 23, 2019
From: STEC, PIOTR
To: FOTONATION LIMITED
Reel/Frame 051355/0132 →
Continuity (3)
Continuation 15942789 · Apr 2, 2018
Continuation 15048224 · Feb 19, 2016
Related Publication 20200143523A1 · May 7, 2020