IP Library Granted Patent US 11,257,192
Granted Patent B2
US 11,257,192 · App. 16/724,877 · Granted Feb 22, 2022

Method for correcting an acquired image

Inventor: Piotr Stec (Galway, IE)
Assignee: FotoNation Limited
G06T5/003G06T7/20H04N5/2329H04N5/23251H04N5/23254H04N5/23258H04N5/23267G06T2207/20201
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,257,192
App. No.
16/724,877
Granted
Feb 22, 2022
Kind
B2
Abstract

A method of correcting an image obtained by an image acquisition device includes obtaining successive measurements, G n , of device movement during exposure of each row of an image. An integration range, idx, is selected in proportion to an exposure time, t e , for each row of the image. Accumulated measurements, C n , of device movement for each row of an image are averaged across the integration range to provide successive filtered measurements, G , of device movement during exposure of each row of an image. The image is corrected for device movement using the filtered measurements G .

Claims (36)

1. A method comprising:

receiving sensor data representing movement of a device, the sensor data comprising a set of measurements of device movement during exposure of a first row and a second row of an image;

determining an integration range based at least in part on an exposure time of the first row and the second row of the image;

determining an average measurement of device movement based at least in part on the set of measurements and the integration range; and

correcting the image for device movement based at least in part on the average measurement.

2. A method according to claim 1 , wherein determining the integration range is further based at least in part on a sampling frequency associated with the first row or the second row of the image.

3. A method according to claim 1 , wherein determining the integration range is further based at least in part on a first sampling frequency associated with the first row and a second sampling frequency associated with the second row.

4. A method according to claim 1 , wherein at least one of the set of measurements of device movement comprises a gyroscope measurement, an accelerometer measurement, or a magnetometer measurement.

5. A method according to claim 1 , wherein the set of measurements of device movement comprises a first measurement of device movement associated with a first sensor and a second measurement of device movement associated with a second sensor.

6. A method according to claim 1 , wherein the image is acquired using a rolling shutter technique.

7. A method according to claim 1 , wherein the image is part of a video sequence and wherein correcting the image for device movement using the average measurement comprises stabilizing multiple images of the video sequence.

8. A method according to claim 1 , wherein correcting the image for device movement using the average measurement comprises correcting blur in at least a portion of the image to account for device motion during image capture.

9. A system comprising:

one or more processors; and

memory storing processor-executable instructions that, when executed by the one or more processors, cause the system to perform actions comprising:

receiving sensor data representing movement of a device, the sensor data comprising a set of measurements of device movement during exposure of a first row and a second row of an image;

determining an integration range based at least in part on an exposure time of the first row and the second row of the image;

determining a measurement of device movement based at least in part on the set of measurements and the integration range; and

correcting the image for device movement based at least in part on the measurement.

10. A system according to claim 9 , wherein at least one of the set of measurements of device movement comprises a gyroscope measurement, an accelerometer measurement, or a magnetometer measurement.

11. A system according to claim 9 , wherein the set of measurements of device movement comprises a first measurement of device movement associated with a first sensor and a second measurement of device movement associated with a second sensor.

12. A system according to claim 9 , wherein determining the integration range is further based at least in part on a sampling frequency associated with the first row or the second row of the image.

13. A system according to claim 9 , wherein the image is acquired using a rolling shutter technique.

14. A system according to claim 9 , wherein the image is part of a video sequence and wherein correcting the image for device movement using the measurement comprises stabilizing multiple images of the video sequence.

15. A system according to claim 9 , wherein correcting the image for device movement using the measurement comprises correcting blur in at least a portion of the image to account for device motion during image capture.

16. An image acquisition device comprising:

a sensor to receive sensor data representing movement of a device, the sensor data comprising a set of measurements of device movement during exposure of a first row and a second row of an image;

one or more processors; and

memory storing processor-executable instructions that, when executed by the one or more processors, cause the image acquisition device to perform actions comprising:

determining an integration range based at least in part on an exposure time of the first row and the second row of the image;

determining an average measurement of device movement based at least in part on the set of measurements and the integration range; and

correcting the image for device movement based at least in part on the average measurement.

17. A image acquisition device according to claim 16 , wherein at least one of the set of measurements of device movement comprises a gyroscope measurement, an accelerometer measurement, or a magnetometer measurement.

18. A image acquisition device according to claim 16 , wherein the set of measurements of device movement comprises a first measurement of device movement associated with a first sensor and a second measurement of device movement associated with a second sensor.

19. A image acquisition device according to claim 16 , wherein the image is acquired using a rolling shutter technique.

20. A image acquisition device according to claim 16 , wherein the image is part of a video sequence and wherein correcting the image for device movement using the average measurement comprises stabilizing multiple images of the video sequence.

Assignments (7)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 12, 2025
From: TOBII TECHNOLOGIES LTD
To: ADEIA MEDIA HOLDINGS LLC
Reel/Frame 071572/0855 →
CONVERSION Recorded Jun 12, 2025
From: ADEIA MEDIA HOLDINGS LLC
To: ADEIA MEDIA HOLDINGS INC.
Reel/Frame 071577/0875 →
SECURITY INTEREST Recorded May 28, 2025
From: ADEIA INC. (F/K/A XPERI HOLDING CORPORATION); ADEIA HOLDINGS INC.; ADEIA MEDIA HOLDINGS INC.; ADEIA IMAGING LLC; ADEIA MEDIA LLC; ADEIA MEDIA SOLUTIONS INC.; ADEIA SEMICONDUCTOR BONDING TECHNOLOGIES INC.; ADEIA TECHNOLOGIES INC.; ADEIA GUIDES INC.; ADEIA SOLUTIONS LLC; ADEIA SEMICONDUCTOR ADVANCED TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR SOLUTIONS LLC; ADEIA SEMICONDUCTOR INTELLECTUAL PROPERTY LLC; ADEIA SEMICONDUCTOR TECHNOLOGIES LLC; ADEIA PUBLISHING INC.
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 071454/0343 →
CHANGE OF NAME Recorded Mar 31, 2025
From: FOTONATION LIMITED
To: TOBII TECHNOLOGIES LIMITED
Reel/Frame 070682/0207 →
CHANGE OF NAME Recorded Feb 17, 2025
From: FOTONATION LIMITED
To: TOBII TECHNOLOGY LIMITED
Reel/Frame 070238/0774 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 16, 2020
From: STEC, PIOTR
To: FOTONATION LIMITED
Reel/Frame 052126/0546 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 23, 2019
From: STEC, PIOTR
To: FOTONATION LIMITED
Reel/Frame 051355/0132 →
Continuity (3)
Continuation 15942789 · Apr 2, 2018
Continuation 15048224 · Feb 19, 2016
Related Publication 20200143523A1 · May 7, 2020