IP Library Granted Patent US 11,678,054
Granted Patent B2
US 11,678,054 · App. 17/526,791 · Granted Jun 13, 2023

Electronic image stabilization

Inventors: Joseph A. Enke (Campbell, CA); Stepan Moskovchenko (Belmont, CA); Benjamin P. Tankersley (San Mateo, CA); Adam Fenn (San Francisco, CA); Nenad Uzunovic (San Mateo, CA)
Assignee: GoPro, Inc.
H04N23/685G01C21/10G02B27/646H04N23/60H04N23/687H04N23/6812H04N23/695
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,678,054
App. No.
17/526,791
Granted
Jun 13, 2023
Kind
B2
Abstract

Systems and methods are disclosed for image signal processing. For example, method may include determining a sequence of orientation estimates based on sensor data from one or more motion sensors. The method may include receiving an image from the image sensor. The method may include filtering the sensor data with a pass band matching an operation bandwidth to the sequence of orientation estimates to obtain filtered data. The method may include invoking an electronic image stabilization module to correct the image based on the filtered data to obtain a stabilized image. The method may include storing, displaying, or transmitting an output image based on the stabilized image.

Claims (39)

1. An image capture device comprising:

an image sensor configured to obtain images;

a motion tracking module configured to determine a sequence of orientation estimates based on sensor data;

a filter configured to filter the sensor data with a pass band matching an operating bandwidth to the sequence of orientation estimates to obtain filtered data; and

an electronic image stabilization module configured to correct the images based on the filtered data.

2. The image capture device of claim 1 , further comprising:

a processor configured to adjust a cutoff frequency of the operating bandwidth of the electronic image stabilization module based on a state of charge of a battery.

3. The image capture device of claim 2 , wherein the state of charge of the battery is based on a voltage measurement of the battery.

4. The image capture device of claim 2 , wherein the processor is configured to compare the state of charge of the battery to a minimum charge level.

5. The image capture device of claim 4 , wherein the processor is configured to reduce the cutoff frequency of the operating bandwidth when the state of charge of the battery is below the minimum charge level.

6. The image capture device of claim 4 , wherein the processor is configured to adjust the cutoff frequency of the operating bandwidth based on a difference between the state of charge of the battery and the minimum charge level.

7. The image capture device of claim 2 , wherein the operating bandwidth is a subset of a maximum operating bandwidth of the electronic image stabilization module.

8. The image capture device of claim 2 , wherein the processor is configured to tune a controller of the electronic image stabilization module to configure the operating bandwidth.

9. A method comprising:

determining a sequence of orientation estimates based on sensor data from one or more motion sensors;

receiving an image from an image sensor;

filtering the sensor data with a pass band matching an operating bandwidth to the sequence of orientation estimates to obtain filtered data;

invoking an electronic image stabilization module to correct the image based on the filtered data to obtain a stabilized image; and

storing, displaying, or transmitting an output image based on the stabilized image.

10. The method of claim 9 , further comprising:

adjusting a cutoff frequency of the operating bandwidth of the electronic image stabilization module based on a state of charge of a battery.

11. The method of claim 10 , wherein the state of charge of the battery is based on a voltage measurement of the battery.

12. The method of claim 10 , further comprising:

comparing the state of charge of the battery to a minimum charge level.

13. The method of claim 12 , further comprising:

reducing the cutoff frequency of the operating bandwidth when the state of charge of the battery is below the minimum charge level.

14. The method of claim 12 , further comprising:

adjusting the cutoff frequency of the operating bandwidth based on a difference between the state of charge of the battery and the minimum charge level.

15. The method of claim 10 , wherein the operating bandwidth is a subset of a maximum operating bandwidth of the electronic image stabilization module.

16. The method of claim 10 , further comprising:

tuning a controller of the electronic image stabilization module to configure the operating bandwidth.

17. A method comprising:

determining a temperature of an image capture device;

adjusting cutoff frequencies based on the temperature;

determining a state of charge of a battery of the image capture device; and

adjusting the cutoff frequencies based on the state of charge of the battery.

18. The method of claim 17 , wherein determining the temperature of the image capture device is based on a thermodynamic model.

19. The method of claim 18 , wherein the thermodynamic model is based on a maximum operational ambient temperature.

20. The method of claim 17 , wherein determining the temperature of the image capture device is based on a direct measurement.

Assignments (3)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 15, 2021
From: ENKE, JOSEPH A.; MOSKOVCHENKO, STEPAN; TANKERSLEY, BENJAMIN P.; FENN, ADAM; UZUNOVIC, NENAD
To: GOPRO, INC.
Reel/Frame 058116/0519 →
Continuity (6)
Continuation 17175538 · Feb 12, 2021
Continuation 16696043 · Nov 26, 2019
Continuation 15915763 · Mar 8, 2018
Provisional Application 62614140 · Jan 5, 2018
Provisional Application 62563224 · Sep 26, 2017
Related Publication 20220078322A1 · Mar 10, 2022
Cited By (1)
US 12,212,847