IP Library › Granted Patent US 11,670,004
Granted Patent B2
US 11,670,004 · App. 17/845,584 · Granted Jun 6, 2023

Systems and methods for dynamic optical medium calibration

Inventors: Nicolas Rahmouni (Paris, FR); Maxim Karpushin (Paris, FR); Thomas Derbanne (Paris, FR)
Assignee: GoPro, Inc.
G06T7/80H04N17/002G06T2207/10004
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,670,004
App. No.
17/845,584
Granted
Jun 6, 2023
Kind
B2
Abstract

An image capture device may be calibrated using calibration parameters. Optical medium through which the image capture device captures images may be changed. The calibration parameters of the image capture device may be dynamically modified to account for the change in the optical medium. The image capture device may be operated in accordance with the modified calibration parameters to capture images through the optical medium.

Claims (41)

1. A system for dynamic optical medium calibration; the system comprising:

one or more physical processors configured by machine-readable instructions to:

obtain images of a scene captured by an image capture device through an optical medium during a capture duration, the images including a first image captured at a first moment within the capture duration and a second image captured at a second moment within the capture duration, wherein the image capture device rotates between the first moment and the second moment;

determine, based on (1) movement of one or more pixels depicting an object within the scene between the first image and the second image and (2) the rotation of the image capture device between the first moment and the second moment, whether the optical medium through which the images have been captured by the image capture device is a first optical medium in which the images are captured solely through an optical element of the image capture device or a second optical medium different from the first optical medium;

responsive to determination that the images have been captured through the second optical medium, select one or more modified calibration parameters of the image capture device for the second optical medium from among predefined calibration parameters, the predefined calibration parameters including different predefined calibration parameters for different types of optical medium; and

effectuate operation of the image capture device based on the one or more modified calibration parameters.

2. The system of claim 1 , wherein:

the images are captured using one or more default calibration parameters;

change in position of the one or more pixels from a first position within the first image to a predicted position within the second image is determined based on the one or more default calibration parameters.

3. The system of claim 2 , wherein the optical medium through which the images have been captured by the image capture device is determined to be the second optical medium different from the first optical medium based on a difference between the predicted position of the one or more pixels within the second image and actual position of the one or more pixels within the second image.

4. The system of claim 2 , wherein the optical medium through which the images have been captured by the image capture device is determined to be the second optical medium different from the first optical medium based on a predicted optical flow corresponding to the predicted position of the one or more pixels within the second image and an actual optical flow corresponding to actual position of the one or more pixels within the second image.

5. The system of claim 1 , wherein the determination that the images have been captured through the second optical medium different from the first optical medium includes determination of a change in the optical medium of the image capture device.

6. The system of claim 5 , wherein the determination of the change in the optical medium of the image capture device includes determination that an optical element extension has been installed on the optical element of the image capture device.

7. The system of claim 1 , wherein the determination of the change in the optical medium of the image capture device includes determination that an interchangeable optical element has been installed in place of the optical element of the image capture device.

8. The system of claim 1 , wherein the determination of the change in the optical medium of the image capture device includes determination that the image capture device has been submerged under water.

9. The system of claim 8 , wherein the optical medium is determined to include water in front of the optical element of the image capture device.

10. A method for dynamic optical medium calibration, the method performed by a computing system including one or more processors, the method comprising:

obtaining, by the computing system, images of a scene captured by an image capture device through an optical medium during a capture duration, the images including a first image captured at a first moment within the capture duration and a second image captured at a second moment within the capture duration, wherein the image capture device rotates between the first moment and the second moment;

determining, by the computing system, based on (1) movement of one or more pixels depicting an object within the scene between the first image and the second image and (2) the rotation of the image capture device between the first moment and the second moment, whether the optical medium through which the images have been captured by the image capture device is a first optical medium in which the images are captured solely through an optical element of the image capture device or a second optical medium different from the first optical medium;

responsive to determining that the images have been captured through the second optical medium, selecting, by the computing system, one or more modified calibration parameters of the image capture device for the second optical medium from among predefined calibration parameters, the predefined calibration parameters including different predefined calibration parameters for different types of optical medium; and

effectuating, by the computing system, operation of the image capture device based on the one or more modified calibration parameters.

11. The method of claim 10 , wherein:

the images are captured using one or more default calibration parameters;

change in position of the one or more pixels from a first position within the first image to a predicted position within the second image is determined based on the one or more default calibration parameters.

12. The method of claim 11 , wherein the optical medium through which the images have been captured by the image capture device is determined to be the second optical medium different from the first optical medium based on a difference between the predicted position of the one or more pixels within the second image and actual position of the one or more pixels within the second image.

13. The method of claim 11 , wherein the optical medium through which the images have been captured by the image capture device is determined to be the second optical medium different from the first optical medium based on a predicted optical flow corresponding to the predicted position of the one or more pixels within the second image and an actual optical flow corresponding to actual position of the one or more pixels within the second image.

14. The method of claim 10 , wherein determining that the images have been captured through the second optical medium different from the first optical medium includes determining a change in the optical medium of the image capture device.

15. The method of claim 14 , wherein determining the change in the optical medium of the image capture device includes determining that an optical element extension has been installed on the optical element of the image capture device.

16. The method of claim 10 , wherein determining the change in the optical medium of the image capture device includes determining that an interchangeable optical element has been installed in place of the optical element of the image capture device.

17. The method of claim 10 , wherein determining the change in the optical medium of the image capture device includes determining that the image capture device has been submerged under water.

18. The method of claim 17 , wherein the optical medium is determined to include water in front of the optical element of the image capture device.

19. A system for dynamic optical medium calibration, the system comprising:

one or more physical processors configured by machine-readable instructions to:

obtain images of a scene captured by an image capture device through an optical medium during a capture duration, the images are captured using one or more default calibration parameters of the image capture device, the images including a first image captured at a first moment within the capture duration and a second image captured at a second moment within the capture duration, wherein the image capture device rotates between the first moment and the second moment;

determine, based on (1) movement of one or more pixels depicting an object within the scene between the first image and the second image, (2) the rotation of the image capture device between the first moment and the second moment, and (3) the one or more default calibration parameters of the image capture device, whether the optical medium through which the images have been captured by the image capture device is a first optical medium in which the images are captured solely through an optical element of the image capture device or a second optical medium different from the first optical medium;

responsive to determination that the images have been captured through the second optical medium, select one or more modified calibration parameters of the image capture device for the second optical medium from among predefined calibration parameters, the predefined calibration parameters including different predefined calibration parameters for different types of optical medium; and

effectuate operation of the image capture device based on the one or more modified calibration parameters.

20. The system of claim 19 , wherein the determination that the images have been captured through the second optical medium different from the first optical medium includes determination that;

an optical element extension has been installed on the optical element of the image capture device;

an interchangeable optical element has been installed in place of the optical element of the image capture device; or

the image capture device has been submerged under water.

Assignments (3)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 21, 2022
From: RAHMOUNI, NICOLAS; KARPUSHIN, MAXIM; DERBANNE, THOMAS
To: GOPRO, INC.
Reel/Frame 060266/0129 →
Continuity (2)
Continuation 16707419 · Dec 9, 2019
Related Publication 20220327741A1 · Oct 13, 2022