IP Library Granted Patent US 12,101,556
Granted Patent B2
US 12,101,556 · App. 18/008,763 · Granted Sep 24, 2024

Wide angle adapter lens for enhanced video stabilization

Inventors: Jonathan Stern (San Mateo, CA); Peiqian Zhao (Mountain View, CA); Ingrid A. Cotoros (Hillsborough, CA)
Assignee: GoPro, Inc.
H04N23/683G02B27/646G03B17/565H04N23/55
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,101,556
App. No.
18/008,763
Granted
Sep 24, 2024
Kind
B2
Abstract

An image capture system for enhanced electronic image stabilization (EIS) includes an image capture device and an adapter lens. The image capture device includes an image sensor, a lens housing, a processor, and a lens assembly that includes a first group of optical elements disposed within the lens housing. The first group of optical elements are used project an image onto the image sensor. The processor performs EIS. The adapter lens is used to enhance EIS of the image capture device. The adapter lens has an adapter lens housing that interfaces with the lens housing. The adapter lens has a second group of optical elements disposed within the adapter lens housing. The second group of optical elements are used to project the image as an image circle on the image sensor.

Claims (37)

1. An image capture system comprising:

an image capture device comprising:

an image sensor;

a lens housing;

a lens assembly comprising a first group of optical elements disposed within the lens housing, wherein the first group of optical elements is configured to project an image onto the image sensor; and

a processor configured to perform electronic image stabilization (EIS) by defining a crop area and mapping pixels based on inertial measurement unit (IMU) data, wherein the processor is configured to map pixels based on a mapping table; and

an adapter lens configured to enhance EIS of the image capture device, the adapter lens comprising:

an adapter lens housing configured to interface with the lens housing; and

a second group of optical elements disposed within the adapter lens housing, wherein the second group of optical elements is configured to project the image as an image circle on the image sensor.

2. The image capture system of claim 1 , wherein the image sensor has a rectangular surface area.

3. The image capture system of claim 2 , wherein the rectangular surface area has a 4:3 aspect ratio or a 16:9 aspect ratio.

4. The image capture system of claim 2 , the image circle is confined within the rectangular surface area of the image sensor.

5. The image capture system of claim 1 , wherein the processor is configured to obtain a sequence of frames.

6. The image capture system of claim 5 , wherein the sequence of frames includes a reference frame and a second frame.

7. The image capture system of claim 1 , wherein the mapping table is based on an optical distortion of the lens assembly and the adapter lens.

8. The image capture system of claim 1 , wherein the first group of optical elements includes at least one aspherical element and at least one spherical element.

9. The image capture system of claim 1 , wherein the second group of optical elements includes at least one aspherical element and at least on spherical element.

10. The image capture system of claim 1 , wherein the first group of optical elements has a first field of view (FOV).

11. The image capture system of claim 10 , wherein the second group of optical elements has a second FOV, and the second FOV is greater than the first FOV.

12. An image capture device comprising:

an image sensor;

a lens housing configured to couple to a detachable adapter lens configured to enhance electronic image stabilization (EIS);

a lens comprising a first group of optical elements disposed within the lens housing, wherein the first group of optical elements is configured to project an image onto the image sensor; and

a processor configured to perform EIS, wherein the processor is configured to map pixels based on a mapping table.

13. The image capture device of claim 12 , wherein the detachable adapter lens comprises a second group of optical elements configured to project the image as an image circle on the image sensor.

14. The image capture device of claim 13 , wherein the image circle is confined within the image sensor.

15. The image capture device of claim 13 , wherein the first group of optical elements has a first field of view (FOV).

16. The image capture device of claim 15 , wherein the second group of optical elements has a second FOV, and wherein the second FOV is greater than the first FOV.

17. A method for enhanced electronic image stabilization (EIS) comprising:

detecting an adapter lens;

adjusting an EIS algorithm based on the adapter lens;

capturing video comprising frames;

applying the adjusted EIS algorithm to the frames to obtain stabilized frames; and

outputting the stabilized frames as stabilized video.

18. The method of claim 17 , wherein a mapping table is used to adjust the EIS algorithm.

19. The method of claim 18 , wherein the mapping table is based on an optical distortion of the adapter lens and an optical distortion of an image capture device lens.

20. The method of claim 17 , wherein detecting the adapter lens includes receiving a user input that indicates an adapter lens type or an adapter lens mode.

Assignments (3)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 7, 2022
From: STERN, JONATHAN; ZHAO, PEIQIAN; COTOROS, INGRID A.
To: GOPRO, INC.
Reel/Frame 062009/0534 →
Continuity (1)
Related Publication 20230224584A1 · Jul 13, 2023