IP Library Granted Patent US 10,721,412
Granted Patent B2
US 10,721,412 · App. 16/231,774 · Granted Jul 21, 2020

Generating long exposure images for high dynamic range processing

Inventors: Bruno César Douady (Les Molières, FR); Vadim Polonichko (San Diego, CA)
Assignee: GoPro, Inc.
H04N5/2355H04N5/22521H04N5/23216H04N5/232933
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,721,412
App. No.
16/231,774
Granted
Jul 21, 2020
Kind
B2
Abstract

Systems and methods are disclosed for generating long exposure images for high dynamic range processing. For example, methods may include receiving a short exposure image that was captured using an image sensor; receiving an additional image that was captured using the image sensor; determining a long exposure image based on the short exposure image and the additional image; applying high dynamic range processing to the short exposure image and the long exposure image to obtain an output image with a larger dynamic range than the short exposure image; and transmitting, storing, or displaying an image based on the output image.

Claims (42)

1. A system comprising:

an image sensor configured to capture images, and

a processing apparatus configured to:

receive a short exposure image that was captured using the image sensor;

receive an additional image that was captured using the image sensor;

determine a long exposure image based on pixel values of the short exposure image and pixel values of the additional image; and

apply high dynamic range processing to the short exposure image and the long exposure image to obtain an output image with a larger dynamic range than the short exposure image.

2. The system of claim 1 , in which the processing apparatus is configured to determine the long exposure image by performing operations comprising:

adding the short exposure image to the additional image.

3. The system of claim 2 , in which the processing apparatus is configured to determine the long exposure image by performing operations comprising:

subtracting a black level of the additional image.

4. The system of claim 1 , in which the image sensor is a digital overlap high dynamic range sensor, and the processing apparatus is configured to receive the short exposure image and the additional image in an interleaved pattern of image portions, such that exposure of an image portion of the additional image commences when pixels of a same image portion of the short exposure image are read and reset.

5. The system of claim 4 , in which the image portion is a row of pixels.

6. The system of claim 4 , in which an exposure duration of the additional image is longer than an exposure duration of the short exposure image.

7. The system of claim 1 , in which the processing apparatus is configured to:

transmit, store, or display an image based on the output image.

8. The system of claim 1 , in which the processing apparatus is attached to the image sensor.

9. A method comprising:

receiving a short exposure image that was captured using an image sensor;

receiving an additional image that was captured using the image sensor;

determining a long exposure image based on pixel values of the short exposure image and pixel values of the additional image;

applying high dynamic range processing to the short exposure image and the long exposure image to obtain an output image with a larger dynamic range than the short exposure image; and

transmitting, storing, or displaying an image based on the output image.

10. The method of claim 9 , in which determining the long exposure image comprises:

adding the short exposure image to the additional image.

11. The method of claim 10 , in which determining the long exposure image comprises:

subtracting a black level of the additional image.

12. The method of claim 9 , in which the image sensor is a digital overlap high dynamic range sensor, and receiving the short exposure image and receiving the additional image comprises receiving the short exposure image and the additional image in an interleaved pattern of image portions, such that exposure of an image portion of the additional image commences when pixels of a same image portion of the short exposure image are read and reset.

13. The method of claim 12 , in which the image portion is a row of pixels.

14. The method of claim 12 , in which an exposure duration of the additional image is longer than an exposure duration of the short exposure image.

15. A non-transitory computer-readable storage medium comprising executable instructions that, when executed by a processor, cause performance of operations comprising:

receiving a short exposure image that was captured using an image sensor;

receiving an additional image that was captured using the image sensor;

determining a long exposure image based on pixel values of the short exposure image and pixel values of the additional image, wherein determining the long exposure image includes adding the short exposure image to the additional image; and

applying high dynamic range processing to the short exposure image and the long exposure image to obtain an output image with a larger dynamic range than the short exposure image.

16. The non-transitory computer-readable storage medium of claim 15 , in which the executable instructions for determining the long exposure image cause the performance of operations comprising:

subtracting a black level of the additional image.

17. The non-transitory computer-readable storage medium of claim 15 , in which the image sensor is a digital overlap high dynamic range sensor, and wherein the executable instructions for receiving the short exposure image and receiving the additional image cause the performance of operations comprising receiving the short exposure image and the additional image in an interleaved pattern of image portions, such that exposure of an image portion of the additional image commences when pixels of a same image portion of the short exposure image are read and reset.

18. The non-transitory computer-readable storage medium of claim 17 , in which the image portion is a row of pixels.

19. The non-transitory computer-readable storage medium of claim 17 , in which an exposure duration of the additional image is longer than an exposure duration of the short exposure image.

20. The non-transitory computer-readable storage medium of claim 15 , wherein the executable instructions cause the performance of operations comprising:

transmitting, storing, or displaying an image based on the output image.

Assignments (6)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
RELEASE OF PATENT SECURITY INTEREST Recorded Jan 25, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: GOPRO, INC.
Reel/Frame 055106/0434 →
SECURITY INTEREST Recorded Oct 19, 2020
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 054113/0594 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 11, 2019
From: DOUADY, BRUNO CESAR; POLONICHKO, VADIM
To: GOPRO, INC.,
Reel/Frame 048554/0539 →
SECURITY INTEREST Recorded Mar 5, 2019
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 048508/0728 →
Continuity (1)
Related Publication 20200204721A1 · Jun 25, 2020
Cited By (1)
US 12,407,939