IP Library Granted Patent US 11,070,742
Granted Patent B2
US 11,070,742 · App. 16/985,499 · Granted Jul 20, 2021

Optimized exposure temporal smoothing for time-lapse mode

Inventors: Nicolas Bessou (Issy-les-Moulineaux, FR); Romain Gounelle (Haut de Seine, FR)
Assignee: GoPro, Inc.
H04N5/2356H04N5/2351H04N5/2353H04N5/2625H04N5/35581H04N5/2258
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,070,742
App. No.
16/985,499
Granted
Jul 20, 2021
Kind
B2
Abstract

A processor of a camera for capturing a time-lapse is configured to acquire a first frame of the time-lapse; calculate an exposure setting for a second frame of the time-lapse; and acquire the second frame of the time-lapse using the exposure setting. The exposure setting prevents a flickering effect in the time-lapse. The exposure setting is determined using one or more preview images that are previewed in a time gap between the first frame and the second frame.

Claims (45)

1. A camera for capturing a time-lapse, comprising:

a processor configured to:

acquire a first frame of the time-lapse;

calculate an exposure setting for a second frame of the time-lapse,

wherein the exposure setting prevents a flickering effect in the time-lapse, and

wherein the exposure setting is determined using one or more preview images that are previewed in a time gap between the first frame and the second frame; and

acquire the second frame of the time-lapse using the exposure setting.

2. The camera of claim 1 , wherein the one or more preview images are not included in the time-lapse.

3. The camera of claim 1 , wherein to determine the exposure setting for the second frame of the time-lapse comprises to:

temporally smooth respective exposure settings of at least some of the one or more preview images.

4. The camera of claim 3 , wherein to temporally smooth the respective exposure settings of the at least some of the one or more preview images comprises to:

temporally smooth every other preview image of the one or more preview images.

5. The camera of claim 3 , wherein to temporally smooth the respective exposure settings of the one or more preview images comprises to:

perform temporal smoothing based on a difference between the second frame of the time-lapse and a last preview image the one or more preview images.

6. The camera of claim 5 , wherein the difference is a luminance difference.

7. The camera of claim 1 , wherein the first frame is acquired in a low-luminance setting and the second frame is acquired in a high-luminance setting.

8. The camera of claim 1 , wherein the first frame is acquired in a high-luminance setting and the second frame is acquired in a low-luminance setting.

9. A method for reducing overexposure or underexposure in a time-lapse, comprising:

acquiring, using an image capture device, a first frame of the time-lapse using a first exposure setting;

obtaining, using the image capture device, a preview image that is not included in the time-lapse using a preview exposure setting;

determining a second exposure setting by smoothing the first exposure setting and the preview exposure setting; and

acquiring, using the image capture device, a second frame of the time-lapse using the second exposure setting.

10. The method of claim 9 , further comprising:

setting a respective auto-exposure setting for a time-lapse mode of the image capture device and at least one of a still mode or a video mode of the image capture device.

11. The method of claim 9 , wherein obtaining, using the image capture device, the preview image comprises:

obtaining a first preview image; and

obtaining a second preview image, wherein the second preview image immediately precedes the second frame and follows the first preview image.

12. The method of claim 11 , wherein determining the second exposure setting by smoothing the first exposure setting and the preview exposure setting comprises:

determining the second exposure setting by continuously smoothing the first exposure setting, a first preview exposure setting of the first preview image, and a second preview exposure setting of the second preview image.

13. The method of claim 11 , wherein the first preview image immediately follows the first frame.

14. The method of claim 9 , wherein obtaining, using the image capture device, the preview image comprises:

setting a preview image capture rate; and

obtaining a plurality of preview images at the preview image capture rate in a time gap between a first capture time of the first frame and a second capture time of the second frame.

15. The method of claim 14 , wherein the preview image capture rate is received from a user of the image capture device.

16. The method of claim 14 , wherein the preview image capture rate is based on at least one of a scene complexity or available compute resources of the image capture device.

17. A non-transitory computer-readable storage medium, comprising executable instructions that, when executed by a processor, facilitate performance of operations for reducing overexposure or underexposure in a time-lapse, the operations comprising operations to:

capture a first frame of the time-lapse using a first exposure setting;

acquire one or more preview images during a time gap between the first frame of the time-lapse and a next frame of the time-lapse, wherein a last preview image of the one or more preview images is acquired using a last exposure setting;

calculate a second exposure setting using the last exposure setting; and

capture the next frame of the time-lapse using the second exposure setting.

18. The non-transitory computer-readable storage medium of claim 17 , wherein the operations further comprise operations to:

continuously estimate a first preview exposure setting for a next preview image of the one or more preview images using a second preview exposure setting of a previous preview image of the one or more preview images.

19. The non-transitory computer-readable storage medium of claim 17 , wherein to calculate the second exposure setting using the last exposure setting comprises to:

apply a damping factor to the second exposure setting.

20. The non-transitory computer-readable storage medium of claim 19 , wherein the damping factor is selected based on a relationship between an exposure difference and a temporal smoothing speed.

Assignments (5)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 24, 2021
From: BESSOU, NICOLAS; GOUNELLE, ROMAIN
To: GOPRO, INC.
Reel/Frame 056029/0505 →
RELEASE OF PATENT SECURITY INTEREST Recorded Jan 25, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: GOPRO, INC.
Reel/Frame 055106/0434 →
SECURITY INTEREST Recorded Oct 19, 2020
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 054113/0594 →
Continuity (3)
Continuation 16107404 · Aug 21, 2018
Provisional Application 62562755 · Sep 25, 2017
Related Publication 20200366828A1 · Nov 19, 2020