IP Library Granted Patent US 11,070,765
Granted Patent B2
US 11,070,765 · App. 16/391,869 · Granted Jul 20, 2021

Method and apparatus for in-camera night lapse video

Inventors: Ojas Gandhi (Fremont, CA); Anandhakumar Chinnaiyan (Fremont, CA); Naveen Chinya Krishnamurthy (Fremont, CA)
Assignee: GoPro, Inc.
H04N5/915H04N19/13H04N19/146H04N19/51H04N19/98
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,070,765
App. No.
16/391,869
Granted
Jul 20, 2021
Kind
B2
Abstract

A method and apparatus for night lapse video capture are disclosed. The apparatus includes an image sensor, an image processor, and a video encoder. The image sensor is configured to capture image data. The image data includes a first image that is temporally precedent to a second image. The image processor is configured to determine a motion estimation. The motion estimation is based on a comparison of a portion of the first image and a portion of the second image. The image processor is configured to subtract a mask from the second image to obtain a denoised image. The mask is based on the motion estimation. The video encoder is configured to receive the denoised image from the image processor. The video encoder is configured to encode the denoised image in a video format. The video encoder is configured to output a video file in the video format.

Claims (42)

1. An image capture device comprising:

an image sensor configured to capture image data at night, wherein the image data includes a first image that is temporally precedent to a second image;

an image processor configured to:

determine a motion estimation based on a comparison of a portion of the first image and a portion of the second image, wherein the portion of the first image corresponds to the portion of the second image;

obtain a mask based on the motion estimation; and

subtract the mask from the second image to obtain a denoised image; and

a video encoder configured to:

dynamically select a bitrate based on an ISO setting of the image capture device prior to an image capture or during the image capture;

receive the denoised image from the image processor;

encode the denoised image in a video format; and

output a video file in the video format.

2. The image capture device of claim 1 , wherein the image sensor is further configured to support an integration time of 30 seconds or more.

3. The image capture device of claim 1 , wherein the video encoder is an advanced video coding (AVC) encoder or a high-efficiency video coding (HEVC) encoder.

4. The image capture device of claim 1 , wherein the video encoder is configured to encode the denoised image at a bitrate from about 60 Mbps to about 120 Mbps.

5. The image capture device of claim 1 , wherein the video encoder is further configured to dynamically select the bitrate based on an integration time.

6. The image capture device of claim 1 , wherein the video encoder is further configured to dynamically select the bitrate based on a function of a scene classification.

7. The image capture device of claim 6 , wherein the scene classification is a night sky, a sunrise, or a sunset.

8. An image capture device comprising:

an image sensor configured to capture image data, wherein the image data includes a first image that is temporally precedent to a second image;

an image processor configured to:

determine a motion estimation based on a comparison of a portion of the first image and a portion of the second image, wherein the portion of the first image corresponds to the portion of the second image; and

subtract a mask from the second image to obtain a denoised image, wherein the mask is based on the motion estimation; and

a video encoder configured to:

dynamically select a bitrate based on an ISO setting of the image capture device prior to an image capture or during the image capture;

receive the denoised image from the image processor;

encode the denoised image in a video format; and

output a video file in the video format.

9. The image capture device of claim 8 , wherein the video encoder is an advanced video coding (AVC) encoder or a high-efficiency video coding (HEVC) encoder.

10. The image capture device of claim 8 , wherein the video encoder is further configured to dynamically select the bitrate based on an integration time.

11. The image capture device of claim 8 , wherein the video encoder is further configured to dynamically select the bitrate based on a function of a scene classification.

12. A method for use by an image capture device, the method comprising:

capturing image data that includes a first image that is temporally precedent to a second image;

determining a motion estimation based on a comparison of a portion of the first image and a portion of the second image, wherein the portion of the first image corresponds to the portion of the second image;

subtracting a mask from the second image to obtain a denoised image, wherein the mask is based on the motion estimation;

dynamically selecting a bitrate based on an ISO setting of the image capture device prior to an image capture or during the image capture;

encoding the denoised image in a video format; and

outputting a video file in the video format.

13. The method of claim 12 , wherein the encoding is an advanced video coding (AVC) or a high-efficiency video coding (HEVC).

14. The method of claim 12 , wherein the denoised image is encoded at a bitrate from about 60 Mbps to about 120 Mbps.

15. The method of claim 12 , wherein dynamically selecting the bitrate is based on an integration time.

16. The method of claim 12 , wherein dynamically selecting the bitrate is based on a function of a scene classification.

17. The method of claim 16 , wherein the scene classification is a night sky, a sunrise, or a sunset.

Assignments (5)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
RELEASE OF PATENT SECURITY INTEREST Recorded Jan 25, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: GOPRO, INC.
Reel/Frame 055106/0434 →
SECURITY INTEREST Recorded Oct 19, 2020
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 054113/0594 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 15, 2019
From: GANDHI, OJAS; CHINNAIYAN, ANANDHAKUMAR; KRISHNAMURTHY, NAVEEN CHINYA
To: GOPRO, INC.
Reel/Frame 049182/0488 →
Continuity (1)
Related Publication 20200344442A1 · Oct 29, 2020