IP Library Granted Patent US 12,363,448
Granted Patent B2
US 12,363,448 · App. 18/610,293 · Granted Jul 15, 2025

Ambient light detection and hyperlapse video generation

Inventors: Jinglun Gao (San Mateo, CA); Jun Hu (San Jose, CA); Shan Tong (Sunnyvale, CA)
Assignee: Meta Platforms Technologies, LLC
H04N23/741G01J1/4204H04N23/51H04N23/651H04N1/00896H04N23/74
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,363,448
App. No.
18/610,293
Granted
Jul 15, 2025
Kind
B2
Abstract

Hyperlapse imaging is described. A device may include a camera, a sensor and a data store. The camera is configured to capture images. The sensor detects ambient light properties. Captured images and the ambient light properties are processed in bulk to generate a hyperlapse video.

Claims (52)

1. A method comprising:

capturing, with a camera of a device, a sequence of raw images, wherein image processing operations of the camera are suspended while the sequence of raw images is being captured;

detecting ambient light properties for at least some of the raw images in the sequence; and

generating a hyperlapse video by performing bulk image processing operations on the sequence of raw images and the ambient light properties.

2. The method of claim 1 , wherein the device is a headset,

and wherein a smartphone performs the bulk image processing operations.

3. The method of claim 1 , wherein the bulk image processing operations include:

analyzing exposure levels for each of the raw images in the sequence; and

adjusting the exposure level of at least one of the raw images based on the analyzed exposure levels.

4. The method of claim 1 , wherein the device includes an ambient light sensor (ALS), and wherein the ambient light properties are detected by the ALS.

5. The method of claim 1 , further comprising:

storing the raw images to a data store within the device; and

responsive to a number of the raw images stored in the data store exceeding a threshold amount:

transferring the stored raw images and the ambient light properties to an image processing device.

6. The method of claim 1 further comprising:

bypassing an image signal processing (ISP) pipeline of the camera during the capturing of the raw images; and

concurrent with the capture of the raw images, adjusting one or more of an exposure setting of the camera and a color setting of the camera based on the ambient light properties.

7. The method of claim 1 further comprising:

suspending image processing operations while the device is in a low-power mode; and

responsive to the low-power mode being disabled, performing the bulk image processing operations, wherein completion of the image processing operations generates the hyperlapse video.

8. The method of claim 1 further comprising:

storing the captured images and the ambient light properties on a data store within the device.

9. The method of claim 8 , wherein the bulk image processing operations are performed after a threshold amount of the captured images are stored on the data store.

10. A device comprising:

a camera configured to capture images;

a sensor configured to detect associated ambient light properties for at least some of the captured images; and

a data store, wherein after a threshold amount of captured images are stored to the data store, the stored captured images and the associated ambient light properties are processed in bulk to generate a hyperlapse video.

11. The device of claim 10 , wherein the device is a headset, and

wherein a smartphone processes, in bulk, the stored captured images and the associated ambient light properties to generate the hyperlapse video.

12. The device of claim 10 , wherein the processing in bulk, the stored captured images and the associated ambient light properties to generate the hyperlapse video includes:

analyzing exposure levels for each of the captured images; and

adjusting the exposure level of at least one of the captured images based on the analyzed exposure levels.

13. The device of claim 10 , wherein the sensor includes an ambient light sensor (ALS).

14. The device of claim 10 , wherein the camera is further configured to bypassing an image signal processing (ISP) pipeline of the camera during the capture of the images,

and wherein concurrent with the capture of the images, one or more of an exposure setting of the camera and a color setting of the camera are adjusted based on the associated ambient light properties detected by the sensor.

15. The device of claim 10 further comprising:

suspending image processing operations while the device is in a low-power mode; and

responsive to the low-power mode being disabled, performing the processing, in bulk, of the captured images and the associated ambient light properties to generate the hyperlapse video.

16. The device of claim 10 , wherein at least one image captured is a high dynamic range (HDR) frame.

17. The device of claim 10 , wherein the device is a headset.

18. A method comprising:

suspending, by an image processing device, image processing operations while in a low-power mode;

capturing a sequence of images while in the low-power mode;

detecting ambient light properties for at least some of the images; and

responsive to the low-power mode being disabled, performing bulk image processing operations by the image processing device using the sequence of images and the ambient light properties.

19. The method of claim 18 , wherein completion of the bulk image processing operations generates a hyperlapse video.

20. The method of claim 18 , further comprising:

detecting, via a position sensor, associated gyroscope data relating to at least some of the images; and

wherein the bulk image processing operations include:

generating a plurality of image frames using the sequence of images;

adjusting one or more of a rotation, orientation, or position of at least one of the image frames based on the gyroscope data; and

generating a video using the plurality of image frames, including the at least one adjusted image frame.

Assignments (2)
CHANGE OF NAME Recorded May 13, 2024
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 067397/0648 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 26, 2024
From: GAO, JINGLUN; HU, JUN; TONG, SHAN
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 067238/0240 →
Continuity (3)
Continuation 17737676 · May 5, 2022
Provisional Application 63257839 · Oct 20, 2021
Related Publication 20240223912A1 · Jul 4, 2024
References Cited (14)
US 7046864B1 · Pine · 2006 [cited by applicant]
US 9838641B1 · Lim et al. · 2017 [cited by applicant]
US 9973727B2 · Joshi et al. · 2018 [cited by applicant]
US 10193627B1 · Herman et al. · 2019 [cited by applicant]
US 10602075B2 · Case · 2020 [cited by applicant]
US 20150293575A1 · Hampson et al. · 2015 [cited by applicant]
US 20170180589A1 · Guo et al. · 2017 [cited by applicant]
US 20170187954A1 · Fukuya et al. · 2017 [cited by applicant]
US 20180167545A1 · Kosaka · 2018 [cited by examiner]
US 20190014242A1 · Piekarski et al. · 2019 [cited by applicant]
US 20190261370A1 · Amini et al. · 2019 [cited by applicant]
US 20200228696A1 · Liu · 2020 [cited by applicant]
US 20220375374A1 · Nicholson et al. · 2022 [cited by applicant]
Muchmore M., “Hyperlapse from Instagram (for iPhone) Review,” PCMag, Aug. 27, 2014, Retrieved from the Internet: URL: https://www.pcmag.com/reviews/hyperlapse-from-instagram-for-iphone. [cited by applicant]