IP Library Granted Patent US 11,019,237
Granted Patent B2
US 11,019,237 · App. 16/884,838 · Granted May 25, 2021

Systems and methods for synchronizing visual content

Inventors: David Newman (San Diego, CA); Gregory Oaul Stewart (San Mateo, CA)
Assignee: GoPro, Inc.
H04N5/0733
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,019,237
App. No.
16/884,838
Granted
May 25, 2021
Kind
B2
Abstract

Multiple image capture devices may individually generate time information and capture images. Individual image captures devices may receive time information of other image capture device(s). Individual image capture devices may transmit its time information to other image capture device(s) independent of reception of the time information of other image capture device(s). Individual image capture devices may generate time synchronization information for the captured images based on its time information and the received time information of other image capture device(s). Images captured by different image capture devices may be time-synchronized based on at least one of generated time-synchronization information.

Claims (41)

1. An image capture device for synchronizing visual content, the image capture device comprising:

an image sensor configured to generate image output signals based on light that becomes incident thereon, the image output signals conveying image information that defines images;

a clock configured to provide time of the image capture device;

one or more processors configured by machine-readable instructions to:

receive time information of another image capture device, the time information of the other image capture device including time of the other image capture device and an identifier of the other image capture device;

transmit time information of the image capture device, the time information of the image capture device including the time of the image capture device and an identifier of the image capture device;

capture a first set of images during a first capture duration based on the image output signals; and

generate first time synchronization information for the first set of images based on the time information of the image capture device and the time information of the other image capture device;

wherein:

the other image capture device captures a second set of images during a second capture duration;

the other image capture device generates second time synchronization information;

an offset between the time of the image capture device and the time of the other image capture device is determined based on a first offset indicated by the first time synchronization information and a second offset indicated by the second time synchronization information;

multiple images from the first set of images and the second set of images are time-synchronized based on the offset between the time of the image capture device and the time of the other image capture device;

the first capture duration for the first set of images overlaps with the second capture duration for the second set of images; and

the overlap between the first capture duration and the second capture duration is used to account for drift in the clock of the image capture device.

2. The image capture device of claim 1 , wherein the first capture duration for the first set of images is different from the second capture duration for the second set of images.

3. The image capture device of claim 1 , wherein time-synchronized images are used to generate a video edit including images captured by the image capture device and the other image capture device.

4. The image capture device of claim 1 , wherein transmission of the time information of the image capture device is independent of reception, by the image capture device, of the time information of the other image capture device.

5. The image capture device of claim 1 , wherein the offset between the time of the image capture device and the time of the other image capture device is determined based on an average of the first offset indicated by the first time synchronization information and the second offset indicated by the second time synchronization information.

6. The image capture device of claim 1 , wherein the first time synchronization information is generated based on the time of the other image capture device and the identifier of the other image capture device.

7. The image capture device of claim 1 , wherein the first time synchronization information is generated based on a difference between the time of the image capture device and the time of the other image capture device, and the identifier of the other image capture device.

8. The image capture device of claim 1 , wherein transmission of the time information by the image capture device and the other image capture device are staggered such that the image capture device transmits the time information of the image capture device at a first time and the other image capture device transmits the time information of the other image capture device at a second time different from the first time.

9. A method for synchronizing visual content, the method performed by an image capture device comprising an image sensor and a clock, the image sensor configured to generate image output signals based on light that becomes incident thereon, the image output signals conveying image information that defines images, the clock configured to provide time of the image capture device, the method comprising:

receiving time information of another image capture device, the time information of the other image capture device including time of the other image capture device and an identifier of the other image capture device;

transmitting time information of the image capture device, the time information of the image capture device including the time of the image capture device and an identifier of the image capture device;

capturing a first set of images during a first capture duration based on the image output signals; and

generating first time synchronization information for the first set of images based on the time information of the image capture device and the time information of the other image capture device;

wherein:

the other image capture device captures a second set of images during a second capture duration;

the other image capture device generates second time synchronization information;

an offset between the time of the image capture device and the time of the other image capture device is determined based on a first offset indicated by the first time synchronization information and a second offset indicated by the second time synchronization information;

multiple images from the first set of images and the second set of images are time-synchronized based on the offset between the time of the image capture device and the time of the other image capture device;

the first capture duration for the first set of images overlaps with the second capture duration for the second set of images; and

the overlap between the first capture duration and the second capture duration is used to account for drift in the clock of the image capture device.

10. The method of claim 9 , wherein the first capture duration for the first set of images is different from the second capture duration for the second set of images.

11. The method of claim 9 , wherein time-synchronized images are used to generate a video edit including images captured by the image capture device and the other image capture device.

12. The method of claim 9 , wherein transmission of the time information of the image capture device is independent of reception, by the image capture device, of the time information of the other image capture device.

13. The method of claim 9 , wherein the offset between the time of the image capture device and the time of the other image capture device is determined based on an average of the first offset indicated by the first time synchronization information and the second offset indicated by the second time synchronization information.

14. The method of claim 9 , wherein the first time synchronization information is generated based on the time of the other image capture device and the identifier of the other image capture device.

15. The method of claim 9 , wherein the first time synchronization information is generated based on a difference between the time of the image capture device and the time of the other image capture device, and the identifier of the other image capture device.

16. The method of claim 9 , wherein transmission of the time information by the image capture device and the other image capture device are staggered such that the image capture device transmits the time information of the image capture device at a first time and the other image capture device transmits the time information of the other image capture device at a second time different from the first time.

Assignments (5)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
RELEASE OF PATENT SECURITY INTEREST Recorded Jan 25, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: GOPRO, INC.
Reel/Frame 055106/0434 →
SECURITY INTEREST Recorded Oct 19, 2020
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 054113/0594 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 27, 2020
From: NEWMAN, DAVID; STEWART, GREGORY OAUL
To: GOPRO, INC.
Reel/Frame 052764/0729 →
Continuity (3)
Continuation 16537290 · Aug 9, 2019
Continuation 16131505 · Sep 14, 2018
Related Publication 20200288043A1 · Sep 10, 2020