IP Library Granted Patent US 10,477,076
Granted Patent B1
US 10,477,076 · App. 16/131,505 · Granted Nov 12, 2019

Systems and methods for synchronizing visual content

Inventors: David Newman (San Diego, CA); Gregory Oaul Stewart (San Mateo, CA)
Assignee: GoPro, Inc.
H04N5/0733
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,477,076
App. No.
16/131,505
Granted
Nov 12, 2019
Kind
B1
Abstract

Multiple image capture devices may individually generate time information and capture images. Individual image captures devices may receive time information of other image capture device(s). Individual image capture devices may transmit its time information to other image capture device(s) independent of reception of the time information of other image capture device(s). Individual image capture devices may generate time synchronization information for the captured images based on its time information and the received time information of other image capture device(s). Images captured by different image capture devices may be time-synchronized based on at least one of generated time-synchronization information.

Claims (44)

1. A system that synchronizes visual content, the system comprising:

multiple image capture devices, individual ones of the multiple image capture devices including:

an optical element configured to guide light within a field of view to an image sensor;

the image sensor configured to generate image output signals based on light that becomes incident thereon, the image output signals conveying image information that defines images;

a clock configured to provide time information of a respective image capture device;

a transmitter configured to transmit first information;

a receiver configured to receive second information; and

one or more processors configured by machine-readable instructions to:

receive time information of one or more other image capture devices using the receiver;

transmit the time information of the respective image capture device using the transmitter, wherein transmission of the time information of the respective image capture device is independent of reception of the time information of the one or more other image capture devices;

capture a set of images during a capture duration based on the image output signals; and

generate time synchronization information for the set of images based on the time information of the respective image capture device and the time information of the one or more other image capture devices;

wherein:

the multiple image capture devices include a first image capture device and a second image capture device;

captured sets of images include a first set of images captured by the first image capture device during a first capture duration and a second set of images captured by the second image capture device during a second capture duration;

first time information of the first image capture device includes a time of the first image capture device and an identifier of the first image capture device, and second time information of the second image capture device includes a time of the second image capture device and an identifier of the second image capture device;

generated time-synchronization information includes first time synchronization information generated by the first image capture device and second time synchronization information generated by the second image capture device, wherein an offset between the time of the first image capture device and the time of the second image capture device is determined based on the first time synchronization information and the second time synchronization information; and

multiple images from the captured sets of images are time-synchronized based on at least one of the generated time-synchronization information.

2. The system of claim 1 , wherein the first capture duration for the first set of images overlaps with the second capture duration for the second set of images.

3. The system of claim 2 , wherein the first capture duration for the first set of images is different from the second capture duration for the second set of images.

4. The system of claim 1 , wherein time-synchronized images are used to generate a video edit including images captured by different image capture devices, the video edit generated by the first image capture device or a server after the capture of the sets of images.

5. The system of claim 1 , wherein transmission of the time information by the multiple image capture devices are staggered such that the first image capture device transmits the first time information of the first image capture device at a first time and the second image capture device transmits the second time information of the second image capture device at a second time different from the first time.

6. The system of claim 1 , wherein the first time synchronization information is generated based on the time of the second image capture device and the identifier of the second image capture device.

7. The system of claim 1 , wherein the first time synchronization information is generated based on a difference between the time of the first image capture device and the time of the second image capture device, and the identifier of the second image capture device.

8. The system of claim 1 , wherein the offset between the time of the first image capture device and the time of the second image capture device is determined based on an average of a first offset indicated by the first time synchronization information and a second offset indicated by the second time synchronization information.

9. The system of claim 1 , wherein:

the multiple image capture devices further include a third image capture device;

the captured sets of images further include a third set of images captured by the third image capture device; and

the generated time-synchronization information further includes third time synchronization information generated by the third image capture device.

10. A method for synchronizing visual content, the method performed by an image capture device comprising (1) an optical element configured to guide light within a field of view to an image sensor, (2) the image sensor configured to generate image output signals based on light that becomes incident thereon, the image output signals conveying image information that defines images, (3) a clock configured to provide time information of the image capture device, (4) a transmitter configured to transmit first information, and (5) a receiver configured to receive second information, the method comprising:

receiving time information of another image capture device using the receiver, the time information of the other image capture device including a time of the other image capture device and an identifier of the other image capture device;

transmitting the time information of the image capture device using the transmitter, the time information of the image capture device including a time of the image capture device and an identifier of the image capture device, wherein transmission of the time information of the image capture device is independent of reception of the time information of the other image capture device;

capturing a first set of images during a first capture duration based on the image output signals; and

generating first time synchronization information for the first set of images based on the time information of the image capture device and the time information of the other image capture device;

wherein:

the other image capture device captures a second set of images during a second capture duration;

the other image capture device generates second time synchronization information;

an offset between the time of the image capture device and the time of the other image capture device is determined based on the first time synchronization information and the second time synchronization information; and

multiple images from the first set of images and the second set of images are time-synchronized based on at least one of the first time synchronization information and the second time synchronization information.

11. The method of claim 10 , wherein the first capture duration for the first set of images overlaps with the second capture duration for the second set of images.

12. The method of claim 11 , wherein the first capture duration for the first set of images is different from the second capture duration for the second set of images.

13. The method of claim 10 , wherein time-synchronized images are used to generate a video edit including images captured by the image capture device and the other image capture device, the video edit generated by the image capture device or a server after the capture of the first set of images and the second set of images.

14. The method of claim 10 , wherein the first time synchronization information is generated based on the time of the other image capture device and the identifier of the other image capture device.

15. The method of claim 10 , wherein the offset between the time of the image capture device and the time of the other image capture device is determined based on an average of a first offset indicated by the first time synchronization information and a second offset indicated by the second time synchronization information.

Assignments (7)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
RELEASE OF PATENT SECURITY INTEREST Recorded Jan 25, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: GOPRO, INC.
Reel/Frame 055106/0434 →
SECURITY INTEREST Recorded Oct 19, 2020
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 054113/0594 →
SECURITY INTEREST Recorded Mar 5, 2019
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 048508/0728 →
SECURITY INTEREST Recorded Dec 3, 2018
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 047713/0309 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 11, 2018
From: NEWMAN, DAVID; STEWART, GREGORY OAUL
To: GOPRO, INC.
Reel/Frame 047138/0080 →