IP Library Granted Patent US 10,686,967
Granted Patent B2
US 10,686,967 · App. 16/537,290 · Granted Jun 16, 2020

Systems and methods for synchronizing visual content

Inventors: David Newman (San Diego, CA); Gregory Oaul Stewart (San Mateo, CA)
Assignee: GoPro, Inc.
H04N5/0733
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,686,967
App. No.
16/537,290
Granted
Jun 16, 2020
Kind
B2
Abstract

Multiple image capture devices may individually generate time information and capture images. Individual image captures devices may receive time information of other image capture device(s). Individual image capture devices may transmit its time information to other image capture device(s) independent of reception of the time information of other image capture device(s). Individual image capture devices may generate time synchronization information for the captured images based on its time information and the received time information of other image capture device(s). Images captured by different image capture devices may be time-synchronized based on at least one of generated time-synchronization information.

Claims (53)

1. A system that synchronizes visual content, the system comprising:

multiple image capture devices including a first image capture device and a second image capture device, individual ones of the multiple image capture devices including an image sensor, a transmitter, a receiver, a clock, and one or more processors;

wherein:

the image sensor is configured to generate image output signals based on light that becomes incident thereon, the image output signals conveying image information that defines images;

the clock is configured to provide time information of a respective image capture device;

the one or more processors of an individual image capture device are configured by machine-readable instructions to:

receive time information of one or more other image capture devices using the receiver;

transmit the time information of the respective image capture device using the transmitter, wherein transmission of the time information of the respective image capture device is independent of reception of the time information of the one or more other image capture devices, wherein first time information of the first image capture device includes a time of the first image capture device and an identifier of the first image capture device, and second time information of the second image capture device includes a time of the second image capture device and an identifier of the second image capture device;

capture a set of images during a capture duration based on the image output signals such that captured sets of images include a first set of images captured by the first image capture device during a first capture duration and a second set of images captured by the second image capture device during a second capture duration; and

generate time synchronization information for the set of images based on the time information of the respective image capture device and the time information of the one or more other image capture devices such that generated time-synchronization information includes first time synchronization information generated by the first image capture device and second time synchronization information generated by the second image capture device, wherein an offset between the time of the first image capture device and the time of the second image capture device is determined based on the first time synchronization information and the second time synchronization information, wherein the offset between the time of the first image capture device and the time of the second image capture device is determined based on an average of a first offset indicated by the first time synchronization information and a second offset indicated by the second time synchronization information;

wherein multiple images from the captured sets of images are time-synchronized based on at least one of the generated time-synchronization information.

2. The system of claim 1 , wherein the first capture duration for the first set of images overlaps with the second capture duration for the second set of images.

3. The system of claim 1 , wherein time-synchronized images are used to generate a video edit including images captured by different image capture devices, the video edit generated by the first image capture device or a server.

4. The system of claim 1 , wherein transmission of the time information by the multiple image capture devices are staggered such that the first image capture device transmits the first time information of the first image capture device at a first time and the second image capture device transmits the second time information of the second image capture device at a second time different from the first time.

5. The system of claim 1 , wherein the first time synchronization information is generated based on the time of the second image capture device and the identifier of the second image capture device.

6. The system of claim 1 , wherein the first time synchronization information is generated based on a difference between the time of the first image capture device and the time of the second image capture device, and the identifier of the second image capture device.

7. The system of claim 1 , wherein:

the multiple image capture devices further include a third image capture device;

the captured sets of images further include a third set of images captured by the third image capture device; and

the generated time-synchronization information further includes third time synchronization information generated by the third image capture device.

8. The system of claim 2 , wherein the first capture duration for the first set of images is different from the second capture duration for the second set of images.

9. A method for synchronizing visual content, the method performed by an image capture device comprising (1) an image sensor configured to generate image output signals based on light that becomes incident thereon, the image output signals conveying image information that defines images, (2) a clock configured to provide time information of the image capture device, (3) a transmitter, and (4) a receiver, the method comprising:

receiving time information of another image capture device using the receiver, the time information of the other image capture device including a time of the other image capture device and an identifier of the other image capture device;

transmitting the time information of the image capture device using the transmitter, the time information of the image capture device including a time of the image capture device and an identifier of the image capture device, wherein transmission of the time information of the image capture device is independent of reception of the time information of the other image capture device;

capturing a first set of images during a first capture duration based on the image output signals; and

generating first time synchronization information for the first set of images based on the time information of the image capture device and the time information of the other image capture device;

wherein:

the other image capture device captures a second set of images during a second capture duration;

the other image capture device generates second time synchronization information;

an offset between the time of the image capture device and the time of the other image capture device is determined based on the first time synchronization information and the second time synchronization information, wherein the offset between the time of the image capture device and the time of the other image capture device is determined based on an average of a first offset indicated by the first time synchronization information and a second offset indicated by the second time synchronization information; and

multiple images from the first set of images and the second set of images are time-synchronized based on at least one of the first time synchronization information and the second time synchronization information.

10. The method of claim 9 , wherein the first capture duration for the first set of images overlaps with the second capture duration for the second set of images.

11. The method of claim 9 , wherein time-synchronized images are used to generate a video edit including images captured by the image capture device and the other image capture device, the video edit generated by the image capture device or a server.

12. The method of claim 9 , wherein the first time synchronization information is generated based on the time of the other image capture device and the identifier of the other image capture device.

13. The method of claim 10 , wherein the first capture duration for the first set of images is different from the second capture duration for the second set of images.

14. An image capture device for synchronizing visual content, the image capture device comprising:

an image sensor configured to generate image output signals based on light that becomes incident thereon, the image output signals conveying image information that defines images;

a clock configured to provide time information of the image capture device;

a transmitter configured to transmit first information;

a receiver configured to receive second information; and

one or more processors configured by machine-readable instructions to:

receive time information of another image capture device using the receiver, the time information of the other image capture device including a time of the other image capture device and an identifier of the other image capture device;

transmit the time information of the image capture device using the transmitter, the time information of the image capture device including a time of the image capture device and an identifier of the image capture device, wherein transmission of the time information of the image capture device is independent of reception of the time information of the other image capture device;

capture a first set of images during a first capture duration based on the image output signals; and

generate first time synchronization information for the first set of images based on the time information of the image capture device and the time information of the other image capture device;

wherein:

the other image capture device captures a second set of images during a second capture duration;

the other image capture device generates second time synchronization information;

an offset between the time of the image capture device and the time of the other image capture device is determined based on the first time synchronization information and the second time synchronization information, wherein the offset between the time of the image capture device and the time of the other image capture device is determined based on an average of a first offset indicated by the first time synchronization information and a second offset indicated by the second time synchronization information; and

multiple images from the first set of images and the second set of images are time-synchronized based on at least one of the first time synchronization information and the second time synchronization information.

15. The image capture device of claim 14 , wherein the first capture duration for the first set of images overlaps with the second capture duration for the second set of images.

16. The image capture device of claim 15 , wherein the first capture duration for the first set of images is different from the second capture duration for the second set of images.

17. The image capture device of claim 14 , wherein time-synchronized images are used to generate a video edit including images captured by the image capture device and the other image capture device, the video edit generated by the image capture device or a server.

Assignments (5)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
RELEASE OF PATENT SECURITY INTEREST Recorded Jan 25, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: GOPRO, INC.
Reel/Frame 055106/0434 →
SECURITY INTEREST Recorded Oct 19, 2020
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 054113/0594 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 9, 2019
From: NEWMAN, DAVID; STEWART, GREGORY OAUL
To: GOPRO, INC.
Reel/Frame 050016/0390 →
Continuity (2)
Continuation 16131505 · Sep 14, 2018
Related Publication 20200092443A1 · Mar 19, 2020