IP Library › Granted Patent US 11,721,367
Granted Patent B2
US 11,721,367 · App. 17/546,726 · Granted Aug 8, 2023

Synchronizing multiple images or videos to an audio track

Inventors: Alexander Collins (Santa Monica, CA); Alexander Vodovoz (Inglewood, CA)
Assignee: Snap Inc.
G11B27/036G11B27/034G11B27/34H04N5/783H04N21/8455H04N21/8547H04N21/8549
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,721,367
App. No.
17/546,726
Filed
Dec 9, 2021
Granted
Aug 8, 2023
Kind
B2
Examiner
MESA, JOSE M
Art Unit
2484
USPC
386/241
Abstract

A method for generation of a video montage file from a plurality of media files is disclosed. The method includes selecting media files from a collection of media files based on a selection criterion, accessing audio feature information for an audio track, the audio feature information including timing information related to audio features of the audio track, generating a first video segment for a first time slot from a first media file, generating a second video segment for a second time slot from a second media file, creating a video montage file by adding the second video segment to the first video segment, and adding the audio track to the video montage file. The selection criterion may comprise a location, a time interval, or presences of the media files in a feed posted by the user on a messaging system or social media platform.

Claims (59)

1. A method, executed by one or more processors, for generation of a video file from a plurality of media files, for presentation on a device including a display, comprising:

selecting media files from a collection of media files based on a selection criterion;

accessing audio feature information for an audio track, the audio feature information including timing information related to audio features of the audio track;

generating a first video segment for a first time slot from a first media file;

generating a second video segment for a second time slot from a second media file;

creating a video montage file by adding the second video segment to the first video segment; and

adding the audio track to the video montage file with an audio feature location in the audio track coinciding with a start of the first video segment.

2. The method of claim 1 wherein the selection criterion comprises a time interval.

3. The method of claim 1 wherein the selection criterion comprises a number of new media files that have been captured or stored by a user of the device.

4. The method of claim 1 wherein the selection criterion comprises location information.

5. The method of claim 1 , wherein the selection criterion is based on a presence of the media files in a feed posted by a user on a messaging system or social media platform.

6. The method of claim 1 wherein the first media file is a first video file, the method further comprising:

extracting a portion of the first video file to generate the first video segment; and

adjusting a playback speed of the portion of the first video file to generate the first video segment, the playback speed being based on a length of the first video file.

7. The method of claim 6 wherein the second media file is an image, further comprising:

generating the second video segment by converting the second media file to a video segment having a length corresponding to the second time slot.

8. The method of claim 1 , further comprising:

determining a first initial cut point for a particular video segment to be generated from a particular video media file;

determining a closest i-frame in the particular video media file to the first initial cut point,

setting a first actual cut point to a location of the closest i-frame;

determining a second actual cut point from the first actual cut point and a length of an associated time slot; and

creating the particular video segment by trimming the particular video media file at the first actual cut point and the second actual cut point.

9. The method of claim 8 further comprising:

determining a second preliminary cut point from the first actual cut point and a length of an associated time slot;

based on a cumulative time offset in the video montage file being greater than zero, setting a second actual cut point to be before the second preliminary cut point;

based on a cumulative time offset in the video montage file being less than zero, setting a second actual cut point to be after the second preliminary cut point; and

creating the particular video segment by trimming the particular video media file at the second actual cut point.

10. A computing apparatus comprising:

a processor; and

a memory storing instructions that, when executed by the processor, configure the apparatus to perform operations to generate a video file from a plurality of media files, for presentation on a display, the operations comprising:

selecting media files from a collection of media files based on a selection criterion;

accessing audio feature information for an audio track, the audio feature information including timing information related to audio features of the audio track;

generating a first video segment for a first time slot from a first media file;

generating a second video segment for a second time slot from a second media file;

creating a video montage file by adding the second video segment to the first video segment; and

adding the audio track to the video montage file with an audio feature location in the audio track coinciding with a start of the first video segment.

11. The computing apparatus of claim 10 wherein the selection criterion comprises a time interval.

12. The computing apparatus of claim 10 wherein the selection criterion comprises a number of new media files that have been captured or stored by a user of the apparatus.

13. The computing apparatus of claim 10 wherein the selection criterion comprises location information.

14. The computing apparatus of claim 10 wherein the selection criterion is based on a presence of the media files in a feed posted by a user on a messaging system or social media platform.

15. The computing apparatus of claim 10 wherein the first media file is a first video file, wherein the instructions further configure the apparatus to perform operations comprising:

extracting a portion of the first video file to generate the first video segment; and

adjusting a playback speed of the portion of the first video file to generate the first video segment, the playback speed being based on a length of the first video file.

16. A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a computer, cause the computer to generate a video file from a plurality of media files by performing operations comprising:

selecting media files from a collection of media files based on a selection criterion;

accessing audio feature information for an audio track, the audio feature information including timing information related to audio features of the audio track;

generating a first video segment for a first time slot from a first media file;

generating a second video segment for a second time slot from a second media file;

creating a video montage file by adding the second video segment to the first video segment; and

adding the audio track to the video montage file with an audio feature location in the audio track coinciding with a start of the first video segment.

17. The computer-readable storage medium of claim 16 wherein the selection criterion comprises a time interval.

18. The computer-readable storage medium of claim 16 wherein the selection criterion comprises location information.

19. The computer-readable storage medium of claim 16 wherein the selection criterion is based on a presence of the media files in a feed posted by a user on a messaging system or social media platform.

20. The computer-readable storage medium of claim 16 ; wherein the instructions further configure the computer to perform operations comprising:

determining a first initial cut point for a particular video segment to be generated from a particular video media file;

determining a closest i-frame in the particular video media file to the first initial cut point;

setting a first actual cut point to a location of the closest i-frame;

determining a second actual cut point from the first actual cut point and a length of an associated time slot; and

creating the particular video segment by trimming the particular video media file at the first actual cut point and the second actual cut point.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 16, 2021
From: COLLINS, ALEXANDER; VODOVOZ, ALEXANDER
To: SNAP INC.
Reel/Frame 058409/0111 →
Continuity (3)
Continuation 17307458 · May 4, 2021
Provisional Application 63168500 · Mar 31, 2021
Related Publication 20220319552A1 · Oct 6, 2022
Cited By (2)
US 12,277,955 US 12,301,941