IP Library › Granted Patent US 10,388,321
Granted Patent B2
US 10,388,321 · App. 15/247,358 · Granted Aug 20, 2019

Looping audio-visual file generation based on audio and video analysis

Inventors: Richard J. Plom (Clayton, CA); Jason J. Mante (New York, NY); Ryan W. Swigart (New York, NY); Mikhail Kaplinskiy (San Francisco, CA)
Assignee: Twitter, Inc.
G11B27/007G11B27/031G11B27/10G11B27/28H04N9/87
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,388,321
App. No.
15/247,358
Filed
Aug 25, 2016
Granted
Aug 20, 2019
Kind
B2
Art Unit
2484
USPC
386/282
Abstract

In one general aspect, a method can include receiving a video loop portion included in a video file and receiving an audio loop portion included in an audio file. The method can include analyzing at least a portion of the audio file based on a musical characteristic and identifying a plurality of segment locations within the audio file based on the analyzing where the plurality of segment locations define a plurality of audio segments of the audio file. The method can also include modifying the video loop portion based on one of the plurality of segment locations in the audio file.

Claims (38)

1. A method, comprising:

receiving a video loop portion included in a video file;

receiving an audio loop portion included in an audio file;

analyzing at least a portion of the audio file based on a musical characteristic;

identifying a plurality of segment locations within the audio file based on the analyzing, the plurality of segment locations defining a plurality of audio segments of the audio file;

presenting, in a user interface, segment location indicators representing at least some of the identified plurality of segment locations within the audio file;

receiving a modification of an audio loop portion selector configured for selecting any number of the presented segment location indicators; and

automatically modifying the video loop portion based on at least one of the plurality of segment locations in the audio file as indicated by the audio loop portion selector.

2. The method of claim 1 , wherein the video loop portion has a duration that is modified based on a duration of the audio loop portion.

3. The method of claim 1 , wherein the video loop portion included in the video file is targeted for looping in an audio-visual (AV) loop file.

4. The method of claim 1 , wherein the video loop portion includes a first video segment and a second video segment,

the method further comprising:

assigning a first weight value to the first video segment and a second weight value to the second video segment,

the modifying the video loop portion includes modifying a duration of the first video segment based on the first weight value and a duration of the second video segment based on the second weight value.

5. The method of claim 4 , wherein the first weight value is different than the second weight value.

6. The method of claim 4 , wherein the first weight value and the second weight value are assigned based on the duration of the first video segment compared with the duration of the second video segment.

7. The method of claim 4 , wherein the first weight value is proportional to the duration of the first video segment.

8. The method of claim 1 , wherein the plurality of segment locations are associated with at least one of an onset or a beat.

9. The method of claim 1 , wherein a duration of at least one of the plurality of audio segments is associated with a musical measure.

10. The method of claim 1 , wherein a duration of at least one of the plurality of audio segments is associated with a number of beats per minute.

11. The method of claim 1 , wherein the video loop portion has a duration less than 6.5 second and the video file has a duration greater than 6.5 seconds.

12. The method of claim 1 , wherein the audio loop portion has a duration less than 6.5 second and the audio file has a duration greater than 6.5 seconds.

13. A method, comprising:

receiving a video loop portion included in a video file;

receiving an audio loop portion included in an audio file, the audio loop portion including a first audio segment and a second audio segment each having a duration defined based on a musical characteristic;

presenting, in a user interface, segment location indicators representing at least the first and second audio segments;

receiving a modification of the audio loop portion made using an audio loop portion selector configured for selecting any number of the presented segment location indicators; and

automatically modifying a duration of the video loop portion based on a duration of the modified audio loop portion.

14. The method of claim 13 , further comprising:

receiving an instruction to include a third audio segment in the audio loop portion; and

modifying a duration of the video loop portion based on the duration of the third audio segment.

15. The method of claim 13 , wherein the first audio segment has a duration equal to a duration of the second audio segment.

16. The method of claim 13 , wherein the first audio segment and the second audio segment each have a duration equal to a duration of a musical measure calculated based on an average number of beats per minute of the audio file.

17. The method of claim 13 , wherein the video loop portion includes a plurality of video segments,

the method further comprising:

assigning a weight value to each of the plurality of video segments,

the modifying the duration of the video loop portion includes modifying a duration of at least one of the plurality of video segments based on the weight value associated with the at least one of the plurality of video segments.

18. The method of claim 17 , wherein each of the weight values assigned to each of the plurality of the video segments is based on a duration of each of the plurality of video segments.

Assignments (8)
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENT RIGHTS (REEL 062079, FRAME 0677) Recorded Mar 3, 2026
From: MORGAN STANLEY SENIOR FUNDING, INC., AS COLLATERAL AGENT
To: X CORP. (F/K/A TWITTER, INC.)
Reel/Frame 075015/0574 →
RELEASE OF SECURITY INTEREST Recorded Apr 30, 2025
From: MORGAN STANLEY SENIOR FUNDING, INC., AS COLLATERAL AGENT
To: X CORP. (F/K/A TWITTER, INC.)
Reel/Frame 071127/0240 →
RELEASE OF SECURITY INTEREST Recorded Mar 27, 2025
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: X CORP. (F/K/A TWITTER, INC.)
Reel/Frame 070670/0857 →
SECURITY INTEREST Recorded Oct 28, 2022
From: TWITTER, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 062079/0677 →
SECURITY INTEREST Recorded Oct 28, 2022
From: TWITTER, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 061804/0001 →
SECURITY INTEREST Recorded Oct 28, 2022
From: TWITTER, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 061804/0086 →
CORRECTIVE ASSIGNMENT TO CORRECT THE EXECUTION DATE OF THE THIRD ASSIGNOR'S PREVIOUSLY RECORDED ON REEL 041428 FRAME 0205. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT OF ASSIGNOR'S INTEREST.. Recorded May 11, 2017
From: PLOM, RICHARD J.; MANTE, JASON J.; SWIGART, RYAN W.; KAPLINSKIY, MIKHAIL
To: TWITTER, INC.
Reel/Frame 042444/0258 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 1, 2017
From: PLOM, RICHARD J.; MANTE, JASON J.; SWIGART, RYAN W.; KAPLINSKIY, MIKHAIL
To: TWITTER, INC.
Reel/Frame 041428/0205 →
Continuity (2)
Provisional Application 62210315 · Aug 26, 2015
Related Publication 20170062006A1 · Mar 2, 2017