IP Library › Granted Patent US 10,991,396
Granted Patent B2
US 10,991,396 · App. 16/884,904 · Granted Apr 27, 2021

Systems and methods for modifying videos based on music

Inventors: Jean Patry (Paris, FR); Guillaume Oulès (Bordeaux, FR)
Assignee: GoPro, Inc.
G11B27/031H04N5/76
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,991,396
App. No.
16/884,904
Granted
Apr 27, 2021
Kind
B2
Abstract

Video information defining video content may be accessed. Music information defining a music track providing an accompaniment for video content may be accessed. The music track may have pulses and one or more music events. Individual music events may correspond to different moments within the music track. One or more music events may be individually classified into one or more categories based on intensities of one or pulses occurring within the music event. One or more visual effects may be selected for different moments within the music track based on the categories of the music events. One or more visual effects may be applied to the video content. One or more visual effects may be applied to one or more moments within the video content aligned to one or more different moments within the music track.

Claims (27)

1. A system for modifying videos based on music, the system comprising:

one or more physical processors configured by machine-readable instructions to:

access music information defining a music track, the music track providing an accompaniment for video content, the music track having one or more music events, the individual music events corresponding to different moments within the music track, wherein the one or more music events are classified based on intensities within multiple frequency ranges of one or more pulses occurring within the music event;

select one or more visual effects for the one or more music events within the music track based on the classification of the one or more music events; and

apply the one or more visual effects to the video content, the one or more visual effects applied to one or more moments within the video content aligned to the one or more music events within the music track.

2. The system of claim 1 , wherein the one or more music events are individually classified into one or more categories, the one or more categories including a weak category and a strong category.

3. The system of claim 1 , wherein one or more consecutive pulses are grouped based on similarity of the intensities within the multiple frequency ranges.

4. The system of claim 3 , wherein the one or more visual effects are selected further based on the grouping of the consecutive pulses.

5. The system of claim 1 , wherein the one or more visual effects include one or more changes in a perceived speed at which the video content is presented during playback.

6. The system of claim 5 , wherein the one or more changes in a perceived speed at which the video content is presented during playback include one or more speed ramps.

7. The system of claim 1 , wherein the one or more visual effects include one or more visual transformations of the video content.

8. The system of claim 7 , wherein the one or more visual transformations of the video content include one or more of a visual zoom, a visual filter, a visual rotation, a visual overlay, or a visual vibration.

9. The system of claim 1 , wherein the one or more physical processors are further configured by machine-readable instructions to analyze the music track to classify the one or more music events.

10. The system of claim 1 , wherein the multiple frequency ranges include a low frequency range, a middle frequency range, and a high frequency range.

11. A method for modifying videos based on music, the method comprising:

accessing music information defining a music track, the music track providing an accompaniment for video content, the music track having one or more music events, the individual music events corresponding to different moments within the music track, wherein the one or more music events are classified based on intensities within multiple frequency ranges of one or more pulses occurring within the music event;

selecting one or more visual effects for the one or more music events within the music track based on the classification of the one or more music events; and

applying the one or more visual effects to the video content, the one or more visual effects applied to one or more moments within the video content aligned to the one or more music events within the music track.

12. The method of claim 11 , wherein the one or more music events are individually classified into one or more categories, the one or more categories including a weak category and a strong category.

13. The method of claim 11 , wherein one or more consecutive pulses are grouped based on similarity of the intensities within the multiple frequency ranges.

14. The method of claim 13 , wherein the one or more visual effects are selected further based on the grouping of the consecutive pulses.

15. The method of claim 11 , wherein the one or more visual effects include one or more changes in a perceived speed at which the video content is presented during playback.

16. The method of claim 15 , wherein the one or more changes in a perceived speed at which the video content is presented during playback include one or more speed ramps.

17. The method of claim 11 , wherein the one or more visual effects include one or more visual transformations of the video content.

18. The method of claim 17 , wherein the one or more visual transformations of the video content include one or more of a visual zoom, a visual filter, a visual rotation, a visual overlay, or a visual vibration.

19. The method of claim 11 , further comprising analyzing the music track to classify the one or more music events.

20. The method of claim 11 , wherein the multiple frequency ranges include a low frequency range, a middle frequency range, and a high frequency range.

Assignments (5)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
RELEASE OF PATENT SECURITY INTEREST Recorded Jan 25, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: GOPRO, INC.
Reel/Frame 055106/0434 →
SECURITY INTEREST Recorded Oct 19, 2020
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 054113/0594 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 27, 2020
From: PATRY, JEAN; OULÈS, GUILLAUME
To: GOPRO, INC.
Reel/Frame 052765/0132 →
Continuity (3)
Continuation 16188679 · Nov 13, 2018
Continuation 15447738 · Mar 2, 2017
Related Publication 20200286520A1 · Sep 10, 2020