IP Library Granted Patent US 10,002,642
Granted Patent B2
US 10,002,642 · App. 15/297,062 · Granted Jun 19, 2018

Methods and devices for generating media items

Inventors: Scott Snibbe (San Francisco, CA); Graham McDermott (Berkeley, CA); Justin Ponczek (San Francisco, CA); Spencer Schoeben (Palo Alto, CA); Jesse Fulton (San Francisco, CA)
Assignee: FACEBOOK, INC.
G11B27/10G06F17/30026G06F17/30038G06F17/30047G06F17/30056G06F17/30174G11B27/031H04N21/233H04N21/235H04N21/2393H04N21/858H04N21/8547
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,002,642
App. No.
15/297,062
Granted
Jun 19, 2018
Kind
B2
Abstract

The various implementations described herein include methods, devices, and systems for generating media items. In one aspect, a method is performed at a server system. The method includes: (1) receiving one or more audio files; (2) obtaining one or more audio characteristics for the audio files; (3) receiving a request to generate a media item using the audio files, the request including one or more criteria; and (4) in response to receiving the request, generating the media item, including: (a) identifying one or more visual media files based on the criteria and the audio characteristics; and (b) generating synchronization information; (5) storing the media item in the server system; and (6) enabling playback of the media item by sending a link for the stored media item to the client device.

Claims (66)

1. A method comprising:

at a server system with one or more processors and memory:

receiving from a user of a client device one or more audio files;

obtaining one or more audio characteristics for the one or more audio files;

receiving from the client device a request to generate a media item using the one or more audio files, the request including one or more criteria for the media item to be generated; and

in response to receiving the request, automatically and without user interaction, generating the media item, including:

identifying one or more visual media files based at least in part on the one or more criteria and the one or more audio characteristics; and

generating synchronization information for synchronizing the one or more audio files with the one or more visual media files during playback of the media item;

storing the media item in the server system, including storing information identifying: (1) the one or more audio files, (2) the identified one or more visual media files, and (3) the generated synchronization information; and

enabling playback of the media item at the client device by sending a link for the stored media item to the client device.

2. The method of claim 1 , further comprising identifying one or more sources for the identified one or more visual media files; and

wherein storing the media item includes storing information identifying at least a subset of the one or more sources.

3. The method of claim 1 , wherein the one or more criteria include identification information for the identified one or more visual media files.

4. The method of claim 1 , wherein the identified one or more visual media files include at least one video, image, or audiovisual file.

5. The method of claim 1 , wherein the one or more audio characteristics include one or more characteristic fingerprints for the one or more audio files; and

wherein identifying the one or more visual media files includes matching, within a predefined degree of accuracy, at least one of the one or more characteristic fingerprints for the one or more audio files to one or more visual media characteristics for the identified one or more visual media files.

6. The method of claim 1 , further comprising, after receiving the request, obtaining a user profile for the user of the client device; and

wherein identifying the one or more visual media files includes identifying the one or more visual media files based at least in part on the user profile.

7. The method of claim 1 , wherein the received request further includes one or more environmental parameters associated with the client device; and

wherein identifying the one or more visual media files includes identifying the one or more visual media files based at least in part on the one or more environmental parameters.

8. The method of claim 1 , wherein identifying the one or more visual media files includes identifying at least a subset of the one or more visual media files based on metadata of at least a subset of the one or more audio files.

9. The method of claim 1 , wherein identifying the one or more visual media files includes applying a matching algorithm to match the one or more criteria with keywords for at least a subset of the identified one or more visual media files.

10. The method of claim 1 , wherein identifying the one or more visual media files includes applying a matching algorithm to match the one or more criteria with extractable characteristics of at least a subset of the identified one or more visual media files.

11. The method of claim 1 , further comprising storing the one or more visual media files in a database of media files at the server system, wherein a respective visual media file in the database of media files is indexed according to a plurality of parameters.

12. The method of claim 11 , further comprising storing the one or more audio files in a database of media files at the server system, wherein the database of media files is indexed according to a plurality of parameters, including one or more of:

keywords and hashtags corresponding to respective audio files;

metadata corresponding to the respective audio files; or

one or more extractable characteristics of the respective audio files.

13. The method of claim 1 , wherein the one or more audio files include at least one of:

one or more audio files captured by the user of the client device; or

one or more audio files captured by friends of the user of the client device.

14. The method of claim 1 , further comprising determining one or more audio or visual effects based at least in part on measured characteristics of the one or more audio files; and

wherein storing the media item further includes storing effect information for adding the one or more audio or visual effects to the media item.

15. The method of claim 1 , further comprising:

receiving feedback from the user as to the accuracy of the generated media item; and

modifying a matching algorithm for identifying the one or more audio visual media files based on the received feedback.

16. The method of claim 1 , further comprising storing the one or more audio files at a first location at the server system; and

wherein storing the media item includes storing information identifying the first location.

17. The method of claim 1 , further comprising:

receiving a playback request from a second client device to playback the media item, wherein the second client device is distinct from the client device; and

in response to receiving the playback request, enabling playback of the media item at the second client device by sending the link to the stored media item to the second client device.

18. The method of claim 1 , further including:

receiving a modification request from a second user to modify the media item;

in response to receiving the modification request, storing a modified version of the media item in the server system;

storing an association between the modified version of the media item and media item in the server system; and

enabling playback of the modified version of the media item at a client device of the second user by sending a link for the modified version of the media item to the client device of the second user.

19. A server system, comprising:

one or more processors; and

memory storing one or more programs to be executed by the one or more processors, the one or more programs comprising instructions for:

receiving from a user of a client device one or more audio files;

obtaining one or more audio characteristics for the one or more audio files;

receiving from the client device a request to generate a media item using the one or more audio files, the request including one or more criteria for the media item to be generated; and

in response to receiving the request, automatically and without user interaction, generating the media item, including:

identifying one or more visual media files based at least in part on the one or more criteria and the one or more audio characteristics; and

generating synchronization information for synchronizing the one or more audio files with the one or more visual media files during playback of the media item;

storing the media item in the server system, including storing information identifying: (1) the one or more audio files, (2) the identified one or more visual media files, and (3) the generated synchronization information; and

enabling playback of the media item at the client device by sending a link for the stored media item to the client device.

20. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions, which, when executed by a server system with one or more processors, cause the server system to:

receive from a user of a client device one or more audio files;

obtain one or more audio characteristics for the one or more audio files;

receive from the client device a request to generate a media item using the one or more audio files, the request including one or more criteria for the media item to be generated; and

in response to receiving the request, automatically and without user interaction, generate the media item, including:

identifying one or more visual media files based at least in part on the one or more criteria and the one or more audio characteristics; and

generating synchronization information for synchronizing the one or more audio files with the one or more visual media files during playback of the media item;

store the media item in the server system, including storing information identifying: (1) the one or more audio files, (2) the identified one or more visual media files, and (3) the generated synchronization information; and

enable playback of the media item at the client device by sending a link for the stored media item to the client device.

Assignments (3)
CHANGE OF NAME Recorded Dec 22, 2021
From: FACEBOOK, INC.
To: META PLATFORMS, INC.
Reel/Frame 058581/0334 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 21, 2017
From: SNIBBE, SCOTT; MCDERMOTT, GRAHAM; PONCZEC, JUSTIN; SCHOEBEN, SPENCER; FULTON, JESSE
To: EYEGROOVE, INC.
Reel/Frame 043655/0310 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 21, 2017
From: EYEGROOVE, INC.
To: FACEBOOK, INC.
Reel/Frame 043655/0358 →
Continuity (3)
Continuation 14608108 · Jan 28, 2015
Provisional Application 61975651 · Apr 4, 2014
Related Publication 20170040039A1 · Feb 9, 2017