IP Library Granted Patent US 10,381,044
Granted Patent B2
US 10,381,044 · App. 14/930,495 · Granted Aug 13, 2019

Systems and methods for generating videos based on selecting media content items and moods

Inventors: Peter Ryan Zich (Menlo Park, CA); Zachary W. Stubenvoll (Los Gatos, CA); James Cameron Ewing (San Francisco, CA); Nicholas J. Kwiatek (San Francisco, CA); Nathaniel Gregory Salciccioli (Palo Alto, CA); Peter Philip Jordan (Los Altos Hills, CA); Alexander Matthew Madjar (San Francisco, CA); Frank Cheng Yan (San Francisco, CA); William Edward Fisher (Richmond, CA)
Assignee: Facebook, Inc.
G11B27/034G06F16/78G11B27/34
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,381,044
App. No.
14/930,495
Granted
Aug 13, 2019
Kind
B2
Abstract

Systems, methods, and non-transitory computer-readable media can acquire a set of media content items. A mood indication can be acquired. A soundtrack can be identified based on the mood indication. A video content item can be dynamically generated in real-time based on the set of media content items and the mood indication. The video content item can include the soundtrack.

Claims (57)

1. A computer-implemented method comprising:

acquiring, by a computing system, a set of media content items;

acquiring, by the computing system, a mood indication;

identifying, by the computing system, a soundtrack based on the mood indication;

determining, by the computing system, one or more visual presentation features for the set of media content items based on the mood indication, the one or more visual presentation features including at least one of a zooming operation or a panning operation;

utilizing, by the computing system, a face detection process to identify one or more locations within one or more media content items, out of the set of media content items, at which one or more faces are depicted;

applying, by the computing system, one or more visual effects based on the one or more locations at which one or more faces are depicted; and

dynamically generating, by the computing system, a video content item in real-time based on the set of media content items, the one or more visual presentation features, the one or more visual effects, and the mood indication, the video content item including the soundtrack.

2. The computer-implemented method of claim 1 , further comprising:

receiving one or more commands to modify the video content item;

applying, based on the one or more commands, at least one of a first modification to the set of media content items or a second modification to the mood indication; and

dynamically generating a modified video content item in real-time based on at least one of the first modification or the second modification.

3. The computer-implemented method of claim 2 , wherein the second modification produces a modified mood indication, wherein a modified soundtrack is identified based on the modified mood indication, and wherein the modified video content item includes the modified soundtrack.

4. The computer-implemented method of claim 1 , wherein at least a subset of the set of media content items is suggested to a user of a social networking system based on one or more social metrics associated with the user.

5. The computer-implemented method of claim 1 , wherein at least some media content items out of the set of media content items are acquired from at least one of a camera roll associated with a user, a social networking system user account associated with the user, or an online media content collection associated with the user.

6. The computer-implemented method of claim 1 , further comprising:

identifying, based on musical qualities of the soundtrack, one or more time points of interest within a playback of the soundtrack; and

presenting one or more media content items out of the set of media content items at the one or more time points of interest.

7. The computer-implemented method of claim 1 , wherein the one or more visual effects include at least one of a panning effect, a zooming effect, a lingering effect, a facial sticker effect, or a facial emoji effect.

8. The computer-implemented method of claim 1 , further comprising:

identifying one or more social interactions associated with one or more media content items out of the set of media content items; and

presenting, in the video content item, information about the one or more social interactions.

9. The computer-implemented method of claim 8 , wherein the information about the one or more social interactions includes one or more chat heads representing one or more users associated with the one or more social interactions.

10. A system comprising:

at least one processor; and

a memory storing instructions that, when executed by the at least one processor, cause the system to perform:

acquiring a set of media content items;

acquiring a mood indication;

identifying a soundtrack based on the mood indication;

determining one or more visual presentation features for the set of media content items based on the mood indication, the one or more visual presentation features including at least one of a zooming operation or a panning operation;

utilizing a face detection process to identify one or more locations within one or more media content items, out of the set of media content items, at which one or more faces are depicted;

applying one or more visual effects based on the one or more locations at which one or more faces are depicted; and

dynamically generating a video content item in real-time based on the set of media content items, the one or more visual presentation features, the one or more visual effects, and the mood indication, the video content item including the soundtrack.

11. The system of claim 10 , wherein the instructions cause the system to further perform:

receiving one or more commands to modify the video content item;

applying, based on the one or more commands, at least one of a first modification to the set of media content items or a second modification to the mood indication; and

dynamically generating a modified video content item in real-time based on at least one of the first modification or the second modification.

12. The system of claim 11 , wherein the second modification produces a modified mood indication, wherein a modified soundtrack is identified based on the modified mood indication, and wherein the modified video content item includes the modified soundtrack.

13. The system of claim 10 , wherein the instructions cause the system to further perform:

identifying, based on musical qualities of the soundtrack, one or more time points of interest within a playback of the soundtrack; and

presenting one or more media content items out of the set of media content items at the one or more time points of interest.

14. A non-transitory computer-readable storage medium including instructions that, when executed by at least one processor of a computing system, cause the computing system to perform a method comprising:

acquiring a set of media content items;

acquiring a mood indication;

identifying a soundtrack based on the mood indication;

determining one or more visual presentation features for the set of media content items based on the mood indication, the one or more visual presentation features including at least one of a zooming operation or a panning operation;

utilizing a face detection process to identify one or more locations within one or more media content items, out of the set of media content items, at which one or more faces are depicted;

applying one or more visual effects based on the one or more locations at which one or more faces are depicted; and

dynamically generating a video content item in real-time based on the set of media content items, the one or more visual presentation features, the one or more visual effects, and the mood indication, the video content item including the soundtrack.

15. The non-transitory computer-readable storage medium of claim 14 , wherein the instructions cause the computing system to further perform:

receiving one or more commands to modify the video content item;

applying, based on the one or more commands, at least one of a first modification to the set of media content items or a second modification to the mood indication; and

dynamically generating a modified video content item in real-time based on at least one of the first modification or the second modification.

16. The non-transitory computer-readable storage medium of claim 15 , wherein the second modification produces a modified mood indication, wherein a modified soundtrack is identified based on the modified mood indication, and wherein the modified video content item includes the modified soundtrack.

17. The non-transitory computer-readable storage medium of claim 14 , wherein the instructions cause the computing system to further perform:

identifying, based on musical qualities of the soundtrack, one or more time points of interest within a playback of the soundtrack; and

presenting one or more media content items out of the set of media content items at the one or more time points of interest.

Assignments (2)
CHANGE OF NAME Recorded Nov 24, 2021
From: FACEBOOK, INC.
To: META PLATFORMS, INC.
Reel/Frame 058545/0408 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 6, 2017
From: ZICH, PETER RYAN; STUBENVOLL, ZACHARY W.; EWING, JAMES CAMERON; KWIATEK, NICHOLAS J.; SALCICCIOLI, NATHANIEL GREGORY; JORDAN, PETER PHILIP; MADJAR, ALEXANDER MATTHEW; YAN, FRANK CHENG; FISHER, WILLIAM EDWARD
To: FACEBOOK, INC.
Reel/Frame 041479/0048 →
Continuity (1)
Related Publication 20170125059A1 · May 4, 2017