IP Library Granted Patent US 10,652,075
Granted Patent B2
US 10,652,075 · App. 14/279,144 · Granted May 12, 2020

Systems and methods for selecting content items and generating multimedia content

Inventors: Fabio Miranda Costa (Mountain View, CA); James Cameron Ewing (San Francisco, CA); Joshua Warren Higgins (San Francisco, CA); Nicholas J. Kwiatek (San Francisco, CA); Kyre Madeleine Osborn (San Francisco, CA); Nathaniel Gregory Salciccoli (Palo Alto, CA); Skyler J. Vander Molen (San Francisco, CA); Shu Wu (Kirkland, WA)
Assignee: Facebook, Inc.
H04L29/08G06F17/22G06F17/24G11B27/034H04L67/02H04L67/22G06Q50/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,652,075
App. No.
14/279,144
Granted
May 12, 2020
Kind
B2
Abstract

Systems, methods, and non-transitory computer-readable media can detect a trigger event for generating multimedia content. A set of content items associated with a user account can be identified. Information associated with at least one of the set of content items or the user account can be acquired. A subset of content items can be selected out of the set of content items based on the information. In some embodiments, each content item in the subset can satisfy specified selection criteria. The multimedia content can be generated based on the subset of content items.

Claims (60)

1. A computer-implemented method comprising:

detecting, by a computing system, a trigger event for generating a multimedia content item designed to reflect an event associated with a user account, wherein the multimedia content item includes video content;

identifying, by the computing system, a set of content items associated with the user account;

acquiring, by the computing system, the set of content items and information associated with the set of content items or the user account;

determining, by the computing system, relevance of each content item of the set of the content items relative to the user account based on the information;

ranking, by the computing system, the relevance of the set of content items based on a ranking algorithm,

wherein the ranking algorithm increases rankings for at least some content items determined by an image classification process to contain one or more faces; and

wherein the ranking algorithm ranks the set of content items containing one or more faces based on affinity coefficients between the user account and one or more persons identified by a facial recognition technique from the one or more faces;

selecting, by the computing system, a subset of content items out of the set of content items, wherein each content item in the subset satisfies one or more ranking thresholds; and

generating, by the computing system, the multimedia content item based on the subset of content items, wherein generating the multimedia content item comprises:

converting non-visual content items in the subset of content items into image representations of the non-visual content items, wherein the non-visual content items include at least one of a text, a post, a status update, or an audio item; and

placing the image representations of the non-visual content items into the video content.

2. The computer-implemented method of claim 1 , further comprising:

providing the user account with access to the multimedia content item, wherein the generating the multimedia content item includes pre-rendering the multimedia content item prior to the providing the user account with the access to the multimedia content item.

3. The computer-implemented method of claim 1 , wherein the generating the multimedia content item includes processing the subset of content items by one or more servers of a social networking system, and wherein an amount of the processing is based on a level of user traffic experienced by the social networking system.

4. The computer-implemented method of claim 1 , further comprising:

modifying, based on one or more commands associated with the user account, the subset of content items to produce a modified set of content items;

generating, in real-time, a modified multimedia content item based on the modified set of content items; and

providing, in real-time, the modified multimedia content item generated based on the modified set of content items.

5. The computer-implemented method of claim 4 , wherein the generating, in real-time, the modified multimedia content item based on the modified set of content items includes transmitting at least one instruction to a computing device associated with the user account, wherein the modified multimedia content item is renderable in real-time using HTML5 by the computing device.

6. The computer-implemented method of claim 1 , wherein each content item in the subset of content items is at least one of a post, a status update, or an image, and wherein the multimedia content item includes video.

7. The computer-implemented method of claim 1 , wherein the generating the multimedia content item includes providing audio content, the audio content being selected based on one or more commands provided via the user account.

8. The computer-implemented method of claim 7 , further comprising:

analyzing the audio content to determine one or more beats of the audio content; and

synchronizing, within an allowable time deviation, at least a portion of the multimedia content item with the one or more beats of the audio content.

9. The computer-implemented method of claim 1 , wherein the trigger event is associated with at least one of a significant event associated with the user account within a social networking system, a user command initiated via the user account, or a system command of the social networking system.

10. The computer-implemented method of claim 9 , wherein the trigger event is associated with the significant event associated with the user account, and wherein the detecting of the trigger event includes analyzing at least one of a post associated with the user account, a status update associated with the user account, a comment associated with the user account, a tag associated with the user account, or an interaction associated with the user account.

11. The computer-implemented method of claim 1 , wherein the selecting the subset of content items out of the set of content items includes ranking the set of content items based on a ranking algorithm, wherein the specified selection criteria include one or more ranking thresholds, and wherein each content item in the subset of content items satisfies the one or more ranking thresholds.

12. The computer-implemented method of claim 11 , wherein the ranking algorithm decreases rankings for at least some content items determined by the image classification process to include at least one of memes or food.

13. The computer-implemented method of claim 11 , wherein the ranking algorithm is based on social interaction analysis.

14. The computer-implemented method of claim 13 , wherein the ranking algorithm increases rankings for at least some content items determined by the social interaction analysis to be associated with a current relationship associated with the user account and decreases rankings for at least some content items determined by the social interaction analysis to be associated with a terminated relationship associated with the user account.

15. The computer-implemented method of claim 1 , wherein at least a first content item in the subset of content items is associated with a first time period and wherein at least a second content item in the subset of content items is associated with a second time period.

16. The computer-implemented method of claim 1 , wherein at least a first content item in the subset of content items is associated with a first location and wherein at least a second content item in the subset of content items is associated with a second location.

17. The computer-implemented method of claim 1 , wherein the user account is associated with at least one of a user of a social networking system, an entity associated with the social networking system, a group associated with the social networking system, a post on the social networking system, an application provided via the social networking system, or an event created through the social networking system.

18. A system comprising:

at least one processor; and

a memory storing instructions that, when executed by the at least one processor, cause the system to perform:

detecting a trigger event for generating a multimedia content item designed to reflect an event associated with a user account, wherein the multimedia content item includes video content;

identifying a set of content items associated with the user account;

acquiring the set of content items and information associated with of the set of content items or the user account;

determining relevance of each content item of the set of the content items relative to the user or user account based on the information;

ranking the relevance of the set of content items based on a ranking algorithm,

wherein the ranking algorithm increases rankings for at least some content items determined by an image classification process to contain one or more faces; and

wherein the ranking algorithm ranks the set of content items containing one or more faces based on affinity coefficients between the user account and one or more persons identified by a facial recognition technique from the one or more faces;

selecting a subset of content items out of the set of content items, wherein each content item in the subset satisfies one or more ranking thresholds; and

generating the multimedia content item based on the subset of content items, wherein generating the multimedia content item comprises:

converting non-visual content items in the subset of content items into image representations of the non-visual content items, wherein the non-visual content items include at least one of a text, a post, a status update, or an audio item; and

placing the image representations of the non-visual content items into the video content.

19. A non-transitory computer-readable storage medium including instructions that, when executed by at least one processor of a computing system, cause the computing system to perform:

detecting a trigger event for generating a multimedia content item designed to reflect an event associated with a user account, wherein the multimedia content item includes video content;

identifying a set of content items associated with the user account;

acquiring the set of content items and information associated with of the set of content items or the user account;

determining relevance of each content item of the set of the content items relative to the user or user account based on the information;

ranking the relevance of the set of content items based on a ranking algorithm,

wherein the ranking algorithm increases rankings for at least some content items determined by an image classification process to contain one or more faces; and

wherein the ranking algorithm ranks the set of content items containing one or more faces based on affinity coefficients between the user account and one or more persons identified by a facial recognition technique from the one or more faces;

selecting a subset of content items out of the set of content items, wherein each content item in the subset satisfies one or more ranking thresholds; and

generating the multimedia content item based on the subset of content items, wherein generating the multimedia content item comprises:

converting non-visual content items in the subset of content items into image representations of the non-visual content items, wherein the non-visual content items include at least one of a text, a post, a status update, or an audio item; and

placing the image representations of the non-visual content items into the video content.

Assignments (2)
CHANGE OF NAME Recorded Nov 23, 2021
From: FACEBOOK, INC.
To: META PLATFORMS, INC.
Reel/Frame 058234/0431 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 14, 2014
From: COSTA, FABIO MIRANDA; EWING, JAMES CAMERON; HIGGINS, JOSHUA WARREN; KWIATEK, NICHOLAS J.; OSBORN, KYRE MADELEINE; SALCICCOLI, NATHANIEL GREGORY; VANDER MOLEN, SKYLER J.; WU, SHU
To: FACEBOOK, INC.
Reel/Frame 034177/0141 →
Continuity (1)
Related Publication 20150331842A1 · Nov 19, 2015