IP Library Granted Patent US 10,915,568
Granted Patent B2
US 10,915,568 · App. 16/661,150 · Granted Feb 9, 2021

Selecting digital content for inclusion in media presentations

Inventors: Stephen Trey Moore (San Antonio, TX); Augustine Vidal Pedraza, IV (San Antonio, TX); Florian Denis (Paris, FR); Jean Caillé (Paris, FR)
Assignee: GoPro, Inc.
G06F16/438G06F3/04842G06F16/44
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,915,568
App. No.
16/661,150
Granted
Feb 9, 2021
Kind
B2
Abstract

Implementations of the present disclosure are generally directed to receiving, a plurality of items of digital content from one or more data sources associated with a user, providing a plurality of clusters of digital content, each cluster including one or more items of digital content of the plurality of items of digital content, for a cluster: determining a goodness measure for each item of digital content within the cluster, the goodness measure being at least partially based on metadata associated with a respective item of digital content, and selecting at least one item of digital content from the cluster for inclusion in the media presentation, and providing the media presentation for display on a computing device of the user, the media presentation including the at least one item of digital content.

Claims (39)

1. A system comprising:

one or more processors configured perform operations comprising:

clustering items of digital content into a hierarchy of clusters, the hierarchy of clusters including moment clusters and scene clusters, individual moment clusters including two or more of the scene clusters, and individual scene clusters including one or more of the items of digital content;

determining a goodness measure for individual items of digital content within the individual scene clusters, the goodness measure indicating a quality of a respective item of digital content;

selecting two or more of the items of digital content for potential inclusion in a media presentation based on a hierarchical process of identifying at least one item of digital content from the individual scene clusters based on the goodness measure and selecting a plurality of the identified items of digital content from the individual moment clusters for potential inclusion in the media presentation, wherein the selected items of digital content include a first item of digital content, a second item of digital content, and a third item of digital content;

identifying redundant digital content from among the selected items of digital content such that the first item of digital content is identified as being redundant of the second item of digital content;

selectively removing an item of redundant digital content from the selected items of digital content for potential inclusion in the media presentation based on the quality of the item of redundant digital content indicated by the respective goodness measure such that the first item of digital content is removed from the selected items of digital content responsive to the respective goodness measure of the first item of digital content not exceeding a threshold goodness measure, and such that the first item of digital content is retained as one of the selected items of digital content responsive to the respective goodness measure of the first item of digital content exceeding the threshold goodness measure, wherein the respective goodness measure of the first item of digital content exceeding the threshold goodness measure indicates that the quality of the first item of digital content is sufficiently high that removal of the first item of digital content from potential inclusion in the media presentation is not performed; and

providing the media presentation for display on a computing device of a user, the media presentation comprising at least one of the selected items of digital content.

2. The system of claim 1 , wherein the redundant digital content are identified among the selected items of digital content based on an overlap between metadata associated with the respective items of digital content exceeding a threshold overlap.

3. The system of claim 2 , wherein the redundant digital content are identified further based on a difference in the respective goodness measures.

4. The system of claim 3 , wherein the redundant digital content are identified further based on the difference in the respective goodness measures being less than a threshold difference.

5. The system of claim 1 , wherein the goodness measure is determined based on metadata associated with the respective item of digital content and/or content of the respective item of digital content.

6. The system of claim 5 , wherein the metadata comprises time, location, duration, keyword, and type.

7. The system of claim 1 , wherein the items of digital content comprise images, videos or text.

8. The system of claim 1 , wherein at least some of the items of digital content are received from a computer-implemented service accessed by the user.

9. The system of claim 1 , wherein at least some of the items of digital content are received from the computing device of the user.

10. The system of claim 1 , wherein the individual moment clusters correspond to a period of time, and the individual scene clusters correspond to a sub-period of time.

11. The system of claim 10 , wherein the period of time corresponding to the individual moment clusters is changed based on a number of items of digital content within one or more of the moment clusters.

12. The system of claim 1 , wherein the individual moment clusters correspond to a geographic area, and the individual scene clusters correspond to a sub-geographic area.

13. The system of claim 12 , wherein the geographic area corresponding to the individual moment clusters is changed based on a number of items of digital content within one or more of the moment clusters.

14. The system of claim 1 , wherein a number of items of digital content selected from the individual moment clusters for inclusion in the media presentation is based on sizes of the individual moment clusters.

15. The system of claim 1 , wherein metadata associated with the respective item of digital content includes values for brightness, contrast, blur/sharpness, and/or number of human faces in the respective item of digital content, and the goodness measure for the respective item of digital content is determined based on the values for brightness, contrast, blur/sharpness, and/or number of human faces.

16. The system of claim 15 , wherein the goodness measure for the respective item of digital content is determined based on a weighted average of the values for brightness, contrast, blur/sharpness, and/or number of human faces.

17. The system of claim 1 , wherein the goodness measure for the respective item of digital content is set to a minimum value based on the metadata associated with the respective item of digital content not including any values for brightness, contrast, blur/sharpness, or number of human faces in the respective item of digital content.

18. The system of claim 1 , wherein the respective item of digital content is removed from a respective cluster based on the metadata associated with the respective item of digital content not including any values for brightness, contrast, blur/sharpness, or number of human faces in the respective item of digital content.

19. A computer-implemented method for selecting digital content to be included in a media presentation, the method being executed using one or more processors and comprising:

clustering, by the one or more processors, items of digital content into a hierarchy of clusters, the hierarchy of clusters including moment clusters and scene clusters, individual moment clusters including two or more of the scene clusters, and individual scene clusters including one or more of the items of digital content;

determining, by the one or more processors, a goodness measure for individual items of digital content within the individual scene clusters, the goodness measure indicating a quality of a respective item of digital content;

selecting, by the one or more processors, two or more of the items of digital content for potential inclusion in a media presentation based on a hierarchical process of identifying at least one item of digital content from the individual scene clusters based on the goodness measure and selecting a plurality of the identified items of digital content from the individual moment clusters for potential inclusion in the media presentation, wherein the selected items of digital content include a first item of digital content, a second item of digital content, and a third item of digital content;

identifying, by the one or more processors, redundant digital content from among the selected items of digital content such that the first item of digital content is identified as being redundant of the second item of digital content;

selectively removing, by the one or more processors, an item of redundant digital content from the selected items of digital content for potential inclusion in the media presentation based on the quality of the item of redundant digital content indicated by the respective goodness measure such that the first item of digital content is removed from the selected items of digital content responsive to the respective goodness measure of the first item of digital content not exceeding a threshold goodness measure, and such that the first item of digital content is retained as one of the selected items of digital content responsive to the respective goodness measure of the first item of digital content exceeding the threshold goodness measure, wherein the respective goodness measure of the first item of digital content exceeding the threshold goodness measure indicates that the quality of the first item of digital content is sufficiently high such that that removal of the first item of digital content from potential inclusion in the media presentation is not performed; and

providing, by the one or more processors, the media presentation for display on a computing device of a user, the media presentation comprising at least one of the selected items of digital content.

20. A non-transitory computer readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:

clustering items of digital content into a hierarchy of clusters, the hierarchy of clusters including moment clusters and scene clusters, individual moment clusters including two or more of the scene clusters, and individual scene clusters including one or more of the items of digital content;

determining a goodness measure for individual items of digital content within the individual scene clusters, the goodness measure indicating a quality of a respective item of digital content;

selecting two or more of the items of digital content for potential inclusion in a media presentation based on a hierarchical process of identifying at least one item of digital content from the individual scene clusters based on the goodness measure and selecting a plurality of the identified items of digital content from the individual moment clusters for potential inclusion in the media presentation, wherein the selected items of digital content include a first item of digital content, a second item of digital content, and a third item of digital content;

identifying redundant digital content from among the selected items of digital content such that the first item of digital content is identified as being redundant of the second item of digital content;

selectively removing, by the one or more processors, an item of redundant digital content from the selected items of digital content for potential inclusion in the media presentation based on the quality of the item of redundant digital content indicated by the respective goodness measure such that the first item of digital content is removed from the selected items of digital content responsive to the respective goodness measure of the first item of digital content not exceeding a threshold goodness measure, and such that the first item of digital content is retained as one of the selected items of digital content responsive to the respective goodness measure of the first item of digital content exceeding the threshold goodness measure, wherein the respective goodness measure of the first item of digital content exceeding the threshold goodness measure indicates that the quality of the first item of digital content is sufficiently high such that that removal of the first item of digital content from potential inclusion in the media presentation is not performed; and

providing the media presentation for display on a computing device of a user, the media presentation comprising at least one of the selected items of digital content.

Assignments (6)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
RELEASE OF PATENT SECURITY INTEREST Recorded Jan 25, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: GOPRO, INC.
Reel/Frame 055106/0434 →
CORRECTIVE ASSIGNMENT TO CORRECT THE SPELLING OF THE SECOND INVENTOR'S NAME PREVIOUSLY RECORDED ON REEL 050801 FRAME 0137. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Nov 3, 2020
From: MOORE, STEPHEN TREY; PEDRAZA, AUGUSTINE VIDAL, IV; DENIS, FLORIAN; CAILLÉ, JEAN
To: GOPRO, INC.
Reel/Frame 054307/0079 →
SECURITY INTEREST Recorded Oct 19, 2020
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 054113/0594 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 23, 2019
From: MOORE, STEPHEN TREY; PEDRAZA, AUGUSTINE IDAL, IV; DENIS, FLORIAN; CAILLÉ, JEAN
To: GOPRO, INC.
Reel/Frame 050801/0137 →
Continuity (5)
Continuation 15358773 · Nov 22, 2016
Continuation In Part 15100887
Provisional Application 61910823 · Dec 2, 2013
Provisional Application 61910839 · Dec 2, 2013
Related Publication 20200057775A1 · Feb 20, 2020