IP Library Granted Patent US 10,467,279
Granted Patent B2
US 10,467,279 · App. 15/358,773 · Granted Nov 5, 2019

Selecting digital content for inclusion in media presentations

Inventors: Stephen Trey Moore (San Antonio, TX); Augustine Vidal Pedraza, IV (San Antonio, TX); Florian Denis (Paris, FR); Jean Caillé (Paris, FR)
Assignee: GoPro, Inc.
G06F16/438G06F3/04842G06F16/44
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,467,279
App. No.
15/358,773
Granted
Nov 5, 2019
Kind
B2
Abstract

Implementations of the present disclosure are generally directed to receiving, a plurality of items of digital content from one or more data sources associated with a user, providing a plurality of clusters of digital content, each cluster including one or more items of digital content of the plurality of items of digital content, for a cluster: determining a goodness measure for each item of digital content within the cluster, the goodness measure being at least partially based on metadata associated with a respective item of digital content, and selecting at least one item of digital content from the cluster for inclusion in the media presentation, and providing the media presentation for display on a computing device of the user, the media presentation including the at least one item of digital content.

Claims (46)

1. A computer-implemented method for selecting digital content to be included in a media presentation, the method being executed using one or more processors and comprising:

receiving, by the one or more processors, items of digital content from one or more data sources associated with a user;

clustering, by the one or more processors, the items of digital content into a hierarchy of clusters, the hierarchy of clusters including moment clusters and scene clusters, individual moment clusters including two or more of the scene clusters, and individual scene clusters including one or more of the items of digital content;

determining, by the one or more processors, a goodness measure for each item of digital content within the individual scene clusters, the goodness measure indicating a quality of a respective item of digital content, the goodness measure being at least partially based on metadata associated with the respective item of digital content;

identifying, by the one or more processors, at least one item of digital content from the individual scene clusters based on the goodness measure;

selecting, by the one or more processors, a plurality of the identified items of digital content from the individual moment clusters for inclusion in the media presentation;

identifying, by the one or more processors, two or more of the selected items of digital content as redundant digital content based on overlap between the metadata associated with the respective item of digital content such that a first item of digital content is identified as being redundant of a second item of digital content based on overlap between the metadata associated with the first item of digital content and the metadata associated with the second item of digital content;

removing, by the one or more processors, an item of redundant digital content from inclusion in the media presentation based on the quality of the item of redundant digital content indicated by the goodness measure not being sufficiently high such that one of the first item of digital content and the second item of digital content is removed from inclusion in the media presentation based on a first goodness measure of the first item of digital content and a second goodness measure of the second item of digital content not exceeding a threshold goodness measure while both the first item of digital content and the second item of digital content are retained for inclusion in the media presentation based on the first goodness measure of the first item of digital content and the second goodness measure of the second item of digital content exceeding the threshold goodness measure, wherein the first goodness measure of the first item of digital content and the second goodness measure of the second item of digital content exceeding the threshold goodness measure indicates that the qualities of the first item of digital content and the second item of digital content are sufficiently high such that that removal of the item of redundant digital content from inclusion in the media presentation is not performed for the first item of digital content and the second item of digital content; and

providing, by the one or more processors, the media presentation for display on a computing device of the user, the media presentation comprising at least one selected item of digital content.

2. The method of claim 1 , wherein identifying two or more of the selected items of digital content as redundant digital content is performed based on one or more of an overlap in the metadata, and a difference in respective goodness measures.

3. The method of claim 1 , wherein the goodness measure is further determined based on content of the respective item of digital content.

4. The method of claim 1 , wherein the metadata comprises time, location, duration, keyword, and type.

5. The method of claim 1 , wherein items of digital content comprise images, videos or text.

6. The method of claim 1 , wherein at least one data source is associated with a computer-implemented service accessed by the user.

7. The method of claim 1 , wherein at least one data source comprises the computing device of the user.

8. The method of claim 1 , wherein the individual moment clusters correspond to a period of time, and the individual scene clusters correspond to a sub-period of time.

9. The method of claim 8 , wherein the period of time corresponding to the individual moment clusters is changed based on a number of items of digital content within one or more of the moment clusters.

10. The method of claim 1 , wherein the individual moment clusters correspond to a geographic area, and the individual scene clusters correspond to a sub-geographic area.

11. The method of claim 10 , wherein the geographic area corresponding to the individual moment clusters is changed based on a number of items of digital content within one or more of the moment clusters.

12. The method of claim 1 , wherein a number of items of digital content selected from the individual moment clusters for inclusion in the media presentation is based on sizes of the individual moment clusters.

13. The method of claim 1 , wherein metadata associated with the respective item of digital content includes values for brightness, contrast, color histogram, blur/sharpness, and/or number of human faces in the respective item of digital content, and the goodness measure for the respective item of digital content is determined based on the values for brightness, contrast, blur/sharpness, and/or number of human faces.

14. The method of claim 13 , wherein the goodness measure for the respective item of digital content is determined based on a weighted average of the values for brightness, contrast, blur/sharpness, and/or number of human faces.

15. The method of claim 1 , wherein the goodness measure for the respective item of digital content is set to a minimum value based on the metadata associated with the respective item of digital content not including any values for brightness, contrast, color histogram, blur/sharpness, or number of human faces in the respective item of digital content.

16. The method of claim 1 , wherein the respective item of digital content is removed from a respective cluster based on the metadata associated with the respective item of digital content not including any values for brightness, contrast, color histogram, blur/sharpness, or number of human faces in the respective item of digital content.

17. The method of claim 1 , wherein the two or more of the selected items of digital content are identified as redundant digital content based on the overlap between the metadata associated with the respective item of digital content exceeding a threshold overlap.

18. The method of claim 17 , wherein the two or more of the selected items of digital content are identified as redundant digital content further based on a difference in the goodness measure of the respective items of redundant digital content being less than a threshold difference.

19. A system comprising:

a data store for storing data; and

one or more processors configured to interact with the data store, the one or more processors being further configured to perform operations f comprising:

receiving items of digital content from one or more data sources associated with a user;

clustering the items of digital content into a hierarchy of clusters, the hierarchy of clusters including moment clusters and scene clusters, individual moment clusters including two or more of the scene clusters, and individual scene clusters including one or more of the items of digital content;

determining a goodness measure for each item of digital content within the individual scene clusters, the goodness measure indicating a quality of a respective item of digital content, the goodness measure being at least partially based on metadata associated with the respective item of digital content;

identifying at least one item of digital content from the individual scene clusters based on the goodness measure;

selecting a plurality of the identified items of digital content from the individual moment clusters for inclusion in the media presentation;

identifying two or more of the selected items of digital content as redundant digital content based on overlap between the metadata associated with the respective item of digital content such that a first item of digital content is identified as being redundant of a second item of digital content based on overlap between the metadata associated with the first item of digital content and the metadata associated with the second item of digital content;

removing an item of redundant digital content from inclusion in the media presentation based on the quality of the item of redundant digital content indicated by the goodness measure not being sufficiently high such that one of the first item of digital content and the second item of digital content is removed from inclusion in the media presentation based on a first goodness measure of the first item of digital content and a second goodness measure of the second item of digital content not exceeding a threshold goodness measure while both the first item of digital content and the second item of digital content are retained for inclusion in the media presentation based on the first goodness measure of the first item of digital content and the second goodness measure of the second item of digital content exceeding the threshold goodness measure, wherein the first goodness measure of the first item of digital content and the second goodness measure of the second item of digital content exceeding the threshold goodness measure indicates that the qualities of the first item of digital content and the second item of digital content are sufficiently high such that that removal of the item of redundant digital content from inclusion in the media presentation is not performed for the first item of digital content and the second item of digital content; and

providing the media presentation for display on a computing device of the user, the media presentation comprising at least one selected item of digital content.

20. A non-transitory computer readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:

receiving items of digital content from one or more data sources associated with a user;

clustering the items of digital content into a hierarchy of clusters, the hierarchy of clusters including moment clusters and scene clusters, individual moment clusters including two or more of the scene clusters, and individual scene clusters including one or more of the items of digital content;

determining a goodness measure for each item of digital content within the individual scene clusters, the goodness measure indicating a quality of a respective item of digital content, the goodness measure being at least partially based on metadata associated with the respective item of digital content;

identifying at least one item of digital content from the individual scene clusters based on the goodness measure;

selecting a plurality of the identified items of digital content from the individual moment clusters for inclusion in the media presentation;

identifying two or more of the selected items of digital content as redundant digital content based on overlap between the metadata associated with the respective item of digital content such that a first item of digital content is identified as being redundant of a second item of digital content based on overlap between the metadata associated with the first item of digital content and the metadata associated with the second item of digital content;

removing an item of redundant digital content from inclusion in the media presentation based on the quality of the item of redundant digital content indicated by the goodness measure not being sufficiently high such that one of the first item of digital content and the second item of digital content is removed from inclusion in the media presentation based on a first goodness measure of the first item of digital content and a second goodness measure of the second item of digital content not exceeding a threshold goodness measure while both the first item of digital content and the second item of digital content are retained for inclusion in the media presentation based on the first goodness measure of the first item of digital content and the second goodness measure of the second item of digital content exceeding the threshold goodness measure, wherein the first goodness measure of the first item of digital content and the second goodness measure of the second item of digital content exceeding the threshold goodness measure indicates that the qualities of the first item of digital content and the second item of digital content are sufficiently high such that that removal of the item of redundant digital content from inclusion in the media presentation is not performed for the first item of digital content and the second item of digital content; and

providing the media presentation for display on a computing device of the user, the media presentation comprising at least one selected item of digital content.

Assignments (6)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
RELEASE OF PATENT SECURITY INTEREST Recorded Jan 25, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: GOPRO, INC.
Reel/Frame 055106/0434 →
SECURITY INTEREST Recorded Oct 19, 2020
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 054113/0594 →
SECURITY INTEREST Recorded Feb 22, 2017
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 041777/0440 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 12, 2016
From: MOORE, STEPHEN TREY; PEDRAZA, AUGUSTINE VIDAL, IV; DENIS, FLORIAN; CAILLÉ, JEAN
To: GOPRO, INC.
Reel/Frame 040713/0493 →
Continuity (4)
Continuation In Part 15100887
Provisional Application 61910823 · Dec 2, 2013
Provisional Application 61910839 · Dec 2, 2013
Related Publication 20170075886A1 · Mar 16, 2017