IP Library Granted Patent US 10,910,015
Granted Patent B2
US 10,910,015 · App. 16/811,216 · Granted Feb 2, 2021

Synthesizing a presentation from multiple media clips

Inventors: Dale T. Roberts (San Anselmo, CA); Randall E. Cook (Kensington, CA); Markus K. Cremer (Orinda, CA)
Assignee: Gracenote, Inc.
G11B27/036G11B27/031G11B27/10G11B27/28G11B27/34H04N5/262H04N7/17336H04N21/21805H04N21/2743H04N21/8549G06F16/40G06F16/958G06F40/103G06F40/106G06F40/14G06F40/174G06F40/177
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,910,015
App. No.
16/811,216
Granted
Feb 2, 2021
Kind
B2
Abstract

In an example implementation, a method is described. The implementation accesses a plurality of media clips and metadata for the plurality of media clips. The implementation also uses the metadata for the plurality of media clips to select, from the plurality of media clips, a subset of media clips including a first media clip and a second media clip. The implementation also matches a first fingerprint of at least a part of the first media clip with a second fingerprint of at least a part of the second media clip. The implementation also determines a temporal overlap of the first media clip with the second media clip based at least in part on the match. The implementation also, based on the temporal overlap, merges the first media clip and the second media clip into a group of overlapping media clips, and generates a presentation that includes the group.

Claims (64)

1. A method comprising:

accessing, by one or more processors, a plurality of media clips and metadata for the plurality of media clips;

using the metadata for the plurality of media clips to select, by the one or more processors, from the plurality of media clips, a subset of media clips including a first media clip and a second media clip;

matching, by the one or more processors, a first fingerprint of at least a part of the first media clip with a second fingerprint of at least a part of the second media clip;

determining, by the one or more processors, a temporal overlap of the first media clip with the second media clip based at least in part on the match of the first fingerprint of at least the part of the first media clip with the second fingerprint of at least the part of the second media clip;

based on the temporal overlap of the first media clip with the second media clip:

merging, by the one or more processors, the first media clip and the second media clip into a group of temporally-overlapping media clips, and

synthesizing, by the one or more processors, the group of temporally-overlapping media clips into a media presentation.

2. The method of claim 1 , wherein the using of the metadata for the plurality of media clips to select the subset of media clips comprises:

selecting the first media clip for inclusion in the subset of media clips based on the first media clip having a set of one or more first metadata parameters, and

selecting the second media clip for inclusion in the subset of media clips based on the second media clip having a second metadata parameter that matches at least one first metadata parameter of the set of first metadata parameters.

3. The method of claim 2 , wherein the set of first metadata parameters comprises one or more of a name of a multimedia event, a location of the multimedia event, or a date of a multimedia event.

4. The method of claim 2 , wherein the set of first metadata parameters comprises one or more of a user identifier, a time stamp, a camera setting, an encoding format, an encoding bit rate, a frame rate, a video resolution, or an aspect ratio.

5. The method of claim 2 , wherein the set of first metadata parameters comprises one or more of a location within a venue, a camera angle, or a camera motion.

6. The method of claim 1 , wherein the using of the metadata for the plurality of media clips to select the subset of media clips comprises:

selecting the first media clip for inclusion in the subset of media clips based on the first media clip having a first metadata parameter, and

selecting the second media clip for inclusion in the subset of media clips based on the second media clip having a second metadata parameter that is different from the first metadata parameter and has proximity to the first metadata parameter.

7. The method of claim 1 , wherein the metadata comprises metadata indicating respective privacy statuses of at least some of the plurality of media clips, and

wherein the using of the metadata for the plurality of media clips to select the subset of media clips comprises:

selecting the first media clip for inclusion in the subset of media clips based on a first privacy status of the first media clip indicating permission to include the first media clip in the media presentation, and

selecting the second media clip for inclusion in the subset of media clips based on a second privacy status of the second media clip indicating permission to include the second media clip in the media presentation.

8. The method of claim 7 , wherein the using of the metadata for the plurality of media clips to select the subset of media clips further comprises determining not to include a third media clip of the plurality of media clips in the subset of the media clips based on a third privacy status of the third media clip indicating a denial of permission to include the third media clip in the media presentation.

9. The method of claim 1 , further comprising:

matching a first metadata of the first media clip with a second metadata of the second media clip,

wherein the determining of the temporal overlap of the first media clip and the second media clip is based on the match of the first metadata of the first media clip with the second metadata of the second media clip.

10. A non-transitory machine-readable storage medium having instructions stored thereon, which, when executed by one or more processors, cause the one or more processors to perform operations comprising:

accessing a plurality of media clips and metadata for the plurality of media clips;

using the metadata for the plurality of media clips to select, from the plurality of media clips, a subset of media clips including a first media clip and a second media clip;

matching a first fingerprint of at least a part of the first media clip with a second fingerprint of at least a part of the second media clip;

determining a temporal overlap of the first media clip with the second media clip based at least in part on the match of the first fingerprint of at least the part of the first media clip with the second fingerprint of at least the part of the second media clip;

based on the temporal overlap of the first media clip with the second media clip:

merging the first media clip and the second media clip into a group of temporally-overlapping media clips, and

synthesizing the group of temporally-overlapping media clips into a media presentation.

11. The non-transitory machine-readable storage medium of claim 10 , wherein the using of the metadata for the plurality of media clips to select the subset of media clips comprises:

selecting the first media clip for inclusion in the subset of media clips based on the first media clip having a set of one or more first metadata parameters, and

selecting the second media clip for inclusion in the subset of media clips based on the second media clip having a second metadata parameter that matches at least one first metadata parameter of the set of first metadata parameters.

12. The non-transitory machine-readable storage medium of claim 11 , wherein the set of first metadata parameters comprises one or more of a name of a multimedia event, a location of the multimedia event, or a date of a multimedia event.

13. The non-transitory machine-readable storage medium of claim 11 , wherein the set of first metadata parameters comprises one or more of a location within a venue, a camera angle, or a camera motion.

14. The non-transitory machine-readable storage medium of claim 10 , wherein the using of the metadata for the plurality of media clips to select the subset of media clips comprises:

selecting the first media clip for inclusion in the subset of media clips based on the first media clip having a first metadata parameter, and

selecting the second media clip for inclusion in the subset of media clips based on the second media clip having a second metadata parameter that is different from the first metadata parameter and has proximity to the first metadata parameter.

15. The non-transitory machine-readable storage medium of claim 10 , wherein the metadata comprises metadata indicating respective privacy statuses of at least some of the plurality of media clips, and

wherein the using of the metadata for the plurality of media clips to select the subset of media clips comprises:

selecting the first media clip for inclusion in the subset of media clips based on a first privacy status of the first media clip indicating permission to include the first media clip in the media presentation, and

selecting the second media clip for inclusion in the subset of media clips based on a second privacy status of the second media clip indicating permission to include the second media clip in the media presentation.

16. The non-transitory machine-readable storage medium of claim 15 , wherein the using of the metadata for the plurality of media clips to select the subset of media clips further comprises determining not to include a third media clip of the plurality of media clips in the subset of the media clips based on a third privacy status of the third media clip indicating a denial of permission to include the third media clip in the media presentation.

17. A system comprising:

one or more processors; and

a non-transitory computer-readable storage medium, having stored thereon program instructions that, upon execution by the one or more processors, cause performance of operations comprising:

accessing a plurality of media clips and metadata for the plurality of media clips;

using the metadata for the plurality of media clips to select, from the plurality of media clips, a subset of media clips including a first media clip and a second media clip;

matching a first fingerprint of at least a part of the first media clip with a second fingerprint of at least a part of the second media clip;

determining a temporal overlap of the first media clip with the second media clip based at least in part on the match of the first fingerprint of at least the part of the first media clip with the second fingerprint of at least the part of the second media clip;

based on the temporal overlap of the first media clip with the second media clip:

merging the first media clip and the second media clip into a group of temporally-overlapping media clips, and

synthesizing the group of temporally-overlapping media clips into a media presentation.

18. The system of claim 17 , wherein the using of the metadata for the plurality of media clips to select the subset of media clips comprises:

selecting the first media clip for inclusion in the subset of media clips based on the first media clip having a set of one or more first metadata parameters, and

selecting the second media clip for inclusion in the subset of media clips based on the second media clip having a second metadata parameter that matches at least one first metadata parameter of the set of first metadata parameters.

19. The system of claim 18 , wherein the set of first metadata parameters comprises one or more of a name of a multimedia event, a location of the multimedia event, or a date of a multimedia event.

20. The system of claim 17 , wherein the metadata comprises metadata indicating respective privacy statuses of at least some of the plurality of media clips, and

wherein the using of the metadata for the plurality of media clips to select the subset of media clips comprises:

selecting the first media clip for inclusion in the subset of media clips based on a first privacy status of the first media clip indicating permission to include the first media clip in the presentation, and

selecting the second media clip for inclusion in the subset of media clips based on a second privacy status of the second media clip indicating permission to include the second media clip in the media presentation.

Assignments (8)
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 6, 2020
From: ROBERTS, DALE T.; COOK, RANDALL E.; CREMER, MARKUS K.
To: GRACENOTE, INC.
Reel/Frame 052037/0845 →
Continuity (5)
Continuation 15946946 · Apr 6, 2018
Continuation 14694624 · Apr 23, 2015
Continuation 12239082 · Sep 26, 2008
Provisional Application 60976186 · Sep 28, 2007
Related Publication 20200211600A1 · Jul 2, 2020