IP Library › Granted Patent US 10,923,155
Granted Patent B2
US 10,923,155 · App. 16/811,213 · Granted Feb 16, 2021

Synthesizing a presentation from multiple media clips

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,923,155
App. No.
16/811,213
Granted
Feb 16, 2021
Kind
B2
Abstract

In an example implementation, a method is described. The implementation accesses a plurality of media clips including a first video clip and a second video clip. The implementation also matches a first fingerprint of at least a part of the first video clip with a second fingerprint of at least a part of the second video clip. The implementation also determines a temporal overlap of the first video clip with the second video clip based at least in part on the match. The implementation also, based on the temporal overlap of the first video clip with the second video clip, merges the first video clip and the second video clip into a group of overlapping video clips, and transmits, to a client computing device, data identifying the group of overlapping video clips and specifying a synchronization of the first video clip with the second video clip.

Claims (52)

1. A method comprising:

accessing, by one or more processors of a server computing device, a plurality of media clips including a first video clip and a second video clip;

matching, by the one or more processors, a first fingerprint of at least a part of the first video clip with a second fingerprint of at least a part of the second video clip;

determining, by the one or more processors, a temporal overlap of the first video clip with the second video clip based at least in part on the match of the first fingerprint of at least the part of the first video clip with the second fingerprint of at least the part of the second video clip; and

based on the temporal overlap of the first video clip with the second video clip:

merging, by the one or more processors, the first video clip and the second video clip into a group of temporally-overlapping video clips,

transmitting, by the one or more processors, to a client computing device, data identifying the group of temporally-overlapping video clips and specifying a synchronization of the first video clip with the second video clip, and

generating, by the one or more processors, for display on a display device of the client computing device, a graphical user interface that identifies the group of temporally-overlapping video clips, specifies the synchronization of the first video clip with the second video clip, and allows access to, and manipulation of, the first and second video clips.

2. The method of claim 1 , wherein the synchronization comprises a spatial synchronization of the first video clip with the second video clip.

3. The method of claim 1 , wherein the synchronization comprises a temporal synchronization of the first video clip with the second video clip.

4. The method of claim 1 , wherein the match of the first fingerprint of at least the part of the first video clip with the second fingerprint of at least the part of the second video clip is a match of a first audio fingerprint of at least a part of a first audio waveform of the first video clip with a second audio fingerprint of at least a part of a second audio waveform of the second video clip, and

wherein the synchronization is based on the match of the first audio fingerprint of at least the part of the first audio waveform of the first video clip with the second audio fingerprint of at least the part of the second audio waveform of the second video clip.

5. The method of claim 1 , wherein the match of the first fingerprint of at least the part of the first video clip with the second fingerprint of at least the part of the second video clip is a match of a first video fingerprint of at least a part of the first video clip with a second video fingerprint of at least a part of the second video clip, and

wherein the synchronization is based on the match of the first video fingerprint of at least the part of the first video clip with the second video fingerprint of at least the part of the second video clip.

6. The method of claim 1 , wherein the synchronization comprises a synchronization of the first video clip and the second video clip with an audio track.

7. The method of claim 1 , further comprising:

determining, by the one or more processors, that the first video clip and the second video clip are clips of the same multimedia event,

wherein the merging of the first video clip and the second video clip into the group of temporally-overlapping video clips is further based on the determination that the first video clip and the second video clip are clips of the same multimedia event.

8. The method of claim 1 , wherein the accessing of the plurality of media clips comprises receiving the plurality of media clips from the client computing device.

9. The method of claim 1 , wherein the transmitting, to the client computing device, of the data identifying the group of temporally-overlapping video clips and specifying the synchronization of the first video clip with the second video clip comprises transmitting, to the client computing device, the data identifying the group of temporally-overlapping video clips and specifying the synchronization of the first video clip with the second video clip to facilitate the client computing device synthesizing, based on the synchronization, the group of temporally-overlapping video clips into a media presentation.

10. The method of claim 1 , wherein the data specifying the synchronization comprises data indicating how to synchronize the first video clip with the second video clip.

11. The method of claim 1 , further comprising:

based on the temporal overlap of the first video clip with the second video clip, synchronizing, by the one or more processors, the first video clip with the second video clip to generate a third video clip comprising at least part of the first video clip synchronized with at least part of the second video clip,

wherein the data specifying the synchronization comprises the third video clip.

12. A non-transitory machine-readable storage medium having instructions stored thereon, which, when executed by one or more processors of a server computing device, cause the one or more processors to perform operations comprising:

accessing a plurality of media clips including a first video clip and a second video clip;

matching a first fingerprint of at least a part of the first video clip with a second fingerprint of at least a part of the second video clip;

determining a temporal overlap of the first video clip with the second video clip based at least in part on the match of the first fingerprint of at least the part of the first video clip with the second fingerprint of at least the part of the second video clip; and

based on the temporal overlap of the first video clip with the second video clip:

merging the first video clip and the second video clip into a group of temporally-overlapping video clip,

transmitting, to a client computing device, data identifying the group of temporally-overlapping video clips and specifying a synchronization of the first video clip with the second video clip, and

generating, for display on a display device of the client computing device, a graphical user interface that identifies the group of temporally-overlapping video clips, specifies the synchronization of the first video clip with the second video clip, and allows access to, and manipulation of, the first and second video clips.

13. The non-transitory machine-readable storage medium of claim 12 , wherein the synchronization comprises a spatial synchronization of the first video clip with the second video clip.

14. The non-transitory machine-readable storage medium of claim 12 , wherein the synchronization comprises a temporal synchronization of the first video clip with the second video clip.

15. The non-transitory machine-readable storage medium of claim 12 , wherein the match of the first fingerprint of at least the part of the first video clip with the second fingerprint of at least the part of the second video clip is a match of a first audio fingerprint of at least a part of a first audio waveform of the first video clip with a second audio fingerprint of at least a part of a second audio waveform of the second video clip, and

wherein the synchronization is based on the match of the first audio fingerprint of at least the part of the first audio waveform of the first video clip with the second audio fingerprint of at least the part of the second audio waveform of the second video clip.

16. The non-transitory machine-readable storage medium of claim 12 , wherein the synchronization comprises a synchronization of the first video clip and the second video clip with an audio track.

17. The non-transitory machine-readable storage medium of claim 12 , wherein the transmitting, to the client computing device, of the data identifying the group of temporally-overlapping video clips and specifying the synchronization of the first video clip with the second video clip comprises transmitting, to the client computing device, the data identifying the group of temporally-overlapping video clips and specifying the synchronization of the first video clip with the second video clip to facilitate the client computing device synthesizing, based on the synchronization, the group of temporally-overlapping video clips into a media presentation.

18. The non-transitory machine-readable storage medium of claim 12 , wherein the data specifying the synchronization comprises data indicating how to synchronize the first video clip with the second video clip.

19. The non-transitory machine-readable storage medium of claim 12 , the operations further comprising:

based on the temporal overlap of the first video clip with the second video clip, synchronizing the first video clip with the second video clip to generate a third video clip comprising at least part of the first video clip synchronized with at least part of the second video clip,

wherein the data specifying the synchronization comprises the third video clip.

20. A server computing device comprising:

one or more processors; and

a non-transitory computer-readable storage medium, having stored thereon program instructions that, upon execution by the one or more processors, cause performance of operations comprising:

accessing a plurality of media clips including a first video clip and a second video clip;

matching a first fingerprint of at least a part of the first video clip with a second fingerprint of at least a part of the second video clip;

determining a temporal overlap of the first video clip with the second video clip based at least in part on the match of the first fingerprint of at least the part of the first video clip with the second fingerprint of at least the part of the second video clip; and

based on the temporal overlap of the first video clip with the second video clip:

merging the first video clip and the second video clip into a group of temporally-overlapping video clips, and

transmitting, to a client computing device, data identifying the group of temporally-overlapping video clips and specifying a synchronization of the first video clip with the second video clip, and

generating, for display on a display device of the client computing device, a graphical user interface that identifies the group of temporally-overlapping video clips, specifies the synchronization of the first video clip with the second video clip, and allows access to, and manipulation of, the first and second video clips.

Assignments (8)
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 6, 2020
From: ROBERTS, DALE T.; COOK, RANDALL E.; CREMER, MARKUS K.
To: GRACENOTE, INC.
Reel/Frame 052037/0687 →