IP Library Granted Patent US 10,297,286
Granted Patent B2
US 10,297,286 · App. 15/973,118 · Granted May 21, 2019

System and methods to associate multimedia tags with user comments and generate user modifiable snippets around a tag time for efficient storage and sharing of tagged items

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,297,286
App. No.
15/973,118
Granted
May 21, 2019
Kind
B2
Abstract

Example methods and apparatus to add a tagged snippet of multimedia content to a playlist are disclosed. An example apparatus comprises an automatic content recognition search service to search a fingerprint database to find a match between query fingerprints for a snippet of multimedia content captured from a multimedia program at a timestamp and reference fingerprints of matching reference multimedia content stored in the fingerprint database, a tag service to generate a tag representing the snippet of multimedia content, wherein the tag, the timestamp, meta information associated with the matching reference multimedia content, and a monitored variable for a number of viewers of the snippet of multimedia content are stored in a database storage as a tagged snippet of multimedia content, and to add the tagged snippet of multimedia content to a playlist for an identified multimedia program if the number of viewers of the tagged snippet exceeds a threshold.

Claims (41)

1. An apparatus to add a tagged snippet of multimedia content to a playlist, the apparatus comprising:

an automatic content recognition search service to search a fingerprint database to find a match between query fingerprints for a snippet of original multimedia content captured from a multimedia program at a timestamp and reference fingerprints of matching reference multimedia content stored in the fingerprint database;

a tag service to:

generate a tag representing the snippet of original multimedia content, wherein the tag, the timestamp, meta information associated with the matching reference multimedia content, and a monitored variable for a number of viewers of the snippet of original multimedia content are stored in a database storage as a tagged snippet of multimedia content; and

add the tagged snippet of multimedia content to a playlist for an identified multimedia program if the number of viewers of the tagged snippet exceeds a threshold.

2. The apparatus of claim 1 , wherein the tag service generates additional query fingerprints to improve identification of the snippet of original multimedia content, and supplies the generated additional query fingerprints to be stored with the tag.

3. The apparatus of claim 1 , further comprising:

an automatic content recognition system to:

run an automatic content recognition process to search for a match between the query fingerprints and the original fingerprints stored in the fingerprint database; and

retrieve the meta information associated with the original multimedia content.

4. The apparatus of claim 3 , wherein the automatic content recognition system associates a current time with the identified multimedia program that is known to be playing at the current time and at a channel selected by a user, wherein the original multimedia content found in the database is identified in the meta information that includes scheduled playing time and channel.

5. The apparatus of claim 1 , further comprising:

a snippet service to generate a snippet with an associated tag representing the original multimedia content provided by an automatic content recognition analysis in a search system; and

a storage database to store the generated snippet.

6. The apparatus of claim 5 , further comprising:

a user device to:

access the snippet from the storage database; and

display a plurality of playlists including a playlist of one tag representing the accessed snippet, wherein a user selects the playlist of the one tag to initiate playing of the accessed snippet.

7. The apparatus of claim 1 , further comprising:

a storage database to store a plurality of snippets from the identified multimedia program according to a specified duration, wherein each snippet from the identified multimedia program is a selectively captured snippet of multimedia content having an associated tag; and

a user device to display a playlist of tags representing a sequence of selectively captured segments of multimedia content corresponding to a sequence of snippets, wherein a user selects the playlist to initiate playing of the sequence of the selectively captured snippets.

8. The apparatus of claim 1 , wherein the tag service shares the tag with users in a user group specified in sharing primitives stored with the tag.

9. A non-transitory computer readable storage medium comprising instructions that, when executed, cause a machine to at least:

search a fingerprint database to find a match between query fingerprints for a snippet of original multimedia content captured from a multimedia program at a timestamp and reference fingerprints of matching reference multimedia content stored in the fingerprint database;

generate a tag representing the snippet of original multimedia content, wherein the tag, the timestamp, meta information associated with the matching reference multimedia content, and a monitored variable for a number of viewers of the snippet of original multimedia content are stored in a database storage as a tagged snippet of multimedia content; and

add the tagged snippet of multimedia content to a playlist for an identified multimedia program if the number of viewers of the tagged snippet exceeds a threshold.

10. The non-transitory computer readable storage medium of claim 9 , wherein the instructions, when executed, cause the machine to generate additional query fingerprints to improve identification of the snippet of original multimedia content, and supply the generated additional query fingerprints to be stored with the tag.

11. The non-transitory computer readable storage medium of claim 9 , wherein the instructions, when executed, cause the machine to:

run an automatic content recognition process to search for a match between the query fingerprints and the original fingerprints stored in the fingerprint database; and

retrieve the meta information associated with the original multimedia content.

12. The non-transitory computer readable storage medium of claim 11 , wherein the instructions, when executed, cause the machine to associate a current time with the identified multimedia program that is known to be playing at the current time and at a channel selected by a user, wherein the original multimedia content found in the database is identified in the meta information that includes scheduled playing time and channel.

13. The non-transitory computer readable storage medium of claim 9 , wherein the instructions, when executed, cause the machine to:

generate a snippet with an associated tag representing the original multimedia content provided by an automatic content recognition analysis in a search system; and

store the generated snippet.

14. The non-transitory computer readable storage medium of claim 13 , wherein the instructions, when executed, cause the machine to:

access the snippet from the storage database; and

display a plurality of playlists including a playlist of one tag representing the accessed snippet, wherein a user selects the playlist of the one tag to initiate playing of the accessed snippet.

15. The non-transitory computer readable storage medium of claim 9 , wherein the instructions, when executed, cause the machine to:

store a plurality of snippets from the identified multimedia program according to a specified duration, wherein each snippet from the identified multimedia program is a selectively captured snippet of multimedia content having an associated tag; and

display a playlist of tags representing a sequence of selectively captured segments of multimedia content corresponding to a sequence of snippets, wherein a user selects the playlist to initiate playing of the sequence of the selectively captured snippets.

16. The non-transitory computer readable storage medium of claim 9 , wherein the instructions, when executed, cause the machine to share the tag with users in a user group specified in sharing primitives stored with the tag.

Assignments (9)
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 1, 2019
From: KULARNI, SUNIL SURESH; BOLGAROV, OLEKSIY
To: ZEITERA, LLC
Reel/Frame 048749/0667 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 1, 2019
From: ZEITERA, LLC
To: GRACENOTE, INC.
Reel/Frame 048749/0678 →