IP Library Granted Patent US 10,796,159
Granted Patent B1
US 10,796,159 · App. 16/836,170 · Granted Oct 6, 2020

Content-modification system with use of multiple fingerprint data types feature

Inventors: Andrew Laurence Ashbacher (Aptos, CA); Steven Michael Cormie (Cambridge, GB); John L. Haynes, III (Sandy, UT); Stefan Matthijs Maris (Brooklyn, NY)
Assignee: The Nielsen Company (US), LLC
G06K9/00758G06F16/14G06K9/6201H04N21/2353
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,796,159
App. No.
16/836,170
Granted
Oct 6, 2020
Kind
B1
Abstract

In one aspect, a method includes receiving first query fingerprint data representing first content channeled through a portion of a content-distribution system. The method also includes detecting a first match between the received first query fingerprint data and first reference fingerprint data representing a modifiable content-segment. The method also includes responsive to detecting the first match, performing a first action. The method also includes receiving second query fingerprint data representing content received by a content-presentation device. The method also includes detecting a second match between the received second query fingerprint data and second reference fingerprint data representing second content transmitted by the content-distribution system, where the second content is a modified version of the first content. The method also includes responsive to detecting the second match, performing a second action that is different from the first action.

Claims (50)

1. A method comprising:

receiving first query fingerprint data representing first content channeled through a portion of a content-distribution system;

detecting a first match between the received first query fingerprint data and first reference fingerprint data representing a modifiable content-segment;

responsive to detecting the first match, performing a first action;

receiving second query fingerprint data representing content received by a content-presentation device;

detecting a second match between the received second query fingerprint data and second reference fingerprint data representing second content transmitted by the content-distribution system, wherein the second content is a modified version of the first content and includes at least a portion of the first content; and

responsive to detecting the second match, performing a second action that is different from the first action.

2. The method of claim 1 , wherein the second content comprises the first content with overlay content overlaid thereon.

3. The method of claim 2 , wherein the portion of the content-distribution system is a first portion of the content-distribution system,

wherein the overlay content is a digital video effect (DVE), and

wherein a second portion of the content-distribution system, different from the first portion, comprises a DVE system configured to modify the first content by overlaying the DVE on the first content and then outputting the second content.

4. The method of claim 1 , wherein performing the second action comprises identifying a channel on which the content-presentation device received content.

5. The method of claim 1 , wherein performing the first action comprises identifying an upcoming content-modification opportunity on the identified channel.

6. The method of claim 1 , wherein detecting the second match occurs before detecting the first match, and

wherein performing the second action occurs before performing the first action.

7. The method of claim 1 , wherein the content-distribution system comprises a television-broadcast station.

8. A non-transitory computer-readable storage medium, having stored thereon program instructions that, upon execution by a processor, cause performance of a set of operations comprising:

receiving first query fingerprint data representing first content channeled through a portion of a content-distribution system;

detecting a first match between the received first query fingerprint data and first reference fingerprint data representing a modifiable content-segment;

responsive to detecting the first match, performing a first action;

receiving second query fingerprint data representing content received by a content-presentation device;

detecting a second match between the received second query fingerprint data and second reference fingerprint data representing second content transmitted by the content-distribution system, wherein the second content is a modified version of the first content and includes at least a portion of the first content; and

responsive to detecting the second match, performing a second action that is different from the first action.

9. The non-transitory computer-readable storage medium of claim 8 ,

wherein the second content comprises the first content with overlay content overlaid thereon.

10. The non-transitory computer-readable storage medium of claim 9 , wherein the portion of the content-distribution system is a first portion of the content-distribution system,

wherein the overlay content is a digital video effect (DVE), and

wherein a second portion of the content-distribution system, different from the first portion, comprises a DVE system configured to modify the first content by overlaying the DVE on the first content and then outputting the second content.

11. The non-transitory computer-readable storage medium of claim 8 , wherein performing the second action comprises identifying a channel on which the content-presentation device received content.

12. The non-transitory computer-readable storage medium of claim 8 , wherein performing the first action comprises identifying an upcoming content-modification opportunity on the identified channel.

13. The non-transitory computer-readable storage medium of claim 8 , wherein detecting the second match occurs before detecting the first match, and

wherein performing the second action occurs before performing the first action.

14. The non-transitory computer-readable storage medium of claim 8 , wherein the content-distribution system comprises a television-broadcast station.

15. A computing system comprising:

a processor; and

a non-transitory computer-readable storage medium, having stored thereon program instructions that, upon execution by the processor, cause performance of a set of operations comprising:

receiving first query fingerprint data representing first content channeled through a portion of a content-distribution system;

detecting a first match between the received first query fingerprint data and first reference fingerprint data representing a modifiable content-segment;

responsive to detecting the first match, performing a first action;

receiving second query fingerprint data representing content received by a content-presentation device;

detecting a second match between the received second query fingerprint data and second reference fingerprint data representing second content transmitted by the content-distribution system, wherein the second content is a modified version of the first content and includes at least a portion of the first content; and

responsive to detecting the second match, performing a second action that is different from the first action.

16. The computing system of claim 15 , wherein the second content comprises the first content with overlay content overlaid thereon.

17. The computing system of claim 16 , wherein the portion of the content-distribution system is a first portion of the content-distribution system,

wherein the overlay content is a digital video effect (DVE), and

wherein a second portion of the content-distribution system, different from the first portion, comprises a DVE system configured to modify the first content by overlaying the DVE on the first content and then outputting the second content.

18. The computing system of claim 15 , wherein performing the second action comprises identifying a channel on which the content-presentation device received content.

19. The computing system of claim 15 , wherein performing the first action comprises identifying an upcoming content-modification opportunity on the identified channel.

20. The computing system of claim 15 , wherein detecting the second match occurs before detecting the first match, and

wherein performing the second action occurs before performing the first action.

Assignments (11)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: THE NIELSEN COMPANY (US), LLC
To: ROKU, INC.
Reel/Frame 056106/0376 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Apr 20, 2021
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC; GRACENOTE, INC.
Reel/Frame 056973/0280 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE CORRESPONDENT NAME: MCDONNEL BOEHNEN HULBERT & BERGHOFF LLP PREVIOUSLY RECORDED AT REEL: 052359 FRAME: 0105. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Apr 23, 2020
From: ASHBACHER, ANDREW LAURENCE; CORMIE, STEVEN MICHAEL; HAYNES, JOHN L., III; MARIS, STEFAN MATTHIJS
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 053374/0617 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 9, 2020
From: ASHBACHER, ANDREW LAURENCE; CORMIE, STEVEN MICHAEL; HAYNES, JOHN L., III; MARIS, STEFAN MATTHIJS
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 052359/0105 →