IP Library Granted Patent US 10,555,052
Granted Patent B2
US 10,555,052 · App. 15/971,608 · Granted Feb 4, 2020

Method and apparatus for selection of content from a stream of data

Inventors: Igor Alexandrovich Nagorski (Geldrop, NL); Jan Alexis Daniel Nesvadba (Eindhoven, NL); Ronaldus Maria Aarts (Geldrop, NL)
Assignee: Gracenote, Inc.
H04N21/8133H04N5/50H04N19/467H04N21/235H04N21/2368H04N21/2389H04N21/23892H04N21/234363H04N21/234381H04N21/2541H04N21/4135H04N21/435H04N21/4341H04N21/4383H04N21/4385H04N21/44008H04N21/44016H04N21/4622H04N21/4667H04N21/84H04N21/8456H04N21/8549
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,555,052
App. No.
15/971,608
Granted
Feb 4, 2020
Kind
B2
Abstract

A main stream contains successive content elements of video and/or audio information that encode video and/or audio information at a first data rate. A computation circuit ( 144 ) computes main fingerprints from the successive content elements. A reference stream is received having a second data rate lower than the first data rate. The reference stream defines a sequence of the reference fingerprints. A comparator unit ( 144 ) compares the main fingerprints with the reference fingerprints. The main stream is monitored for the presence of inserted content elements between original content elements, where the original content elements have main fingerprints that match successive reference fingerprints and the inserted content elements have main fingerprints that do not match reference fingerprints. Rendering of inserted content elements to be skipped. In an embodiment when more than one content element matches only one is rendered. In another embodiment matching is used to control zapping to or from the main stream. In another embodiment matching is used to control linking of separately received mark-up information such as subtitles to points in the main stream.

Claims (56)

1. A method comprising:

accessing, by a receiver of a media device, a media stream that includes a sequence of items of content;

accessing, by the media device, a reference stream defining a sequence of reference fingerprints corresponding to respective segments of at least some of the items of content;

computing, by a processor of the media device, a computed fingerprint from a particular segment of the sequence of items of content of the media stream;

comparing, by the processor of the media device, the computed fingerprint to one or more of the reference fingerprints; and

selecting, by the processor of the media device and based on the comparing, one or more of the items of content from the media stream.

2. The method of claim 1 , wherein comparing the computed fingerprint to the one or more of the reference fingerprints comprises determining that the computed fingerprint matches the one or more of the reference fingerprints, and

wherein selecting the one or more of the items of content is responsive to determining that the computed fingerprint matches the one or more of the reference fingerprints.

3. The method of claim 2 , further comprising, responsive to selecting the one or more of the items of content, associating the particular segment of the media stream from which the fingerprint was computed with additional information associated with at least one of the one or more of the reference fingerprints.

4. The method of claim 3 , wherein the additional information includes an indication of additional media content, and

wherein the method further comprises accessing the additional media content.

5. The method of claim 3 , further comprising extracting the additional information from the reference stream; and

storing the associated information in a storage device.

6. The method of claim 3 , further comprising receiving a selection from a user to provide interactive access to the additional information.

7. The method of claim 1 , wherein comparing the computed fingerprint to the one or more of the reference fingerprints comprises determining that the computed fingerprint mismatches the one or more of the reference fingerprints, and

wherein selecting the one or more of the items of content is responsive to determining that the computed fingerprint mismatches the one or more of the reference fingerprints.

8. The method of claim 7 , further comprising, responsive to selecting the one or more of the items of content, rendering the media stream without the selected one or more of the items of content.

9. The method of claim 1 , wherein accessing the media stream is substantially simultaneous with accessing the reference stream.

10. The method of claim 1 , wherein accessing the media stream is performed at a different time than accessing the reference stream.

11. The method of claim 1 , wherein accessing the reference stream comprises:

accessing, by the processor of the media device, a modified version of at least some of the items of content of the media stream; and

computing, by the processor of the media device, the one or more of the reference fingerprints from the modified version of the at least some of the items of content.

12. The method of claim 1 , wherein accessing the reference stream comprises receiving, by the receiver of the media device, the sequence of reference fingerprints.

13. The method of claim 1 , wherein each item of content of the media stream comprises audio content.

14. The method of claim 1 , wherein each item of content of the media stream comprises video content.

15. A non-transitory machine-readable medium having instructions embodied thereon, which, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

accessing a media stream that includes a sequence of items of content;

accessing a reference stream defining a sequence of reference fingerprints corresponding to respective segments of at least some of the items of content;

computing a fingerprint from a particular segment of the sequence of items of content of the media stream;

comparing the computed fingerprint to one or more of the reference fingerprints; and

selecting, based on the comparing, one or more of the items of content from the media stream.

16. The non-transitory machine-readable medium of claim 15 , wherein comparing the computed fingerprint to the one or more of the reference fingerprints comprises determining that the computed fingerprint mismatches the one or more of the reference fingerprints, and

wherein selecting the one or more of the items of content is responsive to determining that the computed fingerprint mismatches the one or more of the reference fingerprints.

17. The non-transitory machine-readable medium of claim 15 , wherein comparing the computed fingerprint to the one or more of the reference fingerprints comprises determining that the computed fingerprint matches the one or more of the reference fingerprints,

wherein selecting the one or more of the items of content is responsive to determining that the computed fingerprint matches the one or more of the reference fingerprints, and

wherein the operations further comprise, responsive to selecting the one or more of the items of content, associating the particular segment of the media stream from which the fingerprint was computed with additional information associated with at least one of the one or more of the reference fingerprints.

18. The non-transitory machine-readable medium of claim 17 , wherein the additional information includes an indication of additional media content, and

wherein the operations further comprise accessing the additional media content.

19. The non-transitory machine-readable medium of claim 15 , wherein accessing the media stream is substantially simultaneous with accessing the reference stream.

20. The non-transitory machine-readable medium of claim 15 , wherein each item of content of the media stream comprises video content.

21. A media device comprising:

a receiver configured to access a media stream that includes a sequence of items of content;

a memory that stores instructions; and

one or more processors configured by the instructions to perform operations comprising:

accessing a reference stream defining a sequence of reference fingerprints corresponding to respective segments of at least some of the items of content,

computing a computed fingerprint from a particular segment of the sequence of items of content of the media stream,

comparing the computed fingerprint to one or more of the reference fingerprints, and

selecting, based on the comparing, one or more of the items of content from the media stream.

22. The media device of claim 21 , wherein comparing the computed fingerprint to the one or more of the reference fingerprints comprises determining that the computed fingerprint mismatches the one or more of the reference fingerprints, and

wherein selecting the one or more of the items of content is responsive to determining that the computed fingerprint mismatches the one or more of the reference fingerprints.

23. The media device of claim 21 , wherein comparing the computed fingerprint to the one or more of the reference fingerprints comprises determining that the computed fingerprint matches the one or more of the reference fingerprints,

wherein selecting the one or more of the items of content is responsive to determining that the computed fingerprint matches the one or more of the reference fingerprints, and

wherein the operations further comprise, responsive to selecting the one or more of the items of content, associating the particular segment of the media stream from which the fingerprint was computed with additional information associated with at least one of the one or more of the reference fingerprints.

24. The media device of claim 23 , wherein the additional information includes an indication of additional media content, and

wherein the operations further comprise accessing the additional media content.

25. The media device of claim 21 , wherein each item of content of the media stream comprises video content.

Assignments (10)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: GRACENOTE, INC.
To: ROKU, INC.
Reel/Frame 056103/0786 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Apr 20, 2021
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC; GRACENOTE, INC.
Reel/Frame 056973/0280 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 8, 2018
From: NESVADBA, JAN ALEXIS DANIEL; AARTS, RONALDUS MARIA; NAGORSKI, IGOR ALEXANDROVICH
To: GRACENOTE, INC.
Reel/Frame 045744/0258 →