IP Library Granted Patent US 10,945,049
Granted Patent B2
US 10,945,049 · App. 16/734,081 · Granted Mar 9, 2021

Method and apparatus for selection of content from a stream of data

Inventors: Igor Alexandrovich Nagorski (Geldrop, NL); Jan Alexis Daniel Nesvadba (Eindhoven, NL); Ronaldus Maria Aarts (Geldrop, NL)
Assignee: Gracenote, Inc.
H04N21/8133H04N5/50H04N19/467H04N21/235H04N21/2368H04N21/2389H04N21/23892H04N21/234363H04N21/234381H04N21/2541H04N21/4135H04N21/435H04N21/4341H04N21/4383H04N21/4385H04N21/44008H04N21/44016H04N21/4622H04N21/4667H04N21/84H04N21/8456H04N21/8549
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,945,049
App. No.
16/734,081
Granted
Mar 9, 2021
Kind
B2
Abstract

A main stream contains successive content elements of video and/or audio information that encode video and/or audio information at a first data rate. A computation circuit ( 144 ) computes main fingerprints from the successive content elements. A reference stream is received having a second data rate lower than the first data rate. The reference stream defines a sequence of the reference fingerprints. A comparator unit ( 144 ) compares the main fingerprints with the reference fingerprints. The main stream is monitored for the presence of inserted content elements between original content elements, where the original content elements have main fingerprints that match successive reference fingerprints and the inserted content elements have main fingerprints that do not match reference fingerprints. Rendering of inserted content elements to be skipped. In an embodiment when more than one content element matches only one is rendered. In another embodiment matching is used to control zapping to or from the main stream. In another embodiment matching is used to control linking of separately received mark-up information such as subtitles to points in the main stream.

Claims (42)

1. An apparatus comprising:

a comparator unit arranged to:

receive a main stream and a reference stream, the main stream having a higher data rate than the reference stream and comprising successive content elements and inserted sections intermixed with the successive content elements, the reference stream defining sequential reference fingerprints that correspond to at least some of the successive content elements;

compute a main fingerprint from the successive content elements; and

compare the main fingerprint with a reference fingerprint among the sequential reference fingerprints defined by the reference stream that has a lower data rate than the main stream; and

a control unit arranged to select content elements from the main stream based on whether the main fingerprint matches the reference fingerprint among the sequential reference fingerprints defined by the reference stream that has the lower data rate than the main stream.

2. The apparatus of claim 1 , wherein the control unit is adapted to select the content elements from the main stream if the main fingerprint mismatches the reference fingerprint and to cause a rendering of the content elements to be skipped.

3. The apparatus of claim 1 , wherein the comparator unit is arranged to detect that multiple instances of the main fingerprint matches the reference fingerprint, the control unit being arranged to cause no more than one of the corresponding content elements to be rendered in response to this detection.

4. The apparatus of claim 1 , further comprising a storage device adapted to store the main stream, the control unit being arranged to select content elements for which the main fingerprint matches the reference fingerprint for selective retrieval from the storage device.

5. The apparatus of claim 1 , further comprising a storage device adapted to store the main stream, as well as mark-up information received in the reference stream, the comparator unit being arranged to cause linking information to be stored indicating where the main fingerprint matches linking points in the reference fingerprint.

6. The apparatus of claim 1 , further comprising a channel selection unit arranged to switch to a rendering of a further stream based on the main fingerprint mismatching the reference fingerprint and to switch to a rendering of the main stream based on the main fingerprint matching the reference fingerprint.

7. The apparatus of claim 1 , further comprising an input adapted to receive the main stream and the reference stream from mutually different distribution media.

8. The apparatus of claim 1 , further comprising an input arranged to receive the main stream via a broadcast channel.

9. The apparatus of claim 1 , further comprising a storage device adapted to record the main stream, content elements for which the main fingerprint mismatches the reference fingerprint being discarded from retention in a storage device.

10. The apparatus of claim 1 , wherein the comparator unit is arranged to compute the reference fingerprint from lower resolution versions of the content elements.

11. A method comprising:

receiving a main stream and a reference stream, the main stream having a higher data rate than the reference stream and comprising successive content elements and inserted sections intermixed with the successive content elements, the reference stream defining sequential reference fingerprints that correspond to at least some of the successive content elements;

computing a main fingerprint from the successive content elements;

comparing the main fingerprint with a reference fingerprint among the sequential reference fingerprints defined by the reference stream that has a lower data rate than the main stream; and

selecting content elements from the main stream based on whether the main fingerprint matches the reference fingerprint among the sequential reference fingerprints defined by the reference stream that has the lower data rate than the main stream.

12. The method of claim 11 , wherein the content elements are selected from the main stream if the main fingerprint mismatches the reference fingerprint; and the method further comprises causing a rendering of the content elements to be skipped.

13. The method of claim 11 , further comprising:

detecting that multiple instances of the main fingerprint match reference fingerprint; and

causing no more than one of the corresponding content elements to be rendered in response to this detection.

14. The method of claim 11 , further comprising:

storing the main stream; and

selecting content elements for which the main fingerprint matches the reference fingerprint for selective retrieval from the stored main stream.

15. The method of claim 11 , further comprising:

storing the main stream, as well as mark-up information received in the reference stream; and

causing linking information to be stored indicating where the main fingerprint matches linking points in the reference fingerprint.

16. The method of claim 11 , further comprising:

switching to a rendering of a further stream based on the main fingerprint mismatching the reference fingerprint; and

switching to a rendering of the main stream based on the main fingerprint matching the reference fingerprint.

17. The method of claim 11 , wherein the receiving of the main stream and the reference stream is from mutually different distribution media.

18. The method of claim 11 , wherein the receiving of the main stream is via a broadcast channel.

19. The method of claim 11 , further comprising:

recording the main stream, content elements for which the main fingerprint mismatches the reference fingerprint being discarded from retention in a storage device.

20. A non-transitory computer readable medium comprising a program of instructions that, when executed by a programmable machine, causes the machine to perform operations comprising:

receiving a main stream and a reference stream, the main stream having a higher data rate than the reference stream and comprising successive content elements and inserted sections intermixed with the successive content elements, the reference stream defining sequential reference fingerprints that correspond to at least some of the successive content elements;

computing a main fingerprint from the successive content elements;

comparing the main fingerprint with a reference fingerprint among the sequential reference fingerprints defined by the reference stream that has a lower data rate than the main stream; and

selecting content elements from the main stream based on whether the main fingerprint matches the reference fingerprint among the sequential reference fingerprints defined by the reference stream that has the lower data rate than the main stream.

Assignments (10)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: GRACENOTE, INC.; A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: GRACENOTE, INC.
To: ROKU, INC.
Reel/Frame 056103/0786 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Apr 20, 2021
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC; GRACENOTE, INC.
Reel/Frame 056973/0280 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 7, 2020
From: NAGORSKI, IGOR ALEXANDROVICH; NESVADBA, JAN ALEXIS DANIEL; AARTS, RONALDUS MARIA
To: GRACENOTE, INC.
Reel/Frame 051441/0920 →