IP Library Granted Patent US 9,143,718
Granted Patent B2
US 9,143,718 · App. 13/778,439 · Granted Sep 22, 2015

Method and apparatus for selection of content from a stream of data

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,143,718
App. No.
13/778,439
Granted
Sep 22, 2015
Kind
B2
Abstract

A main stream contains successive content elements of video and/or audio information that encode video and/or audio information at a first data rate. A computation circuit ( 144 ) computes main fingerprints from the successive content elements. A reference stream is received having a second data rate lower than the first data rate. The reference stream defines a sequence of the reference fingerprints. A comparator unit ( 144 ) compares the main fingerprints with the reference fingerprints. The main stream is monitored for the presence of inserted content elements between original content elements, where the original content elements have main fingerprints that match successive reference fingerprints and the inserted content elements have main fingerprints that do not match reference fingerprints. Rendering of inserted content elements to be skipped. In an embodiment when more than one content element matches only one is rendered. In another embodiment matching is used to control zapping to or from the main stream. In another embodiment matching is used to control linking of separately received mark-up information such as subtitles to points in the main stream.

Claims (93)

1. An apparatus comprising:

a processor configured by a comparator unit to:

receive a main datastream and a reference datastream,

the main datastream including main content elements intermixed with inserted content elements,

the reference datastream having a different data rate than the main datastream and including reference fingerprints of the main content elements of the main datastream;

compute main fingerprints from at least some of the main content elements included in the main datastream; and

a control unit configured to select the main content elements from the main datastream based on a comparison of the main fingerprints to the reference fingerprints.

2. The apparatus of claim 1 , wherein:

the reference datastream includes no fingerprints of the inserted content elements that are included in the main datastream.

3. The apparatus of claim 2 , wherein:

the control unit is configured to cause a channel selector to skip the main datastream during a channel change in response to the reference datastream including no fingerprints of the inserted content elements.

4. The apparatus of claim 1 , wherein:

the main fingerprints match the reference fingerprints; and

the control unit is configured to include the main content elements in a rendering of the main datastream in response to the main fingerprints matching the reference fingerprints.

5. The apparatus of claim 1 , wherein:

the main fingerprints mismatch the reference fingerprints; and

the control unit is configured to exclude the main content elements from a rendering of the main datastream in response to the main fingerprints mismatching the reference fingerprints.

6. The apparatus of claim 1 , wherein:

the comparator unit configures the processor to detect duplicate main fingerprints that match one of the reference fingerprints,

one of the duplicate main fingerprints being computed from a main content element among the main content elements;

the control unit is configured to exclude the main content element from a rendering of the main datastream in response to the detecting of the duplicate main fingerprints.

7. The apparatus of claim 1 further comprising:

a channel selection unit configured to switch a rendering of the main datastream to render a further datastream in response to a determination that the main fingerprints mismatch the reference fingerprints.

8. The apparatus of claim 7 , wherein:

the channel selection unit is configured to restore the rendering of the main datastream in response to a further determination that further main fingerprints match further reference fingerprints.

9. The apparatus of claim 1 , wherein:

the main fingerprints match the reference fingerprints; and the apparatus further comprises

a storage device configured to store the main content elements as a data-reduced version of the main datastream without the inserted content elements.

10. The apparatus of claim 1 , wherein:

the reference datastream further contains mark-up information along with the low resolution versions of the main content elements;

the main fingerprints match the reference fingerprints; and the apparatus further comprises:

a storage device configured to store the received mark-up information with links that correlate the mark-up information to the main content elements.

11. The apparatus of claim 10 , wherein:

the mark-up information includes at least one of sub-title, an alternative language channel, a menu, or a chapter marker.

12. The apparatus of claim 1 , wherein:

the comparator unit configures the processor to receive the main datastream and the reference datastream from mutually different distribution media.

13. The apparatus of claim 1 , wherein:

the main content elements include segments of a motion picture; and

the inserted content elements include commercials.

14. A method comprising:

receiving a main datastream and a reference datastream,

the main datastream including main content elements intermixed with inserted content elements,

the reference datastream having a different data rate than the main datastream and including reference fingerprints of the main content elements of the main datastream;

using a processor, computing main fingerprints from at least some of the main content elements included in the main datastream; and

select the main content elements from the main datastream based on a comparison of the main fingerprints to the reference fingerprints.

15. The method of claim 14 , wherein:

the reference datastream contains no fingerprints of the inserted content elements contained in the main datastream.

16. The method of claim 14 , wherein:

the selecting of the main content elements is based on a determination that the main fingerprints match the reference fingerprints; and the method further comprises

including the main content elements in a rendering of the main datastream in response to the main fingerprints matching the reference fingerprints.

17. The method of claim 14 , wherein:

the selecting of the main content elements is based on a determination that the main fingerprints mismatch the reference fingerprints; and the method further comprises

excluding the main content elements from a rendering of the main datastream in response to the main fingerprints mismatching the reference fingerprints.

18. The method of claim 14 , wherein:

detecting duplicate main fingerprints that match one of the reference fingerprints,

one of the duplicate main fingerprints being computed from a main content element among the main content elements;

excluding the main content element from a rendering of the main datastream in response to the detecting of the duplicate main fingerprints.

19. The method of claim 14 , wherein:

switching a rendering of the main datastream to render a further datastream in response to a determination that the main fingerprints mismatch the reference fingerprints.

20. The method of claim 19 , wherein:

restoring the rendering of the main datastream in response to a further determination that further main fingerprints match further reference fingerprints.

21. The method of claim 14 , wherein:

the selecting of the main content elements is based on a determination that the main fingerprints match the reference fingerprints; and the method further comprises

storing the main content elements as a data-reduced version of the main datastream without the inserted content elements.

22. The method of claim 14 , wherein:

the reference datastream further contains mark-up information along with the low resolution versions of the main content elements;

the selecting of the main content elements is based on a determination that the main fingerprints match the reference fingerprints; and the method further comprises:

storing the received mark-up information with links that correlate the mark-up information to the main content elements.

23. A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

receiving a main datastream and a reference datastream,

the main datastream including main content elements intermixed with inserted content elements,

the reference datastream having a different data rate than the main datastream and including reference fingerprints of the main content elements of the main datastream;

computing main fingerprints from at least some of the main content elements included in the main datastream; and

selecting the main content elements from the main datastream based on a comparison of the main fingerprints to the reference fingerprints.

24. An apparatus comprising:

a processor configured by a comparator unit to:

receive a main datastream and a reference datastream,

the main datastream including main content elements intermixed with inserted content elements,

the reference datastream including low resolution versions of the main content elements of the main datastream;

compute main fingerprints from at least some of the main content elements; and

compute reference fingerprints from at least some of the low resolution versions of the main content elements; and

a control unit configured to select the main content elements from the main datastream based on whether the main fingerprints match the reference fingerprints computed from the low resolution versions contained in the reference datastream.

25. The apparatus of claim 24 , wherein:

the main fingerprints mismatch the reference fingerprints; and

the control unit is configured to exclude the main content elements from a rendering of the main datastream in response to the main fingerprints mismatching the reference fingerprints.

26. The apparatus of claim 24 , wherein:

the comparator unit configures the processor to detect duplicate main fingerprints that match one of the reference fingerprints,

one of the duplicate main fingerprints being computed from a main content element among the main content elements; and

the control unit is configured to exclude the main content element from a rendering of the main datastream in response to the detecting of the duplicate main fingerprints.

27. The apparatus of claim 24 further comprising:

a channel selection unit configured to switch a rendering of the main datastream to render a further datastream in response to a determination that the main fingerprints mismatch the reference fingerprints.

28. The apparatus of claim 24 , wherein:

the reference datastream contains no low resolution versions of the inserted content elements included in the main datastream.

Assignments (16)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
RELEASE (REEL 042262 / FRAME 0601) Recorded Oct 13, 2022
From: CITIBANK, N.A.
To: GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC
Reel/Frame 061748/0001 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: GRACENOTE, INC.
To: ROKU, INC.
Reel/Frame 056103/0786 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Apr 20, 2021
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC; GRACENOTE, INC.
Reel/Frame 056973/0280 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Apr 13, 2017
From: GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE DIGITAL VENTURES, LLC
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 042262/0601 →
RELEASE OF SECURITY INTEREST IN PATENT RIGHTS Recorded Feb 8, 2017
From: JPMORGAN CHASE BANK, N.A.
To: GRACENOTE, INC.; CASTTV INC.; TRIBUNE MEDIA SERVICES, LLC; TRIBUNE DIGITAL VENTURES, LLC
Reel/Frame 041656/0804 →
CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT APPL. NO. 14/282,293 PREVIOUSLY RECORDED AT REEL: 037569 FRAME: 0270. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT. Recorded Jan 26, 2016
From: CASTTV INC.; GRACENOTE, INC.; TRIBUNE BROADCASTING COMPANY, LLC; TRIBUNE MEDIA COMPANY
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 037606/0880 →
SECURITY AGREEMENT Recorded Jan 21, 2016
From: CASTTV INC.; GRACENOTE, INC.; TRIBUNE BROADCASTING COMPANY, LLC; TRIBUNE MEDIA COMPANY
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 037569/0270 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 29, 2015
From: NAGORSKI, IGOR ALEXANDROVICH; NESVADBA, JAN ALEXIS DANIEL; AARTS, RONALDUS MARIA
To: GRACENOTE, INC.
Reel/Frame 036209/0620 →
SECURITY INTEREST Recorded Mar 19, 2014
From: GRACENOTE, INC.
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 032480/0272 →