IP Library Granted Patent US 9,794,644
Granted Patent B2
US 9,794,644 · App. 15/285,056 · Granted Oct 17, 2017

Method and apparatus for selection of content from a stream of data

Inventors: Igor Alexandrovich Nagorski (Geldrop, NL); Jan Alexis Daniel Nesvadba (Eindhoven, NL); Ronaldus Maria Aarts (Geldrop, NL)
Assignee: Gracenote, Inc.
H04N21/8133H04N5/50H04N19/467H04N21/235H04N21/2368H04N21/2389H04N21/23892H04N21/234363H04N21/234381H04N21/2541H04N21/4135H04N21/435H04N21/4341H04N21/4383H04N21/4385H04N21/44008H04N21/44016H04N21/4622H04N21/4667H04N21/84H04N21/8456H04N21/8549
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,794,644
App. No.
15/285,056
Granted
Oct 17, 2017
Kind
B2
Abstract

A main stream contains successive content elements of video and/or audio information that encode video and/or audio information at a first data rate. A computation circuit ( 144 ) computes main fingerprints from the successive content elements. A reference stream is received having a second data rate lower than the first data rate. The reference stream defines a sequence of the reference fingerprints. A comparator unit ( 144 ) compares the main fingerprints with the reference fingerprints. The main, stream is monitored for the presence of inserted content elements between original content elements, where the original content elements have main fingerprints that match successive reference fingerprints and the inserted content elements have main fingerprints that do not match reference fingerprints. Rendering of inserted content elements to be skipped. In an embodiment when more than one content element matches only one is rendered. In another embodiment matching is used to control zapping to or from the main stream. In another embodiment matching is used to control linking of separately received mark-up information such as subtitles to points in the main stream.

Claims (70)

1. A method comprising:

accessing, by a receiver of a media device, a media stream that includes a sequence of items of content;

accessing, by the media device, a reference stream that includes reference fingerprints derived from respective segments of at least some of the items of content;

computing, by a processor of the media device, a fingerprint from a particular segment of the sequence of items of content of the media stream;

comparing, by the processor of the media device, the computed fingerprint to one or more of the reference fingerprints;

determining, by the processor of the media device, based on the comparing, that the computed fingerprint corresponds to a particular one of the one or more reference fingerprints;

identifying a time point associated with the particular one of the one or more reference fingerprints; and

associating the particular segment of the media stream from which the fingerprint was computed with the identified time point.

2. The method of claim 1 , further comprising:

editing, by an editing unit of the media device, the media stream; and

providing the edited media stream to a display screen of the media device.

3. The method of claim 2 , wherein the editing of the media stream comprises causing the display screen to refrain from displaying the particular segment of the media stream.

4. The method of claim 3 , wherein the editing of the media stream comprises selecting, based on the identified time point, a part of the media stream to refrain from displaying.

5. The method of claim 3 , wherein the editing of the media stream comprises:

detecting that two segments of the media stream are duplicative segments; and

responsive to detecting that the two segments of the media stream are duplicative segments, skipping one of the two segments.

6. The method of claim 1 , wherein the reference stream includes an indication of the time point associated with the particular one of the one or more reference fingerprints.

7. The method of claim 1 , wherein the particular segment comprises one or more frames of a video content item included in the sequence of items of content.

8. The method of claim 1 , further comprising storing information about the identified time point for use by an editing unit of the media device.

9. The method of claim 1 , further comprising storing at least a portion of the reference stream.

10. A method comprising:

accessing, by a receiver of a media device, a media stream that includes a sequence of items of content;

accessing, by the media device, a reference stream that includes reference fingerprints derived from respective segments of at least some of the items of content;

computing, by a processor of the media device, a fingerprint from a particular segment of the sequence of items of content of the media stream;

comparing, by the processor of the media device, the computed fingerprint to one or more of the reference fingerprints;

determining, by the processor of the media device, based on the comparing, that the computed fingerprint corresponds to a particular one of the one or more reference fingerprints;

identifying additional information associated with the particular one of the one or more reference fingerprints; and

associating the particular segment of the media stream from which the fingerprint was computed with the identified additional information.

11. The method of claim 10 , wherein the identified additional information includes an indication of additional media content.

12. The method of claim 11 , wherein the additional media content includes audio content.

13. The method of claim 11 , wherein the additional media content includes video content.

14. The method of claim 11 , further comprising accessing the additional media content.

15. A media device comprising:

a receiver configured to:

access a media stream that includes a sequence of items of content; and

access a reference stream that includes reference fingerprints derived from respective segments of at least some of the items of content;

a memory that stores instructions; and

one or more processors configured by the instructions to perform operations comprising:

computing a fingerprint from a particular segment of the sequence of items of content of the media stream;

comparing the computed fingerprint to one or more of the reference fingerprints;

determining, based on the comparing, that the computed fingerprint corresponds to a particular one of the one or more reference fingerprints;

identifying a time point associated with the particular one of the one or more reference fingerprints; and

associating the particular segment of the media stream from which the fingerprint was computed with the identified time point.

16. The media device of claim 15 , wherein the operations further comprise:

editing the media stream; and

causing display of the edited media stream.

17. The media device of claim 16 , wherein the editing of the media stream comprises causing the media device to refrain from causing display of the particular segment of the media stream.

18. The media device of claim 16 , wherein the editing of the media stream comprises selecting, based on the identified time point, a part of the media stream to refrain from displaying.

19. The media device of claim 16 , wherein the editing of the media stream comprises:

detecting that two segments of the media stream are duplicative segments; and

responsive to detecting that the two segments of the media stream are duplicative segments, skipping one of the two segments.

20. The media device of claim 15 , wherein the reference stream includes an indication of the time point associated with the particular one of the one or more reference fingerprints.

21. The media device of claim 15 , wherein the particular segment comprises one or more frames of a video content item included in the sequence of items of content.

22. The media device of claim 15 , further comprising storing information about the identified time point in an index table.

23. The media device of claim 15 , further comprising storing at least a portion of the reference stream.

24. A media device comprising:

a receiver configured to:

access a media stream that includes a sequence of items of content; and

access a reference stream that includes reference fingerprints derived from respective segments of at least some of the items of content;

a memory that stores instructions; and

one or more processors configured by the instructions to perform operations comprising:

computing a fingerprint from a particular segment of the sequence of items of content of the media stream;

comparing the computed fingerprint to one or more of the reference fingerprints;

determining, based on the comparing, that the computed fingerprint corresponds to a particular one of the one or more reference fingerprints;

identifying additional information associated with the particular one of the one or more reference fingerprints; and

associating the particular segment of the media stream from which the fingerprint was computed with the identified additional information.

25. The media device of claim 24 , wherein the identified additional information includes an indication of additional media content.

26. The media device of claim 25 , wherein the additional media content includes audio content.

27. The media device of claim 25 , wherein the additional media content includes video content.

28. The media device of claim 25 , further comprising accessing the additional media content.

Assignments (12)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
RELEASE (REEL 042262 / FRAME 0601) Recorded Oct 13, 2022
From: CITIBANK, N.A.
To: GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC
Reel/Frame 061748/0001 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: GRACENOTE, INC.
To: ROKU, INC.
Reel/Frame 056103/0786 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Apr 20, 2021
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC; GRACENOTE, INC.
Reel/Frame 056973/0280 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Apr 13, 2017
From: GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE DIGITAL VENTURES, LLC
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 042262/0601 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 4, 2016
From: NAGORSKI, IGOR ALEXANDROVICH; NESVADBA, JAN ALEXIS DANIEL; AARTS, RONALDUS MARIA
To: GRACENOTE, INC.
Reel/Frame 039934/0252 →
Priority Claims (1)
EP 041039025 · Aug 12, 2004 · regional
Continuity (5)
Continuation 15204366 · Jul 7, 2016
Continuation 14789048 · Jul 1, 2015
Continuation 13778439 · Feb 27, 2013
Continuation 11573455
Related Publication 20170026716A1 · Jan 26, 2017