IP Library Granted Patent US 10,924,816
Granted Patent B2
US 10,924,816 · App. 16/734,283 · Granted Feb 16, 2021

Method and apparatus for selection of content from a stream of data

Inventors: Igor Alexandrovich Nagorski (Geldrop, NL); Jan Alexis Daniel Nesvadba (Eindhoven, NL); Ronaldus Maria Aarts (Geldrop, NL)
Assignee: Gracenote, Inc.
H04N21/8133H04N5/50H04N19/467H04N21/235H04N21/2368H04N21/2389H04N21/23892H04N21/234363H04N21/234381H04N21/2541H04N21/4135H04N21/435H04N21/4341H04N21/4383H04N21/4385H04N21/44008H04N21/44016H04N21/4622H04N21/4667H04N21/84H04N21/8456H04N21/8549
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,924,816
App. No.
16/734,283
Granted
Feb 16, 2021
Kind
B2
Abstract

A main stream contains successive content elements of video and/or audio information that encode video and/or audio information at a first data rate. A computation circuit ( 144 ) computes main fingerprints from the successive content elements. A reference stream is received having a second data rate lower than the first data rate. The reference stream defines a sequence of the reference fingerprints. A comparator unit ( 144 ) compares the main fingerprints with the reference fingerprints. The main stream is monitored for the presence of inserted content elements between original content elements, where the original content elements have main fingerprints that match successive reference fingerprints and the inserted content elements have main fingerprints that do not match reference fingerprints. Rendering of inserted content elements to be skipped. In an embodiment when more than one content element matches only one is rendered. In another embodiment matching is used to control zapping to or from the main stream. In another embodiment matching is used to control linking of separately received mark-up information such as subtitles to points in the main stream.

Claims (78)

1. A method comprising:

accessing, by a media device, a media stream that includes a first sequence of items of content corresponding to a first channel and a second sequence of items of content corresponding to a second channel;

accessing, by the media device, a first reference stream defining a sequence of first reference fingerprints corresponding to respective segments of at least some of the items of content in the first sequence;

accessing, by the media device, a second reference stream defining a sequence of second reference fingerprints corresponding to respective segments of at least some of the items of content in the second sequence;

computing, by a processor of the media device, a first computed fingerprint from a particular segment of the first sequence of items of content of the media stream and a second computed fingerprint from a particular segment of the second sequence of items of content of the media stream;

performing, by the processor of the media device, comparisons of (i) the first computed fingerprint to one or more of the first reference fingerprints and (ii) the second computed fingerprint to one or more of the second reference fingerprints; and

deciding, based on the comparisons, whether to render the particular segment of the first sequence of items of content or the particular segment of the second sequence of items of content.

2. The method of claim 1 , further comprising:

tuning, by a channel selector of the media device, to the first sequence of items of content corresponding to the first channel; and

while tuning to the first sequence of items of content corresponding to the first channel, determining that the second channel is a predicted next channel to which the channel selector will tune.

3. The method of claim 2 , wherein accessing the second reference stream is responsive to determining that the second channel is a predicted next channel to which the channel selector will tune.

4. The method of claim 2 , wherein deciding whether to render the particular segment of the first sequence of items of content or the particular segment of the second sequence of items of content comprises:

making, based on the comparisons, a determination that (i) the first computed fingerprint mismatches the one or more of the first reference fingerprints and (ii) the second computed fingerprint matches the one or more of the second reference fingerprints; and

responsive to the determination, deciding to render the particular segment of the second sequence of items of content.

5. The method of claim 4 , further comprising:

while tuning to the first sequence of items of content corresponding to the first channel, receiving a command from a remote control unit to select the second channel.

6. The method of claim 1 , wherein accessing the media stream is substantially simultaneous with accessing the first reference stream.

7. The method of claim 6 , wherein accessing the media stream is substantially simultaneous with accessing the second reference stream.

8. The method of claim 1 , wherein accessing the media stream is performed at a different time than accessing the first reference stream and accessing the second reference stream.

9. The method of claim 1 , wherein accessing the first reference stream comprises:

accessing, by the processor of the media device, a modified version of at least some of the items of content of the first sequence; and

computing, by the processor of the media device, the one or more of the first reference fingerprints from the modified version of the at least some of the items of content of the first sequence.

10. The method of claim 1 , wherein accessing the first reference stream comprises receiving, by the receiver of the media device, the first sequence of reference fingerprints.

11. The method of claim 1 , wherein each item of content of the media stream comprises audio content.

12. The method of claim 1 , wherein each item of content of the media stream comprises video content.

13. A non-transitory machine-readable medium having instructions embodied thereon, which, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

accessing, a media stream that includes a first sequence of items of content corresponding to a first channel and a second sequence of items of content corresponding to a second channel;

accessing a first reference stream defining a sequence of first reference fingerprints corresponding to respective segments of at least some of the items of content in the first sequence;

accessing a second reference stream defining a sequence of second reference fingerprints corresponding to respective segments of at least some of the items of content in the second sequence;

computing a first computed fingerprint from a particular segment of the first sequence of items of content of the media stream and a second computed fingerprint from a particular segment of the second sequence of items of content of the media stream;

performing comparisons of (i) the first computed fingerprint to one or more of the first reference fingerprints and (ii) the second computed fingerprint to one or more of the second reference fingerprints; and

deciding, based on the comparisons, whether to render the particular segment of the first sequence of items of content or the particular segment of the second sequence of items of content.

14. The non-transitory machine-readable medium of claim 13 , wherein operations further comprise:

causing a channel selector of a media device to tune to the first sequence of items of content corresponding to the first channel; and

while tuning to the first sequence of items of content corresponding to the first channel, determining that the second channel is a predicted next channel to which the channel selector will tune.

15. The non-transitory machine-readable medium of claim 14 , wherein accessing the second reference stream is responsive to determining that the second channel is a predicted next channel to which the channel selector will tune.

16. The non-transitory machine-readable medium of claim 14 , wherein deciding whether to render the particular segment of the first sequence of items of content or the particular segment of the second sequence of items of content comprises:

making, based on the comparisons, a determination that (i) the first computed fingerprint mismatches the one or more of the first reference fingerprints and (ii) the second computed fingerprint matches the one or more of the second reference fingerprints; and

responsive to the determination, deciding to render the particular segment of the second sequence of items of content.

17. The non-transitory machine-readable medium of claim 16 , wherein operations further comprise:

while tuning to the first sequence of items of content corresponding to the first channel, receiving a command from a remote control unit to select the second channel.

18. The non-transitory machine-readable medium of claim 13 , wherein accessing the media stream is substantially simultaneous with accessing the first reference stream.

19. The non-transitory machine-readable medium of claim 18 , wherein accessing the media stream is substantially simultaneous with accessing the second reference stream.

20. The non-transitory machine-readable medium of claim 13 , wherein accessing the media stream is performed at a different time than accessing the first reference stream and accessing the second reference stream.

21. The non-transitory machine-readable medium of claim 13 , wherein accessing the first reference stream comprises:

accessing a modified version of at least some of the items of content of the first sequence; and

computing the one or more of the first reference fingerprints from the modified version of the at least some of the items of content of the first sequence.

22. The non-transitory machine-readable medium of claim 13 , wherein accessing the first reference stream comprises receiving the first sequence of reference fingerprints.

23. The non-transitory machine-readable medium of claim 13 , wherein each item of content of the media stream comprises audio content.

24. The non-transitory machine-readable medium of claim 13 , wherein each item of content of the media stream comprises video content.

25. A media device comprising:

a plurality of receivers configured to access a media stream that includes a first sequence of items of content corresponding to a first channel and a second sequence of items of content corresponding to a second channel;

a memory that stores instructions; and

one or more processors configured by the instructions to perform operations comprising:

accessing the media stream that includes the first sequence of items of content corresponding to the first channel and the second sequence of items of content corresponding to the second channel;

accessing a first reference stream defining a sequence of first reference fingerprints corresponding to respective segments of at least some of the items of content in the first sequence;

accessing a second reference stream defining a sequence of second reference fingerprints corresponding to respective segments of at least some of the items of content in the second sequence;

computing a first computed fingerprint from a particular segment of the first sequence of items of content of the media stream and a second computed fingerprint from a particular segment of the second sequence of items of content of the media stream;

performing comparisons of (i) the first computed fingerprint to one or more of the first reference fingerprints and (ii) the second computed fingerprint to one or more of the second reference fingerprints; and

deciding, based on the comparisons, whether to render the particular segment of the first sequence of items of content or the particular segment of the second sequence of items of content.

26. The media device of claim 25 , wherein operations further comprise:

tuning, by a channel selector of the media device, to the first sequence of items of content corresponding to the first channel; and

while tuning to the first sequence of items of content corresponding to the first channel, determining that the second channel is a predicted next channel to which the channel selector will tune.

27. The media device of claim 26 , wherein accessing the second reference stream is responsive to determining that the second channel is a predicted next channel to which the channel selector will tune.

28. The media device of claim 26 , wherein deciding whether to render the particular segment of the first sequence of items of content or the particular segment of the second sequence of items of content comprises:

making, based on the comparisons, a determination that (i) the first computed fingerprint mismatches the one or more of the first reference fingerprints and (ii) the second computed fingerprint matches the one or more of the second reference fingerprints; and

responsive to the determination, deciding to render the particular segment of the second sequence of items of content.

29. The media device of claim 28 , wherein operations further comprise:

while tuning to the first sequence of items of content corresponding to the first channel, receiving a command from a remote control unit to select the second channel.

30. The media device of claim 25 , wherein accessing the media stream is substantially simultaneous with accessing the first reference stream.

31. The media device of claim 30 , wherein accessing the media stream is substantially simultaneous with accessing the second reference stream.

32. The media device of claim 25 , wherein accessing the media stream is performed at a different time than accessing the first reference stream and accessing the second reference stream.

33. The media device of claim 25 , wherein accessing the first reference stream comprises:

accessing a modified version of at least some of the items of content of the first sequence; and

computing one or more of the first reference fingerprints from the modified version of the at least some of the items of content of the first sequence.

34. The media device of claim 25 , wherein accessing the first reference stream comprises receiving, by the receiver of the media device, the first sequence of reference fingerprints.

35. The media device of claim 25 , wherein each item of content of the media stream comprises audio content.

36. The media device of claim 25 , wherein each item of content of the media stream comprises video content.

Assignments (10)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: GRACENOTE, INC.
To: ROKU, INC.
Reel/Frame 056103/0786 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Apr 20, 2021
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC; GRACENOTE, INC.
Reel/Frame 056973/0280 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 7, 2020
From: NAGORSKI, IGOR ALEXANDROVICH; NESVADBA, JAN ALEXIS DANIEL; AARTS, RONALDUS MARIA
To: GRACENOTE, INC.
Reel/Frame 051441/0852 →