IP Library Granted Patent US 9,628,830
Granted Patent B1
US 9,628,830 · App. 14/839,339 · Granted Apr 18, 2017

Automatic content recognition (ACR) fingerprinting and video encoding

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,628,830
App. No.
14/839,339
Granted
Apr 18, 2017
Kind
B1
Abstract

Automatic content recognition (ACR) and media content encoding technologies are described. A content device can include a processing device and a capture interface. The processing device can be on a circuit board. A capture interface can be coupled to the processing device and include a data port. The processing device can be operable to execute a capture daemon. The capture daemon can include a capturer to receive media content from a content feed and generate content frames of the media content. The capture daemon can also include an encoder to receive the content frames from the capturer and encode the media content. The capture daemon can include an uploader to receive the encoded media content from the encoder and communicate the encoded media content to a broadcast sever. The capture daemon can also include an ACR fingerprinter to receive the content frames from the capturer and generate ACR fingerprint information.

Claims (77)

1. A content device comprising:

a housing;

a processing device disposed on a circuit board within the housing;

a capture interface coupled to the processing device and integrated into the housing, the capture interface comprising a data port; wherein the processing device is operable to execute a capture daemon, the capture daemon comprising:

a capturer to receive media content from a content feed via the data port of the capture interface and to generate content frames of the media content;

an automatic content recognition (ACR) fingerprinter to receive the content frames from the capturer and generate ACR fingerprint information for the content frames, the ACR fingerprinter to communicate the ACR fingerprint information to an ACR server via a first communication channel, wherein the processing device is to: determine when the ACR fingerprinter fails; cease communicating the ACR fingerprint information to the ACR server; and restart the ACR fingerprinter;

an encoder to receive the content frames from the capturer and encode the media content based on encoding criteria to obtain encoded media content; and

an uploader to receive the encoded media content from the encoder and communicate the encoded media content to a broadcast server via a second communication channel.

2. The content device of claim 1 , wherein the capture interface is operable to convert a first format of the media content to a second format that is compatible with the capturer.

3. The content device of claim 1 , wherein:

the capturer is operable to communicate capture criteria to the capture interface; and

the capture criteria are criteria to obtain media content from the content feed.

4. The content device of claim 1 , wherein the encoding criteria comprises at least one of a security encryption format, display size adjustment information, network processing capabilities information, network communication condition information, or battery capabilities of a media consumption device.

5. The content device of claim 1 , wherein the encoder is to encode the media content in parallel with the ACR fingerprinter generating the ACR fingerprint information.

6. The content device of claim 1 , wherein the ACR fingerprinter is to:

determine ACR fingerprint information for a first media consumption device using a first ACR algorithm; and

determine ACR fingerprint information for a second media consumption device using a second ACR algorithm.

7. The content device of claim 1 , further comprising a software updater executing on the processing device, the software updater to:

communicate with the broadcast server to determine when an update for the content device is scheduled at a time of day; and

update the content device at the scheduled time of day.

8. A content device comprising:

a processing device disposed on a circuit board;

a capture interface coupled to the processing device, the capture interface comprising a data port; wherein the processing device is operable to execute a capture daemon, the capture daemon comprising:

a capturer to:

receive media content from a content feed via the data port of the capture interface;

generate content frames of the media content; and

downscale the content frames to obtain down-scaled content frames;

an encoder to receive the down-scaled content frames from the capturer and encode the media content based on encoding criteria to obtain encoded media content; and

an uploader to receive the encoded media content from the encoder and communicate the encoded media content to a broadcast server; and

an automatic content recognition (ACR) fingerprinter to receive the content frames from the capturer and generate ACR fingerprint information for the content frames, the ACR fingerprinter to communicate the ACR fingerprint information to an ACR server, wherein the processing device is to: determine when the ACR fingerprinter fails; cease communicating the ACR fingerprint information to the ACR server; and restart the ACR fingerprinter.

9. The content device of claim 8 , wherein the capture interface is operable to convert a first format of the media content to a second format that is compatible with the capturer.

10. The content device of claim 8 , wherein:

the capturer is operable to communicate capture criteria to the capture interface; and

the capture criteria are criteria to obtain media content from the content feed.

11. The content device of claim 8 , wherein the encoding criteria comprises at least one of a security encryption format, display size adjustment information, network processing capabilities information, network communication condition information, or battery capabilities of a media consumption device.

12. The content device of claim 8 , wherein the encoder is to encode the media content in parallel with the ACR fingerprinter generating the ACR fingerprint information.

13. The content device of claim 8 , wherein the ACR fingerprinter is to:

determine ACR fingerprint information for a first media consumption device using a first ACR algorithm; and

determine ACR fingerprint information for a second media consumption device using a second ACR algorithm.

14. The content device of claim 8 , further comprising a software updater to:

communicate with a broadcast cloud to determine when an update for the content device is scheduled at a time of day; and

update the content device at the scheduled time of day.

15. A method comprising:

receiving, from a content feed, media content at a capture interface;

communicating, to a capturer, the media content;

communicating, to an automatic content recognition (ACR) fingerprinter and an encoder, the media content from the capturer; and

encoding, by a processing device, the media content based on encoding criteria to obtain encoded media content;

communicating, to an uploader, the encoded media content;

communicating, from the uploader, the encoded media content to a broadcast server;

determining, by the processing device, ACR fingerprinting information based on the media content;

communicating, to an ACR cloud, the ACR fingerprinting information; and

determining, by the processing device, when the ACR fingerprinter fails;

in response to the failure of the ACR fingerprinter, ceasing the communicating of the ACR fingerprint information to the ACR cloud; and

restarting the ACR fingerprinter.

16. The method of claim 15 , further comprising converting a first format of the media content received at the capture interface to a second format that is compatible with the capturer.

17. The method of claim 15 , further comprising communicating, to the capture interface, capture criteria, wherein the capture criteria are criteria to obtain media content from the content feed.

18. The method of claim 15 , wherein the encoding criteria comprises at least one of a security encryption format, display size adjustment information, network processing capabilities information, network communication condition information, or battery capabilities of a media consumption device.

19. The method of claim 15 , further comprising encoding, by the processing device, the media content in parallel with the ACR fingerprinter generating the ACR fingerprint information.

20. The method of claim 15 , further comprising:

determining ACR fingerprint information for a first media consumption device using a first ACR algorithm; and

determining ACR fingerprint information for a second media consumption device using a second ACR algorithm.

21. A non-transitory computer-readable storage medium comprising executable instructions that, when executed by a processing device, cause the processing device to:

receive, from a content feed, media content at a capture interface; and

communicate, to a capturer, the media content;

communicate, to an automatic content recognition (ACR) fingerprinter and an encoder, the media content from the capturer; and

encode, by the processing device, the media content based on encoding criteria to obtain encoded media content;

communicate, to an uploader, the encoded media content;

communicate, from the uploader, the encoded media content to a broadcast server;

determine, by the processing device, ACR fingerprinting information based on the media content;

communicate, to an ACR cloud, the ACR fingerprinting information;

determine that the ACR fingerprinter fails; and

in response to a determination that the ACR fingerprinter fails, restart the ACR fingerprinter while the uploader continues without interruption.

22. The non-transitory computer-readable storage medium of claim 21 , wherein the processing device is to encode the media content and determine the ACR fingerprinting information in parallel.

23. The non-transitory computer-readable storage medium of claim 21 , wherein the processing device is to encode the media content and determine the ACR fingerprinting information independently.

24. The non-transitory computer-readable storage medium of claim 21 , wherein:

the processing device is a remote server; and

the capture interface is an application programming interface (API).

Assignments (11)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: THE NIELSEN COMPANY (US), LLC
To: ROKU, INC.
Reel/Frame 056106/0376 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Apr 20, 2021
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC; GRACENOTE, INC.
Reel/Frame 056973/0280 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 15, 2019
From: SORENSON MEDIA, INC.
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 048355/0949 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 31, 2015
From: ASHBACHER, ANDREW; LIASSIDES, MARCUS
To: SORENSON MEDIA, INC.
Reel/Frame 036459/0839 →