IP Library Granted Patent US 8,959,016
Granted Patent B2
US 8,959,016 · App. 13/341,365 · Granted Feb 17, 2015

Activating functions in processing devices using start codes embedded in audio

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,959,016
App. No.
13/341,365
Granted
Feb 17, 2015
Kind
B2
Abstract

Apparatus, system and method for performing an action such as accessing supplementary data and/or executing software on a device capable of receiving multimedia are disclosed. After multimedia is received, a monitoring code is detected and a signature is extracted in response thereto from an audio portion of the multimedia. The ancillary code includes a plurality of code symbols arranged in a plurality of layers in a predetermined time period, and the signature is extracted from features of the audio of the multimedia. Supplementary data is accessed and/or software is executed using the detected code and/or signature.

Claims (28)

1. A method of performing an action in a device based on receipt of and/or exposure to audio, comprising:

receiving audio at the device, the audio having a monitoring code indicating that the audio is to be monitored;

in response to detection of the monitoring code, generating a signature based on the audio using at least a portion of the audio containing the monitoring code; and

causing the performance of the action at least in part by the device based on at least one of the monitoring code or the signature.

2. The method of claim 1 , wherein the monitoring code comprises a plurality of substantially single-frequency code components.

3. The method of claim 2 , wherein generating the signature comprises one of (a) generating a signature data set reflecting time-domain variations of the received audio in a plurality of frequency sub-bands of the received audio, or (b) generating a signature data set reflecting frequency-domain variations in the received audio.

4. The method according to claim 1 , wherein the action comprises presenting at least one of video, audio, images, HyperText Markup Language (HTML) content, a Uniform Resource Locator (URL), a shortened URL, metadata, or text.

5. The method according to claim 1 , wherein the action comprises activating software on the device.

6. The method according to claim 1 , wherein the action comprises processing at least one of the monitoring code or the signature on the device.

7. The method according to claim 1 , wherein the action comprises transmitting at least one of the monitoring code or the signature from the device for processing, and receiving data in the device generated based on the processing.

8. The method according to claim 1 , wherein the device comprises at least one of a cell phone, a smart phone, a personal digital assistant, a personal computer, a portable computer, a television, a set-top box, or a media box.

9. A method of performing an action in a processing device based on receipt of and/or exposure to audio, comprising:

detecting a monitoring code in received audio, the monitoring code indicating that the audio is to be monitored;

generating a signature in response to detection of the monitoring code, the signature representative of the audio, the signature generated based on at least a portion of the audio containing the monitoring code; and

performing the action with the device based on at least one of the monitoring code or the signature.

10. The method according to claim 9 , wherein the action comprises processing at least one of the monitoring code or the signature on the device to at least one of execute a link, present media, display a web page, or activate software.

11. The method according to claim 9 , wherein the action comprises transmitting at least one of the monitoring code or the signature from the device for processing, and receiving data in the device generated based on the processing.

12. A processing device to perform an action based on receipt of and/or exposure to audio, the processing device comprising:

an input device to receive audio carrying a monitoring code indicating that the audio is to be monitored; and

a processor to detect the monitoring code and, in response to detection of the monitoring code, generate a signature characterizing the audio using at least a portion of the audio containing the monitoring code, wherein the processor is to cause the performance of the action based on at least one of the monitoring code or the signature.

13. The processing device of claim 12 , wherein the monitoring code comprises a plurality of substantially single-frequency code components.

14. The processing device of claim 13 , wherein the processor is to generate the signature by one of (a) generating a signature data set reflecting time-domain variations of the received audio data in a plurality of frequency sub-bands of the received audio, or (b) generating a signature data set reflecting frequency-domain variations in the received audio.

15. The processing device according to claim 12 , wherein the action comprises presenting at least one of one of video, audio, images, HyperText Markup Language (HTML) content, a Uniform Resource Locator (URL), a shortened URL, metadata, or text.

16. The processing device according to claim 12 , wherein the action comprises activating software on the device.

17. The processing device according to claim 12 , wherein the action comprises processing at least one of the monitoring code or the signature on the device to at least one of execute a link, present media, display a web page, or activate software.

18. The processing device according to claim 12 , further comprising an output device, wherein the action comprises transmitting at least one of the monitoring code or the signature from the device using the output device, and the input device is to receive data generated based on processing of the monitoring code or the signature which occurs separate from the device.

19. The processing device according to claim 12 , wherein the processing device comprises at least one of a cell phone, a smart phone, a personal digital assistant, a personal computer, a portable computer, a television, a set-top box, and a media box.

20. The method according to claim 9 , wherein the action comprises presenting at least one of video, audio, images, HyperText Markup Language (HTML) content, a Uniform Resource Locator (URL), a shortened URL, metadata, text or activating software on the device.

Assignments (13)
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
RELEASE (REEL 037172 / FRAME 0415) Recorded Oct 13, 2022
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 061750/0221 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
SUPPLEMENTAL IP SECURITY AGREEMENT Recorded Nov 30, 2015
From: THE NIELSEN COMPANY ((US), LLC
To: CITIBANK, N.A., AS COLLATERAL AGENT FOR THE FIRST LIEN SECURED PARTIES
Reel/Frame 037172/0415 →
CHANGE OF NAME Recorded Mar 28, 2014
From: ARBITRON INC.
To: NIELSEN AUDIO, INC.
Reel/Frame 032554/0759 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 28, 2014
From: NIELSEN AUDIO, INC.
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 032554/0801 →
MERGER Recorded Mar 28, 2014
From: ARBITRON INC.
To: NIELSEN HOLDINGS N.V.
Reel/Frame 032554/0765 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 23, 2012
From: MCKENNA, WILLIAM; BOLLES, JASON; KELLY, JOHN; STAVROPOULOS, JOHN; NEUHAUSER, ALAN R.; LYNCH, WENDELL
To: ARBITRON, INC.
Reel/Frame 028091/0633 →