IP Library Granted Patent US 10,880,023
Granted Patent B2
US 10,880,023 · App. 16/516,045 · Granted Dec 29, 2020

Vehicle-based media system with audio advertisement and external-device action synchronization feature

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,880,023
App. No.
16/516,045
Granted
Dec 29, 2020
Kind
B2
Abstract

In one aspect, an example method to be performed by a vehicle-based media system includes (a) receiving audio content; (b) causing one or more speakers to output the received audio content; (c) using a microphone of the vehicle-based media system to capture the output audio content; (d) identifying reference audio content that has at least a threshold extent of similarity with the captured audio content; (e) identifying a computational action based at least on the identified reference audio content; and (f) sending, via a network interface of the vehicle-based media system, an instruction that causes an external computing device to perform the identified computational action.

Claims (58)

1. A vehicle-based media system comprising:

a network interface for communicating with an external computing device that is distinct from the vehicle-based media system;

a microphone;

one or more processors; and

a non-transitory, computer-readable medium storing instructions that, when executed by the one or more processors, cause the vehicle-based media system to perform a set of operations comprising:

receiving audio content;

causing one or more speakers to output the received audio content;

using the microphone of the vehicle-based media system to capture the output audio content;

identifying reference audio content that has at least a threshold extent of similarity with the captured audio content;

identifying a computational action based at least on the identified reference audio content; and

sending, via the network interface of the vehicle-based media system, an instruction that causes the external computing device to perform the identified computational action.

2. The vehicle-based media system of claim 1 , wherein receiving the audio content comprises receiving primary audio content and secondary audio content, wherein causing the one or more speakers to output the received audio content comprises causing the one or more speakers to output the primary audio content and the secondary audio content, wherein the primary audio content comprises entertainment content, and wherein the secondary audio content comprises advertisement content interspersed among the primary content.

3. The vehicle-based media system of claim 2 , wherein:

using the microphone of the vehicle-based media system to capture the output audio content comprises using the microphone of the vehicle-based media system to capture the secondary audio content; and

identifying reference audio content that has at least the threshold extent of similarity with the captured audio content comprises identifying reference audio content that has at least the threshold extent of similarity with the captured secondary audio content.

4. The vehicle-based media system of claim 3 , wherein identifying the computational action based at least on the identified reference audio content comprises identifying a computational action related to particular advertisement content of the secondary audio content, and wherein sending the instruction that causes the external computing device to perform the identified computational action comprises, while causing the one or more speakers to output the particular advertisement content of the secondary audio content, sending an instruction that causes the external computing device to perform the computational action related to the particular advertisement content.

5. The vehicle-based media system of claim 4 , wherein sending the instruction that causes the external computing device to perform the computational action related to the particular advertisement content comprises sending an instruction that causes the external computing device to display a prompt that, when selected by a user, causes the external computing device to (i) navigate to a web page associated with the particular advertisement content, (ii) retrieve a coupon associated with the particular advertisement content, (iii) display an indication of a geographic location associated with the particular advertisement content, or (iv) display additional advertisement content associated with the particular advertisement content.

6. The vehicle-based media system of claim 1 , wherein identifying the reference audio content that has at least the threshold extent of similarity with the captured audio content comprises:

generating audio fingerprint data of the captured audio content;

comparing the generated audio fingerprint data to a plurality of reference audio fingerprint items; and

determining that a particular reference audio fingerprint item of the plurality of reference audio fingerprint items has at least the threshold extent of similarity with the generated audio fingerprint data.

7. The vehicle-based media system of claim 6 , wherein each respective reference audio fingerprint item of the plurality of audio fingerprint items is associated with a respective computational action, and wherein identifying the computational action based at least on the identified reference audio content comprises identifying the respective computational action associated with the particular reference audio fingerprint item that has at least the threshold extent of similarity with the generated audio fingerprint data.

8. The vehicle-based media system of claim 1 , wherein the set of operations further comprise determining a geographic location of the vehicle-based media system, and wherein identifying the computational action based at least on the identified reference audio content comprises identifying the computational action based on both (i) the identified reference audio content and (ii) the determined geographic location of the vehicle-based media system.

9. A method to be performed by a vehicle-based media system, the method comprising:

receiving audio content;

causing one or more speakers to output the received audio content;

using a microphone of the vehicle-based media system to capture the output audio content;

identifying reference audio content that has at least a threshold extent of similarity with the captured audio content;

identifying a computational action based at least on the identified reference audio content; and

sending, via a network interface of the vehicle-based media system, an instruction that causes an external computing device to perform the identified computational action.

10. The method of claim 9 , wherein receiving the audio content comprises receiving primary audio content and secondary audio content, wherein causing the one or more speakers to output the received audio content comprises causing the one or more speakers to output the primary audio content and the secondary audio content, wherein the primary audio content comprises entertainment content, and wherein the secondary audio content comprises advertisement content interspersed among the primary content.

11. The method of claim 10 , wherein:

using the microphone of the vehicle-based media system to capture the output audio content comprises using the microphone of the vehicle-based media system to capture the secondary audio content; and

identifying reference audio content that has at least the threshold extent of similarity with the captured audio content comprises identifying reference audio content that has at least the threshold extent of similarity with the captured secondary audio content.

12. The method of claim 11 , wherein identifying the computational action based at least on the identified reference audio content comprises identifying a computational action related to particular advertisement content of the secondary audio content, and wherein sending the instruction that causes the external computing device to perform the identified computational action comprises, while causing the one or more speakers to output particular advertisement content of the secondary audio content, sending an instruction that causes the external computing device to perform the computational action related to the particular advertisement content.

13. The method of claim 12 , wherein sending the instruction that causes the external computing device to perform the computational action related to the particular advertisement content comprises sending an instruction that causes the external computing device to display a prompt that, when selected by a user, causes the external computing device to (i) navigate to a web page associated with the particular advertisement content, (ii) retrieve a coupon associated with the particular advertisement content, (iii) display an indication of a geographic location associated with the particular advertisement content, or (iv) display additional advertisement content associated with the particular advertisement content.

14. The method of claim 9 , wherein identifying the reference audio content that has at least the threshold extent of similarity with the captured audio content comprises:

generating audio fingerprint data of the captured audio content;

comparing the generated audio fingerprint data to a plurality of reference audio fingerprint items; and

determining that a particular reference audio fingerprint item of the plurality of reference audio fingerprint items has at least the threshold extent of similarity with the generated audio fingerprint data.

15. The method of claim 14 , wherein each respective reference audio fingerprint item of the plurality of audio fingerprint items is associated with a respective computational action, and wherein identifying the computational action based at least on the identified reference audio content comprises identifying the respective computational action associated with the particular reference audio fingerprint item that has at least the threshold extent of similarity with the generated audio fingerprint data.

16. The method of claim 9 , further comprising determining a geographic location of the vehicle-based media system, wherein identifying the computational action based at least on the identified reference audio content comprises identifying the computational action based on both (i) the identified reference audio content and (ii) the determined geographic location of the vehicle-based media system.

17. A non-transitory, computer-readable medium, having stored thereon program instructions that, upon execution by a vehicle-based media system, cause the vehicle-based media system to perform a set of operations comprising:

receiving audio content;

causing one or more speakers to output the received audio content;

using a microphone of the vehicle-based media system to capture the output audio content;

identifying reference audio content that has at least a threshold extent of similarity with the captured audio content;

identifying a computational action based at least on the identified reference audio content; and

sending, via a network interface of the vehicle-based media system, an instruction that causes an external computing device to perform the identified computational action.

18. The non-transitory, computer-readable medium of claim 17 , wherein:

receiving the audio content comprises receiving primary audio content and secondary audio content, the primary audio content comprising entertainment content, and the secondary audio content comprising advertisement content interspersed among the primary content;

causing the one or more speakers to output the received audio content comprises causing the one or more speakers to output the primary audio content and the secondary audio content;

using the microphone of the vehicle-based media system to capture the output audio content comprises using the microphone of the vehicle-based media system to capture the secondary audio content;

identifying reference audio content that has at least the threshold extent of similarity with the captured audio content comprises identifying reference audio content that has at least the threshold extent of similarity with the captured secondary audio content;

identifying the computational action based at least on the identified reference audio content comprises identifying a computational action related to particular advertisement content of the secondary audio content; and

sending the instruction that causes the external computing device to perform the identified computational action comprises, while causing the one or more speakers to output particular advertisement content of the secondary audio content, sending an instruction that causes the external computing device to perform the computational action related to the particular advertisement content.

19. The non-transitory, computer-readable medium of claim 18 , wherein sending the instruction that causes the external computing device to perform the computational action related to the particular advertisement content comprises sending an instruction that causes the external computing device to display a prompt that, when selected by a user, causes the external computing device to (i) navigate to a web page associated with the particular advertisement content, (ii) retrieve a coupon associated with the particular advertisement content, (iii) display an indication of a geographic location associated with the particular advertisement content, or (iv) display additional advertisement content associated with the particular advertisement content.

20. The non-transitory, computer-readable medium of claim 17 , wherein the set of operations further comprise determining a geographic location of the vehicle-based media system, and wherein identifying the computational action based at least on the identified reference audio content comprises identifying the computational action based on both (i) the identified reference audio content and (ii) the determined geographic location of the vehicle-based media system.

Assignments (8)
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 3, 2019
From: MODI, NISARG A.
To: GRACENOTE, INC.
Reel/Frame 050619/0119 →