IP Library Granted Patent US 11,362,747
Granted Patent B2
US 11,362,747 · App. 17/161,394 · Granted Jun 14, 2022

Vehicle-based media system with audio ad and visual content synchronization feature

Inventor: Nisarg A. Modi (San Ramon, CA)
Assignee: Gracenote, Inc.
H04H20/62G01C21/3605G01C21/3667G01C21/3697G06Q30/0239G06Q30/0266G06Q30/0267G06Q30/0277G10L15/26G10L19/018H04N21/41422H04N21/42203H04R3/12H04W4/023H04W4/44H04N21/812H04R2499/13
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,362,747
App. No.
17/161,394
Granted
Jun 14, 2022
Kind
B2
Abstract

In one aspect, an example method to be performed by a vehicle-based media system includes (a) receiving audio content; (b) causing one or more speakers to output the received audio content; (c) using a microphone of the vehicle-based media system to capture the output audio content; (d) identifying reference audio content that has at least a threshold extent of similarity with the captured audio content; (e) identifying visual content based at least on the identified reference audio content; and (f) outputting, via a user interface of the vehicle-based media system, the identified visual content.

Claims (42)

1. A vehicle-based media system comprising:

a user interface;

one or more processors; and

a non-transitory, computer-readable medium storing instructions that, when executed by the one or more processors, cause the vehicle-based media system to perform a set of operations comprising:

receiving audio content;

causing one or more speakers to output the received audio content;

determining that the received audio content does not include information indicating musical audio content;

in response to determining that the received audio content does not include information indicating musical audio content, identifying reference audio content that has at least a threshold extent of similarity with the received audio content;

identifying visual content based at least on the identified reference audio content, wherein the identified visual content comprises a scannable image that, when scanned by a computing device, causes the computing device to retrieve data associated with the identified reference audio content; and

outputting, via the user interface of the vehicle-based media system, the identified visual content.

2. The vehicle-based media system of claim 1 , wherein receiving the audio content comprises receiving primary audio content and secondary audio content, wherein causing the one or more speakers to output the received audio content comprises causing the one or more speakers to output the primary audio content and the secondary audio content, wherein the primary audio content comprises entertainment content, and wherein the secondary audio content comprises advertisement content interspersed among the primary content.

3. The vehicle-based media system of claim 2 , wherein identifying reference audio content that has at least the threshold extent of similarity with the received audio content comprises identifying reference audio content that has at least the threshold extent of similarity with the received secondary audio content.

4. The vehicle-based media system of claim 3 , wherein identifying visual content based at least on the identified reference audio content comprises identifying visual content related to particular advertisement content of the secondary audio content, and wherein outputting the identified visual content comprises, while causing the one or more speakers to output the particular advertisement content of the secondary audio content, outputting the visual content related to the particular advertisement content.

5. The vehicle-based media system of claim 1 , wherein displaying the scannable image comprises displaying a scannable image that, when scanned by the computing device, causes the computing device to navigate to a web page associated with the particular advertisement content.

6. The vehicle-based media system of claim 1 , wherein displaying the scannable image comprises displaying a scannable image that, when scanned by the computing device, causes the computing device to retrieve a coupon associated with the particular advertisement content.

7. The vehicle-based media system of claim 1 , wherein displaying the scannable image comprises displaying a scannable image that, when scanned by the computing device, causes the computing device to display an indication of a geographic location associated with the particular advertisement content.

8. The vehicle-based media system of claim 1 , wherein outputting the visual content related to the particular advertisement content further comprises displaying an indication of a geographic location associated with the particular advertisement content.

9. The vehicle-based media system of claim 1 , wherein outputting the visual content related to the particular advertisement content comprises displaying additional advertisement content associated with the particular advertisement content.

10. The vehicle-based media system of claim 1 , wherein identifying the reference audio content that has at least the threshold extent of similarity with the received audio content comprises:

generating audio fingerprint data of the received audio content;

comparing the generated audio fingerprint data to a plurality of reference audio fingerprint items; and

determining that a particular reference audio fingerprint item of the plurality of reference audio fingerprint items has at least the threshold extent of similarity with the generated audio fingerprint data.

11. The vehicle-based media system of claim 10 , wherein each respective reference audio fingerprint item of the plurality of audio fingerprint items is associated with respective visual content, and wherein identifying visual content based at least on the identified reference audio content comprises identifying the respective visual content associated with the particular reference audio fingerprint item that has at least the threshold extent of similarity with the generated audio fingerprint data.

12. The vehicle-based media system of claim 1 , wherein the set of operations further comprise determining a geographic location of the vehicle-based media system, and wherein identifying visual content based at least on the identified reference audio content comprises identifying visual content based on both (i) the identified reference audio content and (ii) the determined geographic location of the vehicle-based media system.

13. A method to be performed by a vehicle-based media system, the method comprising:

receiving audio content;

causing one or more speakers to output the received audio content;

determining that the received audio content does not include information indicating musical audio content;

in response to determining that the received audio content does not include information indicating musical audio content, identifying reference audio content that has at least a threshold extent of similarity with the received audio content;

identifying visual content based at least on the identified reference audio content, wherein the identified visual content comprises a scannable image that, when scanned by a computing device, causes the computing device to retrieve data associated with the identified reference audio content; and

outputting, via a user interface of the vehicle-based media system, the identified visual content.

14. The method of claim 13 , wherein receiving the audio content comprises receiving primary audio content and secondary audio content, wherein causing the one or more speakers to output the received audio content comprises causing the one or more speakers to output the primary audio content and the secondary audio content, wherein the primary audio content comprises entertainment content, and wherein the secondary audio content comprises advertisement content interspersed among the primary content.

15. The method of claim 14 , wherein identifying reference audio content that has at least the threshold extent of similarity with the received audio content comprises identifying reference audio content that has at least the threshold extent of similarity with the received secondary audio content.

16. The method of claim 15 , wherein identifying visual content based at least on the identified reference audio content comprises identifying visual content related to particular advertisement content of the secondary audio content, and wherein outputting the identified visual content comprises, while causing the one or more speakers to output the particular advertisement content of the secondary audio content, outputting the visual content related to the particular advertisement content.

17. The method of claim 13 , wherein displaying the scannable image comprises displaying a scannable image that, when scanned by the computing device, causes the computing device to (i) navigate to a web page associated with the particular advertisement content, (ii) retrieve a coupon associated with the particular advertisement content, or (iii) display an indication of a geographic location associated with the particular advertisement content.

18. A non-transitory computer-readable medium, having stored thereon program instructions that, upon execution by a vehicle-based media system, cause the vehicle-based media system to perform a set of operations comprising:

receiving audio content;

causing one or more speakers to output the received audio content;

determining that the received audio content does not include information indicating musical audio content;

in response to determining that the received audio content does not include information indicating musical audio content, identifying reference audio content that has at least a threshold extent of similarity with the received audio content;

identifying visual content based at least on the identified reference audio content, wherein the identified visual content comprises a scannable image that, when scanned by a computing device, causes the computing device to retrieve data associated with the identified reference audio content; and

outputting, via a user interface of the vehicle-based media system, the identified visual content.

Assignments (4)
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 29, 2021
From: MODI, NISARG A.
To: GRACENOTE, INC.
Reel/Frame 055077/0093 →
Continuity (5)
Continuation 16516029 · Jul 18, 2019
Provisional Application 62714623 · Aug 3, 2018
Provisional Application 62714619 · Aug 3, 2018
Provisional Application 62714621 · Aug 3, 2018
Related Publication 20210152263A1 · May 20, 2021