IP Library Granted Patent US 10,237,616
Granted Patent B2
US 10,237,616 · App. 15/153,230 · Granted Mar 19, 2019

Audio correlation for viewership determination

Inventors: Amir Yazdani (Portland, OR); Caroline Horner (Darien, CT); Michael Vinson (Piedmont, CA)
Assignee: comScore, Inc.
H04N21/44222H04N21/233H04N21/251H04N21/41407H04N21/42203H04N21/4394H04N21/44008
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,237,616
App. No.
15/153,230
Granted
Mar 19, 2019
Kind
B2
Abstract

A computer system may include at least one processor and at least one memory storing instructions that, when executed, cause the at least one processor to perform a process. The process may include receiving audio data from a user device, and accessing content data including at least one audio signature associated with video content. The process may also include correlating the audio data with the at least one audio signature and identifying recognized video content based on the correlation of the audio data with the at least one audio. The process may also include receiving tuning data including content being presented on a display component. The process may further include correlating the recognized video content with the tuning data, determining viewed video content based on the correlation of the recognized video content with the tuning data, and storing the viewed video content in a user array.

Claims (93)

1. A system, comprising:

at least one processor; and

at least one memory storing instructions that, when executed, cause the at least one processor to perform a process, the process comprising:

receiving audio data from a single microphone of a device associated with a user;

accessing content data comprising first and second audio signatures associated with video content;

accessing a database including account data associating first and second display components to the user;

correlating the audio data with the first and second audio signatures;

identifying a first recognized video content based on the correlation of the audio data with the first audio signature;

identifying a second recognized video content based on the correlation of the audio data with the second audio signature;

receiving first tuning data indicating content being presented on the first display component;

receiving second tuning data indicating content being presented on the second display component;

correlating the first recognized video content with the first tuning data;

correlating the second recognized video content with the second tuning data;

determining that the device is closer to the first display component than the second display component based on audio qualities and/or temporal aspects of the audio data;

determining viewed video content based on the determination that the device is closer to the first display component than the second display component;

storing the viewed video content in an array associated with the user;

receiving third tuning data indicating content being presented on a third display component; and

determining an identification probability that the user is accessing the content on the third display component based on the array associated with the user.

2. The system of claim 1 , wherein determining the identification probability includes determining a frequency that a type of content is accessed by the user.

3. The system of claim 1 , wherein the process further comprises:

receiving fourth tuning data indicating content being presented on a fourth display component;

correlating fourth recognized video content with the fourth tuning data;

verifying the user array based on the correlation of the fourth recognized video content with the fourth tuning data; and

storing the fourth recognized video content in the user array.

4. The system of claim 1 , wherein the process further comprises:

generating audio fingerprints of the audio data by processing the audio data using a Fourier Transform function,

wherein each of the first and second audio signatures comprises a fingerprint associated with video content,

wherein correlating the audio data with the first and second audio signatures comprises comparing audio fingerprints of the audio data to the fingerprints associated with the video content.

5. The system of claim 1 , wherein the process further comprises:

receiving positioning data from the device indicative of a location of the device;

receiving positioning data of a plurality of display components indicative of a location of each the plurality of display components; and

comparing the location of the device with the locations of the plurality of display components to determine local display components,

wherein correlating the first recognized video content with the first tuning data includes correlating the first recognized video content with tuning data of the local display components.

6. The system of claim 1 , wherein determining the identification probability is performed without any additional audio data.

7. A computer-implemented method, comprising:

receiving, with at least one processor, audio data from a single microphone of a device associated with a user;

accessing, with the at least one processor, content data comprising first and second audio signatures associated with video content;

accessing a database including account data associating first and second display components to the user;

correlating, with the at least one processor, the audio data to the first and second audio signatures;

identifying, with the at least one processor, a first recognized video content based on the correlation of the audio data with the first audio signature;

identifying, with the at least one processor, a second recognized video content based on the correlation of the audio data with the second audio signature;

receiving, with the at least one processor, first tuning data indicating content being presented on the first display component;

receiving, with the at least one processor, second tuning data indicating content being presented on the second display component;

correlating, with the at least one processor, the first recognized video content with the first tuning data;

correlating, with the at least one processor, the second recognized video content with the second tuning data;

determining that the device is closer to the first display component than the second display component based on audio qualities and/or temporal aspects of the audio data;

determining, with the at least one processor, viewed video content based on the determination that the device is closer to the first display component than the second display component;

storing, with the at least one processor, the viewed video content in an array associated with the user;

receiving third tuning data indicating content being presented on a third display component; and

determining an identification probability that the user is accessing the content on the third display component based on the array associated with the user.

8. The computer-implemented method of claim 7 , wherein determining the identification probability includes determining a frequency that a type of content is accessed by the user.

9. The computer-implemented method of claim 7 , further comprises:

receiving fourth tuning data indicating content being presented on a fourth display component;

correlating fourth recognized video content with the fourth tuning data;

verifying the user array based on the correlation of the fourth recognized video content with the fourth tuning data; and

storing the fourth recognized video content in the user array.

10. The computer-implemented method of claim 7 , further comprises:

generating audio fingerprints of the audio data by processing the audio data using a Fourier Transform function,

wherein each of the first and second audio signatures comprises a fingerprint associated with video content,

wherein correlating the audio data with the first and second audio signatures comprises comparing the audio fingerprints of the audio data to the fingerprints associated with the video content.

11. The computer-implemented method of claim 7 , further comprises:

receiving positioning data from the device indicative of a location of the device;

receiving positioning data of a plurality of display components indicative of a location of each the plurality of display components; and

comparing the location of the device with the locations of the plurality of display components to determine local display components,

wherein correlating the first recognized video content with the first tuning data includes correlating the first recognized video content with tuning data of the local display components.

12. The computer-implemented method of claim 7 , wherein determining the identification probability is performed without any additional audio data.

13. A non-transitory computer-readable medium storing instructions which, when executed, cause one or more processors to perform a process, the process comprising:

receiving audio data from a single microphone of a device associated with a user;

accessing content data comprising first and second audio signature associated with video content;

accessing a database including account data associating first and second display components to the user;

correlating the audio data with the first and second audio signatures;

identifying a first recognized video content based on the correlation of the audio data with the first audio signature;

receiving first tuning data indicating content being presented on the first display component;

receiving second tuning data indicating content being presented on the second display component;

correlating the first recognized video content with the first tuning data;

correlating the first recognized video content with the first tuning data;

determining that the device is closer to the first display component than the second display component based on audio qualities and/or temporal aspects of the audio data;

determining viewed video content based on the determination that the device is closer to the first display component than the second display component;

storing the viewed video content in an array associated with the user;

receiving third tuning data indicating content being presented on a third second display component; and

determining an identification probability that the user is accessing the content on the third display component based on the array associated with the user.

14. The non-transitory computer-readable medium of claim 13 , wherein determining the identification probability includes determining a frequency that a type of content is accessed by the user.

15. The non-transitory computer-readable medium of claim 13 , wherein the process further comprises:

receiving fourth tuning data indicating content being presented on a fourth display component;

correlating a fourth recognized video content with the fourth tuning data;

verifying the user array based on the correlation of the fourth recognized video content with the fourth tuning data; and

storing the fourth recognized video content in the user array.

16. The non-transitory computer-readable medium of claim 13 , wherein the process further comprises:

receiving positioning data from the device indicative of a location of the device;

receiving positioning data of a plurality of display components indicative of a location of each the plurality of display components; and

comparing the location of the device with the locations of the plurality of display components to determine local display components,

wherein correlating the first recognized video content with the first tuning data includes correlating the first recognized video content with tuning data of the local display components.

17. The non-transitory computer-readable medium of claim 13 , wherein determining the identification probability is performed without any additional audio data.

Assignments (8)
RELEASE OF SECURITY INTEREST Recorded Jun 2, 2026
From: BLUE TORCH FINANCE LLC
To: COMSCORE, INC.; PROXIMIC, LLC; RENTRAK, LLC (F/N/A RENTRAK CORPORATION)
Reel/Frame 075679/0830 →
RELEASE OF SECURITY INTEREST Recorded Jan 16, 2025
From: BANK OF AMERICA, N.A.
To: COMSCORE, INC.
Reel/Frame 069934/0573 →
SECURITY INTEREST Recorded Jan 3, 2025
From: COMSCORE, INC.; PROXIMIC, LLC; RENTRAK, LLC
To: BLUE TORCH FINANCE LLC
Reel/Frame 069818/0446 →
CORRECTIVE ASSIGNMENT TO CORRECT THE MISSING ASSIGNMENT PAGE 1 AND 22 OMITTED PATENTS PREVIOUSLY RECORDED AT REEL: 056547 FRAME: 0526. ASSIGNOR(S) HEREBY CONFIRMS THE RELEASE OF SECURITY INTEREST. Recorded Jun 6, 2022
From: STARBOARD VALUE AND OPPORTUNITY MASTER FUND LTD.
To: COMSCORE, INC.; RENTRAK CORPORATION; PROXIMIC, LLC
Reel/Frame 060922/0001 →
NOTICE OF GRANT OF SECURITY INTEREST IN PATENTS Recorded May 6, 2021
From: COMSCORE, INC.
To: BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 057279/0767 →
RELEASE OF SECURITY INTEREST IN PATENTS Recorded Mar 25, 2021
From: STARBOARD VALUE AND OPPORTUNITY MASTER FUND LTD.
To: COMSCORE, INC.; RENTRAK CORPORATION; PROXIMIC, LLC
Reel/Frame 056547/0526 →
ASSIGNMENT FOR SECURITY - PATENTS Recorded Jan 16, 2018
From: COMSCORE, INC.; RENTRAK CORPORATION; PROXIMIC, LLC
To: STARBOARD VALUE AND OPPORTUNITY MASTER FUND LTD.
Reel/Frame 045077/0303 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 17, 2016
From: YAZDANI, AMIR; HORNER, CAROLINE; VINSON, MICHAEL
To: COMSCORE, INC.
Reel/Frame 038613/0878 →
Continuity (2)
Provisional Application 62162170 · May 15, 2015
Related Publication 20160337697A1 · Nov 17, 2016