IP Library Granted Patent US 10,595,083
Granted Patent B2
US 10,595,083 · App. 16/140,238 · Granted Mar 17, 2020

Methods and apparatus to determine audio source impact on an audience of media

Inventors: Joseph Gregory Milavsky (Dunedin, FL); Hashem Alsaket (Palos Hills, IL); James Bartelme (Chicago, IL); Jan Besehanic (Tampa, FL); Edward Stembler (Odessa, FL)
Assignee: The Nielsen Company (US), LLC
H04N21/44222G06F16/635G06F17/18G10L15/083G10L15/22H04H60/33H04N21/44204
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,595,083
App. No.
16/140,238
Granted
Mar 17, 2020
Kind
B2
Abstract

Methods, apparatus, systems and articles of manufacture to determine audio source impact on an audience of media are disclosed. A disclosed example method includes dividing monitored audio into successive audio segments including a first audio segment and a second audio segment, the monitored audio associated with monitored media. The example method also includes generating a first confidence value for the first audio segment of the successive segments and a second confidence value for the second audio segment, the first confidence value associated with a presence of a first audio source in the first audio segment, the second confidence value associated with a presence of the first audio source in the second audio segment. The example method further includes comparing (1) a first correlation of the first confidence value and a first rating associated with the first audio segment and (2) a second correlation of the second confidence value and a second rating associated with the second audio segment to determine an impact of the first audio source on audience ratings of the monitored media.

Claims (50)

1. An apparatus comprising:

an audio segmenter implemented by hardware or at least one processor to divide monitored audio into successive audio segments including a first audio segment and a second audio segment, the monitored audio associated with monitored media;

a speaker evaluator to generate a first confidence value from the first audio segment of the successive segments and a second confidence value from the second audio segment, the first confidence value associated with a presence of a voice of a first person in the first audio segment, the second confidence value associated with a presence of the voice of the first person in the second audio segment;

a sentiment analyzer to:

identify a first dialogue associated with the first person and the first audio segment;

identify a second dialogue associated with the first person and the second audio segment; and

determine a first sentiment associated with the first dialogue and a second sentiment associated with the second dialogue; and

an audience rating correlator to:

augment a first rating with the first sentiment, the first rating associated with the first audio segment;

augment a second rating with the second sentiment, the second rating associated with the second audio segment; and

compare (1) a first correlation of the first confidence value and the first rating associated with the first audio segment, and (2) a second correlation of the second confidence value and the second rating associated with the second audio segment to determine an impact of the voice of the first person on audience ratings of the monitored media.

2. The apparatus of claim 1 , wherein the speaker evaluator includes:

a speech pattern generator to generate a pattern from the first audio segment; and

a pattern comparator to compare the generated pattern to a set of reference patterns to generate the first confidence value, the set of reference patterns associated with the voice of the first person.

3. The apparatus of claim 2 , wherein the pattern comparator is to compare the generated pattern to the set of reference patterns based on linear regression.

4. The apparatus of claim 1 , wherein the voice of the first person is a first audio source and the speaker evaluator is further to generate a third confidence value from the first audio segment, the third confidence value associated with a presence of a second audio source in the first audio segment, and further includes a dominant speaker identifier to compare the first confidence value and the third confidence value to determine a dominant audio source in the first segment.

5. The apparatus of claim 4 , wherein the second audio source corresponds to a reference sound.

6. A method comprising:

dividing, by executing an instruction with a processor, monitored audio into successive audio segments including a first audio segment and a second audio segment, the monitored audio associated with monitored media;

generating, by executing an instruction with the processor, a first confidence value from the first audio segment and a second confidence value from the second audio segment, the first confidence value associated with a presence of a voice of a first person in the first audio segment, the second confidence value associated with a presence of the voice of the first person in the second audio segment;

identifying, by executing an instruction with the processor, a first dialogue associated with the first person and the first audio segment;

identifying, by executing an instruction with the processor, a second dialogue associated with the first person and the second audio segment;

determining, by executing an instruction with the processor, a first sentiment associated with the first dialogue and a second sentiment associated with the second dialogue;

augmenting, by executing an instruction with the processor, a first rating with the first sentiment, the first rating associated with the first audio segment;

augmenting, by executing an instruction with the processor, a second rating with the first sentiment, the second rating associated with the second audio segment; and

comparing, by executing an instruction with the processor, (1) a first correlation of the first confidence value and the first rating associated with the first audio segment, and (2) a second correlation of the second confidence value and the second rating associated with the second audio segment to determine an impact of the voice of the first person on audience ratings of the monitored media.

7. The method of claim 6 , wherein the generating of the first confidence value includes:

generating a pattern from the first audio segment; and

comparing the generated pattern to a set of reference patterns to generate the first confidence value, the set of reference patterns associated with the voice of the first person.

8. The method of claim 7 , wherein the comparison of the generated pattern to the set of reference patterns is based on linear regression.

9. The method of claim 6 , wherein the voice of the first person is a first audio source, and further including:

generating a third confidence value from the first audio segment, the third confidence value associated with a presence of a second audio source in the first audio segment; and

comparing the first confidence value and the third confidence value to determine a dominant audio source in the first segment.

10. The method of claim 6 , wherein the identifying of the first dialogue includes analyzing closed captioning data associated with the monitored media.

11. A non-transitory computer readable medium comprising instructions that, when executed, cause a processor to at least:

divide monitored audio into successive audio segments including a first audio segment and a second audio segment, the monitored audio associated with monitored media;

generate a first confidence value from the first audio segment and a second confidence value from the second audio segment, the first confidence value associated with a presence of a voice of a first person in the first audio segment, the second confidence value associated with a presence of the voice of the first person in the second audio segment;

identify a first dialogue associated with the first person and the first audio segment;

identify a second dialogue associated with the first person and the second audio segment;

determine a first sentiment associated with the first dialogue and a second sentiment associated with the second dialogue;

augment a first rating with the first sentiment, the first rating associated with the first audio segment;

augment a second rating with the first sentiment, the second rating associated with the second audio segment; and

compare (1) a first correlation of the first confidence value and the first rating associated with the first audio segment, and (2) a second correlation of the second confidence value and the second rating associated with the second audio segment to determine an impact of the first voice of the first person on audience ratings of the monitored media.

12. The non-transitory computer readable medium of claim 11 , wherein the instructions, when executed, cause the processer to:

generate a pattern from the first audio segment; and

compare the generated pattern to a set of reference patterns to generate the first confidence value, the set of reference patterns associated with the voice of the first person.

13. The non-transitory computer readable medium of claim 12 , wherein instructions, when executed, cause the processor to compare the generated pattern to the set of reference patterns based on linear regression.

14. The non-transitory computer readable medium of claim 13 , wherein the voice of the first person is a first audio source and the instructions, when executed, further cause the processer to:

generate a third confidence value from the first audio segment, the third confidence value associated with a presence of a second audio source in the first audio segment; and

compare the first confidence value and the third confidence value to determine a dominant audio source in the first segment.

Assignments (9)
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 19, 2020
From: BESEHANIC, JAN
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 052984/0257 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 5, 2020
From: MILAVSKY, JOSEPH GREGORY; ALSAKET, HASHEM; BARTELME, JAMES; STEMBLER, EDWARD
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 051731/0390 →
Cited By (1)
US 12,223,935