IP Library Granted Patent US 10,917,691
Granted Patent B2
US 10,917,691 · App. 16/820,334 · Granted Feb 9, 2021

Methods and apparatus to determine audio source impact on an audience of media

Inventors: Joseph Gregory Milavsky (Dunedin, FL); Hashem Alsaket (Palos Hills, IL); James Bartelme (Chicago, IL); Jan Besehanic (Tampa, FL); Edward Stembler (Odessa, FL)
Assignee: The Nielsen Company (US), LLC
H04N21/44222G06F16/635G06F17/18G10L15/083G10L15/22H04H60/33H04N21/44204
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,917,691
App. No.
16/820,334
Granted
Feb 9, 2021
Kind
B2
Abstract

Methods, apparatus, systems and articles of manufacture to determine audio source impact on an audience of media are disclosed. A disclosed example method includes dividing monitored audio into successive audio segments including a first audio segment and a second audio segment. The example method also includes generating a first confidence value from the first audio segment and a second confidence value from the second audio segment, the first confidence value associated with a presence of a first audio source in the first audio segment, the second confidence value associated with a presence of the first audio source in the second audio segment. The example method includes determining an impact of the presence of the first audio source on audience ratings associated with the monitored audio based on the first confidence value, the first quantity of audience members, the second confidence value and the second quantity of audience members to determine.

Claims (65)

1. An apparatus comprising:

an audio segmenter implemented by hardware or at least one processor, the audio segmenter to divide monitored audio into successive audio segments including a first audio segment and a second audio segment, the first audio segment associated with a first quantity of audience members exposed to the monitored audio during the first audio segment, the second audio segment associated with a second quantity of audience members exposed to the monitored audio during the second audio segment;

a speaker evaluator to generate a first confidence value from the first audio segment of the successive segments and a second confidence value from the second audio segment, the first confidence value associated with a presence of a first audio source in the first audio segment, the second confidence value associated with a presence of the first audio source in the second audio segment; and

an audience rating correlator to determine an impact of the presence of the first audio source on audience ratings associated with the monitored audio based on the first confidence value, the first quantity of audience members, the second confidence value and the second quantity of audience members.

2. The apparatus of claim 1 , wherein the speaker evaluator includes:

a speech pattern generator to generate a pattern from the first audio segment; and

a pattern comparator to compare the generated pattern to a set of reference patterns to generate the first confidence value, the set of reference patterns associated with the first audio source.

3. The apparatus of claim 2 , wherein the pattern comparator is to compare the generated pattern to the set of reference patterns based on linear regression.

4. The apparatus of claim 1 , wherein the speaker evaluator is further to generate a third confidence value for the first audio segment, the third confidence value associated with a presence of a second audio source in the first audio segment, and further including a dominant speaker identifier to compare the first confidence value and the third confidence value to determine a dominant audio source in the first segment.

5. The apparatus of claim 1 , wherein the first audio source corresponds to a voice of a first person, and further including:

a sentiment analyzer to:

identify a first dialogue associated with the first person and the first segment;

identify a second dialogue associated with the first person and the second segment;

determine a first sentiment associated with the first dialogue and a second sentiment associated with the second dialogue; and

the audience rating correlator is to correlate a first difference between the first quantity of audience members and the second quantity of audience members and a second difference between the first sentiment and the second sentiment.

6. A non-transitory computer readable medium comprising instructions that, when executed, cause a processor to at least:

divide monitored audio into successive audio segments including a first audio segment and a second audio segment, the first audio segment associated with a first quantity of audience members exposed to the monitored audio during the first audio segment, the second audio segment associated with a second quantity of audience members exposed to the monitored audio during the second audio segment;

generate a first confidence value from the first audio segment and a second confidence value from the second audio segment, the first confidence value associated with a presence of a first audio source in the first audio segment, the second confidence value associated with a presence of the first audio source in the second audio segment; and

determine an impact of the presence of the first audio source on audience ratings associated with the monitored audio based on the first confidence value, the first quantity of audience members, the second confidence value and the second quantity of audience members.

7. The non-transitory computer readable medium of claim 6 , wherein the instructions, when executed, cause the processer to:

generate a pattern from the first audio segment; and

compare the generated pattern to a set of reference patterns to generate the first confidence value, the set of reference patterns associated with the first audio source.

8. The non-transitory computer readable medium of claim 7 , wherein the comparison of the generated pattern to the set of reference patterns is based on linear regression.

9. The non-transitory computer readable medium of claim 6 , wherein the instructions, when executed, further cause the processer to:

generate a third confidence value for the first audio segment, the third confidence value associated with a presence of a second audio source in the first audio segment; and

compare the first confidence value and the third confidence value to determine a dominant audio source in the first segment.

10. The non-transitory computer readable medium of claim 6 , wherein the first audio source corresponds to a voice of a first person, and the instructions, when executed, cause the processer to:

identify a first dialogue associated with the first person and the first segment;

identify a second dialogue associated with the first person and the second segment;

determine a first sentiment associated with the first dialogue and a second sentiment associated with the second dialogue; and

correlate a first difference between the first quantity of audience members and the second quantity of audience members and a second difference between the first sentiment and the second sentiment.

11. An apparatus comprising:

a memory including instructions; and

a processor to execute the instructions to:

divide monitored audio into successive audio segments including a first audio segment and a second audio segment, the first audio segment associated with a first quantity of audience members exposed to the monitored audio during the first audio segment, the second audio segment associated with a second quantity of audience members exposed to the monitored audio during the second audio segment;

generate a first confidence value from the first audio segment and a second confidence value from the second audio segment, the first confidence value associated with a presence of a first audio source in the first audio segment, the second confidence value associated with a presence of the first audio source in the second audio segment; and

determine an impact of the presence of the first audio source on audience ratings associated with the monitored audio based on the first confidence value, the first quantity of audience members, the second confidence value and the second quantity of audience members.

12. The apparatus of claim 11 , wherein the processor further executes the instructions to:

generate a pattern from the first audio segment; and

compare the generated pattern to a set of reference patterns to generate the first confidence value, the set of reference patterns associated with the first audio source.

13. The apparatus of claim 12 , wherein the comparison of the generated pattern to the set of reference patterns is based on linear regression.

14. The apparatus of claim 11 , wherein the processor further executes the instructions to:

generate a third confidence value for the first audio segment, the third confidence value associated with a presence of a second audio source in the first audio segment; and

compare the first confidence value and the third confidence value to determine a dominant audio source in the first segment.

15. The apparatus of claim 11 , wherein the first audio source corresponds to a voice of a first person and the processor further executes the instructions to:

identify a first dialogue associated with the first person and the first segment;

identify a second dialogue associated with the first person and the second segment;

determine a first sentiment associated with the first dialogue and a second sentiment associated with the second dialogue; and

correlate a first difference between the first quantity of audience members and the second quantity of audience members and a second difference between the first sentiment and the second sentiment.

16. A method comprising:

dividing, by executing an instruction with a processor, monitored audio into successive audio segments including a first audio segment and a second audio segment, the first audio segment associated with a first quantity of audience members exposed to the monitored audio during the first audio segment, the second audio segment associated with a second quantity of audience members exposed to the monitored audio during the second audio segment;

generating, by executing an instruction with the processor, a first confidence value from the first audio segment and a second confidence value from the second audio segment, the first confidence value associated with a presence of a first audio source in the first audio segment, the second confidence value associated with a presence of the first audio source in the second audio segment; and

determining, by executing an instruction with the processor, an impact of the presence of the first audio source on audience ratings associated with the monitored audio based on the first confidence value, the first quantity of audience members, the second confidence value and the second quantity of audience members to determine.

17. The method of claim 16 , wherein the generating of the first confidence value includes:

generating a pattern from the first audio segment; and

comparing the generated pattern to a set of reference patterns to generate the first confidence value, the set of reference patterns associated with the first audio source.

18. The method of claim 17 , wherein the comparing of the generated pattern to the set of reference patterns is based on linear regression.

19. The method of claim 16 , further including:

generating a third confidence value for the first audio segment, the third confidence value associated with a presence of a second audio source in the first audio segment; and

comparing the first confidence value and the third confidence value to determine a dominant audio source in the first segment.

20. The method of claim 16 , wherein the first audio source corresponds to a voice of a first person and further including:

identifying a first dialogue associated with the first person and the first segment;

identifying a second dialogue associated with the first person and the second segment;

determining a first sentiment associated with the first dialogue and a second sentiment associated with the second dialogue; and

correlating a first difference between the first quantity of audience members and the second quantity of audience members and a second difference between the first sentiment and the second sentiment.

Assignments (9)
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 5, 2021
From: MILAVSKY, JOSEPH GREGORY; ALSAKET, HASHEM; BARTELME, JAMES; STEMBLER, EDWARD
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 054818/0466 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 5, 2021
From: BESEHANIC, JAN
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 054961/0690 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →