IP Library Granted Patent US 10,694,045
Granted Patent B2
US 10,694,045 · App. 16/291,801 · Granted Jun 23, 2020

Methods and apparatus to generate audience measurement data from population sample data having incomplete demographic classifications

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,694,045
App. No.
16/291,801
Granted
Jun 23, 2020
Kind
B2
Abstract

Methods and apparatus to generate audience measurement data from population sample data having incomplete demographic classifications are disclosed. An example method includes detecting that a number of impressions a time segment of a video occurred based on messages; detecting that no impressions for the time segment of the video were detected by the database proprietor; determining respective percentages of exposures of the video that are attributable to corresponding ones of multiple demographic groups, determining the respective percentages being based on the first demographic information provided by the database proprietor for exposures of other time segments of the video; attributing respective portions of the number of impressions to the demographic groups based on the respective percentages to determine imputed numbers of impressions; generating adjusted numbers of impressions based on the imputed numbers of impressions; and determining ratings information for the video using the adjusted numbers of impressions.

Claims (119)

1. A method to improve an accuracy of online audience measurement, comprising:

collecting, with a processor at an audience measurement entity, messages indicating first impressions of a video delivered to devices via the Internet, the messages identifying time segments of the video presented at the devices;

receiving, with the processor at the audience measurement entity, first demographic information describing first numbers of impressions attributed to respective demographic groups by a database proprietor, the first numbers of impressions representing the time segments of the video, the first numbers of impressions corresponding to the first impressions of the video;

improving an accuracy of the first numbers of impressions by:

based on the messages, detecting, by executing a first instruction with the processor, that a second number of impressions for a first one of the time segments of the video occurred;

detecting, by executing a second instruction with the processor, that no impressions for the first one of the time segments of the video were detected by the database proprietor;

determining, by executing a third instruction with the processor, respective percentages of exposures of the video that are attributable to corresponding ones of a plurality of demographic groups, the determining of the respective percentages being based on the first demographic information provided by the database proprietor for exposures of other time segments of the video;

attributing, by executing a fourth instruction with the processor, respective portions of the second number of impressions to the demographic groups based on the respective percentages to determine imputed numbers of impressions; and

generating, by executing a fifth instruction with the processor, adjusted numbers of impressions corresponding to the video based on the first numbers of impressions and the imputed numbers of impressions; and

determining, by executing a sixth instruction with the processor, ratings information for the time segments of the video using the adjusted numbers of impressions.

2. The method as defined in claim 1 , further including:

detecting that a first number of duration units for the first one of the time segments of the video occurred based on the messages;

detecting that no duration units for the first one of the time segments of the video were detected by the database proprietor;

determining respective second percentages of duration units of the video that are attributable to corresponding ones of the demographic groups, the determining of the respective second percentages being based on the first demographic information provided by the database proprietor for duration units of other time segments of the video;

attributing respective portions of the first number of duration units to the demographic groups based on the second percentages to determine imputed numbers of duration units; and

generating adjusted numbers of duration units based on the first numbers of duration units and the imputed numbers of duration units.

3. The method as defined in claim 1 , further including:

determining third numbers of impressions of the video that are attributable to the respective demographic groups by summing subsets of the first numbers of impressions that correspond to respective ones of the demographic groups;

determining numbers of audience members attributable to the respective demographic groups based on impression frequencies corresponding to the demographic groups and the video; and

determining second ratings information for the video based on the third numbers of impressions and the numbers of audience members.

4. The method as defined in claim 1 , wherein the messages include a first message identifying a non-duration type of impression of the video at a first one of the devices and a second message identifying one of the time segments of the video presented at the first one of the devices.

5. The method as defined in claim 1 , further including:

determining a duration of a first one of the time segments presented at a first one of the devices based on first information transmitted in a first one of the messages;

determining a fourth number of impressions of the first time segment presented at the devices based on a number of the messages containing the first information; and

determining a total duration of the first time segment presented at the devices based on the duration of the first time segment and the fourth number of impressions, the fourth number of impressions and the total duration of the first time segment corresponding to a first one of the demographic groups.

6. The method as defined in claim 1 , wherein the messages contain an identifier relating the first impressions to respective time segments of the video, a distributor of the video, a program distributed by the distributor and of which the video is a part, and an episode that belongs to the program and of which the video is a part.

7. The method as defined in claim 1 , further including:

determining a proportion of the first impressions of a first one of the time segments that are attributed to a first one of the demographic groups by the database proprietor;

identifying a first subset of the first impressions of the first one of the time segments that are not attributed to any of the demographic groups by the database proprietor;

attributing a second subset of the first impressions of the first one of the time segments by applying the proportion to the first subset; and

combining the second subset of the first impressions with the impressions of the first one of the time segments that are attributed to the first one of the demographic groups by the database proprietor to determine redistributed impressions for the first one of the time segments, the determining of the respective percentages of exposures of the video being based on the redistributed impressions.

8. An audience measurement apparatus to improve an accuracy of online audience measurement, comprising:

a first impressions collector to collect messages indicating first impressions of a video delivered to devices via the Internet, the messages to identify time segments of the video presented at the devices;

a second impressions collector to receive first demographic information describing first numbers of impressions attributed to respective demographic groups by a database proprietor, the first numbers of impressions representing the time segments of the video, the first numbers of impressions corresponding to the first impressions of the video;

an exposure distribution data generator to determine respective percentages of exposures of the video that are attributable to corresponding ones of a plurality of demographic groups, the exposure distribution data generator to determine the respective percentages based on the first demographic information provided by the database proprietor for exposures of the time segments of the video;

a segment imputer to:

detect that a second number of impressions for a first one of the time segments of the video occurred based on the messages;

detect that no impressions for the first one of the time segments of the video were detected by the database proprietor; and

attribute respective portions of the second number of impressions to the demographic groups based on the respective percentages to determine imputed numbers of impressions; and

a ratings data generator to:

generate adjusted numbers of impressions based on the first numbers of impressions and the imputed numbers of impressions; and

determine ratings information for the time segments of the video using the adjusted numbers of impressions.

9. The apparatus as defined in claim 8 , further including:

a duration distribution data generator to determine respective second percentages of duration units of the video that are attributable to corresponding ones of the demographic groups, the duration distribution data generator to determine the respective second percentages based on the first demographic information provided by the database proprietor for duration units of other time segments of the video; and

a duration imputer to:

detect that a first number of duration units for the first one of the time segments of the video occurred based on the messages;

detect that no duration units for the first one of the time segments of the video were detected by the database proprietor;

attribute respective portions of the first number of duration units to the demographic groups based on the respective second percentages to determine imputed numbers of duration units; and

generate adjusted numbers of duration units based on the first numbers of duration units and the imputed numbers of duration units.

10. The apparatus as defined in claim 8 , further including:

an exposure data generator to determine third numbers of impressions of the video that are attributable to the respective demographic groups by summing subsets of the first numbers of impressions that correspond to the respective demographic groups; and

an audience adjuster to determine numbers of audience members attributable to the respective demographic groups based on impression frequencies corresponding to the demographic groups and the video, the ratings data generator to determine second ratings information for the video based on the third numbers of impressions and the numbers of audience members.

11. The apparatus as defined in claim 8 , wherein the messages include a first message identifying a non-duration type of impression of the video at a first one of the devices and a second message identifying one of the time segments of the video presented at the first one of the devices.

12. The apparatus as defined in claim 8 , further including:

a segment calibrator to determine a duration of a first one of the time segments presented at a first one of the devices based on first information transmitted in a first one of the messages;

an impressions adjuster to determine a fourth number of impressions of the first time segment presented at the devices based on a number of the messages containing the first information; and

an impression duration data generator to determine a total duration of the first time segment presented at the devices based on the duration of the first time segment and the fourth number of impressions, the fourth number of impressions and the total duration of the first time segment corresponding to a first one of the demographic groups.

13. The apparatus as defined in claim 8 , wherein the messages contain an identifier relating the first impressions to respective time segments of the video, a distributor of the video, a program distributed by the distributor and of which the video is a part, and an episode that belongs to the program and of which the video is a part.

14. The apparatus as defined in claim 8 , further including a demographic distributor to:

determine a proportion of the first impressions of a first one of the time segments that are attributed to a first one of the demographic groups by the database proprietor;

identify a first subset of the first impressions of the first one of the time segments that are not attributed to any of the demographic groups by the database proprietor;

attribute a second subset of the first impressions of the first one of the time segments by applying the proportion to the first subset; and

combine the second subset of the first impressions with the impressions of the first one of the time segments that are attributed to the first one of the demographic groups by the database proprietor to determine redistributed impressions for the first one of the time segments, the segment imputer to determine the respective percentages of exposures of the video based on the redistributed impressions.

15. A tangible computer readable storage medium comprising computer readable instruction which, when executed, cause a processor to at least:

collect, at a processor of an audience measurement entity, messages indicating first impressions of a video delivered to devices via the Internet, the messages to identify time segments of the video presented at the devices;

access, at the processor of the audience measurement entity, first demographic information describing first numbers of impressions of the video attributed to respective demographic groups by a database proprietor, the first numbers of impressions representing the time segments of the video, the first numbers of impressions corresponding to the first impressions of the video;

based on the messages, detect that a second number of impressions for a first one of the time segments of the video occurred;

detect that no impressions for the first one of the time segments of the video were detected by the database proprietor;

determine respective percentages of exposures of the video that are attributable to corresponding ones of a plurality of demographic groups, the instructions to cause the processor to determine the respective percentages based on the first demographic information provided by the database proprietor for exposures of other time segments of the video;

attribute respective portions of the second number of impressions to the demographic groups based on the respective percentages to determine imputed numbers of impressions;

generate adjusted numbers of impressions based on the first numbers of impressions and the imputed numbers of impressions; and

generate a report including ratings information for the time segments of the video using the adjusted numbers of impressions.

16. The storage medium as defined in claim 15 , wherein the instructions are further to cause the processor to:

detect that a first number of duration units for the first one of the time segments of the video occurred based on the messages;

detect that no duration units for the first one of the time segments of the video were detected by the database proprietor;

determine respective second percentages of duration units of the video that are attributable to corresponding ones of the demographic groups, the determining of the respective second percentages being based on the first demographic information provided by the database proprietor for duration units of other time segments of the video;

attribute respective portions of the first number of duration units to the demographic groups based on the respective second percentages to determine imputed numbers of duration units; and

generate adjusted numbers of duration units based on the first numbers of duration units and the imputed numbers of duration units.

17. The storage medium as defined in claim 15 , wherein the instructions are further to cause the processor to:

determine third numbers of impressions of the video that are attributable to the respective demographic groups by summing subsets of the first numbers of impressions that correspond to the respective demographic groups;

determine numbers of audience members attributable to the respective demographic groups based on impression frequencies corresponding to the demographic groups and the media item; and

determine second ratings information for the video based on the third numbers of impressions and the numbers of audience members.

18. The storage medium as defined in claim 15 , wherein the messages include a first message identifying a non-duration type of impression of the video at a first one of the devices and a second message identifying one of the time segments of the video presented at the first one of the devices.

19. The storage medium as defined in claim 15 , wherein the instructions are further to cause the processor to:

determine a duration of a first one of the time segments presented at a first one of the devices based on first information transmitted in a first one of the messages;

determine a fourth number of impressions of the first time segment presented at the devices based on a number of the messages containing the first information; and

determine a total duration of the first time segment presented at the devices based on the duration of the first time segment and the fourth number of impressions, the fourth number of impressions and the total duration of the first time segment corresponding to a first one of the demographic groups.

20. The storage medium as defined in claim 15 , wherein the instructions are to cause the processor to generate the adjusted numbers of impressions by adding ones of the first numbers of impressions to respective ones of the imputed numbers of impressions.

21. An audience measurement apparatus to improve an accuracy of online audience measurement, comprising:

means for collecting messages indicating first impressions of a video delivered to devices via the Internet, the messages to identify time segments of the video presented at the devices;

means for accessing first demographic information describing first numbers of impressions attributed to respective demographic groups by a database proprietor, the first numbers of impressions representing the time segments of the video, the first numbers of impressions corresponding to the first impressions of the video;

means for determining respective percentages of exposures of the video that are attributable to corresponding ones of a plurality of demographic groups, the means for determining the respective percentages to determine the respective percentages based on the first demographic information provided by the database proprietor for exposures of the time segments of the video;

means for imputing a segment to:

detect that a second number of impressions for a first one of the time segments of the video occurred based on the messages;

detect that no impressions for the first one of the time segments of the video were detected by the database proprietor; and

attribute respective portions of the second number of impressions to the demographic groups based on the respective percentages to determine imputed numbers of impressions; and

means for generating adjusted numbers of impressions based on the first numbers of impressions and the imputed numbers of impressions and to determine ratings information for the time segments of the video using the adjusted numbers of impressions.

22. The apparatus as defined in claim 21 , further including:

means for determining respective second percentages of duration units of the video that are attributable to corresponding ones of the demographic groups, the duration distribution data generator to determine the respective second percentages based on the first demographic information provided by the database proprietor for duration units of other time segments of the video; and

means for imputing duration to:

detect that a first number of duration units for the first one of the time segments of the video occurred based on the messages;

detect that no duration units for the first one of the time segments of the video were detected by the database proprietor;

attribute respective portions of the first number of duration units to the demographic groups based on the respective second percentages to determine imputed numbers of duration units; and

generate adjusted numbers of duration units based on the first numbers of duration units and the imputed numbers of duration units.

23. The apparatus as defined in claim 21 , further including:

means for determining third numbers of impressions of the video that are attributable to the respective demographic groups by summing subsets of the first numbers of impressions that correspond to the respective demographic groups; and the means for generating the adjusted numbers of impressions to:

determine numbers of audience members attributable to the respective demographic groups based on impression frequencies corresponding to the demographic groups and the video; and

determine second ratings information for the video based on the third numbers of impressions and the numbers of audience members.

24. The apparatus as defined in claim 21 , wherein the messages include a first message identifying a non-duration type of impression of the video at a first one of the devices and a second message identifying one of the time segments of the video that were presented at the first one of the devices.

25. The apparatus as defined in claim 21 , further including:

means for determining a duration of a first one of the time segments presented at a first one of the devices based on first information transmitted in a first one of the messages;

means for determining a fourth number of impressions of the first time segment presented at the devices based on a number of the messages containing the first information; and

means for determining a total duration of the first time segment presented at the devices based on the duration of the first time segment and the fourth number of impressions, the fourth number of impressions and the total duration of the first time segment corresponding to a first one of the demographic groups.

26. The apparatus as defined in claim 21 , wherein the messages contain an identifier relating the first impressions to respective time segments of the video, a distributor of the video, a program distributed by the distributor and of which the video is a part, and an episode that belongs to the program and of which the video is a part.

27. The apparatus as defined in claim 21 , further including means for distributing demographic information to:

determine a proportion of the first impressions of a first one of the time segments that are attributed to a first one of the demographic groups by the database proprietor;

identify a first subset of the first impressions of the first one of the time segments that are not attributed to any of the demographic groups by the database proprietor;

attribute a second subset of the first impressions of the first one of the time segments by applying the proportion to the first subset; and

combine the second subset of the first impressions with the impressions of the first one of the time segments that are attributed to the first one of the demographic groups by the database proprietor to determine redistributed impressions for the first one of the time segments, the segment imputer to determine the respective percentages of exposures of the video based on the redistributed impressions.

Assignments (8)
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 13, 2019
From: SHAH, DIPTI UMESH; TOUPET, ANTONIA
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 048588/0001 →