IP Library Granted Patent US 10,972,561
Granted Patent B2
US 10,972,561 · App. 16/688,986 · Granted Apr 6, 2021

Methods and apparatus for adjusting model threshold levels

Inventor: Sonya Gierada (London, GB)
Assignee: The Nielsen Company (US), LLC
H04L67/22H04L67/02H04N21/25808H04N21/25891H04N21/44222
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,972,561
App. No.
16/688,986
Granted
Apr 6, 2021
Kind
B2
Abstract

Methods and apparatus for adjusting model threshold levels are disclosed. An example apparatus includes a volume estimator to determine volume estimates corresponding to a total number of users that satisfy a model threshold within a first period of time; an estimate adjuster to when a ratio of (A) modeled users that satisfy the model threshold to (B) a sum of the modeled users that satisfy the model threshold and deterministic client device users does not satisfy a minimum ratio threshold, increase the number of modeled users to satisfy the model threshold; when the total users that satisfy the model threshold does not satisfy a total volume target, increase the number of modeled users to satisfy the total volume target; and updating the total volume target based on the increased number of modeled users; an adjustment factor generator to apply an adjustment factor based on the volume estimates and the updated total volume target to an absolute count of users to generate an adjusted count of users; and a model threshold adjuster to adjust the model threshold based on the adjusted count of users.

Claims (48)

1. An apparatus comprising:

an estimate adjuster to, when a ratio of (A) a number of modeled users that satisfy a model threshold within a first period of time to (B) a sum of the number of the modeled users that satisfy the model threshold and a number of deterministic client device users does not satisfy a minimum ratio threshold, increase the number of modeled users to satisfy the model threshold;

an adjustment factor generator to generate an adjusted count of users by applying an adjustment factor based on volume estimates and an updated total volume target to an absolute count of users, the volume estimates corresponding to the number of users that satisfy the model threshold within the first period of time; and

a model threshold adjuster to adjust the model threshold based on the adjusted count of users.

2. The apparatus of claim 1 , wherein the volume estimates include a number of client device users and a number of modeled client device users.

3. The apparatus of claim 1 , wherein volume estimator is to determine the volume estimates by determining a first volume estimate corresponding to a second number of users that satisfy the model threshold within a second period of time and projecting the second number of users based on a difference between the first period of time and the second period of time.

4. The apparatus of claim 1 , wherein the updated total volume target is a total volume target updated based on the increased number of modeled users, the total volume target is a number of users that satisfy the model threshold to be included in a data segment, and the number of users includes a number of client device users and a number of modeled users.

5. The apparatus of claim 1 , wherein the updated total volume target is the sum of the increased number of modeled users that satisfy the model threshold and client device users that satisfy the model threshold.

6. The apparatus of claim 1 , wherein the adjustment factor generator is to generate the adjustment factor by dividing the updated total volume target by the volume estimates.

7. The apparatus of claim 1 , wherein the absolute count of users is a number of client device users and a number of model users that satisfy the model threshold within a second period of time.

8. The apparatus of claim 1 , wherein the estimate adjuster is to adjust the model threshold based on the adjusted count of users by determining a model threshold value that, when applied to a model, changes the absolute count of users to a count nearest to the updated total volume target.

9. The apparatus of claim 1 , wherein the estimate adjuster is to adjust the model threshold by:

determining a decreased model threshold, the decreased model threshold being less than the model threshold;

determining a decreased model total based on lookback model score data, the decreased model total corresponding to a number of users that studies the decreased model threshold; and

when a first difference between (A) the decreased model total and (B) adjusted absolute count of users is smaller than a second difference between (A) a model threshold total corresponding to the model threshold and (B) the adjusted absolute count of users, replacing the model threshold with the decreased model threshold.

10. The apparatus of claim 1 , wherein the estimate adjuster is to adjust the model threshold by:

determining an increased model threshold, the increased model threshold being more than the model threshold;

determining an increased model total based on lookback model score data, the increased model total corresponding to a number of users that studies the increased model threshold; and

when a first difference between (A) the increased model total and (B) adjusted absolute count of users is smaller than a second difference between (A) a model threshold total corresponding to the model threshold and (B) the adjusted absolute count of users, replacing the model threshold with the increased model threshold.

11. The apparatus of claim 1 , further including an interface to deploy a model corresponding the adjusted model threshold, the model corresponding to a data segment including adjusted count of users.

12. The apparatus of claim 11 , wherein the model further corresponds to a type of media, the deterministic client device users having been exposed to the type of media.

13. The apparatus of claim 1 , wherein the estimate adjuster is to, when the ratio satisfies the minimum ratio threshold, maintain a total volume target corresponding to the updated total volume target.

14. The tangible computer readable storage medium of claim 1 , wherein the instructions cause the one or more processors to, when the ratio satisfies the minimum ratio threshold, maintain a total volume target corresponding to the updated total volume target.

15. A tangible computer readable storage medium comprising instructions which, when executed, cause one or more processors to at least:

when a ratio of (A) a number of modeled users that satisfy a model threshold within a first period of time to (B) a sum of the number of the modeled users that satisfy the model threshold and a number of deterministic client device users does not satisfy a minimum ratio threshold, increase the number of modeled users to satisfy the model threshold;

generate an adjusted count of users by applying an adjustment factor based on volume estimates and an updated total volume target to an absolute count of users, the volume estimates corresponding to the number of users that satisfy the model threshold within the first period of time; and

adjust the model threshold based on the adjusted count of users.

16. The tangible computer readable storage medium of claim 15 , wherein the volume estimates include a number of client device users and a number of modeled client device users.

17. The tangible computer readable storage medium of claim 15 , wherein the instructions cause the one or more processors to determine the volume estimates by determining a first volume estimate corresponding to a second number of users that satisfy the model threshold within a second period of time and projecting the second number of users based on a difference between the first period of time and the second period of time.

18. The tangible computer readable storage medium of claim 15 , wherein the updated total volume target is a total volume target updated based on the increased number of modeled users, the total volume target is a number of users that satisfy the model threshold to be included in a data segment, and the number of users includes a number of client device users and a number of modeled users.

19. The tangible computer readable storage medium of claim 15 , wherein the updated total volume target is the sum of the increased number of modeled users that satisfy the model threshold and client device users that satisfy the model threshold.

20. The tangible computer readable storage medium of claim 15 , wherein the instructions cause the one or more processors to generate the adjustment factor by dividing the updated total volume target by the volume estimates.

21. The tangible computer readable storage medium of claim 15 , wherein the absolute count of users is a number of client device users and a number of model users that satisfy the model threshold within a second period of time.

22. The tangible computer readable storage medium of claim 15 , wherein the instructions cause the one or more processors to adjust the model threshold based on the adjusted count of users by determining a model threshold value that, when applied to a model, changes the absolute count of users to a count nearest to the updated total volume target.

23. The tangible computer readable storage medium of claim 15 , wherein the instructions cause the one or more processors to adjust the model threshold by:

determining a decreased model threshold, the decreased model threshold being less than the model threshold;

determining a decreased model total based on lookback model score data, the decreased model total corresponding to a number of users that studies the decreased model threshold; and

when a first difference between (A) the decreased model total and (B) adjusted absolute count of users is smaller than a second difference between (A) a model threshold total corresponding to the model threshold and (B) the adjusted absolute count of users, replacing the model threshold with the decreased model threshold.

24. The tangible computer readable storage medium of claim 15 , wherein the instructions cause the one or more processors to adjust the model threshold by:

determining an increased model threshold, the increased model threshold being more than the model threshold;

determining an increased model total based on lookback model score data, the increased model total corresponding to a number of users that studies the increased model threshold; and

when a first difference between (A) the increased model total and (B) adjusted absolute count of users is smaller than a second difference between (A) a model threshold total corresponding to the model threshold and (B) the adjusted absolute count of users, replacing the model threshold with the increased model threshold.

25. The tangible computer readable storage medium of claim 15 , wherein the instructions cause the one or more processors to deploy a model corresponding the adjusted model threshold, the model corresponding to a data segment including adjusted count of users.

26. The tangible computer readable storage medium of claim 25 , wherein the model further corresponds to a type of media, the deterministic client device users having been exposed to the type of media.

27. A method comprising:

when a ratio of (A) a number of modeled users that satisfy a model threshold within a first period of time to (B) a sum of the number of the modeled users that satisfy the model threshold and a number of deterministic client device users does not satisfy a minimum ratio threshold, increasing, by executing an instruction with a processor, the number of modeled users to satisfy the model threshold;

generating, by executing an instruction with the processor, an adjusted count of users by applying an adjustment factor based on volume estimates and an updated total volume target to an absolute count of users, the volume estimates corresponding to the number of users that satisfy the model threshold within the first period of time; and

adjusting, by executing an instruction with the processor, the model threshold based on the adjusted count of users.

Assignments (8)
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 23, 2020
From: GIERADA, SONYA
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 051598/0533 →