IP Library Granted Patent US 10,776,728
Granted Patent B1
US 10,776,728 · App. 15/583,337 · Granted Sep 15, 2020

Methods, systems and apparatus for calibrating data using relaxed benchmark constraints

Inventors: Ludo Daemen (Duffel, BE); Robert C. Smith (New York, NY); Edmond Wong (New York, NY); Alexander Radev (New York, NY); Vippal Savani (Oxfordshire, GB); Christophe Koell (Brussels, BE); William Somers (New York, NY)
Assignee: THE NIELSEN COMPANY (US), LLC
G06Q10/06313G06F17/16
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,776,728
App. No.
15/583,337
Granted
Sep 15, 2020
Kind
B1
Abstract

Methods, systems and apparatus for calibrating data using relaxed benchmarks constraints are described. An example apparatus for generating a unique solution when calibrating data via a calibration model having relaxed benchmark constraints includes a calibration engine to execute the calibration model based on a target loss function, a weight loss function, and a budget parameter. The example apparatus further includes a calibrated weights determiner to determine calibrated weights resulting from execution of the calibration model. The example apparatus further includes a calibration model validator to incorporate a stability parameter into the calibration model in response to determining that the calibrated weights do not provide a unique solution for the executed calibration model. The stability parameter is to reduce an influence of the budget parameter on the calibration model to enable the generation of a unique solution.

Claims (34)

1. An apparatus for generating a unique solution when calibrating data via a calibration model having relaxed benchmark constraints, the apparatus comprising:

a calibration engine to execute the calibration model based on a target loss function, a weight loss function, and a budget parameter, the budget parameter being an upper constraint that a weight loss value determined via the weight loss function is allowed to obtain;

a calibrated weights determiner to determine calibrated weights resulting from execution of the calibration model; and

a calibration model validator to incorporate a stability parameter into the calibration model in response to determining that the calibrated weights do not provide a unique solution for the executed calibration model, the stability parameter to reduce an influence of the budget parameter on the calibration model to enable the generation of a unique solution.

2. The apparatus as defined in claim 1 , wherein the calibration engine is to re-execute the calibration model based on the target loss function, the weight loss function, the budget parameter, and the stability parameter, and the calibrated weights determiner is to re-determine the calibrated weights resulting from re-execution of the calibration model.

3. The apparatus as defined in claim 2 , wherein the re-determined calibrated weights are to provide a unique solution for the re-executed calibration model.

4. The apparatus as defined in claim 1 , wherein the calibration engine is to execute the calibration model based further on criteria-based input data to be incorporated into the target loss function and unit-based input data to be incorporated into the weight loss function.

5. The apparatus as defined in claim 4 , wherein the criteria-based input data includes criteria variables and at least one of targets for the criteria variables, upper and lower bounds for the criteria variables, scaling parameters for the criteria variables, or importance parameters for the criteria variables.

6. The apparatus as defined in claim 4 , wherein the unit-based input data includes unit variables and at least one of initial weights for the unit variables, upper and lower bounds for the unit variables, or size parameters for the unit variables.

7. The apparatus as defined in claim 4 , wherein the calibration engine is to execute the calibration model based further on matrix data, the matrix data being based on the criteria-based input data and the unit-based input data.

8. A method for generating a unique solution when calibrating data via a calibration model having relaxed benchmark constraints, the method comprising:

executing the calibration model based on a target loss function, a weight loss function, and a budget parameter, the budget parameter being an upper constraint that a weight loss value determined via the weight loss function is allowed to obtain;

determining, by executing one or more computer readable instructions with a processor, calibrated weights resulting from the executing of the calibration model; and

incorporating, by executing one or more computer readable instructions with the processor, a stability parameter into the calibration model in response to determining that the calibrated weights do not provide a unique solution for the executed calibration model, the stability parameter to reduce an influence of the budget parameter on the calibration model to enable the generation of a unique solution.

9. The method as defined in claim 8 , further including:

re-executing the calibration model based on the target loss function, the weight loss function, the budget parameter, and the stability parameter; and

re-determining the calibrated weights resulting from the re-executing of the calibration model.

10. The method as defined in claim 9 , wherein the re-determined calibrated weights are to provide a unique solution for the re-executed calibration model.

11. The method as defined in claim 8 , wherein the executing of the calibration model is further based on criteria-based input data incorporated into the target loss function and unit-based input data incorporated into the weight loss function.

12. The method as defined in claim 11 , wherein the criteria-based input data includes criteria variables and at least one of targets for the criteria variables, upper and lower bounds for the criteria variables, scaling parameters for the criteria variables, or importance parameters for the criteria variables.

13. The method as defined in claim 11 , wherein the unit-based input data includes unit variables and at least one of initial weights for the unit variables, upper and lower bounds for the unit variables, or size parameters for the unit variables.

14. The method as defined in claim 11 , wherein the executing of the calibration model is further based on matrix data, the matrix data being based on the criteria-based input data and the unit-based input data.

15. A tangible machine-readable storage medium comprising instructions that, when executed, cause a processor to at least:

execute a calibration model based on a target loss function, a weight loss function, and a budget parameter, the calibration model having relaxed benchmark constraints, the budget parameter being an upper constraint that a weight loss value determined via the weight loss function is allowed to obtain;

determine calibrated weights resulting from the execution of the calibration model; and

incorporate a stability parameter into the calibration model in response to determining that the calibrated weights do not provide a unique solution for the executed calibration model, the stability parameter to reduce an influence of the budget parameter on the calibration model to enable the generation of a unique solution.

16. The tangible machine-readable storage medium as defined in claim 15 , wherein the instructions, when executed, are further to cause the processor to:

re-execute the calibration model based on the target loss function, the weight loss function, the budget parameter, and the stability parameter; and

re-determine the calibrated weights resulting from the re-execution of the calibration model.

17. The tangible machine-readable storage medium as defined in claim 16 , wherein the re-determined calibrated weights are to provide a unique solution for the re-executed calibration model.

18. The tangible machine-readable storage medium as defined in claim 15 , wherein the instructions, when executed, are to cause the processor to execute the calibration model based further on criteria-based input data incorporated into the target loss function and unit-based input data incorporated into the weight loss function.

19. The tangible machine-readable storage medium as defined in claim 18 , wherein the criteria-based input data includes criteria variables and at least one of targets for the criteria variables, upper and lower bounds for the criteria variables, scaling parameters for the criteria variables, or importance parameters for the criteria variables.

20. The tangible machine-readable storage medium as defined in claim 18 , wherein the unit-based input data includes unit variables and at least one of initial weights for the unit variables, upper and lower bounds for the unit variables, or size parameters for the unit variables.

21. The apparatus as defined in claim 1 , wherein the target loss function has a flat region, the stability parameter to prevent a minimization procedure of the calibration model from reaching the flat region.

Assignments (8)
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 12, 2017
From: DAEMEN, LUDO; SMITH, ROBERT C.; WONG, EDMOND; RADEV, ALEXANDER; SAVANI, VIPPAL; KOELL, CHRISTOPHE; SOMERS, WILLIAM
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 042353/0806 →
Continuity (4)
Provisional Application 62379517 · Aug 25, 2016
Provisional Application 62379205 · Aug 24, 2016
Provisional Application 62378041 · Aug 22, 2016
Provisional Application 62346897 · Jun 7, 2016