IP Library Granted Patent US 12,079,825
Granted Patent B2
US 12,079,825 · App. 15/256,568 · Granted Sep 3, 2024

Automated learning of models for domain theories

Inventors: Robert Stratton (San Francisco, CA); Dirk Beyer (San Francisco, CA)
Assignee: NEUSTAR, INC.
G06Q30/0201G06N3/123G06N20/00G06Q10/067
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,079,825
App. No.
15/256,568
Granted
Sep 3, 2024
Kind
B2
Abstract

A computer implemented system and process to determine a model for a domain includes identifying a schema that defines a possible causal element of a particular type of behavior. One or more concepts are determined, as well as one or more sub-concepts for each concept, where each concept and sub-concept are associated with a logical relationship. Multiple models are determined from the one or more concepts and the one or more sub-concepts. The multiple models may be calibrated using representative data collected from a real-world source. An optimal model is determined amongst a plurality of calibrated models.

Claims (22)

1. A computer implemented method for determining a model, the method comprising:

(a) identifying, by one or more computing devices, a schema that defines a possible causal element of a particular type of behavior;

(b) determining, by the one or more computing devices, one or more concepts provided in the schema, and one or more sub-concepts for each concept, each concept and each sub-concept being associated with uncalibrated weights and a functional form which represent a logical relationship between them;

(c) determining, by the one or more computing devices, multiple models from the one or more concepts and the one or more sub-concepts;

(d) calibrating, by the one or more computing devices, the multiple models using representative data collected from a real-world source, wherein the calibration utilizes a limited-memory Broyden-Fletcher-Goldfarb-Shanno algorithm to iteratively evaluate a series of possible weight values for a given combination of sub-concepts;

(e) updating the uncalibrated weights with weights from the possible weight values to determine an optimal model amongst a plurality of calibrated models;

(f) determining, by the one or more computing devices, the optimal model amongst the plurality of calibrated models based on a model score that includes a determination of a model fit and a compliance with an expected attribution associated with an existing knowledge of the schema, wherein the model fit is calculated based on real-time data from the real-world source, and wherein determining the optimal model includes adaptively learning the optimal model by repeating (c) and (d) to converge on the optimal model; and

(g) transmitting, by the one or more computing devices, the optimal model to a user interface to thereby support measurement of marketing effectiveness in response to one or more stimuli in a marketplace.

2. The method of claim 1 , wherein identifying the schema includes identifying an independent variable.

3. The method of claim 1 , wherein the schema is associated with a termination threshold.

4. The method of claim 3 , further comprising:

after calibrating the model, making a determination as to whether the model satisfies the termination threshold.

5. The method of claim 1 , wherein determining the optimal model includes selecting the optimal model from the plurality of calibrated models.

6. The method of claim 1 , wherein the model score is based on the model fit to a real-world result.

7. The method of claim 1 , wherein the one or more concepts are based on one or more rules that are specific to a domain threshold.

8. The method of claim 1 , wherein a user identifies the schema by mapping real-world data to each of a dependent and independent variables.

9. The method of claim 1 , wherein a user is separated from the representative data, such that the representative data is inaccessible to the user.

10. The method of claim 1 , wherein the determining the optimal model includes using a genetic algorithm.

11. The method of claim 10 , wherein (d) is performed using a statistical process.

12. The method of claim 1 , further comprising determining an alternative model by forming a cross-over combination of at least two of the plurality of calibrated models, the forming including exchanging at least one feature of the at least two of the plurality of calibrated models to form the alternative model.

13. The method of claim 1 , further comprising determining an alternative model by using a mutation process, wherein one or more features of the at least one of the plurality of calibrated models are randomly altered with a probability equal to a mutation rate.

14. The method of claim 1 , further comprising adjusting a marketing activity based on the optimal model.

Assignments (5)
CORRECTIVE ASSIGNMENT TO CORRECT THE APPLICATION NO. 16/990,698 PREVIOUSLY RECORDED ON REEL 058294 FRAME 0010. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Apr 21, 2022
From: TRU OPTIK DATA CORP.; NEUSTAR INFORMATION SERVICES, INC.; NEUSTAR DATA SERVICES, INC.; TRUSTID, INC.; NEUSTAR, INC.; NEUSTAR IP INTELLIGENCE, INC.; MARKETSHARE PARTNERS, LLC; SONTIQ, INC.
To: DEUTSCHE BANK AG NEW YORK BRANCH
Reel/Frame 059846/0157 →
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS RECORDED AT REEL 058294, FRAME 0161 Recorded Dec 27, 2021
From: JPMORGAN CHASE BANK, N.A.
To: EBUREAU, LLC; IOVATION, INC.; SIGNAL DIGITAL, INC.; TRANS UNION LLC; TRANSUNION INTERACTIVE, INC.; TRANSUNION RENTAL SCREENING SOLUTIONS, INC.; TRANSUNION TELEDATA LLC; AGGREGATE KNOWLEDGE, LLC; TRU OPTIK DATA CORP.; NEUSTAR INFORMATION SERVICES, INC.; TRUSTID, INC.; NEUSTAR, INC.; NEUSTAR IP INTELLIGENCE, INC.; MARKETSHARE PARTNERS, LLC; SONTIQ, INC.
Reel/Frame 058593/0852 →
GRANT OF SECURITY INTEREST IN PATENT RIGHTS Recorded Dec 1, 2021
From: TRU OPTIK DATA CORP.; NEUSTAR INFORMATION SERVICES, INC.; NEUSTAR DATA SERVICES, INC.; TRUSTID, INC.; NEUSTAR, INC.; NEUSTAR IP INTELLIGENCE, INC.; MARKETSHARE PARTNERS, LLC; SONTIQ, INC.
To: DEUTSCHE BANK AG NEW YORK BRANCH
Reel/Frame 058294/0010 →
GRANT OF SECURITY INTEREST IN UNITED STATES PATENTS Recorded Dec 1, 2021
From: EBUREAU, LLC; IOVATION, INC.; SIGNAL DIGITAL, INC.; TRANS UNION LLC; TRANSUNION HEALTHCARE, INC.; TRANSUNION INTERACTIVE, INC.; TRANSUNION RENTAL SCREENING SOLUTIONS, INC.; TRANSUNION TELEDATA LLC; AGGREGATE KNOWLEDGE, LLC; TRU OPTIK DATA CORP.; NEUSTAR INFORMATION SERVICES, INC.; TRUSTID, INC.; NEUSTAR, INC.; NEUSTAR IP INTELLIGENCE, INC.; MARKETSHARE PARTNERS, LLC; SONTIQ, INC.
To: JPMORGAN CHASE BANK, N.A
Reel/Frame 058294/0161 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 8, 2018
From: STRATTON, ROBERT; BEYER, DIRK
To: NEUSTAR, INC.
Reel/Frame 046032/0491 →
Continuity (1)
Related Publication 20180068323A1 · Mar 8, 2018