IP Library Granted Patent US 12,456,132
Granted Patent B2
US 12,456,132 · App. 18/620,239 · Granted Oct 28, 2025

Adaptive real time modeling and scoring

Inventors: Pavan Korada (San Rafael, CA); Sunpreet Singh Khanuja (San Jose, CA); Yun Sam Chong (Santa Clara, CA); Bharat Goyal (San Jose, CA); Edward Robert Rau, Jr. (Riverbank, CA)
Assignee: Zeta Global Corp.
G06Q30/0243G06F16/24578G06F16/9535G06F30/20G06Q30/016G06Q30/0251
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,456,132
App. No.
18/620,239
Granted
Oct 28, 2025
Kind
B2
Abstract

Systems, methods and media for adaptive real time modeling and scoring are provided. In one example, a system for automatically generating predictive scoring models comprises a trigger component to determine, based on a threshold or trigger, such as a detection of new significant relationships, whether a predictive scoring model is ready for a refresh or regeneration. An automated modeling sufficiency checker receives and transforms user-selectable system input data. The user-selectable system input data may comprise at least one of email, display or social media traffic. An adaptive modeling engine operably connected to the trigger component and modeling sufficiency checker is configured to monitor and identify a change in the input data and, based on an identified change in the input data, automatically refresh or regenerate the scoring model for calculating new lead scores. A refreshed or regenerated predictive scoring model is output.

Claims (60)

1 . An adaptive real time modeling and scoring system for generating predictive scoring models, the system comprising:

one or more processors; and

a memory coupled to the one or more processors which stores processor-executable instructions which, when executed by the one or more processors, cause the one or more processors to:

generate multiple predictive scoring models;

identify a consolidated trigger for a combination of the multiple predictive scoring models;

evaluate the multiple predictive scoring models based on a heuristic to select an optimal predictive scoring model;

determine, based on the consolidated trigger, that the optimal predictive scoring model is ready for a refresh;

identify a change in system input data, the system input data comprising elements of a plurality of consumer profiles including one or more of a plurality of email traffic, display traffic and social media traffic;

refresh the predictive scoring model based on the identified change in system input data;

use the refreshed predictive scoring model for generating a look-alike audience; and

generate the look-alike audience to improve system efficiency and data accuracy in audience targeting at least by automatically discovering new data relationships and trends as historical data evolves over time.

2 . The system of claim 1 , wherein the refreshed predictive scoring model is for calculating new lead scores indicating a probability that the new leads will make a purchase.

3 . The system of claim 1 , wherein the processor-executable instructions, when executed, further cause the one or more processors to receive an input defining a consumer profile of an existing target consumer; and

generate a target look-alike audience comprising potential target consumers replicating, at least in part, aspects of the consumer profile.

4 . The system of claim 3 , wherein the processor-executable instructions, when executed, further cause the one or more processors to receive user selections relating to at least some aspects of the consumer profile with an interactive user interface.

5 . The system of claim 4 , wherein the processor-executable instructions, when executed, further cause the one or more processors to receive a selection of a degree of replication accuracy or population size of the target look-alike audience with a consumer element of the interactive user interface.

6 . The system of claim 1 , wherein the processor-executable instructions, when executed, further cause the one or more processors to:

determine an equation including multiple predictive factors weighted by an importance of each predictive factor in predicting a likelihood of a lead to convert; and

change at least one weight of a predictive factor to adapt the refreshed predictive scoring model to include a quality classification for a publisher.

7 . The system of claim 1 , wherein the consolidated trigger is an automated trigger that is based on analysis of historical data and new data that reveals a new relationship between multiple variables that did not exist previously.

8 . A method for performing adaptive real time modeling and scoring, the method comprising, at least:

generating multiple predictive scoring models;

identifying a consolidated trigger for a combination of the multiple predictive scoring models;

evaluating the multiple predictive scoring models based on a heuristic to select an optimal predictive scoring model;

determining, based on the consolidated trigger, that the optimal predictive scoring model is ready for a refresh;

identifying a change in system input data, the system input data comprising elements of a plurality of consumer profiles including one or more of a plurality of email traffic, display traffic and social media traffic;

refreshing predictive scoring model based on the identified change in system input data;

using the refreshed predictive scoring model for one or more of recommending strategies for display media bidding; and

recommending the one or more strategies for display media bidding to improve system efficiency and data accuracy in audience targeting at least by automatically determining differences between pricing assumptions and at least one of an observed quality metric and bid performance.

9 . The method of claim 8 , wherein the refreshed predictive scoring model is for calculating new lead scores indicating a probability that the new leads will make a purchase.

10 . The method of claim 8 , further comprising:

receiving an input defining a consumer profile of an existing target consumer; and

generate a target look-alike audience comprising potential target consumers replicating, at least in part, aspects of the consumer profile.

11 . The method of claim 10 , further comprising:

providing a look-alike audience creator, the look-alike audience creator including an interactive user interface for receiving user selections relating to at least some aspects of the consumer profile.

12 . The method of claim 11 , further comprising:

using the interactive user interface to receive a selection of a degree of replication accuracy or population size of the target look-alike audience.

13 . The method of claim 8 , further comprising:

determining an equation including multiple predictive factors weighted by an importance of each predictive factor in predicting a likelihood of a lead to convert; and

changing at least one weight of a predictive factor to adapt the refreshed predictive scoring model to include a quality classification for a publisher.

14 . The method of claim 8 , wherein the consolidated trigger is an automated trigger that is based on analysis of historical data and new data that reveals a new relationship between different variables that did not exist previously.

15 . A method for performing adaptive real time modeling and scoring, the method comprising, at least:

generating multiple predictive scoring models;

identifying a forced trigger for a combination of the multiple predictive scoring models;

evaluating the multiple predictive scoring models based on a heuristic to select an optimal predictive scoring model;

determining, based on the forced trigger, that the optimal predictive scoring model is ready for a refresh;

identifying a new data file at a pre-defined server location, the new data file comprising an advertiser dataset including elements of a plurality of consumer profiles, each of the plurality of consumer profiles including one or more of a plurality of email traffic, display traffic and social media traffic;

regenerating the predictive scoring model based on the identified new data file;

using the regenerated predictive scoring model for one or more of recommending strategies for display media bidding; and

recommending the one or more strategies for display media bidding to improve system efficiency and data accuracy in audience targeting at least by automatically determining differences between pricing assumptions and at least one of an observed quality metric and bid performance.

16 . The method of claim 15 , wherein the regenerated predictive scoring model is for calculating new lead scores indicating a probability that the new leads will make a purchase.

17 . The method of claim 15 , further comprising:

receiving an input defining a consumer profile of an existing target consumer, and generating a target look-alike audience comprising potential target consumers replicating, at least in part, aspects of the consumer profile.

18 . The method of claim 17 , further comprising:

providing a look-alike audience creator, the look-alike audience creator including an interactive user interface for receiving user selections relating to at least some aspects of the consumer profile.

19 . The method of claim 18 , further comprising:

using the interactive user interface to receive a selection of a degree of replication accuracy or population size of the target look-alike audience.

20 . The method of claim 15 , further comprising:

determining an equation including multiple predictive factors weighted by an importance of each predictive factor in predicting a likelihood of a lead to convert; and

changing at least one weight of a predictive factor to adapt the refreshed predictive scoring model to include a quality classification for a publisher.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 12, 2025
From: KORADA, PAVAN; KHANUJA, SUNPREET SINGH; CHONG, YUN SAM; GOYAL, BHARAT; RAU, EDWARD ROBERT, JR.
To: ZETA GLOBAL CORP.
Reel/Frame 071397/0903 →
Continuity (4)
Continuation 17538647 · Nov 30, 2021
Continuation 15594284 · May 12, 2017
Provisional Application 62336514 · May 13, 2016
Related Publication 20240320704A1 · Sep 26, 2024
References Cited (109)
US 6792399B1 · Phillips et al. · 2004 [cited by applicant]
US 7003476B1 · Samra et al. · 2006 [cited by applicant]
US 7949588B2 · Willis · 2011 [cited by applicant]
US 8271313B2 · Williams et al. · 2012 [cited by applicant]
US 8577736B2 · Swinson et al. · 2013 [cited by applicant]
US 10032174B2 · Hoff · 2018 [cited by applicant]
US 10157352B1 · Chan et al. · 2018 [cited by applicant]
US 10242068B1 · Ross et al. · 2019 [cited by applicant]
US 10387833B2 · Swinson et al. · 2019 [cited by applicant]
US 10395217B1 · Lovejoy · 2019 [cited by applicant]
US 11144949B2 · Korada et al. · 2021 [cited by applicant]
US 11227304B2 · Korada et al. · 2022 [cited by applicant]
US 11354700B2 · Korada et al. · 2022 [cited by applicant]
US 20040103017A1 · Reed et al. · 2004 [cited by applicant]
US 20060242000A1 · Giguiere · 2006 [cited by applicant]
US 20070219848A1 · Hubsher · 2007 [cited by applicant]
US 20070233561A1 · Golec · 2007 [cited by applicant]
US 20070244741A1 · Blume et al. · 2007 [cited by applicant]
US 20080288361A1 · Rego et al. · 2008 [cited by applicant]
US 20090048859A1 · Mccarthy et al. · 2009 [cited by applicant]
US 20110082759A1 · Swinson et al. · 2011 [cited by applicant]
US 20110231230A1 · Christon et al. · 2011 [cited by applicant]
US 20110258016A1 · Barak et al. · 2011 [cited by applicant]
US 20110258049A1 · Ramer et al. · 2011 [cited by applicant]
US 20110264479A1 · Birr · 2011 [cited by applicant]
US 20110276507A1 · O'malley · 2011 [cited by applicant]
US 20110307382A1 · Siegel · 2011 [cited by applicant]
US 20120323695A1 · Stibel · 2012 [cited by applicant]
US 20130066676A1 · Williams et al. · 2013 [cited by applicant]
US 20140046880A1 · Breckenridge et al. · 2014 [cited by applicant]
US 20140149161A1 · Hedges et al. · 2014 [cited by applicant]
US 20140149178A1 · Hedges · 2014 [cited by applicant]
US 20140200993A1 · Murphy · 2014 [cited by applicant]
US 20140214482A1 · Williams et al. · 2014 [cited by applicant]
US 20140236708A1 · Wolff et al. · 2014 [cited by applicant]
US 20140249873A1 · Stephan et al. · 2014 [cited by applicant]
US 20140278981A1 · Mersov et al. · 2014 [cited by applicant]
US 20140316883A1 · Kitts et al. · 2014 [cited by applicant]
US 20150142713A1 · Gopinathan et al. · 2015 [cited by applicant]
US 20150186926A1 · Chittilappilly et al. · 2015 [cited by applicant]
US 20150213503A1 · Friborg, Jr. · 2015 [cited by applicant]
US 20150248693A1 · Dubey · 2015 [cited by applicant]
US 20150379647A1 · Gupta et al. · 2015 [cited by applicant]
US 20160071117A1 · Duncan · 2016 [cited by applicant]
US 20160210657A1 · Chittilappilly et al. · 2016 [cited by applicant]
US 20160217476A1 · Duggal et al. · 2016 [cited by applicant]
US 20170206571A1 · Dhawan et al. · 2017 [cited by applicant]
US 20170300933A1 · Mascaro et al. · 2017 [cited by applicant]
US 20170329881A1 · Korada et al. · 2017 [cited by applicant]
US 20170330220A1 · Korada et al. · 2017 [cited by applicant]
US 20170345054A1 · Sinha et al. · 2017 [cited by applicant]
US 20180060744A1 · Achin et al. · 2018 [cited by applicant]
US 20190251593A1 · Allouche · 2019 [cited by applicant]
US 20190318378A1 · Korada et al. · 2019 [cited by applicant]
US 20220027943A1 · Korada et al. · 2022 [cited by applicant]
US 20220092635A1 · Korada et al. · 2022 [cited by applicant]
US 20220245667A1 · Korada et al. · 2022 [cited by applicant]
“U.S. Appl. No. 15/594,104, Advisory Action malled Mar. 9, 2020”, 5 pgs. [cited by applicant]
“U.S. Appl. No. 15/594,104, Final Office Action malled Jan. 2, 2020”, 31 pgs. [cited by applicant]
“U.S. Appl. No. 15/594,104, Final Office Action mailed Oct. 26, 2020”, 31 pgs. [cited by applicant]
“U.S. Appl. No. 15/594,104, Non Final Office Action mailed Jun. 24, 2020”, 32 pgs. [cited by applicant]
“U.S. Appl. No. 15/594,104, Non Final Office Action mailed Sep. 30, 2019”, 26 pgs. [cited by applicant]
“U.S. Appl. No. 15/594,104, Notice of Allowance mailed Jun. 10, 2021”, 23 pgs. [cited by applicant]
“U.S. Appl. No. 15/594,104, Response filed Jan. 26, 2021 to Final Office Action mailed Oct. 26, 2020”, 13 pgs. [cited by applicant]
“U.S. Appl. No. 15/594,104, Response filed Feb. 27, 2020 to Final Office Action mailed Jan. 2, 2020”, 11 pgs. [cited by applicant]
“U.S. Appl. No. 15/594,104, Response filed Jun. 2, 2020 to Final Office Action mailed Jan. 2, 2020”, 12 pgs. [cited by applicant]
“U.S. Appl. No. 15/594,104, Response filed Jun. 26, 2019 to Restriction Requirement mailed May 23, 209”, 6 pgs. [cited by applicant]
“U.S. Appl. No. 15/594,104, Response filed Nov. 19, 2019 to Non-Final Office Action mailed Sep. 30, 2019”, 15 pgs. [cited by applicant]
“U.S. Appl. No. 15/594,104, Response Filed Sep. 24, 2020 to Non Final Office Action mailed Jun. 24, 2020”, 13 pgs. [cited by applicant]
“U.S. Appl. No. 15/594,104, Restriction Requirement mailed May 23, 2019”, 7 pgs. [cited by applicant]
“U.S. Appl. No. 15/594,284, Corrected Notice of Allowability mailed Nov. 3, 2021”, 9 pgs. [cited by applicant]
“U.S. Appl. No. 15/594,284, Final Office Action mailed May 24, 2021”, 12 pgs. [cited by applicant]
“U.S. Appl. No. 15/594,284, Final Office Action mailed Aug. 4, 2020”, 11 pgs. [cited by applicant]
“U.S. Appl. No. 15/594,284, Non Final Office Action mailed Jan. 16, 2020”, 12 pgs. [cited by applicant]
“U.S. Appl. No. 15/594,284, Non Final Office Action malled Dec. 31, 2020”, 12 pgs. [cited by applicant]
“U.S. Appl. No. 15/594,284, Notice of Allowance mailed Oct. 27, 2021”, 13 pgs. [cited by applicant]
“U.S. Appl. No. 15/594,284, Response filed Mar. 31, 2021 to Non Final Office Action mailed Dec. 31, 2020”, 7 pgs. [cited by applicant]
“U.S. Appl. No. 15/594,284, Response filed Apr. 16, 2020 to Non Final Office Action mailed Jan. 16, 2020”, 9 pgs. [cited by applicant]
“U.S. Appl. No. 15/594,284, Response filed Sep. 22, 2021 to Final Office Action mailed May 24, 2021”, 8 pgs. [cited by applicant]
“U.S. Appl. No. 15/594,284, Response filled Dec. 4, 2020 to Final Office Action malled Aug. 4, 2020”, 8 pgs. [cited by applicant]
“U.S. Appl. No. 16/453,471, Applicant Interview Summary filed Feb. 7, 2022”, 1 pg. [cited by applicant]
“U.S. Appl. No. 16/453,471, Examiner Interview Summary mailed Jan. 7, 2022”, 2 pgs. [cited by applicant]
“U.S. Appl. No. 16/453,471, Final Office Action mailed Feb. 25, 2021”, 39 pgs. [cited by applicant]
“U.S. Appl. No. 16/453,471, Non Final Office Action mailed Sep. 25, 2020”, 38 pgs. [cited by applicant]
“U.S. Appl. No. 16/453,471, Non Final Office Action mailed Nov. 2, 2021”, 27 pgs. [cited by applicant]
“U.S. Appl. No. 16/453,471, Notice of Allowance mailed Jan. 25, 2022”, 23 pgs. [cited by applicant]
“U.S. Appl. No. 16/453,471, Response filed Aug. 25, 2021 to Final Office Action mailed Feb. 25, 2021”, 12 pgs. [cited by applicant]
“U.S. Appl. No. 16/453,471, Response Filed Jan. 25, 2021 to Non Final Office Action mailed Sep. 25, 2020”, 12 pgs. [cited by applicant]
“U.S. Appl. No. 16/453,471, Response filed Dec. 2, 2021 to Non Final Office Action mailed Nov. 2, 2021”, 11 pgs. [cited by applicant]
“U.S. Appl. No. 17/538,647, Examiner Interview Summary mailed Jun. 30, 2023”, 2 pgs. [cited by applicant]
“U.S. Appl. No. 17/538,647, Final Office Action mailed Apr. 14, 2023”, 17 pgs. [cited by applicant]
“U.S. Appl. No. 17/538,647, Non Final Office Action mailed Aug. 24, 2023”, 22 pgs. [cited by applicant]
“U.S. Appl. No. 17/538,647, Non Final Office Action mailed Dec. 28, 2022”, 16 pgs. [cited by applicant]
“U.S. Appl. No. 17/538,647, Notice of Allowance mailed Dec. 27, 2023”, 8 pgs. [cited by applicant]
“U.S. Appl. No. 17/538,647, Response filed Mar. 23, 2023 to Non Final Office Action mailed Dec. 28, 2022”, 9 pgs. [cited by applicant]
“U.S. Appl. No. 17/538,647, Response filed Jul. 14, 2023 to Final Office Action malled Apr. 14, 2023”, 10 pgs. [cited by applicant]
“U.S. Appl. No. 17/538,647, Response filed Nov. 20, 2023 to Non Final Office Action mailed Aug. 24, 2023”, 11 pgs. [cited by applicant]
“U.S. Appl. No. 17/538,647, Supplemental Amendment & Response filed Mar. 28, 2023”, 10 pgs. [cited by applicant]
Aggour, Kareem, et al., “Mining company networks for marketing insights and sales eads”, IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, (2013), 805-812. [cited by applicant]
Dubiel, Jorg, “Promoting target models by potential measures”, (2010), 13 pgs. [cited by applicant]
Ramakrishnan, et al., “Automatic sales lead generation from web data”, IEEE, Computer society, Proceedings of the 22nd international conference on Data engineering., (2006), 10 pgs. [cited by applicant]
Yan, Junchi, et al., “Sales pipeline win propensity prediction: A regression approach”, arXiv:1502.06229v1, (2015), 5 pgs. [cited by applicant]
“U.S. Appl. No. 17/450,490, Non Final Office Action mailed Sep. 27, 2024”, 25 pgs. [cited by applicant]
“U.S. Appl. No. 17/450,490, Response filed Jan. 27, 2025 to Non Final Office Action mailed Sep. 27, 2024”, 12 pgs. [cited by applicant]
“U.S. Appl. No. 17/727,662, Notice of Allowance mailed Feb. 20, 2025”, 16 pgs. [cited by applicant]
“U.S. Appl. No. 17/450,490, Notice of Allowance mailed Apr. 9, 2025”, 29 pgs. [cited by applicant]
Chen, Pei-Yu, “Community-Based Recommender Systems: Analyzing Business Models from a Systems Operator's Perspective”, Proceedings of the 42nd Hawaii International Conference on System Sciences, (2009), 10 pgs. [cited by applicant]
Luciano, Patrick, “Increasing loyalty using predictive modeling in Business-to-Business Telecommunication”, Elsevier, (Jun. 10, 2015), 15 pgs. [cited by applicant]
Wang, Tianyong, “The model of Internet marketing program considering 2ls”, (2005), 6 pgs. [cited by applicant]