IP Library › Granted Patent US 12,614,115
Granted Patent B2
US 12,614,115 · App. 18/152,879 · Granted Apr 28, 2026

Systems and methods for indicator identification

Inventors: Aurghya Maiti (Kolkata, IN); Iftikhar Ahamath Burhanuddin (Karnataka, IN); Atanu R. Sinha (Kodbisanahalli, IN); Saurabh Mahapatra (Sunnyvale, CA); Fan Du (Milpitas, CA)
Assignee: ADOBE INC.
G06N20/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,614,115
App. No.
18/152,879
Granted
Apr 28, 2026
Kind
B2
Abstract

One aspect of a method for data processing includes identifying target time series data for a target metric and candidate time series data for a plurality of indicators predictive of the target metric; training a machine learning model to predict the target time series data based on the candidate time series data; computing first through third predictivity values based on the machine learning model, wherein the first predictivity value indicates that a source indicator from the plurality of indicators is predictive of the target metric, the second predictivity value indicates that an intermediate indicator from the plurality of indicators is predictive of the target metric, and the third predictivity value indicates that the source indicator is predictive of the intermediate indicator; and displaying a portion of the candidate time series data corresponding to the intermediate indicator and the source indicator based on the first through third predictivity values.

Claims (64)

1 . A method for data processing, comprising:

identifying, by a data component, target time series data for a target metric and candidate time series data for a plurality of indicators predictive of the target metric, wherein each of the plurality of indicators comprises a metric different from the target metric;

training, by a training component, a machine learning model to predict the target time series data based on the candidate time series data;

identifying, by a prediction component, a plurality of indicator pairs including a first pair comprising a source indicator from the plurality of indicators and the target metric, a second pair comprising an intermediate indicator from the plurality of indicators and the target metric, and a third pair comprising the source indicator and the intermediate indicator;

computing, by the prediction component, a first predictivity value for the first pair, a second predictivity value for the second pair, and a third predictivity value for the third pair based on the machine learning model and the plurality of indicator pairs, wherein the first predictivity value indicates that the source indicator from the plurality of indicators is predictive of the target metric, wherein the second predictivity value indicates that the intermediate indicator from the plurality of indicators is predictive of the target metric, and wherein the third predictivity value indicates that the source indicator is predictive of the intermediate indicator; and

generating, by a graph component, a graph including the target metric and the plurality of indicators based on the first predictivity value, the second predictivity value, and the third predictivity value, wherein the graph includes a first edge between the source indicator and the target metric, a second edge between the intermediate indicator and the target metric, and a third edge between the source indicator and the intermediate indicator.

2 . The method of claim 1 , further comprising:

displaying, by a user interface, a portion of the candidate time series data corresponding to the intermediate indicator and the source indicator based on the first predictivity value, the second predictivity value, and the third predictivity value.

3 . The method of claim 1 , further comprising:

collecting, by the data component, additional time series data for the intermediate indicator and the source indicator based on the first predictivity value, the second predictivity value, and the third predictivity value; and

generating, by the prediction component, a prediction for the target metric based on the additional time series data.

4 . The method of claim 1 , further comprising:

identifying, by the prediction component, a first time horizon, wherein the source indicator is predictive of the target metric at the first time horizon;

identifying, by the prediction component, a second time horizon that is less than the first time horizon, wherein the intermediate indicator is predictive of the target metric at the second time horizon; and

identifying, by the prediction component, a third time horizon based on the first time horizon and the second time horizon, wherein the source indicator is predictive of the intermediate indicator at the third time horizon.

5 . The method of claim 4 , wherein:

the third time horizon is equal to a difference between the first time horizon and the second time horizon.

6 . The method of claim 4 , wherein:

the first time horizon, the second time horizon, and the third time horizon are identified based on the machine learning model.

7 . The method of claim 6 , further comprising:

identifying, by the prediction component, prediction error values for each of a plurality of time horizons, wherein the first time horizon, the second time horizon, and the third time horizon are identified based on the prediction error values.

8 . The method of claim 4 , further comprising:

receiving, by the prediction component, time horizon input from a user, wherein the first time horizon, the second time horizon, and the third time horizon are identified based on the time horizon input.

9 . The method of claim 1 , further comprising:

generating, by the prediction component, predictivity values for the plurality of indicators, respectively, based on the machine learning model; and

ranking, by the prediction component, the plurality of indicators based on the predictivity values.

10 . The method of claim 1 , further comprising:

ranking, by the prediction component, the plurality of indicator pairs.

11 . A method for data processing, comprising:

identifying, by a data component, target time series data for a target metric and candidate time series data for a plurality of indicators predictive of the target metric;

training, by a training component, a machine learning model to predict the target time series data based on the candidate time series data;

identifying, by a prediction component, a plurality of indicator pairs including a first pair comprising a source indicator from the plurality of indicators and the target metric, a second pair comprising an intermediate indicator from the plurality of indicators and the target metric, and a third pair comprising the source indicator and the intermediate indicator;

identifying, by the prediction component, a first time horizon for the source indicator from the plurality of indicators, wherein the source indicator is predictive of the target metric at the first time horizon;

identifying, by the prediction component, a second time horizon for the intermediate indicator from the plurality of indicators, wherein the intermediate indicator is predictive of the target metric at the second time horizon;

identifying, by the prediction component, a third time horizon for the source indicator, wherein the source indicator is predictive of the intermediate indicator at the third time horizon; and

generating, by a graph component, a graph including the target metric and the plurality of indicators based on the first time horizon, the second time horizon, and the third time horizon, wherein the graph includes a first edge between the source indicator and the target metric, a second edge between the intermediate indicator and the target metric, and a third edge between the source indicator and the intermediate indicator.

12 . The method of claim 11 , wherein:

the second time horizon is less than the first time horizon; and

the third time horizon is based on the first time horizon and the second time horizon.

13 . The method of claim 12 , wherein:

the third time horizon is equal to a difference between the first time horizon and the second time horizon.

14 . The method of claim 11 , wherein:

the first time horizon, the second time horizon, and the third time horizon are identified based on the machine learning model.

15 . The method of claim 14 , further comprising:

identifying, by the prediction component, prediction error values for each of a plurality of time horizons, wherein the first time horizon, the second time horizon, and the third time horizon are identified based on the prediction error values.

16 . The method of claim 11 , further comprising:

receiving, by the prediction component, time horizon input from a user, wherein the first time horizon, the second time horizon, and the third time horizon are identified based on the time horizon input.

17 . The method of claim 16 , further comprising:

generating, by the prediction component, predictivity values for the plurality of indicators, respectively, based on the machine learning model; and

ranking, by the prediction component, the plurality of indicators based on the predictivity values.

18 . The method of claim 11 , further comprising:

identifying, by the prediction component, a plurality of indicator pairs, wherein each of the plurality of indicator pairs includes a first element and a second element; and

ranking, by the prediction component, the plurality of indicator pairs, wherein the source indicator and the intermediate indicator are identified based on the ranking.

19 . An apparatus for data processing, comprising:

a processor;

a memory storing instructions executable by the processor;

a data component executable by the processor to identify target time series data for a target metric and candidate time series data for a plurality of indicators predictive of the target metric;

a training component executable by the processor to train a machine learning model to predict the target time series data based on the candidate time series data;

a prediction component executable by the processor to;

identify a plurality of indicator pairs including a first pair comprising a source indicator from the plurality of indicators and the target metric, a second pair comprising an intermediate indicator from the plurality of indicators and the target metric, and a third pair comprising the source indicator and the intermediate indicator, and

compute a first predictivity value for the first pair, a second predictivity value for the second pair, and a third predictivity value for the third pair based on the machine learning model and the plurality of indicator pairs, wherein the first predictivity value indicates that the source indicator from the plurality of indicators is predictive of the target metric, wherein the second predictivity value indicates that the intermediate indicator from the plurality of indicators is predictive of the target metric, and wherein the third predictivity value indicates that the source indicator is predictive of the intermediate indicator; and

a graph component configured to generate a graph including the target metric and the plurality of indicators based on the first predictivity value, the second predictivity value, and the third predictivity value, wherein the graph includes a first edge between the source indicator and the target metric, a second edge between the intermediate indicator and the target metric, and a third edge between the source indicator and the intermediate indicator.

20 . The apparatus of claim 19 , further comprising:

a user interface configured to display a portion of the candidate time series data corresponding to the source indicator and the intermediate indicator based on the first predictivity value, the second predictivity value, and the third predictivity value.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 11, 2023
From: MAITI, AURGHYA; BURHANUDDIN, IFTIKHAR AHAMATH; SINHA, ATANU R.; MAHAPATRA, SAURABH; DU, FAN
To: ADOBE INC.
Reel/Frame 062341/0071 →
Continuity (1)
Related Publication 20240232702A1 · Jul 11, 2024
References Cited (52)
US 6928398B1 · Fang · 2005 [cited by examiner]
US 8423454B2 · Chen · 2013 [cited by examiner]
US 10185893B2 · Townsend · 2019 [cited by examiner]
US 10360527B2 · Abe · 2019 [cited by examiner]
US 10671931B2 · Bansal · 2020 [cited by examiner]
US 10909095B2 · Suleiman · 2021 [cited by examiner]
US 11093837B2 · Oliner · 2021 [cited by examiner]
US 11262743B2 · Shetty B · 2022 [cited by examiner]
US 11429653B2 · Palanciuc · 2022 [cited by examiner]
US 11443015B2 · Modarresi · 2022 [cited by examiner]
US 11769100B2 · Sinha · 2023 [cited by examiner]
US 11829855B2 · Shrivastava · 2023 [cited by examiner]
US 11935077B2 · Kaveetil · 2024 [cited by examiner]
US 20120173399A1 · Chen et al. · 2012 [cited by applicant]
US 20160142266A1 · Carroll · 2016 [cited by examiner]
US 20170220939A1 · Bansal · 2017 [cited by examiner]
US 20180046926A1 · Achin · 2018 [cited by examiner]
US 20180218269A1 · Oliner et al. · 2018 [cited by applicant]
US 20180300621A1 · Shah et al. · 2018 [cited by applicant]
US 20200159203A1 · Shetty et al. · 2020 [cited by applicant]
US 20200257992A1 · Achin · 2020 [cited by examiner]
US 20210350175A1 · Chauhan · 2021 [cited by examiner]
US 20220188383A1 · Doan Huu · 2022 [cited by examiner]
US 20220383224A1 · Sinha · 2022 [cited by examiner]
US 20230012177A1 · Ghalyan · 2023 [cited by examiner]
CN 109711714 · 2019 [cited by applicant]
CN 111915892 · 2020 [cited by applicant]
WO 2019051701 · 2019 [cited by applicant]
Final Office Action dated Mar. 16, 2023 in corresponding U.S. Appl. No. 17/329,934. [cited by applicant]
Talebi, et al., “Finding Leading Indicators of Fatigue in Operational Data Sets”, Department of Mining Engineering, University of Utah, Salt Lake City, UT 84112, USA 2021, (Year: 2021). [cited by applicant]
Babecky, et al., “Leading Indicators of Crisis Incidence Evidence from Developed Countries”, European Central Bank, Working Paper Series No. 1486 / Oct. 2012. (Year: 2012). [cited by applicant]
Stock, et al., “Forecasting with Leading Indicators: Lessons from the 1990 Recession in the United States”, Prepared for the meeting of the Ekonomiska Radet, Konjunkturinstitutes, Stockholm, Sweden. Oct. 5-6, 1992. (Yea… [cited by applicant]
Gregorova, et al., “Learning Predictive Leading Indicators for Forecasting Time Series Systems with Unknown Clusters of Forecast Tasks”, Geneva school of Business Administration, HES-SO University of Applied Sciences of… [cited by applicant]
St. Louis Fed, “Leading Indicator Series”, Nov. 21, 2022, available at https://fred.stlouisfed.org/tags/series?t=leading+indicator, 7 pages. [cited by applicant]
Petnehazi, “Recurrent Neural Networks for Time Series Forecasting”, arXiv preprint arXiv:1901.00069v1 [cs.LG] Jan. 1, 2019, 22 pages. [cited by applicant]
Federal Reserve Bank of New York, “The Yield Curve as a Leading Indicator”, Nov. 21, 2022, available at https://www.newyorkfed.org/research/capital_markets/ycfaq.html#/, 1 page. [cited by applicant]
Schrage, et al., “Leading With Next-Generation Key Performance Indicators”, Jun. 26, 2018, available at https://sloanreview.mit.edu/projects/leading-with-next-generation-key-performance-indicators/, 6 pages. [cited by applicant]
McGuckin, et al., “The Composite Index of Leading Economic Indicators: How to Make It More Timely”, National Bureau of Economic Research Working Paper 8430, Aug. 2001, 32 pages. [cited by applicant]
Stock, et al., “New Indexes of Coincident and Leading Economic Indicators”, NBER Macroeconomics Annual 1989, vol. 4, Mar. 10, 1989, pp. 351-409, 60 pages. [cited by applicant]
Mostaghimi, “Monetary Policy, Composite Leading Economic Indicators and Predicting the 2001 Recession”, Journal of Forecasting, 23(7), 463-477, Oct. 29, 2004, available at https://onlinelibrary.wiley.com/doi/abs/10.1002… [cited by applicant]
Borden, et al., “Gauging internal efficiency and effectiveness with leading and lagging indicators”, Dec. 14, 2017, available at https://www.mckinsey.com/business-functions/operations/our-insights/gauging-internal-effic… [cited by applicant]
Pai, et al., “A hybrid ARIMA and support vector machines model in stock price forecasting”, Omega, 33 (2005), pp. 497-505, Sep. 16, 2004, 9 pages. [cited by applicant]
Trask, “To Build A Better Marketing Plan, Revisit Your Approach To Planning”, Sep. 2, 2021, available at https://www.forrester.com/blogs/dynamic-marketing-planning/, 9 pages. [cited by applicant]
Mawhinney, “What is a KPI? How To Choose the Best KPIs for Your Business”, Sep. 28, 2022, available at https://blog.hubspot.com/marketing/choosing-kpis, 29 pages. [cited by applicant]
Yeo, “How Will You Measure Your Digital Success?”, Dec. 6, 2021, available at https://blogs.gartner.com/gladys-yeo/2021/12/06/how-will-you-measure-your-digital-success/, 5 pages. [cited by applicant]
Coelho, “This is How Often You Really Should Track Each of Your Marketing Metrics in 2019”, Feb. 22, 2018, available at https://www.impactplus.com/blog/how-often-track-marketing-metrics, 16 pages. [cited by applicant]
Patel, “How Long Does It Take to See Digital Marketing Results?”, Sep. 2, 2016, available at https://www.linkedin.com/pulse/how-long-does-take-see-digital-marketing-results-neil-patel, 12 pages. [cited by applicant]
Alexander, “The Who, What, Why, & How of Digital Marketing”, Aug. 24, 2022, available at https://blog.hubspot.com/marketing/what-is-digital-marketing, 40 pages. [cited by applicant]
Rahal, “Measuring Success: Six Digital Marketing Metrics and KPIs For 2021”, Apr. 28, 2021, available at https://www.forbes.com/sites/forbescommunicationscouncil/2021/04/28/measuring-success-six-digital-marketing-metric… [cited by applicant]
Webfx, “14 Digital Marketing Metrics to Measure”, Nov. 21, 2022, available at https://www.webfx.com/digital-marketing/learn/digital-marketing-metrics/, 24 pages. [cited by applicant]
Iyetomo, et al., “Relationship between Macroeconomic Indicators and Economic Cycles in U.S.”, Scientific Reports vol. 10, Article 8420, May 21, 2020, 12 pages. [cited by applicant]
Guo, et al., “Exploring Interpretable LSTM Neural Networks over Multi-Variable Data”, arXiv preprint arXiv:1905.12034v1 [cs.LG] May 28, 2019, 17 pages. [cited by applicant]