IP Library Granted Patent US 12,406,173
Granted Patent B2
US 12,406,173 · App. 17/085,555 · Granted Sep 2, 2025

Covariate processing with neural network execution blocks

Inventors: Daniel Wong (Montreal, CA); Dmitri Carpov (Montreal, CA); Nicolas Chapados (Montreal, CA)
Assignee: ServiceNow, Inc.
G06N3/06G06N3/049G06N3/08
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,406,173
App. No.
17/085,555
Granted
Sep 2, 2025
Kind
B2
Abstract

A method for forecasting future values of a target variable using past values thereof, the values of the target variable being affected by one or more covariates wherein the covariates are independent from the target variable. The method comprises using a covariate-specific AI model, computing a covariate effect of the covariates on the target variable. The covariates effect is a defined modification to the values of the target variable caused by the covariates. The method also comprises computing intrinsic past values of the target variable by removing the covariate effect of the covariates from past values of the target variable. The method further comprises using a target-variable-specific AI model, generating an intrinsic forecast of the future values of the target variable; and computing a forecast that includes the covariate effect using the intrinsic forecast of the future values of the target variable and the covariate effect.

Claims (62)

1. A method for forecasting future values of a target variable using past values thereof, values of the target variable being affected by one or more covariates wherein the one or more covariates are independent from the target variable, the method comprises:

using a covariate-specific AI model, computing a covariate effect of the one or more covariates on the target variable, the covariate effect being a defined modification to the values of the target variable caused by the one or more covariates;

computing intrinsic past values of the target variable by removing the covariate effect of the one or more covariates from past values of the target variable;

using a target-variable-specific AI model, generating an intrinsic forecast of the future values of the target variable; and

computing a forecast that includes the covariate effect using the intrinsic forecast of the future values of the target variable and the covariate effect of the one or more covariates;

wherein the covariate-specific AI model and the target-variable-specific AI model are pre-trained.

2. The method of claim 1 , wherein the target-variable-specific AI model is further for generating an intrinsic backcast of the past values of the target variable, the intrinsic backcast corresponding to the past values of the target variable obtained using the intrinsic forecast of the future values of the target variable.

3. The method of claim 1 , wherein the target-variable-specific AI model is the same as the covariate-specific AI model.

4. The method of claim 1 , wherein the covariate effect is additive or multiplicative.

5. The method of claim 1 , wherein the target-variable-specific AI model is a neural network based model for univariate time series forecasting (N-BEATS).

6. The method of claim 1 , wherein one or more covariate-specific AI models and a plurality of target-variable-specific AI models are used to forecast the future values of the target variable.

7. The method of claim 6 , further comprising:

repeating until each one of the plurality of the target-variable-specific AI models has produced a respective intrinsic partial forecast of the future values of the target variable:

using each target-variable-specific AI model:

generating the respective intrinsic partial forecast of the future values of the target variable; and

generating a respective intrinsic backcast of the past values of the target variable, the respective intrinsic backcast corresponding to the past values of the target variable obtained using the respective intrinsic partial forecast of the future values of the target variable;

computing a respective partial forecast that includes the covariate effect using the respective intrinsic partial forecast of the future values of the target variable and the covariate effect of the one or more covariates;

computing respective residualized past values of the target variable by subtracting the respective intrinsic backcast of the past values of the target variable from the past values of the target variable;

replacing the past values of the target variable by the respective residualized past values of the target variable; and

summing up the respective partial forecasts that include the covariate effect of each iteration to obtain a final forecast of the future values of the target variable.

8. The method of claim 7 , wherein:

using the covariate-specific AI model to compute the covariate effect of the one or more covariates on the target variable, the covariate effect being the defined modification to the values of the target variable caused by the one or more covariates; and

computing the intrinsic past values of the target variable by removing the covariate effect of the one or more covariates from the past values of the target variable;

are performed at a first and second iteration of the method.

9. The method of claim 7 , wherein:

using the covariate-specific AI model to compute the covariate effect of the one or more covariates on the target variable, the covariate effect being the defined modification to the values of the target variable caused by the one or more covariates; and

computing the intrinsic past values of the target variable by removing the covariate effect of the one or more covariates from the past values of the target variable;

are performed at each iteration of the method.

10. The method of claim 7 , wherein at each iteration, a different target-variable-specific AI model is used to generate the respective partial forecast of the future values of the target variable.

11. The method of claim 1 , wherein the target variable is generated by a target variable process, wherein the covariate effect is generated by a covariate process, wherein the covariate process affects the target variable process, and wherein the covariate process is independent from the target variable process.

12. The method of claim 1 , wherein the one or more covariates are price, day of week, day of month, state where a store is located, holidays, or special events.

13. An artificial intelligence server configured for forecasting future values of a target variable using past values thereof, values of the target variable being affected by one or more covariates wherein the one or more covariates are independent from the target variable, the artificial intelligence server comprising:

a memory module for storing the past values of the target variable; and

a processor module configured to:

using a covariate-specific AI model, compute a covariate effect of the one or more covariates on the target variable, the covariate effect being a defined modification to the values of the target variable caused by the one or more covariates;

compute intrinsic past values of the target variable by removing the covariate effect of the one or more covariates from the past values of the target variable;

using a target-variable-specific AI model, generate an intrinsic forecast of the future values of the target variable; and

compute a forecast that includes the covariate effect using the intrinsic forecast of the future values of the target variable and the covariate effect of the one or more covariates,

wherein the covariate-specific AI model and the target-variable-specific AI model are pre-trained.

14. The artificial intelligence server of claim 13 , wherein the target-variable-specific AI model is further for generating an intrinsic backcast of the past values of the target variable, the intrinsic backcast corresponding to past values of the target variable obtained using the intrinsic forecast of the future values of the target variable.

15. The artificial intelligence server of claim 13 , wherein the target-variable-specific AI model is the same as the covariate-specific AI model.

16. The artificial intelligence server of claim 13 , wherein the covariate effect is additive or multiplicative.

17. The artificial intelligence server of claim 13 , wherein the target-variable-specific AI model is a neural network based model for univariate time series forecasting (N-BEATS).

18. The artificial intelligence server of claim 13 , wherein one or more covariate-specific AI models and a plurality of target-variable-specific AI models are used to forecast the future values of the target variable.

19. The artificial intelligence server of claim 18 , wherein the processor module is further configured to:

repeat until each one of the plurality of the target-variable-specific AI models has produced a respective intrinsic partial forecast of the future values of the target variable:

using each target-variable-specific AI model:

generate the respective intrinsic partial forecast of the future values of the target variable; and

generate a respective intrinsic backcast of the past values of the target variable, the respective intrinsic backcast corresponding to past values of the target variable obtained using the respective intrinsic partial forecast of the future values of the target variable;

compute a respective partial forecast that includes the covariate effect using the respective intrinsic partial forecast of the future values of the target variable and the covariate effect of the one or more covariates;

compute respective residualized past values of the target variable by subtracting the respective intrinsic backcast of the past values of the target variable from the past values of the target variable;

replace the past values of the target variable by the respective residualized past values of the target variable; and

sum up the respective partial forecasts that include the covariate effect of each iteration to obtain a final forecast of the future values of the target variable.

20. The artificial intelligence server of claim 19 , wherein the processor module is configured to perform at a first and second iteration:

using the covariate-specific AI model to compute the covariate effect of the one or more covariates on the target variable, the covariate effect being the defined modification to the values of the target variable caused by the one or more covariates; and

compute the intrinsic past values of the target variable by removing the covariate effect of the one or more covariates from the past values of the target variable.

21. The artificial intelligence server of claim 19 , wherein the processor module is configured to perform at each iteration:

using the covariate-specific AI model to compute the covariate effect of the one or more covariates on the target variable, the covariate effect being the defined modification to the values of the target variable caused by the one or more covariates; and

compute the respective intrinsic past values of the target variable by removing the covariate effect of the one or more covariates from the past values of the target variable.

22. The artificial intelligence server of claim 19 , wherein at each iteration, a different target-variable-specific AI model is used to generate the respective partial forecast of the future values of the target variable.

23. The artificial intelligence server of claim 13 , wherein the target variable is generated by a target variable process, wherein the covariate effect is generated by a covariate process, wherein the covariate process affects the target variable process, and wherein the covariate process is independent from the target variable process.

24. The artificial intelligence server of claim 13 , wherein the one or more covariates are price, day of week, day of month, state where a store is located, holidays, or special events.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 26, 2025
From: SERVICENOW CANADA INC.
To: SERVICENOW, INC.
Reel/Frame 070644/0956 →
CERTIFICATE OF ARRANGEMENT Recorded Mar 17, 2023
From: ELEMENT AI INC.
To: SERVICENOW CANADA INC.
Reel/Frame 063115/0666 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 10, 2020
From: WONG, DANIEL; CARPOV, DMITRI; CHAPADOS, NICOLAS
To: ELEMENT AI INC.
Reel/Frame 054326/0430 →
Continuity (1)
Related Publication 20220138539A1 · May 5, 2022
References Cited (16)
US 20160128997A1 · Nasser · 2016 [cited by examiner]
US 20170182070A1 · Lukas · 2017 [cited by examiner]
US 20180276691A1 · Li · 2018 [cited by examiner]
US 20190205737A1 · Bleiweiss · 2019 [cited by examiner]
US 20200090075A1 · Achin et al. · 2020 [cited by applicant]
US 20210150305A1 · Amiri · 2021 [cited by examiner]
US 20230018125A1 · Lim · 2023 [cited by examiner]
CN 106600404A · 2017 [cited by applicant]
CN 111539573A · 2020 [cited by applicant]
Reddi et al. 2015. Doubly robust covariate shift correction. In Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence (AAAl'15). AAAI Press, 2949â2955. (Year: 2015). [cited by examiner]
Persson et al., “Data-driven Algorithms for Dimension Reduction in Causal Inference” 2016, https://arxiv.org/abs/1309.4054 (Year: 2016). [cited by examiner]
Oreshkin et al., “N-BEATS: Neural basis expansion analysis for interpretable time series forecasting” May 24, 2019, https://arxiv.org/abs/1905.10437v1 (Year: 2019). [cited by examiner]
Cohen et al., “Self-Supervised Dynamic Networks for Covariate Shift Robustness” Jun. 6, 2020, https://arxiv.org/abs/2006.03952 (Year: 2020). [cited by examiner]
Contreras-Reyes et al. “Backcasting and forecasting time series using detrended cross-correlation analysis”, Aug. 27, 2020, Physica A: Statistical Mechanics and its Applications, vol. 560, 125109, ISSN 0378-4371, https:… [cited by examiner]
Chen Z. et al., “Tournament Screening cum EBIC for Feature Selection with High Dimensional Feature Spaces”, Science in China Series A Mathematics, Jun. 2009, vol. 52(6), pp. 1327-1341. [cited by applicant]
International Search Report from corresponding PCT application No. PCT/CA2021/051531 dated Dec. 30, 2021. [cited by applicant]