IP Library › Granted Patent US 12,493,797
Granted Patent B2
US 12,493,797 · App. 17/742,747 · Granted Dec 9, 2025

Multi-level time series forecasting using artificial intelligence techniques

Inventors: Kailash Talreja (Mumbai, IN); Kuruba Ajay Kumar (Andhra Pradesh, IN); Saurabh Jha (Bangalore, IN)
Assignee: Dell Products L.P.
G06N3/088
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,493,797
App. No.
17/742,747
Granted
Dec 9, 2025
Kind
B2
Abstract

Methods, apparatus, and processor-readable storage media for multi-level time series forecasting using artificial intelligence techniques are provided herein. An example computer-implemented method includes determining entity-related features and temporal features from at least a portion of one or more sets of time series data pertaining to at least one entity; creating multiple embeddings by encoding at least a portion of the entity-related features and at least a portion of the temporal features using at least one artificial intelligence-based embedding technique; processing the multiple embeddings using at least one neural network-based attention technique; generating one or more data forecasts across one or more temporal granularity levels by processing at least a portion of results from the processing of the multiple embeddings using at least one artificial intelligence-based categorization technique; and performing one or more automated actions based at least in part on the one or more data forecasts.

Claims (41)

1 . A computer-implemented method comprising:

determining one or more entity-related features and one or more temporal features from at least a portion of one or more sets of time series data pertaining to at least one entity;

creating multiple embeddings by encoding at least a portion of the one or more entity-related features and at least a portion of the one or more temporal features using at least one embedding-based neural network comprising at least one embedding layer;

processing the multiple embeddings using at least one multi-head attention-based neural network comprising at least one intra-sample attention layer, which generates at least one weighted scalar product from one or more portions of the multiple embeddings, and at least one additional attention layer, which generates, using the at least one weighted scalar product, one or more eigenvectors and one or more corresponding eigenvalues;

generating one or more data forecasts across one or more temporal granularity levels by processing at least a portion of results from the processing of the multiple embeddings using at least one categorization-based neural network comprising at least one feed forward layer; and

performing one or more automated actions based at least in part on the one or more data forecasts;

wherein the method is performed by at least one processing device comprising a processor coupled to a memory.

2 . The computer-implemented method of claim 1 , wherein processing at least a portion of results from the processing of the multiple embeddings using at least one categorization-based neural network comprises processing at least a portion of the results from the processing of the multiple embeddings using at least one one-shot learning technique.

3 . The computer-implemented method of claim 1 , wherein performing one or more automated actions comprises automatically training the at least one categorization-based neural network based at least in part on the one or more data forecasts.

4 . The computer-implemented method of claim 1 , wherein performing one or more automated actions comprises automatically initiating at least one action, in connection with one or more external systems, in response to at least a portion of the one or more data forecasts.

5 . The computer-implemented method of claim 1 , wherein determining one or more entity-related features and one or more temporal features comprises selecting fractions of time series data across multiple samples within the one or more sets of time series data.

6 . The computer-implemented method of claim 1 , further comprising:

training the at least one embedding-based neural network based at least in part on combining inter-sample information and intra-sample information across multiple samples within the one or more sets of time series data.

7 . The computer-implemented method of claim 1 , wherein generating the one or more data forecasts comprises processing the at least a portion of results from the processing of the multiple embeddings using at least one masked eigen-score-based attention mechanism in conjunction with one or more one-shot learning prediction components.

8 . A non-transitory processor-readable storage medium having stored therein program code of one or more software programs, wherein the program code when executed by at least one processing device causes the at least one processing device:

to determine one or more entity-related features and one or more temporal features from at least a portion of one or more sets of time series data pertaining to at least one entity;

to create multiple embeddings by encoding at least a portion of the one or more entity-related features and at least a portion of the one or more temporal features using at least one embedding-based neural network comprising at least one embedding layer;

to process the multiple embeddings using at least one multi-head attention-based neural network comprising at least one intra-sample attention layer, which generates at least one weighted scalar product from one or more portions of the multiple embeddings, and at least one additional attention layer, which generates, using the at least one weighted scalar product, one or more eigenvectors and one or more corresponding eigenvalues;

to generate one or more data forecasts across one or more temporal granularity levels by processing at least a portion of results from the processing of the multiple embeddings using at least one categorization-based neural network comprising at least one feed forward layer; and

to perform one or more automated actions based at least in part on the one or more data forecasts.

9 . The non-transitory processor-readable storage medium of claim 8 , wherein processing at least a portion of results from the processing of the multiple embeddings using at least one categorization-based neural network comprises processing at least a portion of the results from the processing of the multiple embeddings using at least one one-shot learning technique.

10 . The non-transitory processor-readable storage medium of claim 8 , wherein performing one or more automated actions comprises automatically training the at least one categorization-based neural network based at least in part on the one or more data forecasts.

11 . The non-transitory processor-readable storage medium of claim 8 , wherein performing one or more automated actions comprises automatically initiating at least one action, in connection with one or more external systems, in response to at least a portion of the one or more data forecasts.

12 . The non-transitory processor-readable storage medium of claim 8 , wherein determining one or more entity-related features and one or more temporal features comprises selecting fractions of time series data across multiple samples within the one or more sets of time series data.

13 . The non-transitory processor-readable storage medium of claim 8 , wherein the program code when executed by the at least one processing device further causes the at least one processing device:

to train the at least one embedding-based neural network based at least in part on combining inter-sample information and intra-sample information across multiple samples within the one or more sets of time series data.

14 . An apparatus comprising:

at least one processing device comprising a processor coupled to a memory;

the at least one processing device being configured:

to determine one or more entity-related features and one or more temporal features from at least a portion of one or more sets of time series data pertaining to at least one entity;

to create multiple embeddings by encoding at least a portion of the one or more entity-related features and at least a portion of the one or more temporal features using at least one embedding-based neural network comprising at least one embedding layer;

to process the multiple embeddings using at least one multi-head attention-based neural network comprising at least one intra-sample attention layer, which generates at least one weighted scalar product from one or more portions of the multiple embeddings, and at least one additional attention layer, which generates, using the at least one weighted scalar product, one or more eigenvectors and one or more corresponding eigenvalues;

to generate one or more data forecasts across one or more temporal granularity levels by processing at least a portion of results from the processing of the multiple embeddings using at least one categorization-based neural network comprising at least one feed forward layer; and

to perform one or more automated actions based at least in part on the one or more data forecasts.

15 . The apparatus of claim 14 , wherein processing at least a portion of results from the processing of the multiple embeddings using at least one categorization-based neural network comprises processing at least a portion of the results from the processing of the multiple embeddings using at least one one-shot learning technique.

16 . The apparatus of claim 14 , wherein performing one or more automated actions comprises automatically training the at least one categorization-based neural network based at least in part on the one or more data forecasts.

17 . The apparatus of claim 14 , wherein performing one or more automated actions comprises automatically initiating at least one action, in connection with one or more external systems, in response to at least a portion of the one or more data forecasts.

18 . The apparatus of claim 14 , wherein determining one or more entity-related features and one or more temporal features comprises selecting fractions of time series data across multiple samples within the one or more sets of time series data.

19 . The apparatus of claim 14 , wherein the at least one processing device is further configured:

to train the at least one embedding-based neural network based at least in part on combining inter-sample information and intra-sample information across multiple samples within the one or more sets of time series data.

20 . The apparatus of claim 14 , wherein generating the one or more data forecasts comprises processing the at least a portion of results from the processing of the multiple embeddings using at least one masked eigen-score-based attention mechanism in conjunction with one or more one-shot learning prediction components.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 12, 2022
From: TALREJA, KAILASH; KUMAR, KURUBA AJAY; JHA, SAURABH
To: DELL PRODUCTS L.P.
Reel/Frame 059988/0329 →
Continuity (1)
Related Publication 20230368035A1 · Nov 16, 2023
References Cited (21)
US 9378200B1 · Cohen et al. · 2016 [cited by applicant]
US 9672279B1 · Cohen et al. · 2017 [cited by applicant]
US 10127304B1 · Cohen et al. · 2018 [cited by applicant]
US 10235452B1 · Savir et al. · 2019 [cited by applicant]
US 10803399B1 · Cohen et al. · 2020 [cited by applicant]
US 11281969B1 · Rangapuram · 2022 [cited by examiner]
US 20170337487A1 · Nock · 2017 [cited by examiner]
US 20200265192A1 · Lin · 2020 [cited by examiner]
US 20210241929A1 · Vishwakarma · 2021 [cited by examiner]
US 20220108195A1 · Kehler · 2022 [cited by examiner]
US 20220121921A1 · Chen · 2022 [cited by examiner]
Wikipedia, Robotic process automation, https://en.wikipedia.org/w/index.php?title=Robotic_process_automation&oldid=1084045031 , Apr. 22, 2022. [cited by applicant]
Wikipedia, ABBYY Fine Reader, https://en.wikipedia.org/w/index.php?title=ABBYY_FineReader&oldid=1082321823 , Apr. 12, 2022. [cited by applicant]
Wikipedia, Alteryx, https://en.wikipedia.org/w/index.php?title=Alteryx&oldid=1078943432 , Mar. 24, 2022. [cited by applicant]
Wikipedia, Microsoft Azure, https://en.wikipedia.org/w/index.php?title=Microsoft_Azure&oldid=1085299553 , Apr. 29, 2022. [cited by applicant]
Entrinsik.com, https://entrinsik.com/informer/ , May 5, 2022. [cited by applicant]
Wikipedia, Long short-term memory, https://en.wikipedia.org/w/index.php?title=Long_short-term_memory&oldid=1085879235 , May 2, 2022. [cited by applicant]
Wikipedia, Autoregressive integrated moving average, https://en.wikipedia.org/w/index.php?title=Autoregressive_integrated_moving_average&oldid=1086361303 , May 5, 2022. [cited by applicant]
Nishida, K., Exploratory.io, An Introduction to Time Series Forecasting with Prophet in Exploratory, Apr. 12, 2017. [cited by applicant]
Rigby, J., TowardsDataScience.com, AddressNet: How to build a robust street address parser using a Recurrent Neural Network, Dec. 5, 2018. [cited by applicant]
Github.com, Libpostal, https://github.com/openvenues/libpostal , May 5, 2022. [cited by applicant]