SYSTEM AND METHOD FOR DEEP CUSTOMIZED NEURAL NETWORKS FOR TIME SERIES FORECASTING
The present teaching relates to method, system, medium, and implementations for machine learning for time series via hierarchical learning. First, global model parameters of a base model are learned via deep learning for forecasting time series measurements of a plurality of time series. Based on the learned base model, target model parameters of a target model are obtained by customizing the base model, wherein the target model corresponds to a specific target time series from the plurality of time series for forecasting time series measurements of the specific target time series.
1 . A method implemented on at least one machine including at least one processor, memory, and communication platform capable of connecting to a network for machine learning for time series, the method comprising:
performing hierarchical learning, which comprises
deep learning global model parameters of a base model for forecasting time series measurements of a plurality of time series, and
obtaining target model parameters of a target model by customizing the base model, wherein the target model corresponds to a target time series from the plurality of time series and is for forecasting time series measurements of the target time series.
2 . The method of claim 1 , wherein
the base model is learned generically for forecasting a time series measurement of any of the plurality time series;
the target model is learned specifically for forecasting a time series measurement of the corresponding target time series.
3 . The method of claim 1 , wherein the step of deep learning comprises:
receiving training data cross the plurality of tine series;
forecasting time series measurements of the training data based on the global model parameters of the base model; and
updating the global model parameters by minimizing a first loss determined based on the forecasted time series measurements from the training data and labels of the training data.
4 . The method of claim 1 , wherein the step of obtaining target model parameters comprises:
initializing the target model parameters for the target model based on target time series measurements forecasted based on the base model and labels of training data from the target time series; and
iteratively updating the target model parameters by minimizing a second loss determined based on a discrepancy between target time series measurements predicted using time series data from the target time series and labels of the time series data from the target time series.
5 . The method of claim 1 , wherein the deep learning of the base model and the customizing the base model are performed simultaneously during the hierarchical learning.
6 . The method of claim 1 , wherein the deep learning of the base model and the customizing the base model are performed in sequence during the hierarchical learning.
7 . The method of claim 3 , wherein the first loss includes a graph based portion related to enrichment of hidden representations associated with the base model.
8 . Machine readable and non-transitory medium having information recorded thereon for machine learning for time series, wherein the information, once read by a machine, causes the machine to perform hierarchical learning by:
deep learning global model parameters of a base model for forecasting time series measurements of a plurality of time series; and
obtaining target model parameters of a target model by customizing the base model, wherein the target model corresponds to a target time series from the plurality of time series and is for forecasting time series measurements of the target time series.
9 . The medium of claim 8 , wherein
the base model is learned generically for forecasting a time series measurement of any of the plurality time series;
the target model is learned specifically for forecasting a time series measurement of the corresponding target time series.
10 . The medium of claim 8 , wherein the step of deep learning comprises:
receiving training data cross the plurality of tine series;
forecasting time series measurements of the training data based on the global model parameters of the base model; and
updating the global model parameters by minimizing a first loss determined based on the forecasted time series measurements from the training data and labels of the training data.
11 . The medium of claim 8 , wherein the step of obtaining target model parameters comprises:
initializing the target model parameters for the target model based on target time series measurements forecasted based on the base model and labels of training data from the target time series; and
iteratively updating the target model parameters by minimizing a second loss determined based on a discrepancy between target time series measurements predicted using time series data from the target time series and labels of the time series data from the target time series.
12 . The medium of claim 8 , wherein the deep learning of the base model and the customizing the base model are performed simultaneously during the hierarchical learning.
13 . The medium of claim 8 , wherein the deep learning of the base model and the customizing the base model are performed in sequence during the hierarchical learning.
14 . The medium of claim 10 , wherein the first loss includes a graph based portion related to enrichment of hidden representations associated with the base model.
15 . A system for machine learning for time series, comprising:
a general deep machine learning mechanism configured for deep learning global model parameters of a base model for forecasting time series measurements of a plurality of time series; and
a customized deep learning mechanism configured for obtaining target model parameters of a target model by customizing the base model, wherein the target model corresponds to a target time series from the plurality of time series and is for forecasting time series measurements of the target time series.
16 . The system of claim 15 , wherein
the base model is learned generically for forecasting a time series measurement of any of the plurality time series;
the target model is learned specifically for forecasting a time series measurement of the corresponding target time series.
17 . The system of claim 15 , wherein the general deep machine learning mechanism performs deep learning by:
receiving training data cross the plurality of tine series;
forecasting time series measurements of the training data based on the global model parameters of the base model; and
updating the global model parameters by minimizing a first loss determined based on the forecasted time series measurements from the training data and labels of the training data.
18 . The system of claim 15 , wherein the customized deep learning mechanism performs obtaining target model parameters by:
initializing the target model parameters for the target model based on target time series measurements forecasted based on the base model and labels of training data from the target time series; and
iteratively updating the target model parameters by minimizing a second loss determined based on a discrepancy between target time series measurements predicted using time series data from the target time series and labels of the time series data from the target time series.
19 . The system of claim 15 , wherein the deep learning of the base model and the customizing the base model are performed simultaneously during the hierarchical learning.
20 . The system of claim 15 , wherein the deep learning of the base model and the customizing the base model are performed in sequence during the hierarchical learning.