Method and apparatus for predicting future behavior of data streams
View Patent ↗Techniques are disclosed for predicting the future behavior of data streams through the use of current trends of the data stream. By way of example, a technique for predicting the future behavior of a data stream comprises the following steps/operations. Statistics are obtained from the data stream. Estimated statistics for a future time interval are generated by using at least a portion of the obtained statistics. A portion of the estimated statistics are utilized to generate one or more representative pseudo-data records within the future time interval. Pseudo-data records are utilized for forecasting of at least one characteristic of the data stream.
1. A method of forecasting at least one characteristic of a data stream, comprising a computer performing the steps of:
obtaining statistics from the data stream;
generating estimated statistics for a future time interval based on at least a portion of the obtained statistics;
utilizing at least a portion of the estimated statistics to generate one or more representative pseudo-data records within the future time interval; and
utilizing the one or more pseudo-data records for the forecasting of at least one characteristic of a data stream;
wherein the obtained statistics comprise summary statistics and the step of obtaining statistics from the data stream comprises obtaining at least one of zeroith, first and second order statistics, representing each set of statistics as the sum of the corresponding base statistics, and continually receiving data points from the data stream, and continually updating the data points into the statistics using additive operations;
wherein the step of updating the statistics using additive operations comprises computing a distance between each incoming data point to a centroid of the statistics of the closest cluster, adding the data point to the closest centroid, and updating the corresponding statistics;
wherein the step of generating estimated statistics for a future time interval comprises dividing the interval into two or more time intervals, and the step of dividing the future time interval into two or more time intervals comprises estimating first and second order statistics for each of the time intervals;
wherein the step of generating the one or more pseudo-data records comprises determining a covariance matrix, using the covariance matrix to find eigenvectors and eigenvalues, and using the eigenvectors to construct the psuedo-data.