Methods and apparatus of analyzing electrical power grid data

1. A method of processing large-scale data regarding an electrical power grid, the method comprising:

accessing a large-scale data set comprising information regarding an electrical power grid;

processing data of the large-scale data set to identify a filter which is configured to remove erroneous data from the large-scale data set;

using the filter, removing erroneous data from the large-scale data set; and

after the removing, processing data of the large-scale data set to identify an event detector which is configured to identify events of interest in the large-scale data set.

2. The method of claim 1 further comprising applying the event detector to the large-scale data set to identify the events of interest.

3. The method of claim 1 wherein the processing to identify the filter comprises processing a data subset of the large-scale data set, the removing comprises applying the filter to the data subset, and the processing to identify the event detector comprises processing the data subset.

4. The method of claim 3 further comprising applying the filter to the large-scale data set and applying the event detector to the large-scale data set after the applying the filter to the large-scale data set.

5. The method of claim 1 wherein the processing to identify the filter comprises:

defining an initial filter;

applying the initial filter to the data,

using results of the applying, revising the initial filter; and

applying the revised filter to the data.

6. The method of claim 1 further comprising identifying a data subset of the large-scale data set, and wherein the processing to identify the filter comprises processing the data of the data subset by:

defining parameters of the filter using the data subset;

applying the filter to the data subset; and

adjusting the parameters using results of the applying.

7. The method of claim 6 further comprising generating statistics regarding a characteristic of the electrical power grid, and the defining parameters comprises defining the parameters using the statistics.

8. The method of claim 6 wherein one of the parameters comprises a threshold of a length of time for a frequency provided by a phasor measurement unit (PMU) to be non-varying and indicative of a type of the erroneous data.

9. The method of claim 1 further comprising applying the event detector to a real-time data stream.

10. The method of claim 1 wherein the information comprises time series data obtained from an electrical power grid.

11. The method of claim 1 wherein the data is sensor data obtained from a plurality of sensors as a result of the sensors monitoring an electrical power grid.

12. A method of defining a model to be used to process large-scale data regarding an electrical power grid, the method comprising:

accessing a large-scale data set comprising information regarding a characteristic of an electrical power grid;

identifying a data subset of the large-scale data set;

processing the data subset to provide statistics of the characteristic of the electrical power grid; and

using the statistics, defining a model which is configured to process the information regarding the characteristic of an electrical power grid of the large-scale data set.

13. The method of claim 12 wherein the defining the model comprises:

specifying parameters of the model corresponding to the characteristic;

applying the model to the data subset; and

revising the parameters using results of the applying.

14. The method of claim 12 wherein the defining the model comprises defining a filter configured to remove erroneous data from the large-scale data set.

15. The method of claim 14 further comprising removing erroneous data from the data subset using the filter, and further comprising defining an event detector configured to identify events of interest within the large-scale data set after the removing.

16. The method of claim 12 wherein the defining the model comprises defining an event detector configured to identify events of interest using the information regarding the characteristic of the electrical power grid.

17. The method of claim 12 wherein the large-scale data comprises information regarding the characteristic of the electrical power grid comprising frequency generated by a plurality of phasor measurement units (PMUs) monitoring the electrical power grid.

18. The method of claim 12 wherein the processing comprises processing using distributed parallel processing, and further comprising, after the identifying, providing the data subset into a format suitable for distributed parallel processing.

19. A method of processing large-scale data regarding an electrical power grid, the method comprising:

identifying events of interest and erroneous data in a data subset of a large-scale data set which comprises information regarding an electrical power grid;

using the identified erroneous data, developing a filter to identify and remove the erroneous data;

applying the filter to remove the erroneous data;

using the identified events of interest, developing an event detector to identify the events of interest; and

after the applying the filter, applying the event detector to identify the events of interest.

20. The method of claim 19 wherein the developing the filter comprises defining a filter, applying the filter to the data subset, and revising the filter using results of the applying the filter to the data subset.

21. The method of claim 20 wherein the developing the event detector comprises developing using the data subset.

22. The method of claim 19 wherein the applyings of the filter and the event detector comprise applyings of the filter and the event detector to the large-scale data set.

23. The method of claim 19 wherein the applyings of the filter and the event detector comprise applyings of the filter and the event detector to data in real time.

24. The method of claim 19 further comprising storing the events of interest in a repository for subsequent access.