System for decomposing events from managed infrastructures

1. An event clustering system, comprising: a first engine in communication with a managed infrastructure, the extraction engine in operation receiving messages from the managed infrastructure and produces events that relate to the managed infrastructure and converts the events into words and subsets used to group the events into clusters that relate to failures or errors in the managed infrastructure, including managed infrastructure physical hardware, the managed infrastructure supporting the flow and processing of information;

a second engine that includes one or more of an Non-negative Matrix Factorization NMF engine, a k-means clustering engine and a topology proximity engine, the second engine determining one or more common steps from events and produces clusters relating to events, the second engine determining one or more common characteristics of events and producing clusters of events relating to the failure or errors in the managed infrastructure, where membership in a cluster indicates a common factor of the events that is a failure or an actionable problem in the physical hardware managed infrastructure directed to supporting the flow and processing of information;

the topology proximity engine using a source address for each event and a graph topology of the managed infrastructure which represents node to node connectivity of the topology proximity engine and to assign a graph coordinate to the event with an optional subset of attributes being extracted for each event and turned into a vector, the topology engine inputs a list of devices and a list a connections between components or nodes in the managed infrastructure;

the k-means clustering engine using the graph coordinates and optionally a subset of attributes assigned to each event to generate cluster to bring together events whose characteristics are similar;

the NMF engine factoring a matrix M into A and B, where A is inspected and substantially significant clusters are extracted, and B is used to assign a start and end time to each cluster, wherein an output of clusters is produced; and

wherein in response to production of the clusters one or more physical changes in a managed infrastructure hardware is made.

2. The system of claim 1 , wherein the managed infrastructure is from a business organization.

3. The system of claim 2 , wherein the managed infrastructure includes, computers, network devices, appliances, mobile devices, text or numerical values from which those text or numerical values indicate a state of any hardware or software component of the managed infrastructure.

4. The system of claim 3 , wherein the managed infrastructure generates data that include attributes selected from at least one of, time, source a description of the event, textural or numerical values from which those text or numerical values indicate a state of any hardware or software component of the managed infrastructure.

5. The system of claim 1 , further comprising:

a publication message bus.

6. The system of claim 1 , further comprising:

a data bus web server coupled to one or more user interfaces.

7. The system of claim 5 , wherein a plurality of link access modules are in communication with the data bus.

8. The system of claim 7 , further comprising: a database.

9. The system of claim 8 , wherein the extraction engine reformats data from the events to create reformatted data.

10. The system of claim 9 , wherein the reformatted data is received at the system bus.

11. The system of claim 9 , further comprising:

a database.

12. The system of claim 9 , wherein a dictionary is generated with the word and subtexts using Shannon Entropy, −ln(1/NGen) and normalizes the words and subtexts.

13. The system of claim 12 , wherein normalized words and subtexts are mapped from a common 0.0 to a non-common 1.0.

14. The system of claim 13 , further comprising:

an entropy database that in operation normalizes entropy for events.

15. The system of claim 1 , wherein normalized entropy for events is mapped to a common, 0.0 and a non-common, 1.0.

16. The system of claim 1 , wherein entropy is assigned to alerts.

17. The system of claim 16 , wherein alerts are run in parallel with the activities of the extraction engine.

18. The system of claim 17 , wherein the alerts are passed to a sigalizer engine.

19. The system of claim 1 , wherein the sigalizer engine generates clusters of alerts.

20. A system for clustering events, comprising:

a first engine configured to receive message data from managed infrastructure that includes managed infrastructure physical hardware that supports the flow and processing of information, the managed infrastructure associated with produced events that relate to it, and those events converted into words and subsets used to group the events that relate to failures or errors in the managed infrastructure, including the managed infrastructure physical and virtual hardware and software;

a second engine that determines one or more common characteristics of events and produces clusters of events relating to the failure of errors in the managed infrastructure, where membership in a cluster indicates a common factor of the events that is a failure or an actionable problem in the physical hardware managed infrastructure directed to supporting the flow and processing of information;

a compare and merge engine that receives outputs from the second engine, the compare and merge engine communicating with one or more user interfaces in a situation room; and

wherein in response to production of the clusters making one or more physical changes in the managed infrastructure hardware.

21. The system of claim 20 , wherein the managed infrastructure is from a business organization.

22. The system of claim 21 , wherein the managed infrastructure includes, computers, network devices, appliances, mobile devices, text or numerical values from which those text or numerical values indicate a state of any hardware or software component of the managed infrastructure.

23. The system of claim 22 , wherein the managed infrastructure generates data that include attributes selected from at least one of, time, source a description of the event, textural or numerical values from which those text or numerical values indicate a state of any hardware or software component of the managed infrastructure.

24. The system of claim 20 , further comprising:

a publication message bus.

25. The system of claim 20 , further comprising:

a data bus web server coupled to one or more user interfaces.

26. The system of claim 20 , wherein a plurality of link access modules are in communication with a data bus.

27. The system of claim 20 , further comprising: a database.

28. The system of claim 20 , wherein the extraction engine reformats data from the events to create reformatted data.

29. The system of claim 28 , wherein the reformatted data is received at the system bus.

30. The system of claim 20 , further comprising:

a database.

31. The system of claim 2 , wherein a dictionary is generated with the word and subtexts using Shannon Entropy, −ln(l/NGen) and normalizes the words and subtexts.

32. The system of claim 31 , wherein normalized words and subtexts are mapped from a common 0.0 to a non-common 1.0.

33. The system of claim 20 , further comprising:

an entropy database that in operation normalizes entropy for events.

34. The system of claim 33 , wherein normalized entropy for events is mapped to a common, 0.0 and a non-common, 1.0.

35. The system of claim 1 , wherein entropy is assigned to alerts.

36. The system of claim 35 , wherein alerts are run in parallel with the activities of the extraction engine.

37. The system of claim 35 , wherein the alerts are passed to a sigalizer engine.

38. The system of claim 1 , wherein the sigalizer engine generates clusters of alerts.