System and method for creating buffered firewall logs for reporting
A system for firewall data log processing, comprising a firewall logging system operating on a first processor and configured to cause the first processor to receive firewall log data and to process the firewall log data on a periodic basis to reduce the size of the firewall log data and a firewall reporting system operating on a second processor and configured to process the reduced size firewall log data to generate a report on a user interface that includes one or more analytics from the reduced size firewall data.
1. A system for firewall data log processing, comprising:
a firewall logging system operating on a first processor and being a hardware processor and having a memory configured to execute components of the hardware processor to cause the first processor to receive firewall log data and to process the firewall log data on a periodic basis to reduce a size of the firewall log data;
a firewall reporting system operating on a second processor and configured to process the reduced size firewall log data to generate a report on a user interface that includes one or more analytics from the reduced size firewall data; and
an extract, transform and load service operating on a third processor and configured to extract two or more subsets of data from the firewall log data, to transform the extracted firewall log data into a metadata schema and to load the metadata schema into a data processing system configured to analyze the firewall log data using the metadata schema.
2. The system of claim 1 wherein the extract, transform and load service further comprises a metadata repository configured to receive the metadata schema and to store the metadata schema.
3. The system of claim 1 wherein the extract, transform and load service further comprises a scheduler configured to periodically process an update using the metadata schema.
4. The system of claim 1 wherein the firewall reporting system comprising a window reporting system operating on the second processor and configured to generate a window user interface display for selecting a predetermined period of time.
5. The system of claim 1 wherein the firewall reporting system comprising a window reporting system operating on the second processor and configured to generate a window user interface display for relocating a display for a predetermined period of time.
6. The system of claim 1 wherein the firewall reporting system comprising a window reporting system operating on the second processor and configured to generate a window user interface display for relocating a display of firewall statistics for a predetermined period of time.
7. The system of claim 1 wherein the firewall reporting system comprising a window reporting system operating on the second processor and configured to generate a window user interface display for relocating a display of firewall statistics for a predetermined user for a predetermined period of time.
8. The system of claim 1 wherein the extract, transform and load service further comprises a scheduler configured to periodically process an update using the metadata schema.
9. The system of claim 1 wherein the extract, transform and load service further comprises:
a metadata repository configured to receive the metadata schema and to store the metadata schema; and
a scheduler configured to periodically process an update using the metadata schema.
10. A method for firewall data log processing, comprising:
receiving firewall log data using one or more first algorithms at a first processor that is configured to load and execute the one or more algorithms;
processing the firewall log data on a periodic basis to reduce a size of the firewall log data using the one or more first algorithms and the first processor;
processing the reduced size firewall log data using one or more second algorithms at a second processor to generate a report on a user interface that includes one or more analytics from the reduced size firewall data; and
extracting two or more subsets of data from the firewall log data using one or more third algorithms operating on a third processor, to transform the extracted firewall log data into a metadata schema and to load the metadata schema into a data processing system that is configured to analyze the firewall log data using the metadata schema.
11. The method of claim 10 further comprising receiving the metadata schema and storing the metadata schema.
12. The method of claim 10 further comprising periodically process an update using the metadata schema.
13. The method of claim 10 further comprising generating a window user interface display for selecting a predetermined period of time for a report.
14. The method of claim 10 further comprising generating a window user interface display for relocating a display for reporting data for a predetermined period of time.
15. The method of claim 10 further comprising generating a window user interface display for relocating a display for reporting firewall statistics for a predetermined period of time.
16. The method of claim 10 further comprising generating a window user interface display for relocating a display of firewall statistics for a predetermined user for a predetermined period of time.
17. The method of claim 10 further comprising periodically processing an update using the metadata schema.
18. A system for firewall data log processing, comprising:
a firewall logging system operating on a first processor and being a hardware processor and having a memory configured to execute components of the hardware processor to cause the first processor to receive firewall log data and to process the firewall log data on a periodic basis to reduce a size of the firewall log data;
a firewall reporting system operating on a second processor and configured to process the reduced size firewall log data to generate a report on a user interface that includes one or more analytics from the reduced size firewall data; and
an extract, transform and load service operating on a third processor and configured to extract two or more subsets of data from the firewall log data, to transform the extracted firewall log data into a metadata schema and to load the metadata schema into a data processing system configured to analyze the firewall log data using the metadata schema.
19. The system of claim 18 wherein the extract, transform and load service further comprises a metadata repository configured to receive the metadata schema and to store the metadata schema.
20. The system of claim 18 wherein the extract, transform and load service further comprises a scheduler configured to periodically process an update using the metadata schema.