File analytics systems including examples providing metrics adjusted for application operation
Examples of file analytics systems are described that may obtain event data from a virtualized file server. The event data may be aggregated and/or filtered to provide metrics which may be adjusted based on the operation of an application used to accomplish a user action. For example, actions relating to an application's temporary file handling may be aggregated and/or excluded when reporting metrics for the virtualized file server. To facilitate reporting of metrics, the file analytics system may provide a lineage index storing an association between files related through operation of the application used to accomplish the user action.
1. A non-transitory computer readable storage medium encoded with instructions, which, when executed, cause a system to:
generate a lineage index configured to store a lineage between multiple files corresponding to a user action, including a first file requested in the user action and a temporary file generated at least in part responsive to the user action corresponding to the first file, wherein the generating further includes establishing a lineage between the first file and the temporary file;
access the lineage index comprising a set of events from a file system pertaining to the multiple files including the first file and the temporary file;
filter the set of events to retain selected events corresponding to the user action and remove at least one event ancillary to the user action; and
report based on the selected events, wherein the reporting comprises providing a number of files associated with the file system, the number of files determined by excluding at least the temporary one or more of the multiple files based at least on the lineage index.
2. The non-transitory computer readable storage medium of claim 1 , wherein the instructions, when executed, cause the system to generate the lineage index at least in part by storing an association between the first file requested in the user action and the temporary file generated at least in part by renaming the first file.
3. The non-transitory computer readable storage medium of claim 1 , wherein the instructions, when executed, cause the system to generate the lineage index at least in part by storing an association between the temporary file generated responsive to the user action and a new file generated by renaming the temporary file.
4. The non-transitory computer readable storage medium of claim 1 , wherein the instructions, when executed, cause the system to filter the set of events to exclude events corresponding to application processing of the user action.
5. The non-transitory computer readable storage medium of claim 1 , wherein the instructions, when executed, cause the system to receive the set of events through an events pipeline from multiple file server virtual machines (FSVMs) hosting the file system.
6. The non-transitory computer readable storage medium of claim 1 , wherein the instructions, when executed, cause the system to generate the lineage index corresponding to the user action comprising a write to a file using an application, and wherein at least one of the multiple files comprises the file and another comprises the temporary file generated by the application responsive to the user action.
7. The non-transitory computer readable storage medium of claim 1 , wherein the instructions, when executed, cause the system to report based on the selected events including to provide a count of actions associated with the user, wherein the count of actions includes a count of the selected events.
8. The non-transitory computer readable storage medium of claim 1 , wherein the instructions, when executed, cause the system to report based on the selected events including to provide the number of files associated with the file system, wherein the number of files is determined based at least in part on the lineage index.
9. The non-transitory computer readable storage medium of claim 1 , wherein the number of files is further determined based at least on excluding one or more of the multiple files ancillary to the user action.
10. A method comprising:
generating a lineage index comprising a lineage between multiple files corresponding to a user action, including a first file requested in the user action and a temporary file generated at least in part responsive to the user action corresponding to the first file, wherein the generating further includes establishing a lineage between the first file and the temporary file;
accessing the lineage index comprising a set of events from a file system pertaining to the multiple files including the first file and the temporary file;
filtering the set of events to retain selected events corresponding to the user action and remove at least one event ancillary to the user action; and
reporting based at least on the selected events, wherein the reporting comprises providing a number of files associated with the file system, the number of files determined by excluding at least the temporary file based at least on the lineage index.
11. The method of claim 10 , wherein generating the lineage index is based at least in part by storing an association between the first file requested in the user action and the temporary file generated at least in part by renaming the first file, the multiple files comprising the first file and the temporary file.
12. The method of claim 10 , wherein generating the lineage index is further based at least in part by storing an association between the temporary file generated responsive to the user action and a new file generated by renaming the temporary file, the multiple files comprising the temporary file and the new file.
13. The method of claim 10 , the method further comprising filtering the set of events to exclude events corresponding to application processing of the user action.
14. The method of claim 10 , the method further comprising receiving the set of events through an events pipeline from multiple file server virtual machines (FSVMs) hosting the file system.
15. The method of claim 10 , the method further comprising generating the lineage index corresponding to the user action comprising a write to a file using an application, and wherein at least one of the multiple files comprises the file and another comprises the temporary file generated by the application responsive to the user action.
16. The method of claim 10 , wherein the reporting is further based on the selected events including to provide a count of actions associated with the user, wherein the count of actions includes a count of the selected events.
17. The method of claim 10 , wherein the reporting is further based on the selected events including to provide the number of files associated with the file system, wherein the number of files is determined based at least in part on the lineage index.
18. The method of claim 10 , wherein the number of files is further determined based at least on excluding one or more of the multiple files ancillary to the user action.
19. A system comprising:
a distributed file server comprising a plurality of file server virtual machines (FSVMs); and
an analytics system, the analytics system configured to:
generate a lineage index configured to store a lineage between multiple files corresponding to a user action, including a first file requested in the user action and a temporary file generated at least in part responsive to the user action corresponding to the first file, wherein the generating further includes establishing a lineage between the first file and the temporary file;
access the lineage index comprising a set of events from a file system pertaining to the multiple files including the first file and the temporary file;
filter the set of events to retain selected events corresponding to the user action and remove at least one event ancillary to the user action; and
report based at least on the selected events, wherein the reporting comprises providing a number of files associated with the file system, the number of files determined by excluding at least the temporary file based at least on the lineage index.
20. The system of claim 19 , wherein the analytics system is configured to generate the lineage index based at least in part on storing an association between the first file requested in the user action and the temporary file generated at least in part by renaming the first file, the multiple files comprising the first file and the temporary file.
21. The system of claim 19 , wherein the analytics system is configured to generate the lineage index based at least in part on storing an association between the temporary file generated responsive to the user action and a new file generated by renaming the temporary file, the multiple files comprising the temporary file and the new file.
22. The system of claim 19 , wherein the analytics system is configured to filter the set of events to exclude events corresponding to application processing of the user action.
23. The system of claim 19 , wherein the analytics system is configured to receive the set of events through an events pipeline from multiple file server virtual machines (FSVMs) hosting the file system.
24. The system of claim 19 , wherein the analytics system is configured to generate the lineage index corresponding to the user action comprising a write to a file using an application, and wherein at least one of the multiple files comprises the file and another comprises the temporary file generated by the application responsive to the user action.
25. The system of claim 19 , wherein the reporting is further based on the selected events including to provide a count of actions associated with the user, wherein the count of actions includes a count of the selected events.
26. The system of claim 19 , the reporting is further based on the selected events including to provide the number of files associated with the file system, wherein the number of files is determined based at least in part on the lineage index.
27. The system of claim 19 , wherein the reporting is further based on the selected events including to provide a number of files associated with the file system, wherein the number of files is determined by excluding one or more of the multiple files based at least on the lineage index.
28. The system of claim 19 , wherein, plurality of file server virtual machines (FSVMs) is a cluster of FSVMs.
29. The system of claim 27 , wherein the number of files is further determined based at least on excluding one or more multiple files ancillary to the user action.