Systems data availability validation
A network connection between a server group of a data intake and query system and each of one or more source network nodes is established. Source data at the server group is received from at least one of the one or more source network nodes via the respective network connections and transformed, by the indexer server, to timestamped data entries of machine data. A model management server detects data constraints for a security model that include a data element used by the security model and an availability requirement set. Using the timestamped data entries, the data constraints are validated, and the validation used to determine a data availability assessment of the security model.
1. A method comprising:
receiving, via a network, a plurality of timestamped data entries from a data source;
obtaining a plurality of data constraints for a first model, wherein the plurality of data constraints comprises a data element used by the first model and an availability requirement set, wherein the availability requirement set defines when the data element is deemed available based on the plurality of timestamped data entries that have the data element;
validating, using the plurality of timestamped data entries as input, the plurality of data constraints to obtain a validation result, wherein validating the plurality of data constraints comprises determining whether the plurality of timestamped data entries satisfies the availability requirement set for the data element;
determining a data availability assessment of the first model based on the validation result; and
storing, in computer storage, the data availability assessment of the first model.
2. The method of claim 1 , wherein validating the plurality of data constraints comprises:
identifying at least a portion of the plurality of timestamped data entries having the data element, and
determining whether the at least the portion satisfies the availability requirement set for the data element.
3. The method of claim 1 , further comprising:
for each entry of the plurality of timestamped data entries, updating a tally of the data element when the data element matches the entry; and
detecting a data constraint of the plurality of data constraints as unsatisfied when the tally fails to satisfy the availability requirement set.
4. The method of claim 1 , further comprising:
transmitting, by an indexer server, the plurality of timestamped data entries to an analyzer server; and
executing, by an analyzer server, the first model using the plurality of timestamped data entries while the plurality of data constraints is validated.
5. The method of claim 1 , further comprising:
identifying a second model as being dependent on the first model; and
presenting an alert for the second model based on the plurality of data constraints of the first model being unsatisfied.
6. The method of claim 1 , wherein the availability requirement set defines a number of events matching the data element to satisfy a corresponding data constraint of the plurality of data constraints.
7. The method of claim 1 , wherein the availability requirement set comprises a temporal requirement.
8. The method of claim 1 , wherein validating the plurality of data constraints further comprises:
verifying that a data value in the plurality of timestamped data entries is valid prior to using the data value to determine whether the availability requirement set is satisfied.
9. The method of claim 1 , further comprising:
determining a data availability assessment of a second model based on the validation result, wherein the second model comprises at least a subset of the plurality of data constraints of the first model.
10. A system comprising:
memory; and
one or more processors configured to perform operations comprising:
receiving, via a network, a plurality of timestamped data entries from a data source,
obtaining a plurality of data constraints for a first model, wherein the plurality of data constraints comprises a data element used by the first model and an availability requirement set, wherein the availability requirement set defines when the data element is deemed available based on the plurality of timestamped data entries that have the data element,
validating, using the plurality of timestamped data entries as input, the plurality of data constraints to obtain a validation result, wherein validating the plurality of data constraints comprises determining whether the plurality of timestamped data entries satisfies the availability requirement set for the data element,
determining a data availability assessment of the first model based on the validation result, and
storing, in computer storage, the data availability assessment of the first model.
11. The system of claim 10 , wherein validating the plurality of data constraints comprises:
identifying at least a portion of the plurality of timestamped data entries having the data element, and
determining whether the at least the portion satisfies the availability requirement set for the data element.
12. The system of claim 10 , the operations further comprising:
for each entry of the plurality of timestamped data entries, updating a tally of the data element when the data element matches the entry; and
detecting a data constraint of the plurality of data constraints as unsatisfied when the tally fails to satisfy the availability requirement set.
13. The system of claim 10 , the operations further comprising:
identifying a second model as being dependent on the first model; and
presenting an alert for the second model based on the plurality of data constraints of the first model being unsatisfied.
14. The system of claim 10 , wherein the availability requirement set comprises a temporal requirement.
15. The system of claim 10 , the operations further comprising:
determining a data availability assessment of a second model based on the validation result, wherein the second model comprises at least a subset of the plurality of data constraints of the first model.
16. A non-transitory computer-readable storage medium storing computer-readable program code which, when executed by one or more processors, cause the one or more processors to perform operations comprising:
receiving, via a network, a plurality of timestamped data entries from a data source;
obtaining a plurality of data constraints for a first model, wherein the plurality of data constraints comprises a data element used by the first model and an availability requirement set, wherein the availability requirement set defines when the data element is deemed available based on the plurality of timestamped data entries that have the data element;
validating, using the plurality of timestamped data entries as input, the plurality of data constraints to obtain a validation result, wherein validating the plurality of data constraints comprises determining whether the plurality of timestamped data entries satisfies the availability requirement set for the data element;
determining a data availability assessment of the first model based on the validation result; and
storing, in computer storage, the data availability assessment of the first model.
17. The non-transitory computer readable storage medium of claim 16 , wherein validating the plurality of data constraints comprises:
identifying at least a portion of the plurality of timestamped data entries having the data element, and
determining whether the at least the portion satisfies the availability requirement set for the data element.
18. The non-transitory computer readable storage medium of claim 16 , the operations further comprising:
for each entry of the plurality of timestamped data entries, updating a tally of the data element when the data element matches the entry; and
detecting a data constraint of the plurality of data constraints as unsatisfied when the tally fails to satisfy the availability requirement set.
19. The non-transitory computer readable storage medium of claim 16 , the operations further comprising:
identifying a second model as being dependent on the first model; and
presenting an alert for the second model based on the plurality of data constraints of the first model being unsatisfied.
20. The non-transitory computer readable storage medium of claim 16 , wherein the availability requirement set comprises a temporal requirement.