Community-based generation of policies for a data platform
A disclosed data platform may be configured to access a custom policy developed by a particular client entity that uses the data platform. The custom policy may invoke a query that targets a target dataset ingested from a cloud environment and stored in a data store. The data platform may determine that the custom policy is likely to be of value to one or more other client entities, besides the particular client entity, that also use the data platform. In response to the determining that the custom policy is likely to be of value to the one or more other client entities, the data platform may generate a community policy based on the custom policy. The community policy may be available for use by the one or more other client entities. Corresponding methods, systems, and products are also disclosed.
1. A method comprising:
accessing, by a data platform, a custom policy developed by a particular client entity that uses the data platform, wherein the custom policy invokes a query that targets a target dataset ingested from a cloud environment and stored in a data store;
determining, by the data platform, that the custom policy is likely to be of value to one or more other client entities based on a combination of one or more of:
a request to publish the policy,
a popularity threshold based on usage,
a sophistication of the author, and
user feedback; and
generating, by the data platform and in response to the determining that the custom policy is likely to be of value to the one or more other client entities, a community policy based on the custom policy, wherein the community policy is available for use by the one or more other client entities, wherein the custom policy is a compliance policy configured to verify that the target dataset complies with a predetermined compliance protocol.
2. The method of claim 1 , wherein the determining that the custom policy is likely to be of value to the one or more other client entities is performed based on an identity of the particular client entity.
3. The method of claim 1 , wherein the determining that the custom policy is likely to be of value to the one or more other client entities is performed based on a popularity metric of the custom policy exceeding a predetermined popularity threshold.
4. The method of claim 1 , further comprising:
receiving, by the data platform from the particular client entity, user input representative of a request to publish the custom policy as a community policy;
wherein the determining that the custom policy is likely to be of value to the one or more other client entities is performed based on the user input representative of the request to publish the custom policy.
5. The method of claim 1 , wherein:
the determining that the custom policy is likely to be of value to the one or more other client entities is performed automatically using a machine learning model implemented by the data platform; and
the machine learning model is trained for identifying custom policies of value to multiple client entities based on a training dataset that includes a plurality of different custom policies deployed under a plurality of different conditions by a plurality of different client entities.
6. The method of claim 1 , further comprising:
managing, by the data platform, a policy repository configured to store a plurality of community policies that are available for use by a plurality of different client entities; and
storing, by the data platform and in response to the generating of the community policy, the community policy within the policy repository.
7. The method of claim 6 , wherein the managing of the policy repository includes:
storing documentation corresponding to each community policy stored within the policy repository; and
providing documentation corresponding to a particular community policy to a particular client device accessing the particular community policy from the policy repository.
8. The method of claim 1 , further comprising providing, by the data platform and for use by a user of the data platform, a graphical user interface that provides graphical assistance configured to assist a user in performing one or more of:
discovering default policies and community policies available for use by a client entity with which the user is associated;
creating new custom policies; or
requesting to publish custom policies as community policies that are available for use by other users associated with other client entities besides the client entity with which the user is associated.
9. The method of claim 1 , wherein the query invoked by the custom policy is a custom query that is also developed by the particular client entity.
10. The method of claim 1 , wherein the query invoked by the custom policy is a default query provided by the data platform to a plurality of client entities including the particular client entity.
11. The method of claim 1 , further comprising constructing, by the data platform and based on client application data ingested from the cloud environment and loaded into the data store, a graph comprising a plurality of nodes connected by a plurality of edges, wherein each node of the plurality of nodes represents a logical entity from the client application data and each edge of the plurality of edges represents a behavioral relationship between nodes connected by the edge.
12. A system comprising:
a memory storing instructions; and
a processor communicatively coupled to the memory and configured to execute the instructions to:
access a custom policy developed by a particular client entity that uses a data platform, wherein the custom policy invokes a query that targets a target dataset ingested from a cloud environment and stored in a data store;
determine that the custom policy is likely to be of value to one or more other client entities based on a combination of one or more of:
a request to publish the policy,
a popularity threshold based on usage,
a sophistication of the author, and
user feedback; and
generate, in response to the determining that the custom policy is likely to be of value to the one or more other client entities, a community policy based on the custom policy, wherein the community policy is available for use by the one or more other client entities, wherein the custom policy is a compliance policy configured to verify that the target dataset complies with a predetermined compliance protocol.
13. The system of claim 12 , wherein:
the processor is further configured to execute the instructions to receive, from the particular client entity, user input representative of a request to publish the custom policy as a community policy; and
the determining that the custom policy is likely to be of value to the one or more other client entities is performed based on at least one of:
an identity of the particular client entity,
a popularity metric of the custom policy exceeding a predetermined popularity threshold, or
the user input representative of the request to publish the custom policy.
14. The system of claim 12 , wherein:
the determining that the custom policy is likely to be of value to the one or more other client entities is performed automatically using a machine learning model implemented by the data platform; and
the machine learning model is trained for identifying custom policies of value to multiple client entities based on a training dataset that includes a plurality of different custom policies deployed under a plurality of different conditions by a plurality of different client entities.
15. The system of claim 13 , wherein the processor is further configured to execute the instructions to:
manage a policy repository configured to store a plurality of community policies that are available for use by a plurality of different client entities; and
store, in response to the generating of the community policy, the community policy within the policy repository.
16. A computer program product embodied in a non-transitory computer readable storage medium and comprising computer instructions for:
accessing a custom policy developed by a particular client entity that uses a data platform, wherein the custom policy invokes a query that targets a target dataset ingested from a cloud environment and stored in a data store;
determining that the custom policy is likely to be of value to one or more other client entities based on a combination of one or more of:
a request to publish the policy,
a popularity threshold based on usage,
a sophistication of the author, and
user feedback; and
generating, in response to the determining that the custom policy is likely to be of value to the one or more other client entities, a community policy based on the custom policy, wherein the community policy is available for use by the one or more other client entities, wherein the custom policy is a compliance policy configured to verify that the target dataset complies with a predetermined compliance protocol.
17. The computer program product of claim 16 , further comprising computer instructions for receiving, from the particular client entity, user input representative of a request to publish the custom policy as a community policy;
wherein the determining that the custom policy is likely to be of value to the one or more other client entities is performed based on at least one of:
an identity of the particular client entity,
a popularity metric of the custom policy exceeding a predetermined popularity threshold, or
the user input representative of the request to publish the custom policy.
18. The computer program product of claim 16 , wherein:
the determining that the custom policy is likely to be of value to the one or more other client entities is performed automatically using a machine learning model implemented by the data platform; and
the machine learning model is trained for identifying custom policies of value to multiple client entities based on a training dataset that includes a plurality of different custom policies deployed under a plurality of different conditions by a plurality of different client entities.
19. The computer program product of claim 16 , further comprising computer instructions for:
managing a policy repository configured to store a plurality of community policies that are available for use by a plurality of different client entities; and
storing, in response to the generating of the community policy, the community policy within the policy repository.