Data exchange on a distributed computing system
A system includes at least one processor and at least one memory including instructions that, when executed by the at least one processor, cause the at least one processor to perform operations. The operations include providing a secure link to an auditable, machine-readable dataset to a client device of a user, the auditable, machine-readable dataset comprising data. At least one policy constraint is provided to at least a portion of the data in the dataset. In response to detecting activation of the secure link at the client device, one or both of the user and the client device is authenticated based on the policy constraint. Streaming access is provided to the auditable, machine-readable dataset in real-time.
1. A method comprising:
receiving a request, from a user, to access a dataset;
in response to receiving the request, providing a secure link to the dataset via an email or text message sent to a client device of the user; and
in response to detecting activation of the secure link:
authenticating the user or the client device based on a first policy constraint associated with the dataset; and
based on authenticating the user or the client device, providing streaming access to the dataset in real-time.
2. The method of claim 1 , further comprising:
withholding, from the client device, a portion of the dataset based on a second policy constraint.
3. The method of claim 1 , further comprising:
in response to failing to authenticate one or both of the user and the client device, withholding at least a portion of the dataset based on a second policy constraint.
4. The method of claim 1 , wherein the dataset comprises one or more clusters of data and each cluster contains one or more topics.
5. The method of claim 1 , wherein a second policy constraint defines what types of customer applications are allowed to stream the dataset.
6. The method of claim 1 , wherein providing the secure link comprises providing the secure link to at least a portion of data in the dataset and an associated schema to the client device of the user.
7. The method of claim 6 , wherein:
the associated schema comprises information about the data; and
the information about the data comprises one or more of a data type, one or more data field titles, or one or more data field types.
8. The method of claim 1 , wherein the dataset comprises an auditable, machine-readable dataset in a machine-processable format.
9. The method of claim 1 , further comprising:
continuously processing real-time data as it is produced or received from a first entity, the continuously processing including modeling computation over unbounded streams of events.
10. The method of claim 1 , wherein:
the dataset comprises events that are represented by a key/value model;
a key represents something that identifies an event; and
a value represents information about the event.
11. A system comprising:
at least one processor; and
at least one memory including instructions that, when executed by the at least one processor, cause the at least one processor to perform operations comprising:
receiving a request, from a user, to access a dataset; in response to receiving the request, providing a secure link to the dataset via an email or text message sent to a client device of the user; and
in response to detecting activation of the secure link:
authenticating the user or the client device based on a first policy constraint associated with the dataset; and
based on authenticating the user or the client device, providing streaming access to the dataset in real-time.
12. The system of claim 11 , wherein the operations further comprise:
withholding, from the client device, a portion of the dataset based on a second policy constraint.
13. The system of claim 11 , wherein the operations further comprise:
in response to failing to authenticate one or both of the user and the client device, withholding at least a portion of the dataset based on a second policy constraint.
14. The system of claim 11 , wherein the dataset comprises one or more clusters of data and each cluster contains a stateful set that manages a plurality of pods.
15. The system of claim 11 , wherein a second policy constraint defines what types of customer applications are allowed to stream the dataset.
16. The system of claim 11 , wherein providing the secure link comprises providing the secure link to at least a portion of data in the dataset and an associated schema to the client device of the user.
17. The system of claim 11 , wherein the dataset comprises an auditable, machine-readable dataset in a machine-processable format.
18. The system of claim 11 , wherein the operations further comprise:
continuously processing real-time data as it is produced or received from a first entity, the continuously processing including modeling computation over unbounded streams of events.
19. The system of claim 11 , wherein:
the dataset comprises events that are represented by a key/value model;
a key represents something that identifies an event; and
a value represents information about the event.
20. A non-transitory machine-storage medium having instructions embodied thereon that, when executed by at least one processor of a machine, cause the at least one processor to perform operations comprising:
receiving a request, from a user, to access a dataset;
in response to receiving the request, providing a secure link to the dataset via an email or text message sent to a client device of the user; and
in response to detecting activation of the secure link:
authenticating the user or the client device based on a first policy constraint associated with the dataset; and
based on authenticating the user or the client device, providing streaming access to the dataset in real-time.