Data exchange on a distributed computing system
A system includes at least one processor and at least one memory including instructions that, when executed by the at least one processor, cause the at least one processor to perform operations. The operations include providing a secure link to an auditable, machine-readable dataset to a client device of a user, the auditable, machine-readable dataset comprising data. At least one policy constraint is provided to at least a portion of the data in the dataset. In response to detecting activation of the secure link at the client device, one or both of the user and the client device is authenticated based on the policy constraint. Streaming access is provided to the auditable, machine-readable dataset in real-time.
1. A method comprising:
receiving a request to access an auditable, machine-readable dataset from a user;
in response to receiving the request, providing a secure link to the auditable, machine-readable dataset via an email or text message to a client device of the user, the auditable, machine-readable dataset comprising data;
providing at least one policy constraint to at least a portion of the data in the dataset; and
in response to detecting activation of the secure link at the client device:
authenticating one or both of the user and the client device based on the policy constraint; and
based on authenticating one or both of the user and the client device, providing streaming access to the auditable, machine-readable dataset in real-time.
2. The method of claim 1 , further comprising withholding, from the client device, at least the portion of the data of the dataset based on the policy constraint.
3. The method of claim 2 , further comprising, in response to failing to authenticate one or both of the user and the client device, withholding at least the portion of the data.
4. The method of claim 1 , wherein:
the auditable, machine-readable dataset comprises one or more clusters of data and each cluster contains one or more topics.
5. The method of claim 1 , wherein the policy constraint defines what types of customer applications are allowed to stream the auditable, machine-readable dataset.
6. The method of claim 1 , wherein providing the secure link comprises providing the secure link to at least the portion of the data in the dataset and an associated schema to the client device of the user.
7. The method of claim 6 , wherein the associated schema comprises information about the data.
8. The method of claim 7 , wherein the information about the data comprises one or more of a data type, one or more data field titles, or one or more data field types.
9. The method of claim 1 , further comprising updating a format of the dataset in response to a second request from the user.
10. The method of claim 1 , wherein the dataset comprises one or more Kafka clusters.
11. The method of claim 1 , wherein the dataset is in a machine-processable format.
12. The method of claim 1 , wherein a format of the dataset comprises one or more of CSV, RDF, XML, or JSON.
13. A system comprising:
at least one processor; and
at least one memory including instructions that, when executed by the at least one processor, cause the at least one processor to perform operations comprising:
receiving a request to access an auditable, machine-readable dataset from a user;
in response to receiving the request, providing a secure link to the auditable, machine-readable dataset via an email or text message to a client device of the user, the auditable, machine-readable dataset comprising data;
providing at least one policy constraint to at least a portion of the data in the dataset; and
in response to detecting activation of the secure link at the client device:
authenticating one or both of the user and the client device based on the policy constraint; and
based on authenticating one or both of the user and the client device, providing streaming access to the auditable, machine-readable dataset in real-time.
14. The system of claim 13 , wherein the operations further comprise withholding, from the client device, the at least some data of the dataset based on the policy constraint.
15. The system of claim 14 , wherein the operations further comprise, in response to failing to authenticate one or both of the user and the client device, withholding at least some of the dataset.
16. The system of claim 13 , wherein the policy constraint defines what types of customer applications are allowed to stream
the auditable, machine-readable dataset.
17. The system of claim 13 , wherein the dataset comprises or more Kafka clusters.
18. The system of claim 13 , wherein the operations further comprise updating a format of the dataset in response to a second request from the user.
19. The system of claim 13 , wherein a format of the dataset comprises one or more of CSV, RDF, XML, and JSON.
20. A machine-storage medium having instructions embodied thereon, the instructions executable by a processor of a machine to perform operations comprising:
receiving a request to access an auditable, machine-readable dataset from a user;
in response to receiving the request, providing a secure link to the auditable, machine-readable dataset via an email or text message to a client device of the user, the auditable, machine-readable dataset comprising data;
providing at least one policy constraint to at least a portion of the data in the dataset; and
in response to detecting activation of the secure link at the client device:
authenticating one or both of the user and the client device based on the policy constraint; and
based on authenticating one or both of the user and the client device, providing streaming access to the auditable, machine-readable dataset in real-time.