Distributed computation systems and methods
Systems and methods are described for performing distributed computations over a data set potentially owned or controlled by many stakeholders, each of whom may set their own policies governing access to and/or other use of their individual data.
1. A method for performing distributed computing tasks using distributed digital data resources having differing associated rules, the method comprising:
receiving, from a distributing entity by a first distributed worker node, a first computing sub-task to be performed by the first distributed worker node using a first digital data resource, the first computing sub-task being a divided sub-task of a plurality of divided sub-tasks associated with a computing task, the first digital data resource being associated with a first set of rules that correspond to one or more conditions for accessing the first digital data resource;
determining, by the first distributed worker node, that the first distributed worker node has at least partial access rights to the first digital data resource, the at least partial access rights being independent of the access rights of the distributing entity;
performing, by the first distributed worker node, the first computing sub-task to generate a first partial result based on the determination that the first distributed worker node has at least partial access rights to the first digital data resource; and
sending, from the first distributed worker node to a collector entity, the first partial result.
2. The method of claim 1 , wherein the first set of rules further correspond to one or more computations that operate on the first digital data resource.
3. The method of claim 1 , wherein the distributing entity and the collector entity comprise the same entity.
4. The method of claim 1 , wherein the first set of rules are determined at least in part by one or more stakeholders in the first digital data resource.
5. The method of claim 1 , wherein the distributing entity has less access rights to the first digital data resource than the at least partial access rights of the first distributed worker node.
6. The method of claim 1 , wherein the distributing entity is not able to set data access policies observed by the first distributed worker node.
7. The method of claim 1 , wherein the distributing entity is not able to set data access policies associated with the first digital data resource.
8. The method of claim 1 , wherein the first set of rules comprises rules selected from a domain of possible rules that are not determined by the distributing entity.
9. The method of claim 1 , wherein the first set of rules are associated with a first set of computations that operate upon the first digital data resource in order to provide a specific view of the first digital data resource.
10. The method of claim 9 , wherein at least one computation of the first set of computations is associated with the first digital data resource and with a first user in order to limit the first user's access to information contained in the first digital data resource by requiring that the at least one computation be applied to the first digital data resource before revealing the information to the first user.
11. The method of claim 9 , wherein the association between the first set of rules with the first set of computations is made by creating a digitally signed document comprising a paring of a unique representation of the first digital data resource and a unique representation of the first set of computations to be associated with the first digital data resource.
12. The method of claim 1 , wherein the first digital data resource comprises medical information.
13. The method of claim 12 , wherein the medical information comprises genomic data relating to a plurality of individuals.
14. The method of claim 12 , wherein the first set of rules comprises rules corresponding to conditions that protect patient privacy.
15. The method of claim 12 , wherein the first digital data resource comprises medical information relating to a plurality of patients including a first patient and a second patient, the first set of rules corresponding to access conditions that are different for medical information relating to the first patient than for medical information relating to the second patient.
16. The method of claim 5 , wherein at least some of the first set of rules are set at least in part by one or more of the plurality of parents.
17. The method of claim 1 , wherein the method further comprises:
generating, by the first distributed worker node, a second computing sub-task to be performed by a second distributed worker node using a second digital data resource, the second computing-sub task being a sub-task of the first computing sub-task, the second digital data resource being associated with a second set of rules that correspond to one or more conditions for accessing the second digital data resource; and
sending, from the first distributed worker node to the second distributed worker node, the second computing sub-task.
18. The method of claim 17 , wherein the method comprises receiving, from the second distributed worker node, a second partial result response to the second computing sub-task.
19. The method of claim 18 , wherein generating the first partial result is based in part on the second partial result.
20. The method of claim 17 , wherein the one or more conditions for accessing the first and second digital data resources corresponding to the first and second set of rules differ from each other.
21. The method of claim 17 , wherein the first distributed worker node does not have access to the second digital data resource and the second distributed worker node does not have access to the first digital data resource.
22. The method of claim 17 , wherein the first and second digital data resources are located in geographically separate locations.
23. The method of claim 22 , wherein the first and second digital data resources are located in different countries.