Data resolution system for management of distributed data
System and methods are described for management of distributed data. In one implementation, a data resolution system receives a data resolution request from a data consumer. The system then identifies data sources based on a schema registry, and queries each of the data sources for data corresponding to the expressions. The system then generates a hydrated data object comprising the received data, and transmits the hydrated data object to the data consumer.
1. A computer-implemented method comprising:
receiving, by a processing device, a data resolution request comprising a data object that comprises a plurality of data resolution expressions;
identifying, by the processing device, a plurality of data sources based on a schema registry that maps the plurality of data resolution expressions to schemas associated with each of the plurality of data sources;
querying, by the processing device, each of the plurality of data sources for data corresponding to the plurality of data resolution expressions;
receiving, by the processing device, the data from the plurality of data sources;
generating, by the processing device, a hydrated version of the data object comprising fields populated with the received data; and
transmitting, by the processing device, the hydrated version of the data object to a data consumer from which the data resolution request originated responsive to a runtime request received from an application utilized by the data consumer.
2. The computer-implemented method of claim 1 , wherein the data resolution request does not include any indication of any of the plurality of data sources for which the processing device queries.
3. The computer-implemented method of claim 1 , wherein the data resolution request is associated with the application utilized by the data consumer, and wherein the data resolution request is received prior to runtime of the application.
4. The computer-implemented method of claim 3 , wherein the hydrated version of the data object is generated before runtime of the application.
5. The computer-implemented method of claim 4 , wherein the hydrated version of the data object is transmitted to the data consumer during runtime of the application.
6. The computer-implemented method of claim 1 , further comprising:
receiving, by the processing device, schema data from each of the plurality of data sources; and
generating or updating, by the processing device, the schema registry to include the received schema data.
7. The computer-implemented method of claim 6 , further comprising:
transmitting, by the processing device, the schema data to the data consumer, wherein the schema data comprises the plurality of expressions, and wherein the data consumer is to make available the plurality of expressions to the application utilized by the data consumer prior to runtime of the application.
8. A database system, comprising:
a processing device; and
a memory device coupled to the processing device, the memory device having instructions stored thereon that, in response to execution by the processing device, cause the processing device to:
receive a data resolution request comprising a data object that comprises a plurality of data resolution expressions;
identify a plurality of data sources based on a schema registry that maps the plurality of expressions to schemas associated with each of the plurality of data sources;
query each of the plurality of data sources for data corresponding to the plurality of expressions;
receive the data from the plurality of data sources;
generate a hydrated version of the data object comprising fields populated with the received data; and
transmit the hydrated version of the data object to a data consumer from which the data resolution request originated responsive to a runtime request received from an application utilized by the data consumer.
9. The database system of claim 8 , wherein the data resolution request does not include any indication of any of the plurality of data sources for which the processing device queries.
10. The database system of claim 8 , wherein the data resolution request is associated with the application utilized by the data consumer, wherein the data resolution request is to be received prior to runtime of the application, and wherein the hydrated version of the data object is to be generated before runtime of the application.
11. The database system of claim 10 , wherein the hydrated version of the data object is to be transmitted to the data consumer during runtime of the application.
12. The database system of claim 8 , wherein the instructions further cause the processing device to:
generate the schema registry to include schema data received from each of the plurality of sources.
13. The database system of claim 12 , wherein the instructions further cause the processing device to:
transmit the schema data to the data consumer, wherein the schema data comprises the plurality of expressions, and wherein the data consumer is to make available the plurality of expressions to the application utilized by the data consumer prior to runtime of the application.
14. A non-transitory computer-readable storage medium having instructions encoded thereon which, when executed by a processing device, cause the processing device to:
receive a data resolution request comprising a data object that comprises a plurality of data resolution expressions;
identify a plurality of data sources based on a schema registry that maps the plurality of expressions to schemas associated with each of the plurality of data sources;
query each of the plurality of data sources for data corresponding to the plurality of expressions;
receive the data from the plurality of data sources;
generate a hydrated version of the data object comprising fields populated with the received data; and
transmit the hydrated version of the data object to a data consumer from which the data resolution request originated responsive to a runtime request received from an application utilized by the data consumer.
15. The non-transitory computer-readable storage medium of claim 14 , wherein the data resolution request does not include any indication of any of the plurality of data sources for which the processing device queries.
16. The non-transitory computer-readable storage medium of claim 14 , wherein the data resolution request is associated with the application utilized by the data consumer, wherein the data resolution request is to be received prior to runtime of the application, and wherein the hydrated version of the data object is to be generated before runtime of the application.
17. The non-transitory computer-readable storage medium of claim 14 , wherein the instructions further cause the processing device to:
generate the schema registry to include schema data received from each of the plurality of sources.
18. The non-transitory computer-readable storage medium of claim 17 , wherein the instructions further cause the processing device to:
transmit the schema data to the data consumer, wherein the schema data comprises the plurality of expressions, and wherein the data consumer is to make available the plurality of expressions to the application utilized by the data consumer prior to runtime of the application.