Database interface system
A database interface system uses individual application program interfaces to receive, convert, combine, and normalize if necessary, datasets received from disparate sources. The datasets may include quotes from various insurance providers. The categorized and normalized data may be further processed for presentation via a user interface that allows selective display of the full combined datasets or graphically selected subsets of the full datasets.
1. A method of processing partially correlated data from disparate data sources, the method comprising:
communicating, via a processor, a request for first data to an Application Programming Interface (API) for a first data source;
receiving, via the processor, a response from the API for the first data source comprising encrypted first data from the first data source, the encrypted first data in a first non-standard format;
decrypting, via the processor, the encrypted first data using keys stored in a secure element;
converting, via a formatting module, the decrypted first data from the first non-standard format to a standard format;
performing, via the processor, a map/reduce function that extracts first elements from the decrypted first data in the standard format;
storing, via the processor, the first elements in a data lake;
analyzing, via the processor, the first elements for differences from second elements in the data lake;
generating, via the processor, display data that includes the differences;
sending, via the processor, the display data to an application having a user interface; and
presenting, at the application, wherein a delta is displayed on the user interface of the application, the delta showing the differences and at least one of the first elements and the second elements.
2. The method of claim 1 , wherein the first elements and second elements comprise insurance related data.
3. The method of claim 2 , wherein the delta comprises differences in insurance related data.
4. The method of claim 3 , wherein the first element and the second element comprise insurance pricing data.
5. The method of claim 4 , further comprising allowing a user to select an insurance plan based on the displayed delta.
6. The method of claim 4 , wherein the API returns census data and quote parameters.
7. The method of claim 1 , wherein first data is communicated using a private blockchain.
8. A method of providing data to an end user comprising:
communicating, via a processor, a request for first data to an Application Programming Interface (API) for a first data source;
receiving, via the processor, a response from the API for the first data source comprising encrypted first data from the first data source, the encrypted first data in a first non-standard format;
decrypting, via the processor, the encrypted first data using keys stored in a secure element;
converting, via a formatting module, the decrypted first data from the first non-standard format to a standard format;
performing, via the processor, a map/reduce function that extracts first elements from the decrypted first data in the standard format;
storing, via the processor, the first elements in a data lake;
analyzing, via the processor, the first elements for differences from second elements in the data lake;
generating, via the processor, display data that includes the differences;
sending, via the processor, the display data to an application having a user interface; and
presenting, at the application, wherein a delta is displayed on the user interface of the application, the delta showing the differences and at least one of the first elements and the second elements.
9. The method of claim 8 , wherein the first elements and second elements comprise insurance related data.
10. The method of claim 9 , wherein the delta comprises differences in insurance related data.
11. The method of claim 10 , wherein the first element and the second element comprise insurance pricing data.
12. The method of claim 11 , further comprising allowing a user to select an insurance plan based on the displayed delta.
13. A method of processing partially correlated data from disparate data sources, the method comprising:
communicating, via a processor, a request for first data to an Application Programming Interface (API) for a first data source;
receiving, via the processor, a response from the API for the first data source comprising first data from the first data source, the first data in a first non-standard format;
converting, via a formatting module, the first data from the first non-standard format to a standard format;
performing, via the processor, a map/reduce function that extracts first elements from the first data in the standard format;
storing, via the processor, the first elements in a data lake;
analyzing, via the processor, the first elements for differences from second elements in the data lake;
generating, via the processor, display data that includes the differences;
sending, via the processor, the display data to an application having a user interface; and
presenting, at the application, wherein a delta is displayed on the user interface of the application, the delta showing the differences and at least one of the first elements and the second elements.
14. The method of claim 13 , wherein the first elements and second elements comprise insurance related data.
15. The method of claim 14 , wherein the delta comprises differences in insurance related data.
16. The method of claim 15 , wherein the first element and the second element comprise insurance pricing data.
17. The method of claim 16 , further comprising allowing a user to select an insurance plan based on the displayed delta.
18. The method of claim 16 , wherein the API returns census data and quote parameters.
19. The method of claim 13 , wherein first data is communicated using a private blockchain.