Hybrid data architecture for use within a cognitive environment
A method for receiving a plurality of types of data within a cognitive information processing system environment comprising: receiving data from a plurality of data sources, the plurality of data sources comprising a public data source and a private data source; accessing information from the plurality of data sources via a cognitive data management module; and, providing the information to an inference and learning system.
1. A method for receiving a plurality of types of data within a cognitive information processing system environment comprising:
receiving data from a plurality of data sources, the plurality of data sources comprising a public data source and a private data source;
accessing information from the public data source and the private data source via a cognitive cloud management module; and,
providing the information to a cognitive inference and learning system, the cognitive inference and learning system executing on a hardware processor of an information processing system, the cognitive inference and learning system comprising a cognitive platform executing on the information processing system, the cognitive platform and the information processing system performing a cognitive computing function, the cognitive platform comprising:
a cognitive engine, the cognitive engine comprising a dataset engine, a graph query engine and an insight engine, the cognitive engine processing the streams of data from the plurality of data sources, the cognitive engine processing the publicly available information stored in the hosted cognitive repository and the privately managed company specific information stored in the private network repository to provide a cognitive insight, the dataset engine being implemented to establish and maintain a dynamic data ingestion and enrichment pipeline, the graph query engine being implemented to receive and process queries such that the queries are bridged into a cognitive graph, the insight engine being implemented to generate a cognitive insight from the cognitive graph, the dataset engine, the graph query engine and the insight engine operating collaboratively to generate the cognitive insight;
a plurality of sourcing agents, the plurality of sourcing agents sourcing the data from the plurality of data sources, and,
a plurality of destination agents, the plurality of destination agents publishing the cognitive insight to a consumer of the cognitive insight.
2. The method of claim 1 , wherein:
the public data source comprises information accessible via a hosted cognitive cloud.
3. The method of claim 2 , wherein:
the hosted cognitive cloud comprises at least one of curated public data sources and licensed data sources.
4. The method of claim 2 , wherein:
the hosted cognitive cloud comprises the cognitive platform, the cognitive platform comprising a hosted cognitive platform.
5. The method of claim 4 , wherein:
the private data sources comprise information accessible via a private network.
6. The method of claim 5 , wherein:
the private network comprises a private cognitive platform, the private cognitive platform being located within and executing on the private network.
7. The method of claim 6 , wherein:
the private network comprises a private application, the private application providing information to and receiving information from the private cognitive platform.
8. The method of claim 6 , wherein:
the private data sources comprise at least one of application data and private data; and,
the private cognitive platform accesses the application data and the private data.
9. The method of claim 6 , wherein:
the cognitive data management module comprises at least one of a developer operations playbook, a management console, a data console and an asset repository.
10. The method of claim 6 , wherein:
the hosted cognitive platform and the private cognitive platform communicate via a secure tunnel.
11. A data architecture for use within a cognitive information processing system environment comprising:
a plurality of data sources, the plurality of data sources comprising a public data source and a private data source, the public data source comprising publicly available information stored in a hosted cognitive repository, the private data source comprising privately managed company specific information stored in a private network repository; and,
a cognitive inference and learning system executing on a hardware processor of an information processing system, the cognitive inference and learning system comprising a cognitive platform executing on the information processing system, the cognitive platform and the information processing system performing a cognitive computing function, the cognitive platform comprising:
a cognitive engine, the cognitive engine comprising a dataset engine, a graph query engine and an insight engine, the cognitive engine processing the data from the plurality of data sources, the cognitive engine processing the publicly available information stored in the hosted cognitive repository and the privately managed company specific information stored in the private network repository to provide a cognitive insight, the dataset engine being implemented to establish and maintain a dynamic data ingestion and enrichment pipeline, the graph query engine being implemented to receive and process queries such that the queries are bridged into a cognitive graph, the insight engine being implemented to generate a cognitive insight from the cognitive graph, the dataset engine, the graph query engine and the insight engine operating collaboratively to generate the cognitive insight;
a plurality of sourcing agents, the plurality of sourcing agents sourcing the data from the plurality of data sources, and,
a plurality of destination agents, the plurality of destination agents publishing the cognitive insight to a consumer of the cognitive insight;
a cognitive cloud management module, the cognitive cloud management module accessing information from the public data source and the private data source and providing the information to the cognitive engine of the cognitive inference and learning system, the cognitive engine processing the publicly available information stored in the hosted cognitive repository and the privately managed company specific information stored in the private network repository to the provide cognitive insight.
12. The data architecture of claim 11 , wherein:
the public data source comprises information accessible via a hosted cognitive cloud.
13. The data architecture of claim 12 , wherein:
the hosted cognitive cloud comprises at least one of curated public data sources and licensed data sources.
14. The data architecture of claim 12 , wherein:
the hosted cognitive cloud comprises the cognitive platform, the cognitive platform comprising a hosted cognitive platform.
15. The data architecture of claim 14 , wherein:
the private data sources comprise information accessible via a private network.
16. The data architecture of claim 15 , wherein:
the private network comprises a private cognitive platform, the private cognitive platform being located within and executing on the private network.
17. The data architecture of claim 16 , wherein:
the private network comprises a private application, the private application providing information to and receiving information from the private cognitive platform.
18. The data architecture of claim 16 , wherein:
the private data sources comprise at least one of application data and private data; and,
the private cognitive platform accesses the application data and the private data.
19. The data architecture of claim 16 , wherein:
the cognitive data management module comprises at least one of a developer operations playbook, a management console, a data console and an asset repository.
20. The data architecture of claim 16 , wherein:
the hosted cognitive platform and the private cognitive platform communicate via a secure tunnel.