Methods and systems for the execution of analysis and/or services against multiple data sources while maintaining isolation of original data source
View Patent ↗Methods and systems for data are disclosed. A system implementation includes a data module for storing data received from an external source. The data module includes a file system for unstructured data, a database for structured data, a transform for operating upon unstructured or structured data, a data broker for receiving data having a first format and providing the data in a second format, a data network for communications within the data module, and a processing module for performing operations upon data. The processing module further includes a process broker and a process container. The process container is for providing one or more instances of processes during a runtime operation. The system further includes an inter-process network for communications within the processing module and an internal gateway for the data module to communicate with the processing module.
1. A machine implemented apparatus for data, the apparatus comprising:
a user interface and a configurator;
the user interface (UI) for outputting an assembly-plan that includes parameters which incorporate the requirements of a participant and are implemented upon generation of a system-implementation,
the user interface for providing inputs to the configurator;
the configurator for:
receiving input from the user interface;
configuring a set of determined modules and/or submodules;
configuring a data module for storing data received from an external source, the data module further comprising:
a file system for unstructured data;
a database for structured data;
a transform for operations upon unstructured or structured data;
a data broker for receiving data having a first format and providing the data in a second format;
a data network for communications within the data module; and
configuring a processing module for performing operations upon data, the process module further comprising:
a process broker;
a process container for providing one or more instances of processes in operation;
an interprocess network for communications within the processing module;
an internal gateway for the data module to communicate with the processing module;
an inbox submodule for source-data,
an outbox submodule for results-data,
an inbound-gateway for the inbox submodule, and
an outbound-gateway for the outbox submodule.
2. The apparatus of claim 1 , further comprising:
the configurator for determining:
a number of process modules,
a number of data modules, and
a number of submodules;
the configurator for instantiating the determined modules and submodules;
the participant comprising at least one of a source entity and a requestor entity;
the determined modules and submodules comprising a system instantiation in response to the needs of the participant, the system instantiation comprising:
an external gateway coupled to the data module, the external gateway for receiving data from an external source;
an isolated-type data-network for allowing communications between elements of the data module;
a process network for allowing communications between elements of the process module; and
a filter for filtering results output by the process module.
3. The apparatus of claim 1 , further comprising:
a first network segment, the first network segment comprising an inbound-data network, the first network segment comprising an isolated-type network which operates in conjunction with a second network segment and the inbound-gateway to only allow network activity that deposits permissible data from external source-data devices into and/or intended for the inbox-submodule.
4. The apparatus of claim 1 , wherein the inbox submodule for source-data is located separately from the outbox submodule for results-data;
the inbound-gateway and the outbound-gateway are implemented by a plurality of gateways;
the inbound-gateway is located separately from the outbound-gateway.
5. The apparatus of claim 1 ,
the inbound-gateway and the outbound-gateway are located within a single module and/or submodule for the inbox-submodule and the outbox-submodule; and
the inbound-gateway and the outbound-gateway are implemented by using a single gateway.
6. The apparatus of claim 1 further comprising:
the participant comprising a device;
a plurality of assembly-plans comprising a complete contract assembly-plan instantiation;
the configurator for automatically instantiating system-components including:
the process module, and each of the network segments,
preferably by using a set of predetermined parameters.
7. The apparatus of claim 1 , further comprising:
the process module for:
providing analysis upon temporary and/or virtually merged dataset(s) within the inbox-submodule, and
outputting results-data to the outbox-submodule;
wherein the parameters for the analysis provided by one or more processes that are provided and/or prescribed by the participant;
wherein the process module for providing only appropriate results-data to a participant device, by virtue of the operation of a network segment dedicated for the processing module in conjunction with the network segment for the output of the processing module to the outbox-submodule; and/or by the operation of the network segment for the outbox-submodule, in conjunction with the network segment for the outbound-gateway;
wherein a data source is advantageously isolated from one or more participant devices.
8. A method comprising:
providing input to a configurator;
receiving the input;
configuring a set of determined modules and/or submodules;
configuring a data module for storing data received from an external source, the data module further comprising:
a file system for unstructured data;
a database for structured data;
a transform for operations upon unstructured or structured data;
a data broker for receiving data having a first format and providing the data in a second format;
a data network for communications within the data module; and
configuring a process module for performing operations upon data, the process module further comprising:
a process broker;
a process container for providing one or more instances of processes in operation;
an interprocess network for communications within the processing module;
an internal gateway for the data module to communicate with the process module;
configuring an inbox submodule for source-data,
configuring an outbox submodule for results-data,
configuring an inbound-gateway for the inbox submodule, and
configuring an outbound-gateway for the outbox submodule.
9. The method of claim 8 , further comprising:
outputting an assembly-plan that includes parameters which incorporate the requirements of a participant and are implemented upon generation of a system-implementation.
10. The method of claim 8 , further comprising:
determining:
a number of process modules,
a number of data modules, and
a number of submodules;
instantiating the determined modules and submodules;
the determined modules and submodules comprising a system instantiation in response to the needs of the participant.
11. The method of claim 8 , further comprising:
configuring a first network segment, the first network segment comprising an inbound-data network, the first network segment comprising an isolated-type network which operates in conjunction with a second network segment and the inbound-gateway to only allow network activity that deposits permissible data from external source-data devices into and/or intended for the inbox-submodule.
12. The method of claim 8 , further comprising:
receiving data from an external source;
allowing communications between elements of the data module;
allowing communications between elements of the process module; and
filtering results output by the process module,
wherein the participant comprising at least one of a source entity and a requestor entity.
13. The method of claim 8 , further comprising:
the inbox submodule for source-data is located separately from the outbox submodule for results-data.
14. The method of claim 8 , wherein
the inbound-gateway and the outbound-gateway are implemented by a plurality of gateways.
15. The method of claim 8 , further comprising:
the inbound-gateway is located separately from the outbound-gateway.
16. The method of claim 8 , wherein
the inbound-gateway and the outbound-gateway are located within a single module and/or submodule for the inbox-submodule and the outbox-submodule; and
the inbound-gateway and the outbound-gateway are implemented by using a single gateway.
17. The method of claim 8 , wherein
the participant comprising a device;
a plurality of assembly-plans comprising a complete contract assembly-plan instantiation.
18. The method of claim 8 , the processing comprising automatically instantiating for the participant system-components including:
the process module, and each of the network segments,
preferably by using a set of predetermined parameters.
19. The method of claim 8 , further comprising:
providing analysis upon temporary and/or virtually merged dataset(s) within the inbox-submodule, and
outputting results-data to the outbox-submodule;
wherein the parameters for the analysis provided by one or more processes that are provided and/or prescribed by the participant.
20. The method of claim 8 , comprising:
providing only appropriate results-data to a participant device, by virtue of the operation of a network segment dedicated for the processing module in conjunction with the network segment for the output of the processing module to the outbox-submodule;
and/or by the operation of the network segment for the outbox-submodule, in conjunction with the network segment for the outbound-gateway;
wherein a data source is advantageously isolated from one or more participant devices.