Systems and methods for data processing and enterprise AI applications
Systems, methods, and devices for a cyberphysical (IoT) software application development platform based upon a model driven architecture and derivative IoT SaaS applications are disclosed herein. The system may include concentrators to receive and forward time-series data from sensors or smart devices. The system may include message decoders to receive messages comprising the time-series data and storing the messages on message queues. The system may include a persistence component to store the time-series data in a key-value store and store the relational data in a relational database. The system may include a data services component to implement a type layer over data stores. The system may also include a processing component to access and process data in the data stores via the type layer, the processing component comprising a batch processing component and an iterative processing component.
1. A method, comprising:
providing a system comprising a plurality of types, wherein each type of the plurality of types comprises a respective data field definition and a respective method definition, and wherein at least one type of the plurality of types provides a configurable interface across disparate programming languages, protocols, and storage elements,
wherein a first type of the plurality of types defines a subset of the plurality of types, and wherein the subset of the plurality of types excludes the first type,
wherein the subset of the plurality of types abstract storage elements and computing services from an application, wherein the storage elements include any of database structure, database language, or storage format,
wherein each respective type of the subset of the plurality of types identifies (i) respective data and (ii) at least one respective machine learning service for application to the respective data;
implementing the system on a remote computing service comprising a plurality of computing resources; and
executing, by a plurality of computing resources, the application using the subset of the plurality of types.
2. The method of claim 1 , further comprising storing the storage elements of the respective data and the computing services in metadata in at least a second type of the subset of the plurality of types.
3. The method of claim 2 , wherein the metadata of the second type of the subset of the plurality of types comprises the respective data field definition and the respective method definition of the respective type corresponding to the second type.
4. The method of claim 2 , further comprising updating the second type of the subset of the plurality of types by updating the metadata of the second type.
5. The method of claim 4 , wherein the metadata of the second type comprises validation rules.
6. The method of claim 1 , wherein the subset of the plurality of types abstract one or more data stores in which the respective data is stored.
7. The method of claim 6 , wherein the plurality of types abstract one or more methods for accessing the one or more data stores.
8. The method of claim 6 , wherein the one or more data stores comprise a key-value store and a relational database.
9. The method of claim 8 , wherein the key-value store is configured to store time-series data and the relational database is configured to store non-time-series data.
10. The method of claim 8 , further comprising implementing the key-value store and the relational database on one or more of the plurality of computing resources.
11. The method of claim 1 , wherein a second type of the plurality of types is associated with a graphical element in a visual analytics designer.
12. The method of claim 1 , wherein the plurality of computing resources comprises virtual machines.
13. The method of claim 1 , further comprising provisioning additional computing resources to accommodate increasing computing demand or releasing a subset of the plurality of computing resources to accommodate decreasing computing demand.
14. The method of claim 1 , wherein the subset of the plurality of types represent physical objects, and wherein the subset of the plurality of types abstract storage elements of the physical objects.
15. The method of claim 14 , wherein the physical objects comprise one or more of a customer, a facility, a sensor, a computing system, or a mobile communication device.
16. The method of claim 1 , wherein the machine learning services include machine learning classifiers for the respective data.
17. The method of claim 1 , wherein the machine learning services include a K-means clustering service for the respective data, and wherein the respective data includes sensor data.
18. The method of claim 1 , wherein the executing the application using the subset of the plurality of types utilizes the configurable interface to integrate disparate data from natively incompatible storage elements.
19. The method of claim 18 , wherein utilizing the configurable interface further integrates disparate data from natively incompatible programming languages.
20. The method of claim 1 , wherein the types enable the application to process data from disparate data sources independent of knowledge of the database structure, database language, or storage format.
21. The method of claim 20 , wherein the disparate data sources are natively incompatible.
22. A system comprising:
one or more processors; and
memory storing instructions that, when executed by the one or more processors, cause the system to perform:
providing a system comprising a plurality of types, wherein each type of the plurality of types comprises a respective data field definition and a respective method definition, and wherein at least one type of the plurality of types provides an interface across different programming languages,
wherein a first type of the plurality of types defines a subset of the plurality of types, and wherein the subset of the plurality of types excludes the first type,
wherein the subset of the plurality of types abstract storage elements of data and computing services from an application, wherein the storage elements include any of database structure, database language, or storage format,
wherein each respective type of the subset of the plurality of types identifies (i) respective data and (ii) at least one respective machine learning service for application to the respective data;
storing the storage elements of the data and the computing services in metadata in at least a second type of the subset of the plurality of types, wherein the metadata of the second type of the subset of the plurality of types comprises the respective data field definition and the respective method definition of the second type;
providing access to the subset of the plurality of types to a remote computing service comprising a plurality of computing resources;
executing, by the plurality of computing resources, the application using the subset of the plurality of types; and
updating, subsequent to executing the application, the second type of the subset of the plurality of types.
23. The system of claim 22 , wherein the updating the second type of the subset of the plurality of types comprises updating the metadata of the second type.
24. The system of claim 23 , wherein updating the metadata of the second type comprises updating the respective data field definition and the respective method definition of the respective type corresponding to the second type.