Data management for edge computing environment
In an edge data management methodology, first information is obtained pertaining to a given data set associated with a computing environment, wherein the computing environment comprises one or more edge computing networks and one or more centralized computing networks. Second information is obtained that is descriptive of processing functionalities available at the one or more edge computing networks. Third information is obtained that is descriptive of processing functionalities available at the one or more centralized computing networks. A processing location decision is generated for at least a portion of the given data set based on the obtained first, second and third information. Time cost information may also be obtained that is associated with processing of at least a portion of the given data set, and used to generate the processing location decision.
1. A method, comprising:
obtaining first information pertaining to a given data set associated with a computing environment, wherein the computing environment comprises one or more edge computing networks and one or more centralized computing networks;
obtaining second information representative of processing functionalities available at the one or more edge computing networks;
obtaining third information representative of processing functionalities available at the one or more centralized computing networks; and
generating a processing location decision for at least a portion of the given data set based on the obtained first, second and third information;
wherein generating the processing location decision comprises:
a determination with respect to a location within the computing environment to process the at least a portion of the given data set; and
obtaining time cost information associated with processing the at least a portion of the given data set at the one or more edge computing networks and at the one or more centralized computing networks, and using the time cost information to perform a cost analysis to make the determination with respect to the location to process the at least a portion of the given data set; and
wherein the obtaining and generating steps are performed via one or more processing devices.
2. The method of claim 1 , further comprising obtaining data variance information for the given data set to determine which portion of the data set is statistically significant, and generating the processing location decision for the statistically significant portion of the given data set.
3. The method of claim 2 , wherein the determination of which portion of the data set is statistically significant is iterative based on a feedback loop associated with a model training process.
4. The method of claim 1 , wherein the processing location decision generating step generates a decision to process the at least a portion of the given data set at the one or more edge computing networks.
5. The method of claim 1 , wherein the processing location decision generating step generates a decision to process the at least a portion of the given data set at the one or more centralized computing networks.
6. The method of claim 1 , wherein the processing location decision generating step generates a decision to coalesce the at least a portion of the given data set with other data at the one or more edge computing networks, the one or more centralized computing networks, or another computing location.
7. The method of claim 1 , further comprising causing the at least a portion of the given data set to be moved from one location in the computing environment to another location in the computing environment based on the processing location decision.
8. The method of claim 1 , further comprising generating a graph-based view of the computing environment from the obtained first, second and third information.
9. The method of claim 1 , wherein the given data set is an edge data set.
10. The method of claim 1 , wherein the processing location decision generating step generates a decision comprising at least two of: a decision to process the at least a portion of the given data set at the one or more edge computing networks; a decision to process the at least a portion of the given data set at the one or more centralized computing networks; and a decision to coalesce the at least a portion of the given data set with other data at the one or more edge computing networks, the one or more centralized computing networks, or another computing location.
11. A system, comprising:
at least one processor, coupled to a memory, and configured to:
obtain first information pertaining to a given data set associated with a computing environment, wherein the computing environment comprises one or more edge computing networks and one or more centralized computing networks;
obtain second information representative of processing functionalities available at the one or more edge computing networks;
obtain third information representative of processing functionalities available at the one or more centralized computing networks; and
generate a processing location decision for at least a portion of the given data set based on the obtained first, second and third information;
wherein generating the processing location decision comprises:
a determination with respect to a location within the computing environment to process the at least a portion of the given data set; and
obtaining time cost information associated with processing the at least a portion of the given data set at the one or more edge computing networks and at the one or more centralized computing networks, and using the time cost information to perform a cost analysis to make the determination with respect to the location to process the at least a portion of the given data set.
12. The system of claim 11 , wherein the at least one processor and memory are further configured to obtain data variance information for the given data set to determine which portion of the data set is statistically significant, and generate the processing location decision for the statistically significant portion of the given data set.
13. The system of claim 12 , wherein the determination of which portion of the data set is statistically significant is iterative based on a feedback loop associated with a model training process.
14. The system of claim 11 , wherein the processing location decision generating step generates a decision comprising one or more of: a decision to process the at least a portion of the given data set at the one or more edge computing networks; a decision to process the at least a portion of the given data set at the one or more centralized computing networks; and a decision to coalesce the at least a portion of the given data set with other data at the one or more edge computing networks, the one or more centralized computing networks, or another computing location.
15. The system of claim 11 , wherein the at least one processor and memory are further configured to cause the at least a portion of the given data set to be moved from one location in the computing environment to another location in the computing environment based on the processing location decision.
16. The system of claim 11 , wherein the at least one processor and memory are further configured to generate a graph-based view of the computing environment from the obtained first, second and third information.
17. The system of claim 11 , wherein the processing location decision generating step generates a decision comprising at least two of: a decision to process the at least a portion of the given data set at the one or more edge computing networks; a decision to process the at least a portion of the given data set at the one or more centralized computing networks; and a decision to coalesce the at least a portion of the given data set with other data at the one or more edge computing networks, the one or more centralized computing networks, or another computing location.
18. An article of manufacture comprising a processor-readable storage medium having encoded therein executable code of one or more software programs, wherein the one or more software programs when executed by one or more processing devices implement steps of:
obtaining first information pertaining to a given data set associated with a computing environment, wherein the computing environment comprises one or more edge computing networks and one or more centralized computing networks;
obtaining second information representative of processing functionalities available at the one or more edge computing networks;
obtaining third information representative of processing functionalities available at the one or more centralized computing networks; and
generating a processing location decision for at least a portion of the given data set based on the obtained first, second and third information;
wherein generating the processing location decision comprises:
a determination with respect to a location within the computing environment to process the at least a portion of the given data set; and
obtaining time cost information associated with processing the at least a portion of the given data set at the one or more edge computing networks and at the one or more centralized computing networks, and using the time cost information to perform a cost analysis to make the determination with respect to the location to process the at least a portion of the given data set.
19. The article of claim 18 , wherein the processing location decision generating step generates a decision comprising one or more of: a decision to process the at least a portion of the given data set at the one or more edge computing networks; a decision to process the at least a portion of the given data set at the one or more centralized computing networks; and a decision to coalesce the at least a portion of the given data set with other data at the one or more edge computing networks, the one or more centralized computing networks, or another computing location.
20. The article of claim 18 , wherein the one or more software programs when executed by the one or more processing devices further implement the step of causing the at least a portion of the given data set to be moved from one location in the computing environment to another location in the computing environment based on the processing location decision.