Auto-repairing mobile communication device data streaming architecture
A method of adapting content distribution. The method comprises receiving a stream of data from a plurality of sources by a computer system, storing the stream of data in a message queueing system executed on the computer system, and analyzing the stream of data based on a model of data content by the computer system, where the model is developed automatically based on training the model with historic data. The method further comprises based on the analysis of the stream of data using the model, adapting the information in the stream of data and after adapting the information in the stream of data, processing the data by a processing system executed on the computer system, where the processing comprises storing at least some of the data in a data store.
1. A method of adapting content distribution, comprising:
receiving a stream of data from a plurality of sources by a computer system, where the data comprises information about a mobile communication device location, a uniform resource locator (URL) accessed by a mobile communication device, a mobile communication device data session connection event, a mobile communication device data session disconnection event, a mobile communication device launch of a mobile application, a mobile communication device mobile application download event, or a combination thereof;
storing the stream of data in a message queueing system executed on the computer system;
analyzing the stream of data based on a model of data content by the computer system, where the model is developed automatically based on training the model with historic data;
based on the analysis of the stream of data using the model, eliminating one of the sources of data from the stream of data based on that source providing erroneous data;
after eliminating the one of the sources of data from the stream of data, processing the data by a processing system executed on the computer system, where the processing comprises storing at least some of the data in a data store;
monitoring data supplied by the eliminated source of data, where the monitored data is not processed with the data of the stream of data;
analyzing the monitored data using the model of data content by the computer system; and
based on the analysis of the monitored data, returning the eliminated source of data to the stream of data that is processed by the processing system,
whereby content distribution based on the data in the data store is performed based on data that is groomed of erroneous data.
2. The method of claim 1 , wherein the model of data content comprises a plurality of weights.
3. The method of claim 1 , wherein the mobile communication device is one of a mobile phone, a smart phone, a personal digital assistant (PDA), a wearable computer, a headset computer, a laptop computer, a tablet computer, or a notebook computer.
4. The method of claim 1 , wherein eliminating the one of the sources of data from the stream of data comprises blacklisting a source of data that is associated with erroneous data.
5. The method of claim 4 , wherein returning the eliminated source of data to the stream of data that is processed by the processing system comprises removing the source of data from a blacklist.
6. The method of claim 1 , further comprising monitoring performance of the computer system and tuning resources of the computer system based on performance monitoring.
7. A method of adapting content distribution, comprising:
receiving a stream of data from a plurality of sources by a computer system, where the data comprises information about a mobile communication device location, a uniform resource locator (URL) accessed by a mobile communication device, a mobile communication device data session connection event, a mobile communication device data session disconnection event, a mobile communication device launch of a mobile application, a mobile communication device mobile application download event, or a combination thereof;
storing the stream of data in a message queueing system executed on the computer system;
analyzing the stream of data based on a model of data content by the computer system, where the model is developed automatically based on training the model with historic data;
based on the analysis of the stream of data using the model, eliminating one of the sources of data from the stream of data based on that source providing erroneous data; and
after eliminating the one of the sources of data from the stream of data, processing the data by a processing system executed on the computer system, where the processing comprises storing at least some of the data in a data store,
whereby content distribution based on the data in the data store is performed based on data that is groomed of erroneous data.
8. The method of claim 7 , further comprising monitoring performance of the computer system and tuning resources of the computer system based on performance monitoring.
9. The method of claim 8 , wherein the performance monitoring comprises monitoring a processor utilization of the computer system.
10. The method of claim 8 , wherein the performance monitoring comprises monitoring memory utilization of the computer system.
11. The method of claim 8 , wherein tuning resources of the computer system comprises allocating additional virtual computing resources.
12. The method of claim 11 , wherein tuning resources of the computer system comprises deallocating virtual computing resources.
13. The method of claim 8 , wherein tuning resources of the computer system comprises allocating additional virtual storage resources.
14. A method of adapting content distribution, comprising:
receiving a stream of data from a plurality of sources by a computer system, where the data comprises information about a mobile communication device location, a uniform resource locator (URL) accessed by a mobile communication device, a mobile communication device data session connection event, a mobile communication device data session disconnection event, a mobile communication device launch of a mobile application, a mobile communication device mobile application download event, or a combination thereof;
storing the stream of data in a message queueing system executed on the computer system;
analyzing the stream of data based on a model of data content by the computer system, where the model is developed automatically based on training the model with historic data;
based on the analysis of the stream of data using the model, adapting the information in the stream of data; and
after adapting the information in the stream of data, processing the data by a processing system executed on the computer system, where the processing comprises storing at least some of the data in a data store,
whereby content distribution based on the data in the data store is performed based on data that is groomed of erroneous data thereby avoiding needless costs of storing erroneous data.
15. The method of claim 14 , wherein the mobile communication device is one of a mobile phone, a smart phone, a personal digital assistant (PDA), a wearable computer, a headset computer, a laptop computer, a tablet computer, or a notebook computer.
16. The method of claim 14 , wherein analyzing the stream of data comprises determining a score of data based on the model and comparing the score to a predefined threshold value.
17. The method of claim 14 , wherein adapting the information in the stream of data comprises correcting errors in the streamed data.
18. The method of claim 14 , wherein adapting the information in the stream of data comprises blacklisting a source of data that is associated with erroneous data.
19. The method of claim 14 , wherein the message queueing system is a Kafka message queueing system.
20. The method of claim 14 , wherein the processing system is a storm processing system.