System, method and program for collecting data
An object of the present disclosure is to provide a system that does not require a large amount of network resources even in a case where data is collected from a large number of data sources. The present disclosure provides a system that collects data from a plurality of data sources to a server, wherein each of the data sources sends data transfer requirements to a controller, the controller determines a transmission policy of each of the data sources on the basis of the data transfer requirements, each of the data sources autonomously sends a request for generating a communication path on the basis of the transmission policy, the controller generates a communication path on the basis of the request for generating a communication path from each of the data sources, and each of the data sources transmits data by use of the generated communication path.
1. A computer network system configured to collect data from a plurality of data sources to a server, the computer network system comprising:
a controller configured to determine transmission policies to be distributed to the plurality of data sources, wherein
each of the data sources is configured to send, to the controller, data transfer requirements when the data is sent to the server, wherein the data transfer requirements include an allowable delay time and a data generation frequency of each of the data sources,
the controller is configured to determine a transmission policy of each of the data sources on a basis of the allowable delay time and the data generation frequency of each of the data sources,
each of the data sources is configured to autonomously transmit a request for generating a communication path on a basis of the transmission policy,
the controller is configured to generate the communication path from each of the data sources to the server on a basis of the request for generating the communication path from each of the data sources, and
each of the data sources is configured to transmit data by use of the generated communication path.
2. The computer network system according to claim 1 , wherein
the transmission policies include:
a transmission policy of generating the communication path immediately after generation of data, transferring the data, and releasing the communication path immediately after completion of the data transfer;
a transmission policy of generating the communication path after a certain amount of data is accumulated, transferring the data, and releasing the communication path immediately after completion of the data transfer; and
a transmission policy of generating the communication path immediately after generation of the data, transferring the data, and continuously holding the communication path for a certain period of time after completion of the data transfer.
3. The computer network system according to claim 1 , wherein
the controller is configured to:
determine a transmission policy of generating the communication path immediately after generation of data, transferring the data, and releasing the communication path immediately after completion of the data transfer in a case where the allowable delay time is equal to or less than a set time and the data generation frequency is equal to or less than a set value,
determine a transmission policy of generating the communication path after a certain amount of data is accumulated, transferring the data, and releasing the communication path immediately after completion of the data transfer in a case where the allowable delay time exceeds the set time and the data generation frequency is equal to or less than the set value, and
determine a transmission policy of generating the communication path immediately after generation of the data, transferring the data, and continuously holding the communication path for a certain period of time after completion of the data transfer in a case where the allowable delay time is equal to or less than the set time and the data generation frequency exceeds the set value.
4. A method for collecting data from a plurality of data sources to a server, comprising:
sending, by the data sources, data transfer requirements when the data is sent to the server to a controller, wherein the data transfer requirements include an allowable delay time and a data generation frequency of each of the data sources;
determining, by the controller, a transmission policy of each of the data sources on a basis of the allowable delay time and the data generation frequency of each of the data sources;
autonomously transmitting, by each of the data sources, a request for generating a communication path on a basis of the transmission policy;
generating, by the controller, the communication path from each of the data sources to the server on a basis of the request for generating the communication path from each of the data sources; and
transmitting, by each of the data sources, data by use of the generated communication path.
5. A non-transitory computer readable medium storing a program,
wherein execution of the program causes a computer to be implemented as each functional unit included in the controller according to claim 1 .