Computer system and control method for data transfer
A computer system for controlling data linkage achieves higher rate data transfer between a first system that performs operations and a second system that acquires data regarding the operations reduces influence on the operations and between the systems. The first system includes a storage unit that manages resources storing data and a control unit that controls data transfer and the second system includes a data acquisition unit. The control unit calculates cost that represents a load of the first system with respect to each of multiple data transfer schemes, determines an applicable data transfer scheme based on the cost, and notifies the second system of that scheme. The data acquisition unit manages states associated with the determined data transfer scheme and sends a request to acquire data from resources based on the determined data transfer scheme and the states.
1. A computer system adapted to control data transfer between multiple systems comprising computers, each having an arithmetic unit, a storage device being connected to the arithmetic unit, and a networking device being connected to the arithmetic unit;
the multiple systems including a first system that performs operations and a second system that acquires data regarding the operations,
the first system comprising a storage unit that manages resources storing the data and a control unit that controls transfer of the data to the second system based on any one of multiple data transfer schemes,
the second system comprising a data acquisition unit that acquires the data from the resources,
wherein the control unit,
upon accepting a query of a data transfer scheme for a target resource from the data acquisition unit, calculates cost that represents a load of the first system with respect to each of the multiple data transfer schemes,
determines an applicable data transfer scheme based on the cost, and
sends information on the determined data transfer scheme to the second system,
wherein the data acquisition unit;
manages states that are information for managing a data transfer state and for use in data transfer based on the determined data transfer scheme, and
sends a request to acquire the data from the resources based on the determined data transfer scheme and the states,
wherein the first system manages cost coefficient information for managing cost coefficients for use in calculating the cost with respect to each of the data transfer schemes,
wherein the control unit:
acquires metrics of the target resource for use to calculate the cost,
acquires the cost coefficients for each of the multiple data transfer schemes from the cost coefficient information, and
calculates the cost with respect to each of the multiple data transfer schemes based on the metrics and the cost coefficients for each of the multiple data transfer schemes.
2. The computer system according to claim 1 ,
wherein the data acquisition unit determines a value that is managed as the states based on the determined data transfer scheme.
3. The computer system according to claim 1 ,
wherein the metrics of the target resource are at least either of the number of pieces of the data being stored in the resource and the data amount in the resource.
4. The computer system according to claim 1 , wherein:
the storage unit stores multiple types of resources for which formats of storing data differ by type; and
the cost coefficient information stores records, each comprising the resource type, the data transfer scheme, and the cost coefficients.
5. The computer system according to claim 1 ,
wherein the control unit, upon receiving a batch transfer request for the target resource from the data acquisition unit, adjusts the data amount to be transferred depending on the load of the first system and sends the data in the target resource to the second system.
6. A control method for data transfer between multiple systems that run in a computer system,
the computer system comprising computers, each having an arithmetic unit, a storage device being connected to the arithmetic unit, and a networking device being connected to the arithmetic unit;
the multiple systems including a first system that performs operations and a second system that acquires data regarding the operations,
the first system comprising a storage unit that manages resources storing the data and a control unit that controls transfer of the data to the second system based on any one of multiple data transfer schemes,
the second system comprising a data acquisition unit that acquires the data from the resources,
the transfer method for data transfer comprising:
a first step in which the control unit, upon accepting a query of a data transfer scheme for a target resource from the data acquisition unit, calculates cost that represents a load of the first system with respect to each of the multiple data transfer schemes;
a second step in which the control unit determines an applicable data transfer scheme based on the cost;
a third step in which the control unit sends information on the determined data transfer scheme to the second system,
a fourth step in which the data acquisition unit manages states that are information for managing a data transfer state and for use in data transfer based on the determined data transfer scheme; and
a fifth step in which the data acquisition unit sends a request to acquire the data from the resources based on the determined data transfer scheme and the states,
wherein:
the first system manages cost coefficient information for managing cost coefficients for use in calculating the cost with respect to each of the data transfer schemes; and
the first step comprises:
a step in which the control unit acquires metrics of the target resource for use to calculate the cost,
a step in which the control unit acquires the cost coefficients for each of the multiple data transfer schemes from the cost coefficient information, and
a step in which the control unit calculates the cost with respect to each of the multiple data transfer schemes based on the metrics and the cost coefficients for each of the multiple data transfer schemes.
7. The control method for data transfer according to claim 6 ,
wherein the fourth step comprises a step in which the data acquisition unit determines a value that is managed as the states based on the determined data transfer scheme.
8. The control method for data transfer according to claim 6 ,
wherein the metrics of the target resource are at least either of the number of pieces of the data being stored in the resource and the data amount in the resource.
9. The control method for data transfer according to claim 6 , wherein:
the storage unit stores multiple types of resources for which formats of storing data differ by type; and
the cost coefficient information stores records, each comprising the resource type, the data transfer scheme, and the cost coefficients.
10. The control method for data transfer according to claim 6 ,
wherein the method further comprises a step in which the control unit, upon receiving a batch transfer request for the target resource from the data acquisition unit, adjusts the data amount to be transferred depending on the load of the first system and sends the data in the target resource to the second system.