Table partition configuration method, apparatus and system for database system
Embodiments of the present disclose provide a method and apparatus for identifying network attacks. The method can include: acquiring access data within at least two time periods of a target website server according to preset fields; counting a quantity of access data having the same content in each of the preset fields within each of the time periods; determining whether the quantities of access data having the same preset fields within each of the time periods are the same; and in response to the quantities of access data having the same preset fields within each of the time periods being the same, determining access requests corresponding to access data having the same quantity as small-traffic network attacks.
1. A table partition configuration method for a database system, comprising:
acquiring reserved throughput of a table that is estimated by a maximum number of records that the table processes within a unit of time;
acquiring service capacity information of partitions in the database system and current partition usage information of the table; and
configuring partitions of the table according to the reserved throughput of the table, the service capacity information of the partitions in the database system, and the current partition usage information of the table.
2. The method of claim 1 , wherein configuring the partitions of the table according to the reserved throughput of the table, the service capacity information of the partitions in the database system, and the current partition usage information of the table further comprises:
determining a quantity of partitions to be configured for the table according to the reserved throughput of the table and the service capacity information of the partitions in the database system; and
configuring the partitions of the table according to the current partition usage information of the table and the quantity of partitions to be configured for the table.
3. The method of claim 2 , wherein configuring the partitions of the table according to the current partition usage information of the table and the quantity of partitions to be configured for the table further comprises:
configuring the partitions of the table according to the current partition usage information of the table and the quantity of partitions to be configured for the table when a current partition quantity of the table does not equal the quantity of partitions to be configured for the table,
wherein the current partition usage information of the table comprises the current partition quantity of the table and the current partition quantity of the table is N and the quantity of partitions to be configured for the table is M.
4. The method of claim 3 , wherein configuring the partitions of the table according to the current partition configuration of the table and the quantity of partitions to be configured for the table comprises:
merging at least two current partitions in the table in response to the current partition quantity N of the table being greater than the quantity M of partitions to be configured for the table, such that a quantity of merged partitions in the table is M after merging, wherein M and N are positive integers.
5. The method of claim 4 , wherein configuring the partitions of the table according to the current partition configuration of the table and the quantity of partitions to be configured for the table further comprises:
merging k current partitions in the table into one partition, in response to the current partition quantity N of the table being k times of the quantity M of partitions to be configured for the table, wherein k is a positive integer greater than one.
6. The method of claim 4 , further comprising: acquiring service capacity information of worker nodes of the database system and loaded partition information of the worker nodes of the database system, wherein configuring partitions of the table further comprises:
determining the quantity of partitions of the table to be loaded on each worker node of the database system according to the service capacity information of the partitions, the quantity of partitions to be configured for the table, an adjusted partition result of the table, the service capacity information of the worker nodes of the database system, and the loaded partition information of the worker nodes of the database system.
7. The method of claim 2 , wherein configuring the partitions of the table according to the current partition configuration of the table and the quantity of partitions to be configured for the table further comprises:
adding M-N blank partitions in the table, in response to the current partition quantity N of the table being less than the quantity M of partitions to be configured for the table, wherein N is a non-negative integer, and M is a positive integer.
8. The method of claim 2 , wherein configuring the partitions of the table according to the current partition configuration of the table and the quantity of partitions to be configured for the table further comprises:
splitting at least two current partitions in the table, in response to the current partition quantity N of the table being less than the quantity M of partitions to be configured for the table, such that a quantity of split partitions in the table is M.
9. The method of claim 8 , wherein configuring the partitions of the table according to the current partition configuration of the table and the quantity of partitions to be configured for the table further comprises:
splitting each current partition in the table into k partitions, in response to the quantity M of partitions to be configured for the table being k times of the current partition quantity N of the table, wherein k is a positive integer greater than 1.
10. The method of claim 2 , wherein configuring the partitions of the table according to the current partition configuration of the table and the quantity of partitions to be configured for the table comprises:
splitting each current partition in the table into M/k sub-partitions and merging every N/k sub-partitions to form merged partitions, in response to the greatest common divisor between the current partition quantity N of the table and the quantity M of partitions to be configured for the table being k, wherein M, N and k are positive integers, M≠k, and N≠k.
11. The method of claim 1 , wherein acquiring reserved throughput of a table further comprises:
acquiring reserved throughput of the table periodically or when the reserved throughput of the table changes.
12. The method of claim 1 , wherein the database system is a NoSQL system.
13. An electronic device, comprising:
a memory configured to store computer executable instructions; and
a processor configured to perform the instructions to cause the electronic device to perform:
acquiring reserved throughput of a table that is estimated by a maximum number of records that the table processes within a unit of time;
acquiring service capacity information of partitions in the database system and current partition usage information of the table; and
configuring partitions of the table according to the reserved throughput of the table, the service capacity information of the partitions in the database system, and the current partition usage information of the table.
14. A database system, comprising: a master node and worker nodes, wherein
the master node is configured to:
acquire reserved throughput of a table, service capacity information of partitions in the database system, and current partition usage information of the table, wherein the reserved throughput of the table is estimated by a maximum number of records that the table processes within a unit of time;
determine partition configuration of the table according to the reserved throughput of the table, the service capacity information of the partitions in the database system, and the current partition usage information of the table; and
configure partitions of the table according to the partition configuration of the table, and schedule the partitions of the table to the worker nodes; and
the worker node is configured to:
load and/or unload partitions of each table on the worker node according to partition scheduling performed by the master node on each table.
15. A non-transitory computer readable medium that stores a set of instructions that is executable by at least one processor of an electronic device to cause the electronic device to perform a table partition configuration method, the method comprising:
acquiring reserved throughput of a table that is estimated by a maximum number of records that the table processes within a unit of time;
acquiring service capacity information of partitions in the database system and current partition usage information of the table; and
configuring partitions of the table according to the reserved throughput of the table, the service capacity information of the partitions in the database system, and the current partition usage information of the table.