Resource Aware Classification System
A data classification component of an enterprise system that integrates computing resource information and network traffic information in near real time to control the impact of transmitting and classifying unstructured data on an overall enterprise system. In some cases, the classification component may combine the computing asset and network performance information for each local resource with computing assets and network performance information associated with a central classification service/server to organize and prioritize classification activities within the overall system to improve and maintain throughput associated with normal system operation
1 . A system comprising:
a communication interface for commination;
one or more processors; and
one or more computer-readable storage media storing computer-executable instructions, which when executed by one or more processors, cause the one or more processors to:
receive a first set of computing resource data associated with a set of resources in the system, the first set of computing resource data received from a set of native modules, wherein individual native modules of the set of software native modules are associated with a resource of the set of resources, the first set of resource data including central processing unit usage;
in response to receiving the first set of computing resource data, adjust an amount of resources within a resource pool, the resource pool assigned to perform classification activities associated with unstructured data;
receive a second set of computing resource data associated with the set of resources, the second set of computing resource data received from the set of native modules; and
in response to receiving the second set of computing resource data, further adjust the amount of resources within the resource pool.
2 . The system as recited in claim 1 , wherein the computer-executable instructions, when executed by the one or more processors, further cause the one or more processors to:
identify the unstructured data within a data repository; and
generate one or more classification tasks to classify the unstructured data in response to identifying the unstructured data within the data repository.
3 . The system as recited in claim 2 , wherein the computer-executable instructions, when executed by the one or more processors, further cause the one or more processors to:
assign a priority to individual ones of the one or more classification tasks.
4 . The system as recited in claim 2 , wherein the computer-executable instructions, when executed by the one or more processors, further cause the one or more processors to:
receive classification information from a classification database; and
generate one or more classification tasks to classify unstructured data based at least in part on the classification information.
5 . The system as recited in claim 2 , wherein the computer-executable instructions, when executed by the one or more processors, further cause the one or more processors to:
assign individual ones of the one or more classification tasks to a schedule queue associated with classification tasks.
6 . The system as recited in claim 1 , wherein the computer-executable instructions, when executed by the one or more processors, further cause the one or more processors to:
receive a third set of computing resource data associated with the set of resources, the third set of computing resource data received from the set of native modules;
in response to receiving the third set of computing resource data, further adjust the amount of resources within the resource pool.
7 . The system as recited in claim 1 , wherein the computer-executable instructions, when executed by the one or more processors, further cause the one or more processors to:
aggregating, by the classification component, the first set of computing resource data and the second set of computing resource data; and
analyzing, by the classification component, the aggregated data to identify one or more patterns associated with resource usage; and
wherein adjusting the amount of resources within the resource pool is based at least in part on the one or more patterns.
8 . A method comprising:
receiving, by a classification component from at least one native module operating on a plurality of devices associated with a system, computing resources usage associated with individual ones of the plurality of devices;
aggregating, by a classification component of the system, computing resource usage information associated with at least one of the plurality of devices, the computing resources information received by the classification component from individual ones of the local modules in near real time; and
adjusting, by the classification component, an amount of resources within a resource pool, the resources within the resource pool assigned to perform classification activities associated with unstructured data based at least in part on the aggregated computing resource usage information.
9 . The method as recited in claim 8 , further comprising:
storing the aggregated computing resource usage information based on periods of time as historical statistical data;
analyzing, by the classification component, the historical statistical data to identify one or more patterns associated with resource usage at a system level; and
wherein adjusting the amount of resources within the resource pool is based at least in part on the one or more patterns.
10 . The method as recited in claim 8 , further comprising:
identifying, by the classification component, the unstructured data within a data repository of the system;
generating one or more classification tasks to classify the unstructured data; and
assigning individual ones of the one or more classification tasks to a first priority queue based at least in part on the aggregated computing resource usage information.
11 . The method as recited in claim 10 , wherein adjusting the amount of resources within the resource pool includes adjusting a percentage of the resources within the resource pool assigned to the first priority queue.
12 . A method comprising:
receive a first set of computing resource data associated with a set of resources in the system, the first set of computing resource data received from a set of native modules, wherein individual native modules of the set of software native modules are associated with a resource of the set of resources, the first set of resource data including central processing unit usage; and
in response to receiving the first set of computing resource data, adjust an amount of resources within a resource pool, the resource pool assigned to perform classification activities associated with unstructured data.
13 . The method as recited in claim 12 , further comprising:
receive a second set of computing resource data associated with the set of resources, the second set of computing resource data received from the set of native modules, the second set of computing resource data received at a period of time after receiving the first set of computing resource data; and
in response to receiving the second set of computing resource data, further adjust the amount of resources within the resource pool.
14 . The method as recited in claim 13 , further comprising:
receive a third set of computing resource data associated with the set of resources, the third set of computing resource data received from the set of native modules, the third set of computing resource data received at a period of time after receiving the first set of computing resource data and the second set of computing resource data;
in response to receiving the third set of computing resource data, further adjust the amount of resources within the resource pool.
15 . The method as recited in claim 12 , further comprising:
identify the unstructured data within a data repository; and
generate one or more classification tasks to classify the unstructured data in response to identifying the unstructured data within the data repository.
16 . The method as recited in claim 12 , further comprising:
receive classification information from a classification database; and
generate one or more classification tasks to classify unstructured data based at least in part on the classification information.
17 . The method as recited in claim 16 , further comprising:
assign individual ones of the one or more classification tasks to a schedule queue associated with classification tasks.
18 . The method as recited in claim 12 , wherein adjusting the amount of resources within the resource pool includes adjusting a percentage of the resources within the resource pool assigned to a first priority queue, the first priority queue inducing classification tasks to be completed by the resources.
19 . The method as recited in claim 12 , wherein adjusting the amount of resources within the resource pool includes adding additional hardware capabilities to the resource pool.
20 . The method as recited in claim 12 , wherein adjusting the amount of resources within the resource pool includes removing hardware capabilities from the resource pool.