Classification and identification from raw data within a memory domain
A system, computer program product, and computer-executable method of managing one or more tiers of memory of a host computing system, the system, computer program product, and computer-executable method including accessing a portion of raw data from a memory page associated with data stored on the one or more tiers of memory, sampling the portion of raw data to select a sample data, analyzing the sample data to determine a sample category, and classifying the portion of raw data based at least in part by considering the sample category.
1. A computer-executable method of managing one or more tiers of memory of a host computing system, the computer-executable method comprising:
accessing a portion of low level, raw data from a memory page associated with data stored on the one or more tiers of memory;
sampling the portion of low level, raw data to select a sample data chunk;
analyzing the sample data chunk to determine a sample category; and
classifying the portion of low level, raw data based at least in part by considering the sample category, wherein the classifying further comprises creating a sample survey of a desired statistical confidence limit for the sample data chunk.
2. The computer-executable method of claim 1 , wherein the analyzing comprises micro-text mining the sample data chunk.
3. The computer-executable method of claim 1 , wherein the analyzing comprises clustering using statistical fingerprinting.
4. The computer-executable method of claim 3 , wherein statistical fingerprinting includes using one or more of the following: a Hamming weight, an arithmetic mean, a Shannon entropy, and a Kolomogrov-Smirnov p-value.
5. The computer-executable method of claim 1 , further comprising providing the classification to the host computing system to enable the host computing system to optimize data stored on the one or more tiers.
6. The computer-executable method of claim 1 , wherein the one or more tiers of memory are provided from one or more memory devices.
7. The computer-executable method of claim 6 , wherein the one or more memory devices includes volatile and non-volatile memory.
8. A system, comprising:
a host computing system including one or more tiers of memory; and
computer-executable program logic encoded in memory of one or more computers enabled to manage the one or more tiers of memory, wherein the computer-executable program logic is configured for the execution of:
accessing a portion of low level, raw data from a memory page associated with data stored on the one or more tiers of memory;
sampling the portion of low level, raw data to select a sample data chunk;
analyzing the sample data chunk to determine a sample category; and
classifying the portion of low level, raw data based at least in part by considering the sample category, wherein the classifying further comprises creating a sample survey of a desired statistical confidence limit for the sample data chunk.
9. The system of claim 8 , wherein the analyzing comprises micro-text mining the sample data chunk.
10. The system of claim 8 , wherein the analyzing comprises clustering using statistical fingerprinting.
11. The system of claim 10 , wherein statistical fingerprinting includes using one or more of the following: a Hamming weight, an arithmetic mean, a Shannon entropy, and a Kolomogrov-Smirnov p-value.
12. The system of claim 8 , wherein the computer-executable program logic is further configured for the execution of providing the classification to the host computing system to enable the host computing system to optimize data stored on the one or more tiers.
13. The system of claim 8 , wherein the one or more tiers of memory are provided from one or more memory devices.
14. The system of claim 13 , wherein the one or more memory devices includes volatile and non-volatile memory.
15. A computer program product for managing one or more tiers of memory of a host computing system, the computer program product comprising:
a non-transitory computer readable medium encoded with computer-executable code, the code configured to enable the execution of:
accessing a portion of low level, raw data from a memory page associated with data stored on the one or more tiers of memory;
sampling the portion of low level, raw data to select a sample data chunk;
analyzing the sample data chunk to determine a sample category; and
classifying the portion of low level, raw data based at least in part by considering the sample category, wherein the classifying further comprises creating a sample survey of a desired statistical confidence limit for the sample data chunk.
16. The computer program product of claim 15 , wherein the analyzing comprises micro-text mining the sample data chunk.
17. The computer program product of claim 15 , wherein the analyzing comprises clustering using statistical fingerprinting.
18. The computer program product of claim 17 , wherein statistical fingerprinting includes using one or more of the following: a Hamming weight, an arithmetic mean, a Shannon entropy, and a Kolomogrov-Smirnov p-value.
19. The computer program product of claim 15 , wherein the code is further configured to enable the execution of providing the classification to the host computing system to enable the host computing system to optimize data stored on the one or more tiers.
20. The computer program product of claim 15 , wherein the one or more tiers of memory are provided for more than one memory device.