Method and apparatus for storing data
The present disclosure provides a method and apparatus for storing data. The method comprises: extracting metric information and metadata associated with the metric information from time series data, the metric information including a time value and a numerical value at the time value; and staling the metric information in an object storage device and the metadata in a database. As compared with the prior art, the present disclosure provides a flexible storage design to guarantee extensibility of storage capacity and meanwhile support fast data retrieving.
1. A method of storing data, comprising:
extracting metric information and metadata associated with the metric information from time series data, the metric information including a time value and a numerical value at the time value;
storing the metric information in an object storage device using a tiering technology and storing the metadata in a database, wherein the object storage device includes a first storage device component as a performance tier and a second storage device component as a capacity tier;
receiving a data request to obtain a portion of the metric information from the object storage device;
searching the database to access metadata pertaining to the portion of the metric information;
locating the portion of the metric information in the object storage device based on the search in the database; and
returning the located portion of the metric information to a user.
2. The method according to claim 1 , wherein the metadata includes entities and a resource, the entities including a measurement item and the resource including a combination of the entities.
3. The method according to claim 2 , wherein the time value and the numerical value are associated with a specific entity among the entities.
4. The method according to claim 1 , wherein the object storage device has a scalable storage space.
5. The method according to claim 1 , further comprising:
splitting a storage block of the metric information into a plurality of segments with fixed timespans.
6. The method according to claim 5 , further comprising:
storing a correspondence between the plurality of segments and the timespans in the database as a part of the metadata.
7. The method according to claim 1 , wherein the database includes a Structured Query Language (SQL) database.
8. The method according to claim 1 , wherein storing the metric information in the object storage device using a tiering technology comprises:
storing the metric information in the first storage device component; and
duplicating the stored metric information to the second storage device component.
9. The method according to claim 8 , further comprising:
in response to storing the metric information in the first storage device component, deleting original object data in the first storage device component based on a policy.
10. The method according to claim 9 , wherein the policy is based on an access frequency and a storage age of the original object data.
11. The method according to claim 9 , further comprising:
if object data to be accessed is only stored in the second storage device component, duplicating the object data from the second storage device component to the first storage device component.
12. The method according to claim 1 , wherein the first storage device component includes a solid state drive (SSD), and the second storage device component includes a hard disk drive (HDD).
13. The method according to claim 1 , further comprising:
providing a dedicated user interface for managing the metric information and the metadata.
14. The method according to claim 13 , wherein the managing includes at least one of: writing, reading, deleting, and updating.
15. The method according to claim 13 , wherein the dedicated user interface includes a representational state transfer (REST) interface.
16. The method according to claim 1 , wherein searching the database is based on a query that specifies a timespan stored in the database, the timespan corresponding to multiple timestamped entries in the object storage device.
17. The method according to claim 1 , wherein the step of storing the metric information and the metadata is performed after the step of extracting the metric information and the metadata and effects storage of the metadata separately from the metric information.
18. An apparatus for storing data, comprising:
processing circuitry coupled to memory, implementing an extraction unit and a control unit;
wherein the extracting unit is configured to extract metric information and metadata associated with the metric information from time series data, the metric information including a time value and a numerical value at the time value; and
wherein the control unit is configured to:
store the metric information in an object storage device using a tiering technology and store the metadata in a database, wherein the object storage device includes a first storage device component as a performance tier and a second storage device component as a capacity tier,
receive a data request to obtain a portion of the metric information from the object storage device,
search the database to access metadata pertaining to the portion of the metric information,
locate the portion of the metric information in the object storage device based on the search in the database, and
return the located portion of the metric information to a user.
19. The apparatus according to claim 18 , wherein the metadata includes entities and a resource, the entities including a measurement item and the resource including a combination of the entities.
20. The apparatus according to claim 19 , wherein the time value and the numerical value are associated with a specific entity among the entities.