Data management system
Methods and systems for managing, storing, and serving data within a virtualized environment are described. In some embodiments, a data management system may manage the extraction and storage of virtual machine snapshots, provide near instantaneous restoration of a virtual machine or one or more files located on the virtual machine, and enable secondary workloads to directly use the data management system as a primary storage target to read or modify past versions of data. The data management system may allow a virtual machine snapshot of a virtual machine stored within the system to be directly mounted to enable substantially instantaneous virtual machine recovery of the virtual machine.
1. A method for operating a data management system, comprising:
acquiring, from a primary system, a full snapshot of a virtual machine of the primary system, the full snapshot corresponding with a first state of the virtual machine at a first point in time;
acquiring, from the primary system, one or more incremental snapshots of the virtual machine, the one or more incremental snapshots corresponding with one or more states of the virtual machine at one or more points in time different from the first point in time;
generating, at the data management system, a directly mountable version of the virtual machine corresponding to a point in time associated with at least one of the full snapshot or one of the one or more incremental snapshots;
receiving, at the data management system, a request to mount the directly mountable version of the virtual machine; and
causing the primary system to directly mount the directly mountable version of the virtual machine from the data management system to allow the primary system to read, from the data management system, data associated with the directly mountable version of the virtual machine maintained at the data management system, modify, at the data management system, the data associated with the directly mountable version of the virtual machine maintained at the data management system, or both.
2. The method of claim 1 , further comprising:
consolidating the full snapshot with one or more of the one or more incremental snapshots to create a second full snapshot of the virtual machine, wherein the second full snapshot corresponds to a state of the virtual machine at a point in time after the first state.
3. The method of claim 2 , further comprising:
consolidating the second full snapshot with one or more of the one or more incremental snapshots to create a third full snapshot of the virtual machine, wherein the third full snapshot corresponds to a state of the virtual machine at a point in time after the point in time associated with the second full snapshot.
4. The method of claim 1 , further comprising:
consolidating the full snapshot with an incremental snapshot corresponding to a point in time after the full snapshot to create a second full snapshot; and
repeating the consolidating the full snapshot for successive full snapshots.
5. The method of claim 4 , wherein repeating the consolidating is performed based on a predetermined schedule.
6. The method of claim 1 , further comprising:
transferring a version of the virtual machine to the primary system while allowing the primary system to directly mount the version maintained by the data management system.
7. The method of claim 6 , further comprising:
causing the primary system to switch back to the version transferred to the primary system.
8. The method of claim 1 , wherein causing the primary system to directly mount the directly mountable version of the virtual machine comprises:
executing a distributed file system protocol to present the directly mountable version of the virtual machine to the primary system.
9. The method of claim 8 , wherein the distributed file system protocol is a Network File System (NFS).
10. A data management system, comprising:
one or more storage devices; and
one or more processors in communication with the one or more storage devices, the one or more processors configured to:
acquire, from a primary system, a full snapshot of a virtual machine of the primary system, the full snapshot corresponding with a first state of the virtual machine at a first point in time;
acquire, from the primary system, one or more incremental snapshots of the virtual machine, the one or more incremental snapshots corresponding with one or more states of the virtual machine at one or more points in time different from the first point in time;
generate, at the data management system, a directly mountable version of the virtual machine corresponding to a point in time associated with at least one of the full snapshot or one of the one or more incremental snapshots;
receive, at the data management system, a request to mount the directly mountable version of the virtual machine; and
cause the primary system to directly mount the directly mountable version of the virtual machine to allow the primary system to read, from the data management system, data associated with the directly mountable version of the virtual machine maintained at the data management system, modify, at the data management system, the data associated with the directly mountable version of the virtual machine maintained at the data management system, or both.
11. The data management system of claim 10 , wherein the one or more processors are configured to:
consolidate the full snapshot with one or more of the one or more incremental snapshots to create a second full snapshot of the virtual machine, wherein the second full snapshot corresponds to a state of the virtual machine at a point in time after the first state.
12. The data management system of claim 11 , wherein the one or more processors are configured to:
consolidate the second full snapshot with one or more of the one or more incremental snapshots to create a third full snapshot of the virtual machine, wherein the third full snapshot corresponds to a state of the virtual machine at a point in time after the point in time associated with the second full snapshot.
13. The data management system of claim 10 , wherein the one or more processors are configured to:
consolidate the full snapshot with an incremental snapshot corresponding to a point in time after the full snapshot to create a second full snapshot; and
repeat the consolidating the full snapshot for successive full snapshots.
14. The data management system of claim 11 , wherein the consolidating is repeated based on a predetermined schedule.
15. The data management system of claim 10 , wherein the one or more processors are configured to:
transfer a version of the virtual machine to the primary system while allowing the primary system to directly mount the version maintained by the data management system.
16. The data management system of claim 15 , wherein the one or more processors are configured to:
cause the primary system to switch back to the version transferred to the primary system.
17. The data management system of claim 10 , wherein the one or more processors are configured to:
execute a distributed file system protocol to present the directly mountable version of the virtual machine to the primary system.
18. The data management system of claim 17 , wherein the distributed file system protocol is a Network File System (NFS).
19. One or more storage devices containing processor-readable code for programming one or more processors to perform a method for operating a data management system, the processor-readable code configured to:
acquire, from a primary system, a full snapshot of a virtual machine of the primary system, the full snapshot corresponding with a first state of the virtual machine at a first point in time;
acquire, from the primary system, one or more incremental snapshots of the virtual machine, the one or more incremental snapshots corresponding with one or more states of the virtual machine at one or more points in time different from the first point in time;
generate, by the data management system, a directly mountable version of the virtual machine corresponding to a point in time associated with at least one of the full snapshot or one of the one or more incremental snapshots;
receive, at the data management system, a request to mount the directly mountable version of the virtual machine; and
cause the primary system to directly mount the directly mountable version of the virtual machine to allow the primary system to read, from the data management system, data associated with the directly mountable version of the virtual machine maintained at the data management system, modify, at the data management system, the data associated with the directly mountable version of the virtual machine maintained at the data management system, or both.
20. The one or more storage devices of claim 19 , wherein the processor-readable code is configured to:
consolidate the full snapshot with one or more of the one or more incremental snapshots to create a second full snapshot of the virtual machine, wherein the second full snapshot corresponds to a state of the virtual machine at a point in time after the first state.