Copying a file system
An illustrative data storage system is configured to use pods to efficiently copy files systems constructed of block objects. In certain examples, the storage system generates, based on a pod that includes a file system constructed of block objects, a virtual copy of the pod such that modifications made to the pod (e.g., modifications to contents of the block objects by way of the pod) after the generation of the virtual copy of the pod are distinct from the virtual copy of the pod. In certain examples, the virtual copy of the pod is a writeable clone of the pod and modifications made to the clone (e.g., modifications to contents of the block objects by way of the clone) after the generation of the clone are distinct from the pod.
1 . A data storage system comprising:
a memory storing instructions; and
a processor communicatively coupled to the memory and configured to execute the instructions to:
generate, based on a pod that includes a file system constructed of block objects that are presented to the file system and that map file system data structures representative of files and directories of the file system to blocks of data, wherein the block objects are modifiable, with the block objects supporting random read-write access to ranges of bytes at a block level of the block objects, a virtual copy of the pod such that modifications made to the pod after the generation of the virtual copy of the pod are distinct from the virtual copy of the pod;
the pod being a storage system construct that groups storage entities within a namespace and supports operations on the storage entities as a group.
2 . The data storage system of claim 1 , wherein:
the pod and the virtual copy of the pod initially share contents of the block objects; and
in response to a request to modify content of a block object of the block objects, the processor is configured to execute the instructions to:
generate a first virtual private instance of the block object in the pod, wherein the first virtual private instance of the block object shares, with the block object, the content of the block object and a pod-relative identity of the block object; and
generate a second virtual private instance of the block object in the virtual copy of the pod, wherein the second virtual private instance of the block object shares, with the block object, the content of the block object and the pod-relative identity of the block object.
3 . The data storage system of claim 2 , wherein the processor is configured to execute the instructions to:
determine that the request is received by way of the pod; and
apply a modification associated with the request to the first virtual private instance of the block object in the pod and not to the second virtual private instance of the block object in the virtual copy of the pod.
4 . The data storage system of claim 2 , wherein the processor is configured to execute the instructions to:
determine that the request is received by way of the virtual copy of the pod; and
apply a modification associated with the request to the second virtual private instance of the block object in the virtual copy of the pod and not to the first virtual private instance of the block object in the pod.
5 . The data storage system of claim 1 , wherein:
the block objects store metadata for the files and directories of the file system; and
the block objects, the files, and the directories are within the namespace of the pod.
6 . The data storage system of claim 1 , wherein:
the virtual copy of the pod comprises a clone of the pod; and
the generating of the virtual copy of the pod comprises creating a new mutable pod that is a virtual clone of the pod.
7 . The data storage system of claim 1 , wherein:
the generating of the virtual copy of the pod comprises updating a modification epoch of the pod from a first epoch to a second epoch;
the first epoch represents the pod at a point in time when the virtual copy of the pod is generated; and
the second epoch represents a mutable version of the pod after the point in time when the virtual copy of the pod is generated.
8 . The data storage system of claim 1 , wherein:
the pod and the virtual copy of the pod initially share contents of the block objects; and
the generating of the virtual copy of the pod comprises marking the shared contents of the block objects as copy-on-write contents.
9 . The data storage system of claim 1 , wherein:
the files and directories of the file system are managed in a file system layer of the data storage system; and
the files and directories of the file system are constructed of the block objects managed in a block object store of the data storage system.
10 . The data storage system of claim 9 , wherein contents of the block objects:
represent contents of the files and directories of the file system.
11 . The data storage system of claim 1 , wherein the processor is configured to execute the instructions to use the virtual copy of the pod in a replication process for the pod.
12 . A data storage system comprising:
a memory storing instructions; and
a processor communicatively coupled to the memory and configured to execute the instructions to:
generate, based on a pod that includes a file system constructed of block objects that are presented to the file system and that comprise metadata that maps file system data structures representative of files and directories of the file system to blocks of data in the data storage system, wherein the block objects are modifiable, with the block objects supporting random read-write access to ranges bytes at a block level of the block objects, a clone of the pod, wherein the pod and the clone of the pod initially share contents of the block objects;
receive a request to modify content of a block object of the block objects;
determine that the content of the block object is shared between the pod and the clone of the pod;
generate, based on the request, a first virtual private instance of the block object that is local to the pod and shares, with the block object, the content of the block object; and
generate, based on the request, a second virtual private instance of the block object that is local to the clone of the pod and shares, with the block object, the content of the block object.
13 . The data storage system of claim 12 , wherein the processor is configured to execute the instructions to:
determine that the request is received by way of the clone of the pod; and
apply a modification associated with the request to the second virtual private instance of the block object in the clone of the pod and not to the first virtual private instance of the block object in the pod.
14 . A method comprising:
generating, based on a pod that includes a file system constructed of block objects in a data storage system, a virtual copy of the pod, wherein the pod and the virtual copy of the pod initially share contents of the block objects, wherein the block objects are presented to the file system and map file system data structures representative of files and directories of the file system to blocks of data, wherein the block objects are modifiable, with the block objects supporting random read-write access to ranges of bytes at a block level of the block objects;
receiving a request to modify content of a block object of the block objects;
determining that the content of the block object is shared between the pod and the virtual copy of the pod;
generating a first virtual instance of the block object that is local to the pod and shares, with the block object, the content of the block object; and
generating a second virtual instance of the block object that is local to the virtual copy of the pod and shares, with the block object, the content of the block object.
15 . The method of claim 14 , further comprising:
determining that the request is received by way of the pod; and
applying a modification associated with the request to the first virtual instance of the block object in the pod and not to the second virtual instance of the block object in the virtual copy of the pod.
16 . The method of claim 14 , further comprising:
determining that the request is received by way of the virtual copy of the pod; and
applying a modification associated with the request to the second virtual instance of the block object in the virtual copy of the pod and not to the first virtual instance of the block object in the pod.
17 . The method of claim 14 , wherein the virtual copy of the pod comprises an immutable snapshot of the pod.
18 . The method of claim 14 , wherein:
the virtual copy of the pod comprises a clone of the pod; and
the generating of the virtual copy of the pod comprises creating a new mutable pod that is a virtual clone of the pod.
19 . The method of claim 14 , wherein:
the generating of the virtual copy of the pod comprises updating an identity of the pod from a first identity to a second identity;
the first identity represents the pod at a point in time when the virtual copy of the pod is generated; and
the second identity represents a mutable version of the pod after the point in time when the virtual copy of the pod is generated.
20 . The method of claim 14 , wherein:
the generating of the virtual copy of the pod comprises marking the shared contents of the block objects as copy-on-write contents.