File creation with requester-specified backing
Various embodiments described herein provide for creation of a file that is backed by a requester-specified set of data storage objects. According to some embodiments, a request is received to create a new file on a file system that is backed by a specified set of data storage objects stored on a set of memory components. For example, the specified set of data storage objects can be associated with storage of one or more portions of an existing file stored on the set of memory components. In response to receiving the request to create the new file, a file data structure can be generated on the file system that represents the new file, where the file data structure comprises a mapping to the specified set of data storage objects. Subsequently, the request can be responded to with data that confirms creation of the new file on the file system.
1. A system comprising:
a set, of memory components; and
a processing device, operatively coupled to the set of memory components, configured to perform operations comprising:
receiving a request to create a new file on a file system that is backed by a specified set of existing data storage objects stored on the set of memory components;
in response to receiving the request to create the new file:
creating the new file by generating a file data structure on the file system that represents the new file, the file data structure comprising a mapping to the specified set of existing data storage objects, and an existing data storage object in the specified set of existing data storage objects comprising at least one of:
a block device storage object of the set of memory components; or
a data storage object that is associated with a log structured merge tree data structure stored on the set of memory components; and
responding to the request with data that confirms creation of the new file on the file system; and
causing the new file to be mapped into volatile memory.
2. The system of claim 1 , wherein the request to create the new file comprises a request to create a memory-mapped file on the file system that is backed by the specified set of existing data storage objects.
3. The system of claim 1 , wherein the new file is mapped into the volatile memory by a memory-mapped file method that implements demand paging.
4. The system of claim 1 , wherein the file system comprises a virtual file system.
5. The system of claim 1 , wherein the specified set of existing data storage objects comprises an ordered collection of data storage objects.
6. The system of claim 1 , wherein the existing data storage object comprises a media data block, the media data block comprises an abstraction of a set of block device storage objects, and the set of block device storage objects comprises the block device storage object.
7. The system of claim 1 , wherein the specified set of existing data storage objects is associated with storage of one or more portions of an existing file stored on the set of memory components.
8. The system of claim 1 , wherein the mapping to the specified set of existing data storage objects comprising a set of universally unique identifiers corresponding to the specified set of existing data storage objects.
9. The system of claim 1 , wherein the log structured merge tree data structure stores a set of key-value pairs.
10. A method comprising:
receiving a request to create a new file on a file system that is backed by a specified set of existing data storage objects stored on a set of memory components;
in response to receiving the request to create the new file:
creating the new file by generating a file data structure on the file system that represents the new file, the file data structure comprising a mapping to the specified set of existing data storage objects, and an existing data storage object n the specified set of existing data storage objects comprising at least one of:
a block device storage object of the set of memory components; or
a data storage object that is associated with a log structured merge tree d structure stored on the set of memory components; and
responding to the request with data that confirms creation of the new file on e file system; and
causing the new file to be mapped into volatile memory.
11. The method of claim 10 , wherein the request to create the new file comprises a request to create a memory-mapped file on the file system that is backed by the specified set of existing data storage objects.
12. The method of claim 10 , wherein the new file is mapped into the volatile memory by a memory-mapped file method that implements demand paging.
13. The method of claim 10 , wherein the file system comprises a virtual file system.
14. The method of claim 10 , wherein the existing data storage object comprises a media data block, the media data block comprises an abstraction of a set of block device storage objects, and the set of block device storage objects comprises the block device storage object.
15. The method of claim 10 , wherein the mapping to the specified set of existing data storage objects comprising a set of universally unique identifiers corresponding to the specified set of existing data storage objects.
16. A non-transitory machine-readable storage medium comprising instructions that, when executed by a processing device, cause the processing device to perform operations comprising:
receiving a request to create a new file on a file system that is backed by a specified set of existing data storage objects stored on a set of memory components;
in response to receiving the request to create the new file:
creating the new file by generating a file data structure on the file system that represents the new file, the file data structure comprising a mapping to the specified set of existing data storage objects, and an existing data storage object in the specified set of existing data storage objects comprising at least one of:
a block device storage object of the set of memory components; or
a data storage object that is associated with a log structured merge tree data structure stored on the set of memory components; and
responding to the request with data that confirms creation of the new file on the file system; and
causing the new file to be mapped into volatile memory.
17. The non-transitory machine-readable storage medium of claim 16 , wherein the existing data storage object comprises a media data block, the media data block comprises an abstraction of a set of block device storage objects, and the set of block device storage objects comprises the block device storage object.
18. The non-transitory machine-readable storage medium of claim 16 , wherein the log structured merge tree data structure stores a set of key-value pairs.
19. The non-transitory machine-readable storage medium of claim 16 , wherein the specified set of existing data storage objects is associated with storage of one or more portions of an existing file stored on the set of memory components.
20. The method of claim 10 , wherein the specified set f existing data storage objects is associated with storage of one or more portions of an existing file stored on the set of memory components.