File system with multi-class in situ tiered archiving
View Patent ↗Example apparatus and methods provide a file system that stores files in multiple different logical units. The logical units are associated with different classes of devices. The file system interacts with the logical units through block-based interfaces. The file system is a single file system that spans the multiple logical units. The multiple different logical units include data storage devices for which the file system manages block storage allocation and an object storage system that manages its own block storage allocation rather than having the file system manage its block storage allocation. The file system may maintain a single namespace, hierarchy, or directory structure for the multiple logical units. The object storage system may protect files using redundant copies, erasure codes, or other approaches. An archive process may selectively move files from other devices to the object storage system and leave a symbolic link behind.
1. An electronic data storage system, comprising:
a file system comprising one or more processors configured to store files in two or more different logical units, where the file system interacts with a logical unit through a block-based interface;
where the two or more different logical units comprise:
one or more data storage devices configured as logical units having block-based interfaces; and
an object storage system configured as a logical unit having a block-based interface, where the object storage system produces and stores one or more redundant copies of a file stored in the object storage system by the file system;
where the file system manages block storage allocation for the one or more data storage devices,
where the file system does not manage block storage allocation for the object storage system,
where the object storage system manages block storage allocation for the object storage system, and
where the file system addresses files in a single hierarchy that spans the two or more different logical units.
2. The system of claim 1 , where the object storage system produces and stores one or more erasure codes computed for a file stored in the object storage system by the file system.
3. The system of claim 1 , where the one or more data storage devices include a device selected from the group including a hard disk drive, a solid state drive, a shingled magnetic recording drive, and a tape drive.
4. The system of claim 1 , where the one or more data storage devices include a combination of two or more different types of devices selected from the group including a hard disk drive, a solid state drive, a shingled magnetic recording drive, and a tape drive.
5. The system of claim 1 , where the file system establishes and manages an affinity relationship between a file and a logical unit based, at least in part, on an attribute of the file, the attribute of the file being a file name, a file location, a file size, a file type, an input/output pattern, an application that produced the file, a file protection, or a file access type.
6. The system of claim 5 , where the file system selects a logical unit to store the file based, at least in part, on the affinity relationship.
7. The system of claim 1 , comprising an archiver that selects a file in the file system to be archived based, at least in part, on a file criteria and provides the file to the object storage system to be archived.
8. The system of claim 7 , where the file criteria is a file name, a file location, a file size, a file type, an application that produced the file, a file age, a file access time, or a file access history.
9. The system of claim 7 , where the archiver determines when to provide the file to be archived to the object storage system based on a condition of the file system, the condition being an activity level being experienced by the file system or a capacity available to the file system.
10. The system of claim 7 , where the archiver is part of the file system.
11. The system of claim 7 , where the file system establishes a symbolic link in a location in the file system from which the file to be archived was copied to a location in the file system in the object storage system where the file was archived.
12. The system of claim 1 , comprising a user interface configured to facilitate identifying a logical unit or affinity to which a user wants a file to be stored.