Fast startup for modular storage systems
Described herein are several embodiments of systems and processes to decrease startup time for subsystems of a storage system. According to some embodiments, subsystem memory is allocated using memory-mapped files.
1. A method comprising:
generating pre-allocated memory regions for a plurality of subsystems within a storage system; and
for each of the plurality of subsystems;
initiating a process; and
mapping a corresponding one of the pre-allocated memory regions into a memory space of the process, wherein a pre-allocated memory region is generated prior to a corresponding subsystem starting up,
wherein the plurality of subsystems includes a management subsystem, the method further comprising:
for each of the plurality of subsystems other than the management subsystem, reporting to the management subsystem that the subsystem is ready to process I/O operations;
processing I/O operations using the plurality of subsystems;
regenerating a pre-allocated memory region for a subsystem in response to a binary associated with subsystem being modified,
wherein regenerating a pre-allocated memory region for a subsystem comprises truncating a file within an in-memory file system.
2. The method of claim 1 wherein generating pre-allocated memory regions for a plurality of subsystems within a storage system comprises calculating an amount of dynamic memory required by each of the plurality of subsystems.
3. The method of claim 1 further comprising:
for each of the plurality of subsystems, initializing data structures used by components of the subsystem.
4. The method of claim 1 wherein generating a pre-allocated memory region for a subsystem comprises generating a file within an in-memory file system.
5. The method of claim 4 wherein the file is sized based on the subsystem's memory requirements.
6. The method of claim 4 wherein mapping a corresponding one of the pre-allocated memory regions into the process's memory space comprises mapping the file into the process's memory space.
7. The method of claim 6 wherein mapping the file into the process's memory space comprises using mmap.
8. A system comprising:
a processor;
a volatile memory; and
a non-volatile memory storing computer program code that when executed on the processor causes the processor to execute a process operable to perform the operations of:
generating pre-allocated memory regions for a plurality of subsystems within a storage system, wherein a pre-allocated memory region is generated prior to a corresponding subsystem starting up; and
for each of the plurality of subsystems,
initiating a process; and
mapping a corresponding one of the pre-allocated memory regions into a memory space of the process,
wherein the plurality of subsystems includes a management subsystem, the method further comprising:
for each of the plurality of subsystems other than the management subsystem, reporting to the management subsystem that the subsystem is ready to process I/O operations;
processing I/O operations using the plurality of subsystems;
regenerating a pre-allocated memory region for a subsystem in response to a binary associated with subsystem being modified,
wherein regenerating a pre-allocated memory region for a subsystem comprises truncating a file within an in-memory file system.
9. The system of claim 8 wherein the computer program code that when executed on the processor causes the processor to execute a process operable to generate pre-allocated memory regions for subsystems within a storage system by calculating an amount of dynamic memory required by each of the plurality of subsystems.
10. The system of claim 8 wherein the computer program code that when executed on the processor causes the processor to execute a process is operable to perform the further operations of:
for each of the plurality of subsystems, initializing data structures used by components of the subsystem.
11. The system of claim 8 wherein the computer program code that when executed on the processor causes the processor to execute a process operable to generate a pre-allocated memory region for a subsystem by generating a file within an in-memory file system.
12. The system of claim 11 wherein the file is sized based on the subsystem's memory requirements.
13. The system of claim 11 wherein the computer program code that when executed on the processor causes the processor to execute a process operable to map a corresponding one of the pre-allocated memory regions into the process's memory space by mapping the file into the process's memory space.
14. The system of claim 13 wherein the computer program code that when executed on the processor causes the processor to execute a process operable to map the file into the process's memory space using mmap.