Multiple virtual namespaces on a single physical namespace to avoid file system restarts and improve availability
One example method includes defining a physical namespace, determining a number of virtual namespaces, virtualizing the physical namespace by defining the virtual namespaces on the physical namespace, and generating a modified lookup key that is a function of a name of one of the virtual namespaces. The modified lookup key may be moved between virtual namespaces without requiring interruption of a backup or restore process, and without requiring an associated file system to be taken offline. Movement of the modified lookup key may be transparent to a user and may permit preservation of scripts that were in place prior to the move.
1. A method, comprising:
defining a physical namespace in a file system;
determining a number of virtual namespaces;
virtualizing the physical namespace by defining the virtual namespaces on the physical namespace;
generating a lookup key for each file saved in each virtual namespace based on a name of each virtual namespace and a full key of each file of the physical namespace, wherein the physical namespace maps the lookup key to the full key of each file saved in the physical namespace and the full key includes direction information and file name information in the file system;
when lookup keys in one virtual namespace are moved to another virtual namespace different from the one virtual namespace within the physical namespace, modifying the lookup keys of the one virtual namespace for the another virtual namespace based on a name of the another virtual namespace without requiring a restart of the file system, interruption of an ongoing data backup process, or data restore process; and
performing a compaction process comprising copying all key-value pairs <K, V> from a sparse one of the virtual namespaces to a non-sparse virtual namespace of the virtual namespaces,
wherein the non-sparse virtual namespace is selected based on current space usage in the non-sparse virtual namespace and a predicted growth of space usage in the non-sparse virtual namespace.
2. The method as recited in claim 1 , wherein the number of virtual namespaces is determined as a function of a number of significant digits of a parent id of a full key upon which the modified lookup key is based.
3. The method as recited in claim 1 , wherein the modified lookup key maps to an associated full key in one of the virtual namespaces.
4. The method as recited in claim 1 , wherein availability of a file to which the modified lookup key corresponds is unaffected by movement of the modified lookup key from one of the virtual namespaces to another of the virtual namespaces.
5. The method as recited in claim 1 , wherein movement of the modified lookup key from one of the virtual namespaces to another of the virtual namespaces does not necessitate a change to a script for a process involving a file to which the modified lookup key corresponds.
6. The method as recited in claim 1 , further comprising performing a fastcopy process comprising copying all key-value pairs <K, V> from one of the virtual namespaces to a target virtual namespace of the virtual namespaces,
wherein the target virtual namespace is selected using an artificial intelligence (AI)/machine learning (ML) process.
7. The method as recited in claim 1 , further comprising performing a process involving the use of a temporary directory,
wherein the process comprises relocating only active entries, and not dead entries, of one of the virtual namespaces to a target virtual namespace of the virtual namespaces, and
wherein the target virtual namespace to which the active entries are moved is selected based on current space usage in the target virtual namespace and a predicted growth of space usage in the target virtual namespace.
8. A computer readable storage medium having stored therein instructions that are executable by one or more hardware processors to perform operations comprising:
defining a physical namespace in a file system;
determining a number of virtual namespaces;
virtualizing the physical namespace by defining the virtual namespaces on the physical namespace;
generating a lookup key for each file saved in each virtual namespace based on a name of each virtual namespace and a full key of each file of the physical namespace, wherein the physical namespace maps the lookup key to the full key of each file saved in the physical namespace and the full key includes direction information and file name information in the file system; and
when lookup keys in one virtual namespace are to be moved to another virtual namespace different from the one virtual namespace within the physical namespace, modifying the lookup keys of the one virtual namespace for the another virtual namespace based on a name of the another virtual namespace without requiring a restart of the file system, interruption of an ongoing data backup process, or data restore process,
wherein the operations further comprise performing a compaction process comprising copying all key-value pairs <K, V> from a sparse one of the virtual namespaces to a non-sparse virtual namespace of the virtual namespaces, and
wherein the non-sparse virtual namespace is selected based on current space usage in the non-sparse virtual namespace, and a predicted growth of space usage in the non-sparse virtual namespace.
9. The computer readable storage medium as recited in claim 8 , wherein the number of virtual namespaces is determined as a function of a number of significant digits of a parent id of a full key upon which the modified lookup key is based.
10. The computer readable storage medium as recited in claim 8 , wherein the modified lookup key maps to an associated full key in one of the virtual namespaces.
11. The computer readable storage medium as recited in claim 8 , wherein availability of a file to which the modified lookup key corresponds is unaffected by movement of the modified lookup key from one of the virtual namespaces to another of the virtual namespaces.
12. The computer readable storage medium as recited in claim 8 , wherein movement of the modified lookup key from one of the virtual namespaces to another of the virtual namespaces does not necessitate a change to a script for a process involving a file to which the modified lookup key corresponds.
13. The computer readable storage medium as recited in claim 8 , wherein the operations further comprise performing a fastcopy process comprising copying all key-value pairs <K, V> from one of the virtual namespaces to a target virtual namespace of the virtual namespaces, and wherein the target virtual namespace is selected using an artificial intelligence (AI)/machine learning (ML) process.
14. The computer readable storage medium as recited in claim 8 , wherein the operations further comprise performing a process involving the use of a temporary directory,
wherein the process comprises relocating only active entries, and not dead entries, of one of the virtual namespaces to a target virtual namespace of the virtual namespaces, and
wherein the target virtual namespace to which the active entries are moved is selected based on current space usage in the target virtual namespace and a predicted growth of space usage in the target virtual namespace.