Identifier mapping techniques for cross node consistency
Methods, systems, and devices for data management are described. A server hosted by a storage node within a cluster of a data management system (DMS) may receive a request to access a file stored in a distributed file system. The request may be associated with a security identifier (SID). The server may transmit an indication of the SID to a shared repository accessible to the cluster. Accordingly, the server may receive an indication of a mapping between the SID and one or both of a user identifier (UID) or a group identifier (GID) associated with the SID. The server may transmit an indication of the file and the UID/GID to the distributed file system, which may compare the UID/GID to a list of authorized identifiers for the file. If the UID/GID is on the list of authorized identifiers, the distributed file system may execute the request accordingly.
1. A method for data management, comprising:
receiving, at a server hosted by a storage node within a cluster of storage nodes in a data management system (DMS), a request to access a file stored in a distributed file system of the DMS, wherein the request indicates a security identifier (SID) associated with the request;
transmitting, from the server to a shared repository that is accessible to the storage nodes within the cluster, an indication of the SID associated with the request;
receiving, at the server and from the shared repository, an indication of a mapping between the SID associated with the request and one or both of a user identifier (UID) or a group identifier (GID) associated with the SID;
transmitting, to the distributed file system, an indication of the file and one or both of the UID or the GID provided by the shared repository;
determining, by the distributed file system, whether to grant the request to access the file based at least in part on comparing the UID and the GID provided by the server to a set of identifiers stored at the distributed file system in association with the file; and
accessing, by the distributed file system, the file in accordance with the request based at least in part on determining that one or both of the UID or the GID is included in the set of identifiers stored at the distributed file system in association with the file.
2. The method of claim 1 , further comprising:
adding, to the shared repository, an entry that includes the mapping between the SID associated with the request and one or both of the UID or the GID associated with the SID in response to determining that the SID associated with the request is absent from other entries of the shared repository.
3. The method of claim 1 , further comprising:
retrieving, from the shared repository, an entry that includes the mapping between the SID associated with the request and one or both of the UID or the GID associated with the SID in response to determining that the SID associated with the request is present in the shared repository.
4. The method of claim 1 , further comprising:
providing, by the server hosted by the storage node, a server message block (SMB) share to a client associated with the SID, wherein the SMB share is used to ingest snappable data from the client or to expose snapshots of snappables to the client for restore and live mount operations.
5. The method of claim 1 , wherein accessing the file comprises:
returning, to a client associated with the SID, a read response that includes data from the file stored within the distributed file system.
6. The method of claim 1 , wherein accessing the file comprises:
creating and storing the file at the distributed file system in accordance with the request, wherein the file is stored in association with the UID and the GID.
7. The method of claim 1 , wherein the SID associated with the request is obtained from a Common Internet File System (CIFS) session between the server and a client associated with the SID.
8. The method of claim 1 , wherein each node within the cluster hosts a respective Samba server that is operable to communicate with the distributed file system and the shared repository.
9. The method of claim 1 , wherein the mapping between the SID associated with the request and one or both of the UID or the GID associated with the SID is consistent across all the storage nodes within the cluster based at least in part on the shared repository being accessible to all the storage nodes within the cluster.
10. The method of claim 1 , wherein the mapping between the SID associated with the request and one or both of the UID or the GID associated with the SID is consistent across multiple clusters of storage nodes within the DMS based at least in part on the shared repository being accessible to all the storage nodes within the multiple clusters.
11. The method of claim 1 , wherein the shared repository is hosted by a central database system within the DMS.
12. The method of claim 1 , wherein:
the request is associated with a Common Internet File System (CIFS) client of the DMS; and
the server hosted by the storage node comprises a Samba server.
13. The method of claim 1 , wherein:
the SID associated with the request is associated with a Windows operating system; and
the UID and the GID associated with the SID are associated with a Linux operating system.
14. The method of claim 1 , wherein the distributed file system comprises a Linux or Unix-based file system.
15. An apparatus for data management, comprising:
a processor;
memory coupled with the processor; and
instructions stored in the memory and executable by the processor to cause the apparatus to:
receive, at a server hosted by a storage node within a cluster of storage nodes in a data management system (DMS), a request to access a file stored in a distributed file system of the DMS, wherein the request indicates a security identifier (SID) associated with the request;
transmit, from the server to a shared repository that is accessible to the storage nodes within the cluster, an indication of the SID associated with the request;
receive, at the server and from the shared repository, an indication of a mapping between the SID associated with the request and one or both of a user identifier (UID) or a group identifier (GID) associated with the SID;
transmit, to the distributed file system, an indication of the file and one or both of the UID or the GID provided by the shared repository;
determine, by the distributed file system, whether to grant the request to access the file based at least in part on comparing the UID and the GID provided by the server to a set of identifiers stored at the distributed file system in association with the file; and
access, by the distributed file system, the file in accordance with the request based at least in part on determining that one or both of the UID or the GID is included in the set of identifiers stored at the distributed file system in association with the file.
16. The apparatus of claim 15 , wherein the instructions are further executable by the processor to cause the apparatus to:
add, to the shared repository, an entry that includes the mapping between the SID associated with the request and one or both of the UID or the GID associated with the SID in response to determining that the SID associated with the request is absent from other entries of the shared repository.
17. The apparatus of claim 15 , wherein the instructions are further executable by the processor to cause the apparatus to:
retrieve, from the shared repository, an entry that includes the mapping between the SID associated with the request and one or both of the UID or the GID associated with the SID in response to determining that the SID associated with the request is present in the shared repository.
18. The apparatus of claim 15 , wherein the instructions are further executable by the processor to cause the apparatus to:
provide, by the server hosted by the storage node, a server message block (SMB) share to a client associated with the SID, wherein the SMB share is used to ingest snappable data from the client or to expose snapshots of snappables to the client for restore and live mount operations.
19. The apparatus of claim 15 , wherein, to access the file, the instructions are executable by the processor to cause the apparatus to:
return, to a client associated with the SID, a read response that includes data from the file stored within the distributed file system.
20. A non-transitory computer-readable medium storing code for data management, the code comprising instructions executable by a processor to:
receive, at a server hosted by a storage node within a cluster of storage nodes in a data management system (DMS), a request to access a file stored in a distributed file system of the DMS, wherein the request indicates a security identifier (SID) associated with the request;
transmit, from the server to a shared repository that is accessible to the storage nodes within the cluster, an indication of the SID associated with the request;
receive, at the server and from the shared repository, an indication of a mapping between the SID associated with the request and one or both of a user identifier (UID) or a group identifier (GID) associated with the SID;
transmit, to the distributed file system, an indication of the file and one or both of the UID or the GID provided by the shared repository;
determine, by the distributed file system, whether to grant the request to access the file based at least in part on comparing the UID and the GID provided by the server to a set of identifiers stored at the distributed file system in association with the file; and
access, by the distributed file system, the file in accordance with the request based at least in part on determining that one or both of the UID or the GID is included in the set of identifiers stored at the distributed file system in association with the file.