Systems and methods for multiplexing data of an underlying index
Disclosed herein are systems and method for multiplexing data of an underlying index. In an exemplary aspect, an index handler may: search for a data file in a plurality of data buckets associated with an index, wherein at least one respective data bucket of a plurality of data buckets is attached to a respective slot of a plurality of slots; identify, based on the searching, a first data bucket of the plurality of data buckets that comprises the data file; in response to determining that the first data bucket is not attached to any of the plurality of slots, attach the first data bucket to a first slot of the plurality of slots; and enable access to the data file via the first data bucket attached to the first slot.
1. A method for multiplexing data of an underlying index, the method comprising:
searching for a data file in a plurality of data buckets associated with an index, wherein at least one respective data bucket of a plurality of data buckets is attached to a respective slot of a plurality of slots;
identifying, based on the searching, a first data bucket of the plurality of data buckets that comprises the data file;
in response to determining that the first data bucket is not attached to any of the plurality of slots, attaching the first data bucket to a first slot of the plurality of slots; and
enabling access to the data file via the first data bucket attached to the first slot.
2. The method of claim 1 , wherein a first subset of the plurality of data buckets is stored on a first device and a second subset of the plurality of data buckets is stored on a second device.
3. The method of claim 1 , further comprising:
in response to determining that none of the plurality of data buckets comprises the data file, searching for an image associated with data file in a file system, wherein the data file is of a first type of data; and
generating a second data bucket based on the image.
4. The method of claim 3 , wherein an image associated with the data file is not found, further comprising:
in response to determining that the image does not exist, performing a look-up of index mapping configuration files for the first type of data;
requesting an indexer to create a new index based on the index mapping configuration files;
receiving, from the indexer, the new index;
generating an image of the new index; and
copying the generated image to create the second data bucket.
5. The method of claim 1 , wherein attaching the first data bucket to the first slot of the plurality of slots, further comprises:
determining whether at least one slot of the plurality of slots is available and is compatible with a first type of data associated with the data file;
in response to determining that the first slot is available is compatible with the first type of data, selecting the first slot to attach to the first data bucket.
6. The method of claim 5 , further comprising:
in response to determining that the at least one slot is not available, providing a configuration file to the indexer to create a new slot;
clearing contents of the new slot created by the indexer;
recording a slot name and information type of the new slot; and
identifying the first slot as the new slot to attach to the first data bucket.
7. The method of claim 1 , wherein attaching the first data bucket to the first slot of the plurality of slots comprises mounting the first data bucket to the first slot for a pre-determined lease time.
8. The method of the claim 7 , further comprising detaching the first data bucket from the first slot in response to determining that the pre-determined lease time has expired.
9. The method of claim 1 , wherein searching for the data file is in response to receiving, from a software application, a request to access the data file, and wherein enabling access comprises enabling access to the software application.
10. A system for multiplexing data of an underlying index, the system comprising:
a hardware processor configured to:
search for a data file in a plurality of data buckets associated with an index, wherein at least one respective data bucket of a plurality of data buckets is attached to a respective slot of a plurality of slots;
identify, based on the searching, a first data bucket of the plurality of data buckets that comprises the data file;
in response to determining that the first data bucket is not attached to any of the plurality of slots, attach the first data bucket to a first slot of the plurality of slots; and
enable access to the data file via the first data bucket attached to the first slot.
11. The system of claim 10 , wherein a first subset of the plurality of data buckets is stored on a first device and a second subset of the plurality of data buckets is stored on a second device.
12. The system of claim 10 , wherein the hardware processor is further configured to:
in response to determining that none of the plurality of data buckets comprises the data file, search for an image associated with data file in a file system, wherein the data file is of a first type of data; and
generate a second data bucket based on the image.
13. The system of claim 12 , wherein an image associated with the data file is not found, wherein the hardware processor is further configured to:
in response to determining that the image does not exist, perform a look-up of index mapping configuration files for the first type of data;
request an indexer to create a new index based on the index mapping configuration files;
receive, from the indexer, the new index;
generate an image of the new index; and
copy the generated image to create the second data bucket.
14. The system of claim 10 , wherein the hardware processor is further configured to attach the first data bucket to the first slot of the plurality of slots, by:
determining whether at least one slot of the plurality of slots is available and is compatible with a first type of data associated with the data file;
in response to determining that the first slot is available is compatible with the first type of data, selecting the first slot to attach to the first data bucket.
15. The system of claim 14 , wherein the hardware processor is further configured to:
in response to determining that the at least one slot is not available, provide a configuration file to the indexer to create a new slot;
clear contents of the new slot created by the indexer;
record a slot name and information type of the new slot; and
identify the first slot as the new slot to attach to the first data bucket.
16. The system of claim 10 , wherein the hardware processor is further configured to attach the first data bucket to the first slot of the plurality of slots by mounting the first data bucket to the first slot for a pre-determined lease time.
17. The system of the claim 16 , wherein the hardware processor is further configured to detach the first data bucket from the first slot in response to determining that the pre-determined lease time has expired.
18. The system of claim 10 , wherein the hardware processor is further configured to search for the data file in response to receiving, from a software application, a request to access the data file, and wherein enabling access comprises enabling access to the software application.
19. A non-transitory computer readable storage medium storing thereon computer executable instructions for multiplexing data of an underlying index, comprising instructions for:
searching for a data file in a plurality of data buckets associated with an index, wherein at least one respective data bucket of a plurality of data buckets is attached to a respective slot of a plurality of slots;
identifying, based on the searching, a first data bucket of the plurality of data buckets that comprises the data file;
in response to determining that the first data bucket is not attached to any of the plurality of slots, attaching the first data bucket to a first slot of the plurality of slots; and
enabling access to the data file via the first data bucket attached to the first slot.