Efficient embedding table storage and lookup
The present disclosure provides systems, methods, and computer program products for providing efficient embedding table storage and lookup in machine-learning models. A computer-implemented method may include obtaining an embedding table comprising a plurality of embeddings respectively associated with a corresponding index of the embedding table, compressing each particular embedding of the embedding table individually allowing each respective embedding of the embedding table to be decompressed independent of any other embedding in the embedding table, packing the embedding table comprising individually compressed embeddings with a machine-learning model, receiving an input to use for locating an embedding in the embedding table, determining a lookup value based on the input to search indexes of the embedding table, locating the embedding based on searching the indexes of the embedding table for the determined lookup value, and decompressing the located embedding independent of any other embedding in the embedding table.
1. A computer-implemented method for performing efficient embedding table storage and lookup in machine-learning models, comprising:
obtain, by one or more processors, an embedding table associated with a machine-learning model, the embedding table comprising a plurality of embeddings respectively associated with a corresponding index of the embedding table;
compressing, by the one or more processors, each particular embedding of the embedding table individually allowing each respective embedding of the embedding table to be decompressed independent of any other embedding in the embedding table; and
packing, by the one or more processors, the embedding table comprising individually compressed embeddings with the machine-learning model.
2. The computer-implemented method of claim 1 , further comprising:
updating, by the one or more processors, respective indexes of the embedding table based on a hashing operation.
3. The computer-implemented method of claim 1 , further comprising:
providing, by the one or more processors, the embedding table comprising individually compressed rows packed with the machine-learning model to one or more computing devices.
4. The computer-implemented method of claim 1 , wherein the compressing is performed independent from a machine-learning platform.
5. The computer-implemented method of claim 1 , wherein the compressing is performed using compression unavailable from a machine-learning platform.
6. The computer-implemented method of claim 1 , wherein respective embeddings in the embedding table are associated with an item from a plurality of items included in a vocabulary.
7. The computer-implemented method of claim 1 , wherein the machine-learning model is associated with an embedding layer of a neural network.