Methods and apparatus for compression data streams

1. A method for encoding information, the method comprising:

calculating a probability distribution function (PDF) for scaler data;

matching the PDF to PDF templates to determine a closest matching PDF template;

determining an encoder corresponding to the closest matching PDF template, wherein a corresponding encoder identifier is determined;

encoding the scaler data with the encoder to generate an encoded stream;

transmitting the encoded stream and the encoder identifier; and

maintaining the PDF templates in a database, wherein the operation of matching includes accessing the database to obtain the PDF templates and matching the PDF to the PDF templates using KL (Kullback-Leibler) divergence to determine the closest matching PDF template.

2. The method of claim 1 , wherein the operation of determining the encoder comprises determining an entropic encoder corresponding to the closest matching PDF template.

3. The method of claim 1 , wherein the operation of transmitting further comprising transmitting the encoded stream and the encoder identifier over at least one of a wired link and a wireless link.

4. The method of claim 1 , further comprising:

receiving the encoded stream and the encoder identifier;

determining a decoder based on the encoder identifier; and

decoding the encoded stream using the decoder to obtain the scaler data.

5. A method for encoding information, the method comprising:

binning received vector data into a plurality of bins;

determining a centroid for each bin to form a dictionary of centroids;

tagging the vector data with tags that identify a centroid associated with each vector;

counting a number of vectors in each bin to construct a probability distribution function (PDF) of centroids;

matching the PDF of centroids to PDF templates to determine a closest matching PDF template;

determining an encoder corresponding to the closest matching PDF template wherein a corresponding encoder identifier is identified;

encoding the tags with the encoder to generate an encoded data stream; and

transmitting the encoded stream, the encoder identifier, and the dictionary of centroids.

6. The method of claim 5 , wherein the operation of encoding comprises encoding the tags with an entropic encoder to generate the encoded data stream.

7. The method of claim 5 , further comprising optionally encoding the vector data with an auto-encoder prior to the operation of determining the vector centroids.

8. The method of claim 5 , further comprising maintaining the PDF templates in a database.

9. The method of claim 5 , wherein the operation of matching comprises:

accessing the database to obtain the PDF templates; and

matching the PDF of centroids to the PDF templates using KL (Kullback-Leibler) divergence to determine the closest matching PDF template.

10. The method of claim 5 , wherein the operation of transmitting further comprising transmitting the encoded stream and the encoder identifier over at least one of a wired link and a wireless link.

11. The method of claim 5 , further comprising:

receiving the encoded stream, the encoder identifier, and the dictionary;

determining a decoder based on the encoder identifier;

decoding the encoded stream using the decoder to obtain the tags;

converting the tags into a vector representation using the dictionary; and

outputting the vector representation as the vector data.

12. The method of claim 11 , further comprising optionally decoding the vector representation using a decoder portion of an auto-encoder before the operation of outputting.

13. An apparatus for encoding information, the apparatus comprising:

a probability distribution function (PDF) computation circuit that calculates a PDF associated with input data;

a matching circuit that matches the PDF to PDF templates to determine a closest matching PDF template, and determines an encoder corresponding to the closest matching PDF template wherein a corresponding encoder identifier is determined, wherein the matching circuit accesses a database to obtain the PDF templates and matches the PDF to the PDF templates using KL (Kullback-Leibler) divergence to determine the closest matching PDF template; and

an encoding circuit that encodes input data with the encoder to generate an encoded stream, and transmits the encoded stream and the encoder identifier.

14. The apparatus of claim 13 , further comprising a database that stores the PDF templates.

15. The apparatus of claim 13 , wherein the encoding circuit transmits the encoded stream and the encoder identifier over at least one of a wired link and a wireless link.

16. The apparatus of claim 13 , wherein the input data is scaler data and the apparatus further comprises:

a receiver that receives the encoded stream and the encoder identifier; and

a decoding circuit that determines a decoder based on the encoder identifier, and decodes the encoded stream using the decoder to obtain the scaler data.

17. The apparatus of claim 13 , wherein the input data is vector data and the apparatus further comprises a vector centroid computation circuit that generates tagged vectors from the vector data, and wherein the tagged vectors are input to the probability distribution function (PDF) computation circuit as the input data.

18. An apparatus for encoding information comprising:

means for calculating a probability distribution function (PDF) for scaler data;

means for matching the PDF to PDF templates to determine a closest matching PDF template;

means for determining an encoder corresponding to the closest matching PDF template, wherein a corresponding encoder identifier is determined;

means for encoding the scaler data with the encoder to generate an encoded stream;

means for transmitting the encoded stream and the encoder identifier; and

means for maintaining the PDF templates in a database, wherein means for matching includes means for accessing the database to obtain the PDF templates and means for matching the PDF to the PDF templates using KL (Kullback-Leibler) divergence to determine the closest matching PDF template.

19. The apparatus of claim 18 , wherein means for determining includes means for determining an entropic encoder corresponding to the closest matching PDF template.

20. The method of claim 18 , wherein means for transmitting includes means for transmitting the encoded stream and the encoder identifier over at least one of a wired link and a wireless link.