Systems and methods for optimizing bit utilization in data encoding
View Patent ↗In one of many possible embodiments, a system for optimizing bit utilization in data encoding is provided. The exemplary system includes a data processing subsystem configured to identify a total number of unique characters within a set of data, which number represents an original base of representation of the set of data. The data processing subsystem is further configured to convert the set of data to a base of representation that is higher than the original base of representation and then encode the base-converted data with a fixed-length encoding scheme.
1. A system comprising:
a data source configured to provide a set of data; and
a data processing subsystem including a computing device communicatively coupled to said data source and configured to
identify a total number of unique characters within said set of data, said set of data having an original base of representation equal to said total number of unique characters;
convert said set of data to a higher base of representation, said higher base of representation being greater in value than said original base of representation; and
encode said base-converted data with a fixed-length encoding scheme.
2. The system of claim 1 , wherein said data processing subsystem is further configured to store said unique characters within a digit list file.
3. The system of claim 2 , wherein one or more characters not included within said set of data are additionally stored within said digit list file.
4. The system of claim 2 , wherein said data processing subsystem is further configured to use said digit list file to convert said set of data to said higher base of representation.
5. The system of claim 1 , wherein said higher base of representation comprises a maximum power of said original base of representation that is less than or equal to 2 n , wherein n is equal to a length of said fixed-length encoding scheme.
6. The system of claim 1 , further comprising a compression module configured to compress said encoded data.
7. The system of claim 1 , further comprising a decoder configured to decode said encoded data.
8. The system of claim 1 , wherein said data processing system is further configured to convert said base-converted data to said original base of representation.
9. The system of claim 1 , wherein said fixed-length encoding scheme comprises at least one of an American Standard Code for Information Interchange (ASCII) encoding scheme, an Extended Binary-Coded Decimal Interchange Code (EBCDIC) encoding scheme, and a Unicode encoding scheme.
10. The system of claim 1 , wherein said set of data comprises decimal data.
11. The system of claim 1 , wherein said set of data comprises a text file.
12. A method comprising:
identifying using a computing device a total number of unique characters within a set of data, said set of data having an original base of representation equal to said total number of unique characters;
converting said set of data to a higher base of representation, said higher base of representation being greater in value than said original base of representation; and
encoding said base-converted data with a fixed-length encoding scheme.
13. The method of claim 12 , further comprising storing within a digit list file said unique characters.
14. The method of claim 13 , further comprising storing within said digit list file one or more characters not included within said set of data.
15. The method of claim 13 , further comprising using said digit list file to convert said set of data to said higher base of representation.
16. The method of claim 12 , wherein said higher base of representation comprises a maximum power of said original base of representation that is less than or equal to 2 n , wherein n is equal to a length of said fixed-length encoding scheme.
17. The method of claim 12 , further comprising compressing said encoded data.
18. The method of claim 12 , further comprising decoding said encoded data.
19. The method of claim 12 , further comprising converting said base-converted data to said original base of representation.
20. The method of claim 12 , wherein said fixed-length encoding scheme comprises at least one of an American Standard Code for Information Interchange (ASCII) encoding scheme, an Extended Binary-Coded Decimal Interchange Code (EBCDIC) encoding scheme, and a Unicode encoding scheme.
21. The method of claim 12 , wherein said set of data comprises decimal data.
22. A method comprising:
identifying using a computing device a total number of unique characters within a set of data, said set of data having an original base of representation equal to said total number of unique characters;
storing said unique characters within a digit list file;
using said digit list file to convert said set of data to a higher base of representation, said higher base of representation being greater in value than said original base of representation; and
encoding said base-converted data with a fixed-length encoding scheme.
23. The method of claim 22 , wherein said higher base of representation comprises a maximum power of said original base of representation permitted by a length of said fixed-length encoding scheme.
24. The method of claim 22 , further comprising compressing said encoded data.
25. The method of claim 22 , wherein said higher base of representation comprises a maximum power of said original base of representation that is less than or equal to 2 n , wherein n is equal to a length of said fixed-length encoding scheme.