Hierarchical bitmasks for indicating the presence or absence of serialized data fields
Disclosed are systems and methods for communicating with a sender machine and a receiver machine, and analyzing a bitmask associated with a message to be sent from the sender machine to the receiver machine, such that the bitmask comprises one or more presence bits and one or more absence bits, such that the presence bits indicate that an associated field of the message are included in the message and the absence bits indicate that an associated field of the message are omitted in the message. The systems and methods also dynamically determine compression instructions to compress the bitmask, and provide the compression instructions to the sender machine, wherein the compression instructions reduce size of the bitmask associated with the message to be sent to the receiver machine.
1. A format server for providing bitmask compression instructions, wherein the format server is operable to:
communicate with a sender machine and a receiver machine;
analyze a bitmask associated with a message to be sent from the sender machine to the receiver machine, wherein the bitmask comprises one or more presence bits and one or more absence bits, wherein the presence bits indicate that an associated field of the message are included in the message and the absence bits indicate that an associated field of the message are omitted in the message;
dynamically determine compression instructions to compress the bitmask, wherein the compression instructions comprise:
generating a tree using the presence bits and the absence bits; and
generating the compressed bitmask by traversing the tree comprising the presence bits and the absence bits; and
provide the compression instructions to the sender machine, wherein the compression instructions reduce size of the bitmask associated with the message to be sent to the receiver machine.
2. The format server of claim 1 , wherein the format server is further operable to provide the compression instructions to the receiver machine, wherein the receiver machine utilizes the compression instructions to uncompress the compressed bitmask of the message.
3. The format server of claim 1 , wherein the message is compressed according to the bit mask and the bitmask of the message is compressed according to the compression instructions.
4. The format server of claim 1 , wherein the message may have one or more fields that are sorted to group together one or more fields likely to have a value and group together one or more fields not likely to have a value.
5. The format server of claim 1 , wherein the format server is further operable to invert the bitmask prior to compressing the bitmask.
6. The format server of claim 1 , wherein the compression instructions can be used by the receiver machine to decompress the compressed bitmask by traversing the tree, reconstructing all subtrees having an absence bit, and copying a leaf node when traversed.
7. The format server of claim 1 , wherein the format server is a message-oriented middleware server.
8. The format server of claim 1 , wherein the sender and receiver machines that receive the compression instructions can store the compression instructions for future message compression or decompression of bitmasks sent or received by the sender and receiver machines without having to communicate with the format server.
9. A method for providing bitmask compression instructions, where the method comprises:
communicating, by a format server, with a sender machine and a receiver machine;
analyzing a bitmask associated with a message to be sent from the sender machine to the receiver machine, wherein the bitmask comprises one or more presence bits and one or more absence bits, wherein the presence bits indicate that an associated field of the message are included in the message and the absence bits indicate that an associated field of the message are omitted in the message;
dynamically determining compression instructions to compress the bitmask, wherein the compression instructions comprise:
generating a tree using the presence bits and the absence bits; and
generating the compressed bitmask by traversing the tree comprising the presence bits and the absence bits; and
providing the compression instructions to the sender machine, wherein the compression instructions reduce size of the bitmask associated with the message to be sent to the receiver machine.
10. The method of claim 9 , wherein the method further comprises providing the compression instructions to the receiver machine, wherein the receiver machine utilizes the compression instructions to uncompress the compressed bitmask of the message.
11. The method of claim 9 , wherein the message is compressed according to the bit mask, and the bitmask of the message is compressed according to the compression instructions.
12. The method of claim 9 , wherein the message may have one or more fields that are sorted to group together one or more fields likely to have a value and group together one or more fields not likely to have a value.
13. The method of claim 9 , wherein the method further comprises inverting the bitmask prior to compressing the bitmask.
14. The method of claim 9 , wherein the compression instructions can be used by the receiver machine to decompress the compressed bitmask by traversing the tree, reconstructing all subtrees having an absence bit, and copying a leaf node when traversed.
15. The method of claim 9 , wherein the format server is a message-oriented middleware server.
16. The method of claim 9 , wherein the sender and receiver machines that receive the compression instructions can store the compression instructions for future message compression or decompression of bitmasks sent or received by the sender and receiver machines without having to communicate with the format server.
17. Logic for providing bitmask message compression instructions, the logic being embodied in a non-transitory computer-readable medium and when executed operable to:
communicate with a sender machine and a receiver machine;
analyze a bitmask associated with a message to be sent from the sender machine to the receiver machine, wherein the bitmask comprises one or more presence bits and one or more absence bits, wherein the presence bits indicate that an associated field of the message are included in the message and the absence bits indicate that an associated field of the message are omitted in the message;
dynamically determine compression instructions to compress the bitmask, wherein the compression instructions comprise:
generating a tree using the presence bits and the absence bits; and
generating the compressed bitmask by traversing the tree comprising the presence bits and the absence bits; and
provide the compression instructions to the sender machine, wherein the compression instructions reduce size of the bitmask associated with the message to be sent to the receiver machine.
18. The logic of claim 17 , wherein the logic when executed is further operable to provide the compression instructions to the receiver machine, wherein the receiver machine utilizes the compression instructions to uncompress the compressed bitmask of the message.