Efficient sensor data delivery
A method is provided to enhance efficiency of sensor event data transmission over network. Specifically, a method is described to buffer a set of sensor data, to group one or more of the set of sensor data having a same type for batch processing. The batch processing includes compressing and securing operations on the grouped sensor data, and restore the original message sequence of the grouped sensor data.
1. A method comprising:
compressing a batch of messages having a message pattern to create a set of compressed messages, the messages including sensor event data;
associating a first batch metadata with the set of compressed messages, the first batch metadata describing how the set of compressed messages is formatted;
applying a security operation to the set of compressed messages to create a set of secured messages;
updating the first batch metadata with security operation information to create a second batch metadata; and
associating the second batch metadata with the set of secured messages;
wherein:
the message pattern for each message in the batch of messages is the same.
2. The method of claim 1 , further comprising:
setting a message buffer for receiving a plurality of messages, the message buffer having an adjustable size; and
generating from the plurality of messages the batch of messages having the message pattern.
3. The method of claim 1 , further comprising:
determining a message pattern;
identifying a set of messages having the message pattern; and
generating the batch of messages from the set of messages.
4. The method of claim 1 , wherein applying the security operation to the set of compressed messages includes:
replacing a data field and an associated value of messages of the set of compressed messages with a token to create a set of tokenized messages; and
applying cryptographic operations to the set of tokenized messages.
5. The method of claim 4 , wherein the token is predefined in a token dictionary.
6. The method of claim 1 , further comprising:
transmitting the set of secured messages and the second batch metadata to an application; and
retrieving a message from the set of secured messages and corresponding third batch metadata.
7. A computer program product comprising a computer readable storage medium having stored thereon:
first program instructions programmed to compress a batch of messages having a message pattern to create a set of compressed messages, the messages including sensor event data;
second program instructions programmed to associate a first batch metadata with the set of compressed messages, the first batch metadata describing how the set of compressed messages is formatted;
third program instructions programmed to apply a security operation to the set of compressed messages to create a set of secured messages;
fourth program instructions programmed to update the first batch metadata with security operation information to create a second batch metadata; and
fifth program instructions programmed to associate the second batch metadata with the set of secured messages;
wherein:
the message pattern for each message in the batch of messages is the same.
8. The computer program product of claim 7 , further comprising:
sixth program instructions programmed to set a message buffer for receiving a plurality of messages, the message buffer having an adjustable size; and
seventh program instructions programmed to generate from the plurality of messages the batch of messages having the message pattern.
9. The computer program product of claim 7 , further comprising:
sixth program instructions programmed to determine a message pattern;
seventh program instructions programmed to identify a set of messages having the message pattern; and
eighth program instructions programmed to generate the batch of messages from the set of messages.
10. The computer program product of claim 7 , wherein the third program instructions programmed to apply the security operation to the set of compressed messages include:
program instructions to replace a data field and an associated value of messages of the set of compressed messages with a token to create a set of tokenized messages; and
program instructions to apply cryptographic operations to the set of tokenized messages.
11. The computer program product of claim 10 , wherein the token is predefined in a token dictionary.
12. The computer program product of claim 7 , further comprising:
sixth program instructions programmed to transmit the set of secured messages and the second batch metadata to an application; and
seventh program instructions programmed to retrieve a message from the set of secured messages and corresponding second batch metadata.
13. A computer system comprising:
a processor set; and
a computer readable storage medium;
wherein:
the processor set is structured, located, connected, and/or programmed to run program instructions stored on the computer readable storage medium; and
the program instructions include:
first program instructions programmed to compress a batch of messages having a message pattern to create a set of compressed messages, the messages including sensor event data;
second program instructions programmed to associate a first batch metadata with the set of compressed messages, the first batch metadata describing how the set of compressed messages is formatted;
third program instructions programmed to apply a security operation to the set of compressed messages to create a set of secured messages;
fourth program instructions programmed to update the first batch metadata with security operation information to create a second batch metadata; and
fifth program instructions programmed to associate the second batch metadata with the set of secured messages;
wherein:
the message pattern for each message in the batch of messages is the same.
14. The computer system of claim 13 , further comprising:
sixth program instructions programmed to set a message buffer for receiving a plurality of messages, the message buffer having an adjustable size; and
seventh program instructions programmed to generate from the plurality of messages the batch of messages having the message pattern.
15. The computer system of claim 13 , further comprising:
sixth program instructions programmed to determine a message pattern;
seventh program instructions programmed to identify a set of messages having the message pattern; and
eighth program instructions programmed to generate the batch of messages from the set of messages.
16. The computer system of claim 13 , wherein the third program instructions programmed to apply the security operation to the set of compressed messages include:
program instructions to replace a data field and an associated value of messages of the set of compressed messages with a token to create a set of tokenized messages; and
program instructions to apply cryptographic operations to the set of tokenized messages.
17. The computer system of claim 16 , wherein the token is predefined in a token dictionary.
18. The computer system of claim 13 , further comprising:
sixth program instructions programmed to transmit the set of secured messages and the second batch metadata to an application; and
seventh program instructions programmed to retrieve a message from the set of secured messages and corresponding second batch metadata.