Efficient sensor data delivery
A method is provided to enhance efficiency of sensor event data transmission over network. Specifically, a method is described to buffer a set of sensor data, to group one or more of the set of sensor data having a same type for batch processing. The batch processing includes compressing and securing operations on the grouped sensor data, and restore the original message sequence of the grouped sensor data.
1. A method comprising:
associating a set of batched messages with a first batch metadata;
compressing the set of batched messages to create a set of compressed messages;
updating the first batch metadata to generate a second batch metadata;
associating the second batch metadata with the set of compressed messages;
applying security operations to the set of compressed messages to create a set of secured messages;
updating the second batch metadata to generate a third batch metadata; and
associating the third batch metadata with the set of secured messages.
2. The method of claim 1 , wherein the set of batched messages includes a sensor event message.
3. The method of claim 1 , wherein the set of batched messages have a same message pattern.
4. The method of claim 1 , further comprising:
setting a message buffer for receiving a plurality of messages, the message buffer having an adjustable size; and
generating the set of batched messages from similar messages within the plurality of messages.
5. The method of claim 1 , further comprising:
determining a message pattern;
identifying a set of messages having the message pattern; and
generating the set of batched messages from the set of messages.
6. The method of claim 1 , wherein applying security operations to the set of compressed messages includes:
replacing certain data fields and associated values of messages of the set of compressed messages with tokens to create a set of tokenized messages, the tokens being predefined in a token dictionary; and
applying cryptographic operations to the set of tokenized messages.
7. The method of claim 1 , further comprising:
transmitting the set of secured messages and the third batch metadata to an application; and
retrieving a message from the set of secured messages and corresponding third batch metadata.
8. The method of claim 7 , wherein retrieving a message from the set of secured messages and corresponding third batch metadata includes:
retrieving the set of compressed messages and the second batch metadata from the set of secured messages and the third batch metadata;
retrieving the set of batched messages and the first batch metadata from the set of compressed messages and the second batch metadata; and
retrieving the message from the set of batched messages and corresponding first batch metadata.
9. A computer program product comprising a computer readable storage medium having stored thereon:
first program instructions programmed to associate a set of batched messages with a first batch metadata;
second program instructions programmed to compress the set of batched messages to create a set of compressed messages;
third program instructions programmed to update the first batch metadata to generate a second batch metadata;
fourth program instructions programmed to associate the second batch metadata with the set of compressed messages;
fifth program instructions programmed to apply security operations to the set of compressed messages to create a set of secured messages;
sixth program instructions programmed to update the second batch metadata to generate a third batch metadata; and
seventh program instructions programmed to associate the third batch metadata with the set of secured messages.
10. The computer program product of claim 9 , wherein the set of batched messages includes a sensor event message.
11. The computer program product of claim 9 , wherein the set of batched messages have a same message pattern.
12. The computer program product of claim 9 , further comprising:
eighth program instructions programmed to set a message buffer for receiving a plurality of messages, the message buffer having an adjustable size; and
ninth program instructions programmed to generate the set of batched messages from similar messages within the plurality of messages.
13. The computer program product of claim 9 , further comprising:
eighth program instructions programmed to determine a message pattern;
ninth program instructions programmed to identify a set of messages having the message pattern; and
tenth program instructions programmed to generate the set of batched messages from the set of messages.
14. The computer program product of claim 9 , wherein applying security operations to the set of compressed messages includes:
replacing certain data fields and associated values of messages of the set of compressed messages with tokens to create a set of tokenized messages, the tokens being predefined in a token dictionary; and
applying cryptographic operations to the set of tokenized messages.
15. The computer program product of claim 9 , further comprising:
eighth program instructions programmed to transmit the set of secured messages and the third batch metadata to an application; and
ninth program instructions programmed to retrieve a message from the set of secured messages and corresponding third batch metadata.
16. The computer program product of claim 15 , wherein retrieving a message from the set of secured messages and corresponding third batch metadata includes:
retrieving the set of compressed messages and the second batch metadata from the set of secured messages and the third batch metadata;
retrieving the set of batched messages and the first batch metadata from the set of compressed messages and the second batch metadata; and
retrieving the message from the set of batched messages and corresponding first batch metadata.
17. A computer system comprising:
a processor set; and
a computer readable storage medium;
wherein:
the processor set is structured, located, connected, and/or programmed to run program instructions stored on the computer readable storage medium; and
the program instructions include:
first program instructions programmed to associate a set of batched messages with a first batch metadata;
second program instructions programmed to compress the set of batched messages to create a set of compressed messages;
third program instructions programmed to update the first batch metadata to generate a second batch metadata;
fourth program instructions programmed to associate the second batch metadata with the set of compressed messages;
fifth program instructions programmed to apply security operations to the set of compressed messages to create a set of secured messages;
sixth program instructions programmed to update the second batch metadata to generate a third batch metadata; and
seventh program instructions programmed to associate the third batch metadata with the set of secured messages.
18. The computer system of claim 17 , wherein the set of batched messages includes a sensor event message.
19. The computer system of claim 17 , wherein the set of batched messages have a same message pattern.
20. The computer system of claim 17 , further comprising:
eighth program instructions programmed to set a message buffer for receiving a plurality of messages, the message buffer having an adjustable size; and
ninth program instructions programmed to generate the set of batched messages from similar messages within the plurality of messages.