Efficient sensor data delivery
View Patent ↗A method is provided to enhance efficiency of sensor event data transmission over network. Specifically, a method is described to buffer a set of sensor data, to group one or more of the set of sensor data having a same type for batch processing. The batch processing includes compressing and securing operations on the grouped sensor data, and restore the original message sequence of the grouped sensor data.
1. A method, the method comprising:
receiving a plurality of messages;
generating a set of batched messages and a first batch metadata associated with the set of batched messages from the plurality of messages;
compressing the set of batched messages to create a set of compressed batched messages;
updating the first batch metadata to generate a second batch metadata, the second batch metadata associated with the set of compressed batched messages;
applying security operations to the set of compressed batched messages to create a set of secured compressed batched messages; and
updating the second batch metadata to generate a third batch metadata, the third batch metadata associated with the set of secured compressed batched messages.
2. The method of claim 1 , wherein the plurality of messages include sensor event messages.
3. The method of claim 1 , wherein receiving a plurality of messages include setting a message buffer for the plurality of messages, the message buffer having an adjustable size.
4. The method of claim 1 , wherein messages in a batch of the set of batched messages have a same message pattern.
5. The method of claim 1 , wherein generating a set of batched messages from the plurality of messages includes:
identifying a message pattern;
matching one or more messages of the plurality of messages with the message pattern; and
grouping the one or more messages having the same message pattern as a batch of messages.
6. The method of claim 5 , further includes:
identifying duplicate messages in the plurality of messages; and
removing the duplicate messages from the plurality of messages.
7. The method of claim 1 , wherein applying security operations to the set of compressed batched messages includes:
replacing certain data fields and associated values of messages of the set of compressed batched messages with tokens to create a set of tokenized compressed batched messages, the tokens being predefined in a token dictionary; and
applying crypto operations to the set of tokenized compressed batched messages.
8. The method of claim 7 , wherein the token dictionary is enhanced by a first computer and synchronized to a second computer.
9. The method of claim 1 , further comprising:
transmitting the set of secured compressed batched messages and the third batch metadata to an application; and
retrieving messages from the set of secured compressed batched messages and the third batch metadata.
10. The method of claim 9 , wherein retrieving messages from the set of secured compressed batched messages and the third batch metadata include:
retrieving the set of compressed batched messages and the second batch metadata from the set of secured compressed batched messages and the third batch metadata;
retrieving the set of batched messages and the first batch metadata from the set of compressed batched messages and the second batch metadata; and
retrieving messages from the set of batched messages and the first batch metadata.
11. A computer program product comprising a computer readable storage medium having a set of instructions stored therein which, when executed by a processor, causes the processor to deliver messages by:
receiving a plurality of messages;
generating a set of batched messages and a first batch metadata associated with the set of batched messages from the plurality of messages;
compressing the set of batched messages to create a set of compressed batched messages;
updating the first batch metadata to generate a second batch metadata, the second batch metadata associated with the set of compressed batched messages;
applying security operations to the set of compressed batched messages to create a set of secured compressed batched messages; and
updating the second batch metadata to generate a third batch metadata, the third batch metadata associated with the set of secured compressed batched messages.
12. The computer program product of claim 11 , wherein the plurality of messages include sensor event messages.
13. The computer program product of claim 11 , wherein receiving a plurality of messages include setting a message buffer for the plurality of messages, the message buffer having an adjustable size.
14. The computer program product of claim 11 , wherein messages in a batch of the set of batched messages have a same message pattern.
15. The computer program product of claim 11 , wherein generating a set of batched messages from the plurality of messages includes:
identifying a message pattern;
matching one or more messages of the plurality of messages with the message pattern; and
grouping the one or more messages having the same message pattern as a batch of messages.
16. The computer program product of claim 15 , further includes:
identifying duplicate messages in the plurality of messages; and
removing the duplicate messages from the plurality of messages.
17. A computer system comprising:
a processor set; and
a computer readable storage medium;
wherein:
the processor set is structured, located, connected, and/or programmed to run program instructions stored on the computer readable storage medium; and
the program instructions which, when executed by the processor set, cause the processor set to deliver messages by:
receiving a plurality of messages;
generating a set of batched messages and a first batch metadata associated with the set of batched messages from the plurality of messages;
compressing the set of batched messages to create a set of compressed batched messages;
updating the first batch metadata to generate a second batch metadata, the second batch metadata associated with the set of compressed batched messages;
applying security operations to the set of compressed batched messages to create a set of secured compressed batched messages; and
updating the second batch metadata to generate a third batch metadata, the third batch metadata associated with the set of secured compressed batched messages.
18. The computer system of claim 17 , wherein applying security operations to the set of compressed batched messages includes:
replacing certain data fields and associated values of messages of the set of compressed batched messages with tokens to create a set of tokenized compressed batched messages, the tokens being predefined in a token dictionary; and
applying crypto operations to the set of tokenized compressed batched messages.
19. The computer system of claim 17 , wherein the token dictionary is enhanced by a first computer and synchronized to a second computer.
20. The computer of claim 17 , further comprising:
transmitting the set of secured compressed batched messages and the third batch metadata to an application; and
retrieving messages from the set of secured compressed batched messages and the third batch metadata.