Processing continuously generated data using a rolling transaction procedure
Processing of continuously generated data using a rolling transaction procedure is described. For instance, a system can process a data stream comprising a first segment and a second segment. A transaction associated with the data stream can be initiated and in response to the transaction being initiated, a first transaction segment for the first segment and a second transaction segment for the second segment are generated. Further, a scaling event that modifies the second segment into a third segment and a fourth segment can be detected, and a data stream transaction procedure is executed to end the transaction.
1. A system, comprising:
a processor; and
a memory that stores executable instructions that, when executed by the processor, facilitate performance of operations, comprising:
processing a data stream comprising a first segment of a main stream and a second segment of the main stream;
starting a transaction associated with the data stream;
in response to the starting the transaction, creating a first transaction segment associated with the first segment and a second transaction segment associated with the second segment, wherein the first transaction segment and the second transaction segment are configured to be merged to segments of the main stream upon a call to commit the transaction;
detecting a scaling event that modifies the second segment into a third segment of the main stream and a fourth segment of the main stream; and
executing a data stream transaction procedure to end the transaction.
2. The system of claim 1 , wherein the operations further comprise:
in response to the executing the data stream transaction procedure, creating a fifth segment of the main stream associated with the first segment and a sixth segment of the main stream associated with the third segment and the fourth segment.
3. The system of claim 2 , wherein the operations further comprise:
in response to the executing the data stream transaction procedure, merging the first transaction segment to the fifth segment and merging the second transaction segment to the sixth segment and sealing the fifth segment and the sixth segment.
4. The system of claim 2 , wherein the operations further comprise:
creating a seventh segment of the main stream associated with the first segment.
5. The system of claim 4 , wherein the operations further comprise:
creating an eighth segment of the main stream associated with the third segment.
6. The system of claim 5 , wherein the operations further comprise:
creating a ninth segment of the main stream associated with the fourth segment.
7. The system of claim 1 , wherein the scaling event is initiated as result of a data traffic threshold value being determined to have satisfied a function with respect to a traffic threshold.
8. The system of claim 1 , wherein the executing the data stream transaction procedure is in response to ending the transaction after the scaling the first segment.
9. A method, comprising:
processing, by a device comprising a processor, a data stream comprising a first segment of a main stream and a second segment of the main stream;
initiating, by the device, a transaction associated with the data stream;
in response to the initiating the transaction, generating, by the device, a first transaction segment for the first segment and a second transaction segment for the second segment, wherein the first transaction segment and the second transaction segment are configured to be merged to segments of the main stream upon a call to commit the transaction;
detecting, by the device, a scaling event that modifies the second segment into a third segment of the main stream and a fourth segment of the main stream; and
executing, by the device, a data stream transaction procedure to end the transaction.
10. The method of claim 9 , further comprising:
in response to the executing the data stream transaction procedure, creating, by the device, a fifth segment of the main stream associated with the first segment and a sixth segment of the main stream associated with the third segment and the fourth segment.
11. The method of claim 10 , further comprising:
in response to the executing the data stream transaction procedure, merging the first transaction segment to the fifth segment and merging the second transaction segment to the sixth segment and sealing, by the device, the fifth segment and the sixth segment.
12. The method of claim 10 , further comprising:
generating, by the device, a seventh segment of the main stream for the first segment.
13. The method of claim 12 , further comprising:
generating, by the device, an eighth segment of the main stream for the third segment; and
generating, by the device, a ninth segment of the main stream for the fourth segment.
14. The method of claim 9 , wherein the scaling event is initiated as result of a data traffic threshold value reaching above a traffic threshold.
15. The method of claim 9 , wherein the executing the data stream transaction procedure is in response to ending the transaction after the scaling the first segment.
16. A machine-readable storage medium, comprising executable instructions that, when executed by a processor, facilitate performance of operations, comprising:
processing a data stream comprising a first segment of a main stream and a second segment of the main stream;
starting a transaction associated with the data stream;
in response to the starting the transaction, creating a first transaction segment associated with the first segment and a second transaction segment associated with the second segment wherein the first transaction segment and the second transaction segment are configured to be merged to segments of the main stream upon a call to commit the transaction;
detecting a scaling event that modifies the second segment into a third segment of the main stream and a fourth segment of the main stream; and
executing a commit request for the transaction, wherein the executing the commit request comprises executing a data stream transaction procedure to end the transaction.
17. The machine-readable storage medium of claim 16 , wherein the operations further comprise:
in response to the executing the data stream transaction procedure, creating a fifth segment of the main stream associated with the first segment and a sixth segment of the main stream associated with the third segment and the fourth segment; and
in response to the executing the data stream transaction procedure, merging the first transaction segment to the fifth segment and merging the second transaction segment to the sixth segment and sealing the fifth segment and the sixth segment.
18. The machine-readable storage medium of claim 17 , wherein the operations further comprise:
generating a seventh segment of the main stream for the first segment;
generating an eighth segment of the main stream for the third segment; and
generating a ninth segment of the main stream for the fourth segment.
19. The machine-readable storage medium of claim 16 , wherein the scaling event is initiated as result of a data traffic threshold value being determined to be above a traffic threshold.
20. The machine-readable storage medium of claim 16 , wherein the executing the data stream transaction procedure is in response to ending the transaction after the scaling of the first segment.