Network data source time management for data streaming processing system
A method, computer-readable medium, and device for processing a stream of records are disclosed. A method may receive a registration request from a data source to join in providing a plurality of records to the stream, synchronize a timing system with the data source, receive an initial timestamp from the data source, and post the initial timestamp to a plurality of operators or a plurality of subscribers before the data source is allowed to send records into the stream.
1. A device comprising:
a processor of a data stream processing system implementing a coordinator for processing a stream of records; and
a computer-readable medium storing instructions which, when executed by the processor, cause the processor to perform operations, the operations comprising:
receiving a registration request from a data source to join in providing a plurality of records to the stream;
synchronizing a timing system with the data source;
receiving an initial timestamp from the data source; and
posting the initial timestamp to a plurality of operators or a plurality of subscribers before the data source is allowed to send records into the stream, wherein the initial timestamp that is posted is for enabling each of the plurality of operators or the plurality of subscribers to update a respective local timestamp table.
2. The device of claim 1 , wherein the initial timestamp was previously chosen from among a respective initial timestamp posted by each of the plurality of operators or the plurality of subscribers.
3. The device of claim 2 , wherein each respective initial timestamp posted by each of the plurality of operators or the plurality of subscribers is greater than a minimum value in the respective local timestamp table of each of the plurality of operators or the plurality of subscribers.
4. The device of claim 2 , the operations further comprising:
receiving the initial timestamp that was previously chosen from among the respective initial timestamp posted by each of the plurality of operators or the plurality of subscribers; and
providing the initial timestamp to the data source.
5. The device of claim 1 , wherein plurality of records comprises data associated with at least one virtual network function of a software defined network.
6. The device of claim 5 , wherein the at least one virtual network function comprises at least one of: a virtual router, a virtual switch, a virtual feature server, a virtual firewall, a virtual database server, a virtual media server, a virtual cache, or a virtual middle-box.
7. The device of claim 5 , wherein the at least one virtual network function comprises at least one of: a virtual mobility management entity, a virtual home subscriber server, a virtual serving gateway, or a virtual packet data network gateway.
8. A method comprising:
receiving, by a processor of a data stream processing system implementing a coordinator for processing a stream of records, a registration request from a data source to join in providing a plurality of records to the stream;
synchronizing, by the processor, a timing system with the data source;
receiving, by the processor, an initial timestamp from the data source; and
posting, by the processor, the initial timestamp to a plurality of operators or a plurality of subscribers before the data source is allowed to send records into the stream, wherein the initial timestamp that is posted is for enabling each of the plurality of operators or the plurality of subscribers to update a respective local timestamp table.
9. The method of claim 8 , wherein the initial timestamp was previously chosen from among a respective initial timestamp posted by each of the plurality of operators or the plurality of subscribers.
10. The method of claim 9 , wherein each respective initial timestamp posted by each of the plurality of operators or the plurality of subscribers is greater than a minimum value in the respective local timestamp table of each of the plurality of operators or the plurality of subscribers.
11. The method of claim 9 , further comprising:
receiving, by the processor, the initial timestamp that was previously chosen from among the respective initial timestamp posted by each of the plurality of operators or the plurality of subscribers; and
providing, by the processor, the initial timestamp to the data source.
12. The method of claim 8 , wherein plurality of records comprises data associated with at least one virtual network function of a software defined network.
13. The method of claim 12 , wherein the at least one virtual network function comprises at least one of: a virtual router, a virtual switch, a virtual feature server, a virtual firewall, a virtual database server, a virtual media server, a virtual cache, or a virtual middle-box.
14. The method of claim 12 , wherein the at least one virtual network function comprises at least one of: a virtual mobility management entity, a virtual home subscriber server, a virtual serving gateway, or a virtual packet data network gateway.
15. A non-transitory computer-readable medium storing instructions which, when executed by a processor of a data stream processing system implementing a coordinator for processing a stream of records, cause the processor to perform operations, the operations comprising:
receiving a registration request from a data source to join in providing a plurality of records to the stream;
synchronizing a timing system with the data source;
receiving an initial timestamp from the data source; and
posting the initial timestamp to a plurality of operators or a plurality of subscribers before the data source is allowed to send records into the stream, wherein the initial timestamp that is posted is for enabling each of the plurality of operators or the plurality of subscribers to update a respective local timestamp table.
16. The non-transitory computer-readable medium of claim 15 , wherein the initial timestamp was previously chosen from among a respective initial timestamp posted by each of the plurality of operators or the plurality of subscribers.
17. The non-transitory computer-readable medium of claim 16 , wherein each respective initial timestamp posted by each of the plurality of operators or the plurality of subscribers is greater than a minimum value in the respective local timestamp table of each of the plurality of operators or the plurality of subscribers.
18. The non-transitory computer-readable medium of claim 16 , the operations further comprising:
receiving the initial timestamp that was previously chosen from among a respective initial timestamp posted by each of the plurality of operators or the plurality of subscribers; and
providing the initial timestamp to the data source.
19. The non-transitory computer-readable medium of claim 15 , wherein plurality of records comprises data associated with at least one virtual network function of a software defined network.
20. The non-transitory computer-readable medium of claim 19 , wherein the at least one virtual network function comprises at least one of: a virtual router, a virtual switch, a virtual feature server, a virtual firewall, a virtual database server, a virtual media server, a virtual cache, or a virtual middle-box.