Streaming data distributed processing method and device

1. A streaming data distributed processing method, comprising: obtaining service data identifier information of a data record of streaming data, a to-be-processed real-time value of the data record, and a time sequence characteristic of the to-be-processed real-time value of the data record, the service data identifier information representing service data;

obtaining a time sequence characteristic of a processed real-time value of the service data based on a correspondence relationship between the service data identifier information and the time sequence characteristic of the processed real-time value;

comparing the time sequence characteristic of the to-be-processed real-time value and the time sequence characteristic of the processed real-time value, and in response to that the time sequence characteristic of the to-be-processed real-time value is later than the time sequence characteristic of the processed real-time value, updating the time sequence characteristic of the processed real-time value to the time sequence characteristic of the to-be-processed real-time value;

employing the to-be-processed real-time value of the service data in service computations before the time sequence characteristic of the processed real-time value of the service data has been stored;

using the time sequence characteristic of the to-be-processed value of the service data as the time sequence characteristic of the processed real-time value; and

saving the correspondence relationship between the service data identifier information and the time sequence characteristic of the processed real-time value, wherein:

the service data identifier information comprises: an identifier characteristic and at least one identifier field;

a combination of all identifier fields represents one piece or one set of the service data; and

the identifier characteristic is generated based on a predetermined portion of the combination of all identifier fields.

2. The method according to claim 1 , wherein the time sequence characteristic comprises: a real time-value generation time.

3. The method according to claim 1 , wherein:

the streaming data comprises: a flow of messages carrying the service data identifier information, the to-be-processed real-time value, and the time sequence characteristic of the to-be-processed real-time value;

the time sequence characteristic of the real-time value comprises: a real-time value generation time and a message identifier of a message containing the real-time value, the message identifier reflecting a time sequence of message generation; and

the time sequence of the to-be-processed real-time value being later than the time sequence of the processed real-time value comprises: the to-be-processed real-time value's generation time being later than the processed real-time value's generation time, or the generation times of the to-be processed and processed real-time values being the same and a time sequence reflected by a message identifier of a message containing the to-be-processed real-time value being later than a time sequence reflected by a message identifier of a message containing the processed real-time value.

4. The method according to claim 1 , wherein the streaming data distributed processing method runs in parallel and independently on at least two software function modules.

5. The method according to claim 1 , wherein:

the at least one identifier field comprises: a main service primary key identifier and an application signature; and

the identifier characteristic is first several bits of a digest value of the main service primary key identifier.

6. The method according to claim 1 , further comprising:

in response to that the time sequence characteristic of the to-be-processed real-time value is not later than the time sequence characteristic of the processed real-time value, inhibiting the to-be-processed real-time value of the service date to be used in the service computations.

7. A streaming data distributed processing apparatus, comprising: a processor and a non-transitory computer-readable storage medium coupled to the processor, the storage medium storing instructions that, when executed by the processor, cause the apparatus to perform:

obtaining service data identifier information of a data record of streaming data, a to-be-processed real-time value of the data record, and a time sequence characteristic of the to-be-processed real-time value of the data record, the service data identifier information representing service data;

obtaining a time sequence characteristic of a processed real-time value of the service data based on a correspondence relationship between the service data identifier information and the time sequence characteristic of the processed real-time value;

comparing the time sequence characteristic of the to-be-processed real-time value and the time sequence characteristic of the processed real-time value, and in response to that the time sequence characteristic of the to-be-processed real-time value is later than the time sequence characteristic of the processed real-time value, updating the time sequence characteristic of the processed real-time value to the time sequence characteristic of the to-be-processed real-time value;

employing the to-be-processed real-time value of the service data in service computations before the time sequence characteristic of the processed real-time value of the service data has been stored;

using the time sequence characteristic of the to-be-processed value of the service data as the time sequence characteristic of the processed real-time value; and

saving the correspondence relationship between the service data identifier information and the time sequence characteristic of the processed real-time value, wherein:

the service data identifier information comprises: an identifier characteristic and at least one identifier field;

a combination of all identifier fields represents one piece or one set of the service data; and

the identifier characteristic is generated based on a predetermined portion of the combination of all identifier fields.

8. The apparatus according to claim 7 , wherein the time sequence characteristic comprises: a real-time value generation time.

9. The apparatus according to claim 7 , wherein:

the streaming data comprises: a flow of messages carrying the service data identifier information, the to-be-processed real-time value, and the time sequence characteristic of the to-be-processed real-time value;

the time sequence characteristic of the real-time comprises: a real-time value generation time and a message identifier of a message containing the real-time value, the message identifier reflecting a time sequence of message generation; and

the time sequence of the to-be-processed real-time value being later than the time sequence of the processed real-time comprises: the to-be-processed real-time value's generation time being later than the processed real-time value's generation time, or the generation times of the to-be-processed and processed real-time values being the same and a time sequence reflected by a message identifier of a message containing the to-be-processed real-time value being later than a time sequence reflected by a message identifier of a message containing the processed real-time value.

10. The apparatus according to claim 7 , wherein the streaming data distributed processing apparatus runs in parallel and independently on at least two software function modules.

11. The apparatus according to claim 7 , wherein:

the at least one identifier field comprises: a main service primary key identifier and an application signature; and

the identifier characteristic is first several bits of a digest value of the main service primary key identifier.

12. The apparatus according to claim 7 , wherein the instructions further cause the apparatus to perform:

in response to that the time sequence characteristic of the to-be-processed real-time value is not later than the time sequence characteristic of the processed real-time value, inhibiting the to-be-processed real-time value of the service data to be used in the service computations.

13. A non-transitory computer-readable storage medium storing instructions that, when executed by a processor, cause the processor to perform:

obtaining service data identifier information of a data record of streaming data, a to-be-processed real-time value of the data record, and a time sequence characteristic of the to-be-processed real-time value of the data record, the service data identifier information representing service data;

obtaining a time sequence characteristic of a processed real-time value of the service data based on a correspondence relationship between the service data identifier information and the time sequence characteristic of the processed real-time value;

comparing the time sequence characteristic of the to-be-processed real-time value and the time sequence characteristic of the processed real-time value, and in response to that the time sequence characteristic of the to-be-processed real-time value is later than the time sequence characteristic of the processed real-time value, updating the time sequence characteristic of the processed real-time value to the time sequence characteristic of the to-be-processed real-time value;

employing the to-be-processed real-time value of the service data in service computations before the time sequence characteristic of the processed real-time value of the service data has been stored;

using the time sequence characteristic of the to-be-processed value of the service data as the time sequence characteristic of the processed real-time value; and

saving the correspondence relationship between the service data identifier information and the time sequence characteristic of the processed real-time value, wherein:

the service data identifier information comprises: an identifier characteristic and at least one identifier field;

a combination of all identifier fields represents one piece or one set of the service data; and

the identifier characteristic is generated based on a predetermined portion of the combination of all identifier fields.

14. The storage medium according to claim 13 , wherein the time sequence characteristic comprises: a real-time value generation time.

15. The storage medium according to claim 13 , wherein:

the streaming data comprises: a flow of messages carrying the service data identifier information, the to-be-processed real-time value, and the time sequence characteristic of the to-be-processed real-time value;

the time sequence characteristic of the real-time value comprises: a real-time value generation time and a message identifier of a message containing the real-time value, the message identifier reflecting a time sequence of message generation; and

the time sequence of the to-be-processed real-time value being later than the time sequence of the processed real-time value comprises: the to-be-processed real-time value's generation time being later than the processed real-time value's generation time, or the generation times of the to-be-processed and processed real-time values being the same and a time sequence reflected by a message identifier of a message containing the to-be-processed real-time value being later than a time sequence reflected by a message identifier of a message containing the processed real-time value.

16. The storage medium according to claim 13 , wherein:

the at least one identifier field comprises: a main service primary key identifier and an application signature; and

the identifier characteristic is first several bits of a digest value of the main service primary key identifier.

17. A non-transitory computer-readable storage medium storing instructions that, when executed by a processor, cause the processor to perform:

obtaining service data identifier information of a data record of streaming data, a to-be-processed real-time value of the data record, and a time sequence characteristic of the to-be-processed real-time value of the data record, the service data identifier information representing service data;

obtaining a time sequence characteristic of a processed real-time value of the service data based on a correspondence relationship between the service data identifier information and the time sequence characteristic of the processed real-time value;

comparing the time sequence characteristic of the to-be-processed real-time value and the time sequence characteristic of the processed real-time value, and in response to that the time sequence characteristic of the to-be-processed real-time value is later than the time sequence characteristic of the processed real-time value, updating the time sequence characteristic of the processed real-time value to the time sequence characteristic of the to-be-processed real-time value;

employing the to-be-processed real-time value of the service data in service computations before the time sequence characteristic of the processed real-time value of the service data has been stored;

using the time sequence characteristic of the to-be-processed value of the service data as the time sequence characteristic of the processed real-time value; and

saving the correspondence relationship between the service data identifier information and the time sequence characteristic of the processed real-time value, wherein:

the streaming data comprises: a flow of messages carrying the service data identifier information, the to-be-processed real-time value, and the time sequence characteristic of the to-be-processed real-time value;

the time sequence characteristic of the real-time value comprises: a real-time value generation time and a message identifier of a message containing the real-time value, the message identifier reflecting a time sequence of message generation; and

the time sequence of the to-be-processed real-time value being later than the time sequence of the processed real-time value comprises: the to-be-processed real-time value's generation time being later than the processed real-time value's generation time, or the generation times of the to-be-processed and processed real-time values being the same and a time sequence reflected by a message identifier of a message containing the to-be-processed real-time value being later than a time sequence reflected by a message identifier of a message containing the processed real-time value.