Method, device and system for synchronously playing message stream and audio-video stream

1. A method for synchronously playing a message stream and an audio-video stream, wherein the method is executed at a stream-pulling terminal, comprising:

pulling an audio-video stream from an audio-video server and playing the audio-video stream, pulling a message stream from a message server and caching the message stream;

wherein each audio-video frame in the audio-video stream, transmitted from a stream-pushing terminal to the audio-video server via a connection channel established between the stream-pushing terminal and the audio-video server, is supplemented with an audio-video timestamp by the audio-video server, the audio-video timestamp representing a time that the audio-video server acquires the audio-video frame;

wherein each message in the message stream, transmitted from the stream-pushing terminal to the message server via a connection channel established between the stream-pushing terminal and the message server, is supplemented with a message timestamp by the message server, the message timestamp representing a time that the message server acquires the message; and

wherein a server time of the message server and a server time of the audio-video server keep synchronous;

determining, in accordance with the audio-video timestamp of the audio-video frame and the message timestamp of the message, a message in a cached message stream synchronously played with an audio-video frame to be played, and playing the message.

2. The method in accordance with claim 1 , wherein that each audio-video frame in the audio-video stream is supplemented with an audio-video timestamp, and each message in the message stream is supplemented with a message timestamp comprises:

each audio-video frame in the audio-video stream is supplemented with an audio-video frame acquisition time written by the audio-video server into an SEI field, each message in the message stream is supplemented with a message acquisition time written by the message server into a timestamp field, and a server time of the audio-video server and a server time of the message server keep synchronous.

3. The method in accordance with claim 2 , wherein the step of determining, in accordance with the audio-video timestamp of the audio-video frame and the message timestamp of the message, a message in the cached message stream synchronously played with the audio-video frame to be played comprises:

determining a message with a message timestamp in the message stream earlier than or the same as an audio-video timestamp of the audio-video frame to be played as a message played synchronously with the audio-video frame to be played.

4. A stream-pulling terminal, wherein the stream-pulling terminal comprises: at least a processor and a memory, the memory being used to store computer-readable instructions which, when executed by the at least a processor, perform a method for synchronously playing a message stream and an audio-video stream;

wherein the method comprises:

pulling an audio-video stream from an audio-video server and playing the audio-video stream, pulling a message stream from a message server and caching the message stream;

wherein each audio-video frame in the audio-video stream, transmitted from a stream-pushing terminal to the audio-video server via a connection channel established between the stream-pushing terminal and the audio-video server, is supplemented with an audio-video timestamp by the audio-video server, the audio-video timestamp representing a time that the audio-video server acquires the audio-video frame;

each message in the message stream, transmitted from the stream-pushing terminal to the message server via a connection channel established between the stream-pushing terminal and the message server, is supplemented with a message timestamp by the message server, the message timestamp representing a time that the message server acquires the message; and

a server time of the message server and a server time of the audio-video server keep synchronous;

determining a message in a cached message stream synchronously played with an audio-video frame to be played in accordance with the audio-video timestamp of the audio-video frame and the message timestamp of the message, and playing the message.

5. The stream-pulling terminal in accordance with claim 4 , wherein each audio-video frame in the audio-video stream is supplemented with an audio-video timestamp, and each message in the message stream is supplemented with a message timestamp comprises:

each audio-video frame in the audio-video stream is supplemented with an audio-video frame acquisition time written by the audio-video server into an SEI field, each message in the message stream is supplemented with a message acquisition time written by the message server into a timestamp field, and a server time of the audio-video server and a server time of the message server keep synchronous.

6. The stream-pulling terminal in accordance with claim 5 , wherein the method comprises:

determining a message with a message timestamp in the message stream earlier than or the same as an audio-video timestamp of the audio-video frame to be played as a message played synchronously with the audio-video frame to be played.

7. A system for synchronously playing a message stream and an audio-video stream, wherein the system comprises a stream-pulling terminal, a stream-pushing terminal, an audio-video server and a message server,

wherein the stream-pushing terminal is configured to push the audio-video stream to the audio-video server via a connection channel established between the stream-pushing terminal and the audio-video server, and push the message stream to the message server via a connection channel established between the stream-pushing terminal and the message server;

the audio-video server is configured to receive the audio-video stream, and to supplement each audio-video frame in a received audio-video stream with an audio-video timestamp, the audio-video timestamp representing a time that the audio-video server acquires a respective audio-video frame;

the message server is configured to receive the message stream, and to supplement each message in a received message stream with a message timestamp, the message timestamp representing a time that the message server acquires a respective message;

the stream-pulling terminal is configured to:

pull an audio-video stream from the audio-video server and playing the audio-video stream, pull a message stream from the message server and cache the message stream

determine a message in a cached message stream synchronously played with an audio-video frame to be played in accordance with the audio-video timestamp of the audio-video frame and the message timestamp of the message, and to play the message;

wherein a server time of the message server and a server time of the audio-video server keep synchronous.

8. The system in accordance with claim 7 , wherein the stream-pulling terminal are configured to:

determine a message with a message timestamp in the message stream earlier than or the same as an audio-video timestamp of the audio-video frame to be played as a message played synchronously with the audio-video frame to be played.

9. The system in accordance with claim 7 , wherein the audio-video server is configured to:

write an audio-video frame acquisition time into an SEI field of each audio-video frame in the received audio-video stream;

the message server is configured to:

write a message acquisition time into a timestamp field of each message in the received message stream, so that the stream-pulling terminal determines a message in a cached message stream and synchronously played with the audio-video frame to be played in a cached message stream in accordance with the audio-video timestamp of the audio-video frame and the message timestamp of the message, and plays the message.