Maintaining persistence of a messaging system
Methods, systems, and apparatus, including computer programs for receiving, from a first client device, a request for messages of a first channel of a plurality of channels starting at a position in the first channel, wherein each channel comprises a respective ordered plurality of messages stored in one or more respective buffers according to the order, each buffer having a respective time-to-live; receiving, from one of the second client devices, a response message comprising one or more messages of the first channel that are at or after the position in the order; and sending the messages to the first client device.
1. A method, comprising:
determining that a first message in a first channel of a plurality of channels corresponding to a position in the first channel is stored in a buffer having a time-to-live that has expired, wherein each channel comprises a respective plurality of messages stored in one or more respective buffers according to an order, wherein each buffer comprises a respective time-to-live, and, based thereon:
sending, by one or more computer processors, a request for a history of messages beginning at the position to one or more client devices that subscribe to the first channel;
receiving, from the one or more client devices, a response message comprising one or more messages of the first channel that are at or after the position;
retrieving messages for the first channel from one or more buffers of the first channel having time-to-lives that have not expired; and
combining, by the one or more computer processors the retrieved messages and the messages from the response message.
2. The method of claim 1 , comprising:
receiving a request from a second client device for messages of the first channel starting at the position.
3. The method of claim 2 , comprising:
sending the combined messages to the second client device.
4. The method of claim 1 , comprising:
storing at least one of the messages from the response message and the combined messages.
5. The method of claim 1 , wherein the retrieved messages and the message from the response messages are combined according to the order.
6. The method of claim 1 , wherein each of the one or more client devices are configured to store locally the one or more messages of the first channel that are at or after the position.
7. The method of claim 1 , comprising:
selecting the response message from the client device that includes a most messages requested for the history of messages.
8. The method of claim 1 , wherein combining the retrieved messages and the messages from the response message comprises:
removing one or more duplicate messages from the combined messages.
9. The method of claim 1 , wherein sending the request for the history of messages beginning at the position to the one or more client devices that subscribe to the first channel comprises:
determining a respective connection latency to the first channel for the one or more client devices; and
identifying the client device having a shortest connection latency.
10. The method of claim 1 , wherein sending the request for the history of messages beginning at the position to the one or more client devices that subscribe to the first channel comprises:
determining time durations of respective current connection sessions to the first channel for the one or more client devices; and
identifying the client device having the longest current connection session.
11. A system, comprising:
one or more computer processors programmed to perform operations to:
determine that a first message in a first channel of a plurality of channels corresponding to a position in the first channel is stored in a buffer having a time-to-live that has expired, wherein each channel comprises a respective plurality of messages stored in one or more respective buffers according to an order, wherein each buffer comprises a respective time-to-live, and, based thereon:
send a request for a history of messages beginning at the position to one or more client devices that subscribe to the first channel;
receive, from the one or more client devices, a response message comprising one or more messages of the first channel that are at or after the position;
retrieve messages for the first channel from one or more buffers of the first channel having time-to-lives that have not expired; and
combine the retrieved messages and the messages from the response message.
12. The system of claim 11 , wherein the operations further to:
receive a request from a second client device for messages of the first channel starting at the position; and
send the combined messages to the second client device.
13. The system of claim 11 , wherein the operations further to:
store at least one of the messages from the response message and the combined messages.
14. The system of claim 11 , wherein the retrieved messages and the message from the response messages are combined according to the order.
15. The system of claim 11 , wherein each of the one or more client devices to store locally the one or more messages of the first channel that are at or after the position.
16. The system of claim 11 , wherein the operations further to:
select the response message from the client device that includes a most messages requested for the history of messages.
17. The system of claim 11 , wherein to combine the retrieved messages and the messages from the response message the one or more computer processors are further to:
remove one or more duplicate messages from the combined messages.
18. The system of claim 11 , wherein to send the request for the history of messages beginning at the position to the one or more client devices that subscribe to the first channel the one or more computer processors are further to:
determine a respective connection latency to the first channel for the one or more client devices; and
identify the client device having a shortest connection latency.
19. The system of claim 11 , wherein to send the request for the history of messages beginning at the position to the one or more client devices that subscribe to the first channel the one or more computer processors are further to:
determine time durations of respective current connection sessions to the first channel for the one or more client devices; and
identify the client device having the longest current connection session.
20. A non-transitory computer-readable medium having instructions stored thereon that, when executed by one or more computer processors, cause the one or more computer processors to:
determine that a first message in a first channel of a plurality of channels corresponding to a position in the first channel is stored in a buffer having a time-to-live that has expired, wherein each channel comprises a respective plurality of messages stored in one or more respective buffers according to an order, wherein each buffer comprises a respective time-to-live, and, based thereon:
send, by the one or more computer processors, a request for a history of messages beginning at the position to one or more client devices that subscribe to the first channel;
receive, from the one or more client devices, a response message comprising one or more messages of the first channel that are at or after the position;
retrieve, messages for the first channel from one or more buffers of the first channel having time-to-lives that have not expired; and
combine, by the one or more computer processors, the retrieved messages and the messages from the response message.