Scalable, real-time messaging system
Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for receiving from a plurality of publisher clients a plurality of messages, assigning each of the messages to one of a plurality of distinct channels wherein each channel comprises an ordered plurality of messages, storing messages of each of the channels in one or more respective buffers according to the order, each buffer having a respective time-to-live, retrieving messages for one or more of the channels from respective buffers having time-to-lives that have not expired and according to the order, and sending the retrieved messages to a plurality of subscriber clients.
1. A computer-implemented method, comprising:
storing messages of each of a plurality of channels in one or more respective buffers according to an order,
wherein each message is associated with a particular one of the plurality of channels, and
wherein each buffer comprises a respective time-to-live; and
retrieving messages for the particular channel from the one or more respective buffers allocated to the channel that have not expired and according to the order.
2. The method of claim 1 , comprising:
receiving a plurality of messages from a plurality of publisher clients.
3. The method of claim 2 , wherein the order comprises the order in which messages for the channel were received.
4. The method of claim 1 , wherein expiration of the time-to-live of each buffer is based on when the buffer was allocated to the channel.
5. The method of claim 1 , wherein the particular channel is initiated by a message from a publisher client.
6. The method of claim 1 , wherein storing messages of each of the plurality of channels comprises:
identifying a first buffer for storing messages of the particular channel;
ordering messages for the particular channel based on, at least in part, a respective time each of the messages was received from respective publisher clients; and
storing a first portion of the messages of the particular channel as ordered in the first buffer.
7. The method of claim 6 , comprising:
determining that the first buffer is full and, based thereon:
identifying a second buffer; and
storing a different second portion of the messages of the particular channel as ordered in the second buffer.
8. The method of claim 1 , wherein storing messages of each of the plurality of channels comprises:
storing messages of each channel earlier in the order in buffers having time-to-lives that will expire sooner than buffers used to store messages of each channel later in the order.
9. The method of claim 1 , wherein retrieving messages for the particular channel is initiated by a connection from a subscriber client subscribing to the particular channel.
10. The method of claim 1 , comprising:
sending messages retrieved for the particular channel to one or more subscriber clients that have subscribed to the particular channel.
11. A system, comprising:
one or more computer processors programmed to perform operations comprising:
storing messages of each of a plurality of channels in one or more respective buffers according to an order,
wherein each message is associated with a particular one of the plurality of channels, and
wherein each buffer comprises a respective time-to-live; and
retrieving messages for the particular channel from the one or more respective buffers allocated to the channel that have not expired and according to the order.
12. The system of claim 11 , wherein the operations further comprise:
receiving a plurality of messages from a plurality of publisher clients.
13. The system of claim 12 , wherein the order comprises the order in which messages for the channel were received.
14. The system of claim 11 , wherein expiration of the time-to-live of each buffer is based on when the buffer was allocated to the channel.
15. The system of claim 11 , wherein the particular channel is initiated by a message from a publisher client.
16. The system of claim 11 , wherein the operation of storing messages of each of the plurality of channels comprises:
identifying a first buffer for storing messages of the particular channel;
ordering messages for the particular channel based on, at least in part, a respective time each of the messages Was received from respective publisher clients; and
storing a first portion of the messages of the particular channel as ordered in the first buffer.
17. The system of claim 11 , wherein the operation of storing messages of each of the plurality of channels comprises:
storing messages of each channel earlier in the order in buffers having time-to-lives that will expire sooner than buffers used to store messages of each channel later in the order.
18. The system of claim 11 , wherein retrieving messages for the particular channel is initiated by a connection from a subscriber client subscribing to the particular channel.
19. The system of claim 11 , wherein the operations further comprise:
sending messages retrieved for the particular channel to one or more subscriber clients that have subscribed to the particular channel.
20. An article, comprising:
a non-transitory computer-readable medium having instructions stored thereon that, when executed by one or more computer processors, cause the computer processors to perform operations comprising:
storing messages of each of a plurality of channels in one or more respective buffers according to an order,
wherein each message is associated with a particular one of the plurality of channels, and
wherein each buffer comprises a respective time-to-live; and
retrieving messages for the particular channel from the one or more respective buffers allocated to the channel that have not expired and according to the order.