Scalable, real-time messaging system
A publish-subscribe messaging systems and methods are described. A method may include retrieving, by one or more computer processors, messages for a particular one of a plurality of channels from one or more respective buffers allocated to the particular channel that have not expired and according to an order, wherein each buffer comprises a respective time-to-live. The method also includes sending, by the one or more computer processors, the messages retrieved for the particular channel to one or more subscriber clients that have subscribed to the particular channel.
1. A method, comprising:
retrieving, by one or more computer processors, messages for a particular one of a plurality of channels from one or more respective buffers allocated to the particular channel that have not expired and according to an order,
wherein each buffer comprises a respective time-to-live; and
sending, by the one or more computer processors, the messages retrieved for the particular channel to one or more subscriber clients that have subscribed to the particular channel.
2. The method of claim 1 , comprising:
receiving the messages from a plurality of publisher clients.
3. The method of claim 1 , comprising:
storing the messages of each of the plurality of channels in the one or more respective buffers according to the order.
4. The method of claim 1 , wherein the order comprises the order in which the messages for the channel are received.
5. The method of claim 1 , wherein expiration of the time-to-live of each buffer is based on when the buffer was allocated to the particular channel.
6. The method of claim 1 , wherein the particular channel is initiated by a message from a publisher client.
7. The method of claim 1 , comprising:
identifying a first buffer to store the messages of the particular channel;
ordering the messages for the particular channel based on, at least in part, a respective time each of the messages was received from respective publisher clients; and
storing a first portion of the messages of the particular channel as ordered in the first buffer.
8. The method of claim 7 , comprising:
determining that the first buffer is full; and, based thereon:
identifying a second buffer; and
storing a different second portion of the messages of the particular channel as ordered in the second buffer.
9. The method of claim 1 , comprising:
storing the messages of each channel earlier in the order in buffers having time-to-lives that will expire sooner than buffers used to store the messages of each channel later in the order.
10. The method of claim 1 , wherein retrieval of the messages for the particular channel is initiated by a connection from the one or more subscriber clients subscribing to the particular channel.
11. A system, comprising:
one or more computer processors programmed to perform operations to:
retrieve messages for a particular one of a plurality of channels from one or more respective buffers allocated to the particular channel that have not expired and according to an order,
wherein each buffer comprises a respective time-to-live; and
send the messages retrieved for the particular channel to one or more subscriber clients that have subscribed to the particular channel.
12. The system of claim 11 , wherein the operations are further to:
receive the messages from a plurality of publisher clients.
13. The system of claim 11 , wherein the operations are further to:
store the messages of each of the plurality of channels in the one or more respective buffers according to the order.
14. The system of claim 11 , wherein the order comprises the order in which the messages for the channel are received.
15. The system of claim 11 , wherein expiration of the time-to-live of each buffer is based on when the buffer was allocated to the particular channel.
16. The system of claim 11 , wherein the particular channel is initiated by a message from a publisher client.
17. The system of claim 11 , wherein the operations are further to:
identify a first buffer to store the messages of the particular channel;
order the messages for the particular channel based on, at least in part, a respective time each of the messages was received from respective publisher clients; and
store a first portion of the messages of the particular channel as ordered in the first buffer.
18. The system of claim 17 , wherein the operations are further to:
determine that the first buffer is full; and, based thereon:
identify a second buffer; and
store a different second portion of the messages of the particular channel as ordered in the second buffer.
19. The system of claim 11 , wherein the operations are further to:
store the messages of each channel earlier in the order in buffers having time-to-lives that will expire sooner than buffers used to store the messages of each channel later in the order.
20. A non-transitory computer-readable medium having instructions stored thereon that, when executed by one or more computer processors, cause the one or more computer processors to:
retrieve messages for a particular one of a plurality of channels from one or more respective buffers allocated to the particular channel that have not expired and according to an order,
wherein each buffer comprises a respective time-to-live; and
send the messages retrieved for the particular channel to one or more subscriber clients that have subscribed to the particular channel.