Mechanism to allow a messaging system to automatically switch to asynchronous operation due to high demand
An embodiment can include a method and one system comprising receiving documents, via a processor, the documents having a source application and a destination application and generating one or more chunks including the documents. The method and system can include determining a destination threshold of the destination application representing a maximum volume the destination application can receive in a timeframe. The method and system can further determine using one or more characteristics of the destination application and attributes of the one or more chunks that the maximum volume was not reached in the timeframe. The method and system can transmit the one or more chunks to the destination application.
1. A method comprising:
receiving documents, via a processor, the documents associated with a source application providing the documents and a destination application to receive the documents;
determining whether to transmit the documents to a chunking system based upon characteristics of the destination application, wherein the characteristics of the destination application comprise any of a volume of documents previously transmitted to the destination application in a relevant period of time; information about one or more queues associated with the destination application, priority information of the documents in the one or more queues, priority information associated with the documents, whether chunks are being prepared for transmission, and/or the time one or more chunks were sent;
for documents transmitted to the chunking system, generating one or more chunks as a collection of documents including the documents;
determining a destination threshold of the destination application representing a maximum volume the destination application can receive;
determining using one or more of the characteristics of the destination application and attributes of the one or more chunks that the maximum volume was not reached; and
for documents transmitted to the chunking system, transmitting the one or more chunks to the destination application based on the one or more characteristics of the destination application and attributes of the one or more chunks.
2. The method of claim 1 , comprising:
transmitting a message to the source application indicating that the documents have been transmitted to the destination application.
3. The method of claim 2 , wherein the receiving the documents includes storing the documents in a bucket priority queue.
4. The method of claim 1 , wherein the documents include a priority and storing the documents in a bucket priority queue in accordance to the priority of the documents.
5. The method of claim 1 , wherein generating the one or more chunks is performed by the chunking system.
6. The method of claim 5 , wherein determining to the send the documents to the chunking system includes identifying the one or more characteristics of the destination application and the destination threshold of the destination application.
7. The method of claim 6 , wherein the maximum volume is a number of documents which can be received in one request.
8. The method of claim 6 , wherein the maximum volume is a data size.
9. The method of claim 5 , wherein one or more chunks are generated in accordance with an order defined by a document of the received documents in relation to another document of the received documents.
10. The method of claim 9 , wherein transmitting the one or more chunks includes transmitting the one or more chunks in accordance with the order defined by the documents.
11. An electronic device, comprising:
a processor; and
memory storing instructions, wherein the processor is configured to execute the instructions such that the processor and memory are configured to:
receive documents, the documents associated with a source application providing the documents and a destination application to receive the documents;
determine whether to transmit the documents to a chunking system based upon characteristics of the destination application, wherein the characteristics of the destination application comprise any of a volume of documents previously transmitted to the destination application in a relevant period of time: information about one or more queues associated with the destination application, priority information of the documents in the one or more queues, priority information associated with the documents, whether chunks are being prepared for transmission, and/or the time one or more chunks were sent;
for documents transmitted to the chunking system, generate one or more chunks as a collection of documents including the documents;
determine a destination threshold of the destination application representing a maximum volume the destination application can receive;
determine using one or more of the characteristics of the destination application and attributes of the one or more chunks that the maximum volume was not reached; and
for documents transmitted to the chunking system, transmit the one or more chunks to the destination application based on the one or more characteristics of the destination application and attributes of the one or more chunks.
12. The electronic device of claim 11 , wherein the processor and memory are configured to transmit a message to the source application indicating that the documents have been transmitted to the destination application.
13. The electronic device of claim 12 , wherein receiving the documents includes storage of the documents in a bucket priority queue.
14. The electronic device of claim 11 , wherein the documents includes a priority and storing the documents in a bucket priority queue in accordance to the priority of the documents.
15. The electronic device of claim 11 , wherein generating the one or more chunks is performed by the chunking system.
16. The electronic device of claim 15 , wherein determining to the send the documents to the chunking system includes identifying one or more characteristics of the destination application and the destination threshold of the destination application.
17. The electronic device of claim 16 , wherein the maximum volume is a number of documents which can be received in one request.
18. The electronic device of claim 16 , wherein the maximum volume is a data size.
19. The electronic device of claim 15 , wherein the one or more chunks are generated in accordance with an order defined by a document of the received documents in relation to another document of the received documents.
20. The electronic device of claim 19 , wherein transmitting the one or more chunks includes transmitting the one or more chunks in accordance with the order defined by the documents.
21. The method of claim 1 , further comprising:
when it is identified that a document is high priority, the destination threshold has not been reached, and one or more queues associated with the destination application do not include high priority documents, transmitting the document to the destination application and not to the chunking system.
22. The method of claim 1 , further comprising:
when it is identified that a document is high priority, the destination threshold has not been reached, and one or more queues associated with the destination include high priority documents, transmitting the document to the chunking system.
23. The electronic device of claim 11 , further comprising:
when it is identified that a document is high priority, the destination threshold has not been reached, and one or more queues associated with the destination application do not include high priority documents, transmitting the document to the destination application and not to the chunking system.
24. The electronic device of claim 11 , further comprising:
when it is identified that a document is high priority, the destination threshold has not been reached, and one or more queues associated with the destination include high priority documents, transmitting the document to the chunking system.