Stream based compressibility with auto-feedback

1. A system comprising:

an orchestrator including a storage controller managing one or more storage nodes to store data from a plurality of service guests;

one or more processors, wherein the orchestrator executes on the one or more processors to:

receive, from one or more storage nodes, compression ratio measurements associated with attempts to compress data from a plurality of applications running in the plurality of service guests;

receive a request for storing a first data stream from a first application of the plurality of applications, the first application running in a first service guest of the plurality of service guests; and

provide, to the one or more storage nodes, the first data stream and an indication of a compression ratio of previously stored data associated with the first application.

2. The system of claim 1 , wherein the orchestrator executes on the one or more processors to:

based on a compression ratio of previously stored data associated with the first application being less than a threshold, assign a first compressibility setting to the first data stream, wherein the first compressibility setting causes a storage node to store the first data stream without attempting to compress the first data stream;

receive a request for storing a second data stream from a second application of the plurality of applications, the second application running in the first service guest; and

based on a compression ratio of previously stored data from the second application being greater than the threshold, assign a second compressibility setting to the second data stream, wherein the second compressibility setting causes the storage node to attempt compressing the second data stream.

3. The system of claim 1 , wherein the orchestrator executes on the one or more processors to:

assign a first identifier to the first data stream from the first service guest and a second identifier to the second data stream from a second service guest.

4. The system of claim 3 , wherein the first identifier is mapped to a first compression ratio of the previously stored data associated with the first application, wherein the second identifier is mapped to a second compression ratio of the previously stored data associated with the second application.

5. The system of claim 1 , wherein the previously stored data associated with the first application was sent from an instance of the first application running on a second service guest of the plurality of service guests.

6. The system of claim 1 , wherein the orchestrator executes on the one or more processors to:

determine that the first application does not have previously stored data; and

responsively provide the first data stream to the storage node without applying the first compressibility setting.

7. The system of claim 1 , wherein the orchestrator executes on the one or more processors to:

determine that the first application has a user-defined compressibility setting related to a compressibility of the first data stream; and

responsively assign the user-defined compressibility setting to the first data stream.

8. A method comprising:

receiving, from one or more storage nodes, compression ratio measurements associated with attempts to compress data from a plurality of applications running in a plurality of service guests;

receive a request for storing a first data stream from a first application of the plurality of applications, the first application running in a first service guest of the plurality of service guests; and

based on a compression ratio of previously stored data from the first application being less than a threshold, assign a first compressibility setting to the first data stream, wherein the first compressibility setting causes a storage node to store the first data stream without attempting to compress the first data stream.

9. The method of claim 8 , further comprising:

receiving a request for storing a second data stream from a second application of the plurality of applications, the second application running in the first service guest; and

based on a compression ratio of previously stored data from the second application being greater than the threshold, assigning a second compressibility setting to the second data stream, wherein the second compressibility setting causes the storage node to attempt compressing the second data stream.

10. The method of claim 8 , further comprising:

assigning a first identifier to the first data stream from the first service guest and a second identifier to a second data stream from a second service guest.

11. The method of claim 10 , wherein the first identifier is mapped to a first compression ratio of the previously stored data associated with the first application, wherein the second identifier is mapped to a second compression ratio of the previously stored data associated with the second application.

12. The method of claim 8 , wherein the previously stored data associated with the first application was sent from an instance of the first application running on a second service guest of the plurality of service guests.

13. The method of claim 8 , further comprising:

determining that the first application does not have previously stored data; and

responsively providing the first data stream to the storage node without applying the first compressibility setting.

14. The method of claim 8 , further comprising:

determining that the first application has a user-defined compressibility setting related to a compressibility of the first data stream; and

responsively assigning the user-defined compressibility setting to the first data stream.

15. A non-transitory computer readable medium storing instructions that, when executed by one or more processors, cause a computing system to:

receive, from one or more storage nodes, compression ratio measurements associated with attempts to compress data from a plurality of applications running in a plurality of service guests;

receive a request for storing a first data stream from a first application of the plurality of applications, the first application running in a first service guest of the plurality of service guests; and

based on a compression ratio of previously stored data from the first application being less than a threshold, assign a first compressibility setting to the first data stream, wherein the first compressibility setting causes a storage node to store the first data stream without attempting to compress the first data stream.

16. The non-transitory computer readable medium of claim 15 , wherein the instructions further cause the computing system to:

receive a request for storing a second data stream from a second application of the plurality of applications, the second application running in the first service guest; and

based on a compression ratio of previously stored data from the second application being greater than the threshold, assign a second compressibility setting to the second data stream, wherein the second compressibility setting causes the storage node to attempt compressing the second data stream.

17. The non-transitory computer readable medium of claim 15 , wherein the instructions further cause the computing system to:

assign a first identifier to the first data stream from the first service guest and a second identifier to a second data stream from a second service guest.

18. The non-transitory computer readable medium of claim 17 , wherein the first identifier is mapped to a first compression ratio of the previously stored data associated with the first application, wherein the second identifier is mapped to a second compression ratio of the previously stored data associated with the second application.

19. The non-transitory computer readable medium of claim 15 , wherein the previously stored data associated with the first application was sent from an instance of the first application running on a second service guest of the plurality of service guests.

20. The non-transitory computer readable medium of claim 15 , wherein the instructions further cause the computing system to:

determine that the first application does not have previously stored data; and

responsively provide the first data stream to the storage node without applying the first compressibility setting.