Optimizing data storage with access windows
Methods, systems, apparatus, including computer programs encoded on computer storage media, for reclaiming storage space in a storage environment. In one aspect, the method includes actions of aggregating data that is indicative of access to one or more data objects, determining a future storage cost associated with each of a plurality of data objects, determining an access window for each of the plurality of data objects, identifying a data object based on (i) the future storage cost that satisfies a predetermined threshold and (ii) a data object access window, providing a notification to a user device that requests feedback from a user indicating whether the data object can be deleted, and in response to receiving data that indicates that the data object can be deleted, generating an instruction to cause deletion of the data object upon the expiration of the access window.
1. A computer-implemented method when executed by data processing hardware causes the data processing hardware to perform operations comprising:
aggregating access data for a plurality of data objects stored at a storage environment;
for each respective data object of the plurality of data objects:
determining a corresponding access window associated with the respective data object based on the aggregated access data, the corresponding access window comprising an expiration date in the future; and
determining a corresponding future storage cost associated with the respective data object;
identifying a particular data object of the plurality of data objects based on:
a likelihood that the particular data object will not be accessed outside the corresponding access window of the particular data object; and
the corresponding future storage cost of the particular data object satisfying a predetermined cost threshold; and
generating an instruction to delete the particular data object upon expiration of the corresponding access window of the particular data object.
2. The computer-implemented method of claim 1 , wherein the operations further comprise, before generating the instruction to delete the particular data object, determining that a policy rule does not apply to the particular data object.
3. The computer-implemented method of claim 2 , wherein generating the instruction to delete the particular data object is based on determining that the policy rule does not apply to the particular data object.
4. The computer-implemented method of claim 3 , wherein the policy rule comprises a data retention policy.
5. The computer-implemented method of claim 3 , wherein the policy rule comprises a legal policy.
6. The computer-implemented method of claim 1 , wherein determining the corresponding future storage cost associated with the respective data object comprises using one or more heuristics to estimate a potential future storage cost associated with the respective data object based on a predicted future depreciation of storage prices.
7. The computer-implemented method of claim 1 , wherein the operations further comprise, for each respective data object of the plurality of data objects, determining a corresponding confidence score indicating a likelihood that the respective data object will be accessed after the expiration date.
8. The computer-implemented method of claim 7 , wherein determining the corresponding future storage cost associated with the respective data object is based on the corresponding confidence score.
9. The computer-implemented method of claim 1 , wherein the operations further comprise providing a notification to a user device, the notification requesting feedback from a user indicating whether the particular data object can be deleted upon expiration of the corresponding access window of the particular data object.
10. The computer-implemented method of claim 1 , wherein the operations further comprise receiving data indicating that the particular object can be deleted upon expiration of the corresponding access window of the particular data object.
11. A system comprising:
data processing hardware of one or more server computers; and
memory hardware in communication with the data processing hardware, the memory hardware storing instructions that when executed on the data processing hardware cause the one or more server computers to perform operations comprising:
aggregating access data for a plurality of data objects stored at a storage environment;
for each respective data object of the plurality of data objects:
determining a corresponding access window associated with the respective data object based on the aggregated access data, the corresponding access window comprising an expiration date in the future; and
determining a corresponding future storage cost associated with the respective data object;
identifying a particular data object of the plurality of data objects based on:
a likelihood that the particular data object will not be accessed outside the corresponding access window of the particular data object; and
the corresponding future storage cost of the particular data object satisfying a predetermined cost threshold; and
generating an instruction to delete the particular data object upon expiration of the corresponding access window of the particular data object.
12. The system of claim 11 , wherein the operations further comprise, before generating the instruction to delete the particular data object, determining that a policy rule does not apply to the particular data object.
13. The system of claim 12 , wherein generating the instruction to delete the particular data object is based on determining that the policy rule does not apply to the particular data object.
14. The system of claim 13 , wherein the policy rule comprises a data retention policy.
15. The system of claim 13 , wherein the policy rule comprises a legal policy.
16. The system of claim 11 , wherein determining the corresponding future storage cost associated with the respective data object comprises using one or more heuristics to estimate a potential future storage cost associated with the respective data object based on a predicted future depreciation of storage prices.
17. The system of claim 11 , wherein the operations further comprise, for each respective data object of the plurality of data objects, determining a corresponding confidence score indicating a likelihood that the respective data object will be accessed after the expiration date.
18. The system of claim 17 , wherein determining the corresponding future storage cost associated with the respective data object is based on the corresponding confidence score.
19. The system of claim 11 , wherein the operations further comprise providing a notification to a user device, the notification requesting feedback from a user indicating whether the particular data object can be deleted upon expiration of the corresponding access window of the particular data object.
20. The system of claim 11 , wherein the operations further comprise receiving data indicating that the particular object can be deleted upon expiration of the corresponding access window of the particular data object.