Efficient method for data invulnerability architecture (DIA) and data corruption detection for deduped cloud objects
One example method includes receiving, at a cloud storage site, a write request that identifies an object to be written to the cloud storage site, storing the object at the cloud storage site, receiving, at the cloud storage site, a read request that identifies the object, performing, at the cloud storage site, an evaluation of the object to determine if the object is corrupted, and sending a message identifying an outcome of the evaluation. One or more of the operations at the cloud storage site may be performed by an Object Lambda function that has been configured by a dedupe application.
1. A method, comprising:
receiving, at a cloud storage site from a dedupe application, a write request that identifies an object to be written to the cloud storage site;
storing the object at the cloud storage site;
receiving, at the cloud storage site from the dedupe application, a read request that identifies the object;
in response to receiving the read request, performing, at the cloud storage site, an evaluation of the object to determine if the object is corrupted; and
sending, from the cloud storage site to the dedupe application, a message identifying an outcome of the evaluation.
2. The method as recited in claim 1 , wherein the performing of the evaluation is carried out by an Object Lambda function hosted at the cloud storage site.
3. The method as recited in claim 2 , wherein operation of the lambda function is automatically triggered by receipt, at the cloud storage site, of the read request.
4. The method as recited in claim 1 , wherein the message indicates either that the object is corrupted, or that the object is not corrupted.
5. The method as recited in claim 1 , wherein when the evaluation indicates that the object is not corrupted, a write operation for the object is marked as complete.
6. The method as recited in claim 1 , wherein an Object Lambda function that carries out the evaluation is configured by the dedupe application so that the Object Lambda function includes logic to iterate, parse, and validate the data in the object.
7. The method as recited in claim 1 , wherein a configuration of the lambda function is determined based on a requirement of the dedupe application.
8. The method as recited in claim 1 , wherein the object is deduplicated prior to being stored at the cloud storage site.
9. The method as recited in claim 1 , wherein no data is downloaded from the cloud storage site by the dedupe application.
10. A non-transitory storage medium having stored therein instructions that are executable by one or more hardware processors to perform operations comprising:
receiving, at a cloud storage site from a dedupe application, a write request that identifies an object to be written to the cloud storage site;
storing the object at the cloud storage site;
receiving, at the cloud storage site from the dedupe application, a read request that identifies the object;
in response to receiving the read request, performing, at the cloud storage site, an evaluation of the object to determine if the object is corrupted; and
sending, from the cloud storage site to the dedupe application, a message identifying an outcome of the evaluation.
11. The non-transitory storage medium as recited in claim 10 , wherein the performing of the evaluation is carried out by an Object Lambda function hosted at the cloud storage site.
12. The non-transitory storage medium as recited in claim 11 , wherein operation of the lambda function is automatically triggered by receipt, at the cloud storage site, of the read request.
13. The non-transitory storage medium as recited in claim 10 , wherein the message indicates either that the object is corrupted, or that the object is not corrupted.
14. The non-transitory storage medium as recited in claim 10 , wherein when the evaluation indicates that the object is not corrupted, a write operation for the object is marked as complete.
15. The non-transitory storage medium as recited in claim 10 , wherein an Object Lambda function that carries out the evaluation is configured by the dedupe application so that the Object Lambda function includes logic to iterate, parse, and validate the data in the object.
16. The non-transitory storage medium as recited in claim 10 , wherein a configuration of the lambda function is determined based on a requirement of the dedupe application.
17. The non-transitory storage medium as recited in claim 10 , wherein the object is deduplicated prior to being stored at the cloud storage site.
18. The non-transitory storage medium as recited in claim 10 , wherein no data is downloaded from the cloud storage site by the dedupe application.