Data masking in a microservice architecture
A method includes retrieving, with a masker controller job, an object and an associated object ID from a masking bucket that is defined in storage, making a copy of the object, with a masker worker microservice, masking the copy of the object to create a masked object, transmitting the masked object to an object access microservice, with the object access microservice, transmitting the masked object to a deduplication microservice, with the deduplication microservice, deduplicating the masked object, and storing the masked object in the storage.
1. A method, comprising:
with a masker controller job, retrieving an object and an associated object ID from a masking bucket that is defined in storage;
making a copy of the object;
with a masker worker microservice, masking the copy of the object to create a masked object;
transmitting the masked object to an object access microservice;
with the object access microservice, transmitting the masked object to a deduplication microservice;
with the deduplication microservice, deduplicating the masked object; and
storing the masked object in the storage.
2. The method as recited in claim 1 , wherein the masker controller job forwards the copy of the object to the masker worker microservice.
3. The method as recited in claim 1 , wherein the masker worker microservice transmits the masked object to the masker controller.
4. The method as recited in claim 1 , wherein making a copy comprises making the copy in a streaming manner.
5. The method as recited in claim 1 , wherein the masker controller job retrieves the object and the object ID from the masker bucket by performing operations comprising:
reading out the object ID from the masker bucket;
placing the object ID in a channel; and
initiating a thread which retrieves the object ID from the channel, and which retrieves the object from the masker bucket.
6. The method as recited in claim 1 , wherein after successful masking of the copy of the object, the masker controller job deletes the object ID from the masker bucket.
7. The method as recited in claim 1 , wherein the masker controller job selects the masker worker to which the object is sent for masking.
8. The method as recited in claim 1 , wherein the masker worker microservice is provided by a masker worker that is a member of a scalable group of masker workers that are each capable of providing an instance of the masker worker microservice, and the masker controller job apportions a masking workload among the masker workers in the group.
9. The method as recited in claim 1 , further comprising receiving, at the masker bucket, the object and object ID from a user.
10. The method as recited in claim 1 , further comprising receiving by the masker controller job, by way of a user interface (UI), an indication of a user selection of the object for masking, and a user selection of the masker bucket.
11. A non-transitory storage medium having stored therein instructions that are executable by one or more hardware processors to perform operations comprising:
with a masker controller job, retrieving an object and an associated object ID from a masking bucket that is defined in storage;
making a copy of the object;
with a masker worker microservice, masking the copy of the object to create a masked object;
transmitting the masked object to an object access microservice;
with the object access microservice, transmitting the masked object to a deduplication microservice;
with the deduplication microservice, deduplicating the masked object; and
storing the masked object in the storage.
12. The non-transitory storage medium as recited in claim 11 , wherein the masker controller job forwards the copy of the object to the masker worker microservice.
13. The non-transitory storage medium as recited in claim 11 , wherein the masker worker microservice transmits the masked object to the masker controller.
14. The non-transitory storage medium as recited in claim 11 , wherein making a copy comprises making the copy in a streaming manner.
15. The non-transitory storage medium as recited in claim 11 , wherein the masker controller job retrieves the object and the object ID from the masker bucket by performing operations comprising:
reading out the object ID from the masker bucket;
placing the object ID in a channel; and
initiating a thread which retrieves the object ID from the channel, and which retrieves the object from the masker bucket.
16. The non-transitory storage medium as recited in claim 11 , wherein after successful masking of the copy of the object, the masker controller job deletes the object ID from the masker bucket.
17. The non-transitory storage medium as recited in claim 11 , wherein the masker controller job selects the masker worker to which the object is sent for masking.
18. The non-transitory storage medium as recited in claim 11 , wherein the masker worker microservice is provided by a masker worker that is a member of a scalable group of masker workers that are each capable of providing an instance of the masker worker microservice, and the masker controller job apportions a masking workload among the masker workers in the group.
19. The non-transitory storage medium as recited in claim 11 , wherein the operations further comprising receiving, at the masker bucket, the object and object ID from a user.
20. The non-transitory storage medium as recited in claim 11 , wherein the operations further comprise receiving by the masker controller job, by way of a user interface (UI), an indication of a user selection of the object for masking, and a user selection of the masker bucket.