Processing event messages for data objects in a message queue to determine data to redact

1. A computer program product for determining data in an object to redact, wherein the computer program product comprises a computer readable storage medium having computer readable program code embodied therein that when executed performs operations, the operations comprising:

receiving event messages for objects from a source server managing the objects in a storage, wherein the event messages include facets for data instances in the objects from deep data inspection of the objects, wherein the facets associate data instances in the objects with redaction relevant attributes of the associated data instances that are used to determine whether the data instances for which the facets are provided should be redacted, wherein a facet indicates a redaction relevant attribute associated with a data instance in one of the objects;

adding the event messages to a message queue;

maintaining redaction rules indicating data types to redact;

determining an event message in the message queue for an object having a facet with a redaction relevant attribute matching one of the data types in the redaction rules; and

redacting a data instance in the object indicated in the facet with the redaction relevant attribute matching one of the data types indicated in the redaction rules to redact.

2. The computer program product of claim 1 , wherein a facet that indicates data to redact comprises at least one of sensitive data, personally identifiable information, and financial information.

3. The computer program product of claim 1 , wherein the object subject to the redacting comprises a first object and the determined event message comprises a first event message, wherein the operations further comprise:

receiving an update on a new data type to redact;

determining a second event message in the message queue for a second object having a facet indicating a redaction relevant attribute matching the new data type; and

redacting a data instance in the second object the facet in the second event message associates with the redaction relevant attribute matching the new data type.

4. The computer program product of claim 3 , wherein the operations further comprise:

adding the new data type to the redaction rules.

5. The computer program product of claim 1 , wherein an event message includes metadata on an updated object, wherein deep data inspection is performed on the updated object to update facets for the updated object that is added to the message queue.

6. The computer program product of claim 1 , wherein the event messages are generated immediately after a modification resulting in an updated object to provide information on real-time changes to updated objects to the message queue.

7. The computer program product of claim 1 , wherein the operations further comprise:

receiving an update on a new data field to redact;

determining a facet in an event message in the message queue for an object indicating data for the new data field; and

redacting data for determined facet in the object for the new data field.

8. The computer program product of claim 1 , wherein the operations further comprise:

receiving notification of an event message added to the message queue; and

reading the message queue to read the event message in response to receiving the notification.

9. The computer program product of claim 8 , wherein the operations further comprise:

in response to adding an event message to the message queue, determining a consumer process subscribed to the message queue to which the event message was added; and

sending the notification to the determined consumer process to cause the determined consumer process to read the event message added to the message queue.

10. A system for determining data to redact in an object and in communication with a source server managing objects in a storage, comprising:

a processor; and

a computer readable storage medium having computer readable program code embodied therein that when executed by the processor performs operations, the operations comprising:

receiving event messages for objects from the source server, wherein the event messages include facets for data instances in the objects from deep data inspection of the objects, wherein the facets associate data instances in the objects with redaction relevant attributes of the associated data instances that are used to determine whether the data instances for which the facets are provided should be redacted, wherein a facet indicates a redaction relevant attribute associated with a data instance in one of the objects;

adding the event messages to a message queue;

maintaining redaction rules indicating data types to redact;

determining an event message in the message queue for an object having a facet with a redaction relevant attribute matching one of the data types in the redaction rules; and

redacting a data instance in the object indicated in the facet with the redaction relevant attribute matching one of the data types indicated in the redaction rules to redact.

11. The system of claim 10 , wherein a facet that indicates data to redact comprises at least one of sensitive data, personally identifiable information, and financial information.

12. The system of claim 10 , wherein the object subject to the redacting comprises a first object and the determined event message comprises a first event message, wherein the operations further comprise:

receiving an update on a new data type to redact;

determining a second event message in the message queue for a second object having a facet indicating a redaction relevant attribute matching the new data type; and

redacting a data instance in the second object the facet in the second event message associates with the redaction relevant attribute matching the new data type.

13. The system of claim 12 , wherein the operations further comprise:

adding the new data type to the redaction rules.

14. The system of claim 10 , wherein the operations further comprise:

receiving an update on a new data field to redact;

determining a facet in an event message in the message queue for an object indicating data for the new data field; and

redacting data for determined facet in the object for the new data field.

15. The system of claim 10 , wherein the operations further comprise:

receiving notification of an event message added to the message queue; and

reading the message queue to read the event message in response to receiving the notification.

16. The system of claim 15 , wherein the operations further comprise:

in response to adding an event message to the message queue, determining a consumer process subscribed to the message queue to which the event message was added; and

sending the notification to the determined consumer process to cause the determined consumer process to read the event message added to the message queue.

17. A method for determining data in an object to redact, comprising:

receiving event messages for objects from a source server managing the objects in a storage, wherein the event messages include facets for data instances in the objects from deep data inspection of the objects, wherein the facets associate data instances in the objects with redaction relevant attributes of the associated data instances that are used to determine whether the data instances for which the facets are provided should be redacted, wherein a facet indicates a redaction relevant attribute associated with a data instance in one of the objects;

adding the event messages to a message queue;

maintaining redaction rules indicating data types to redact;

determining an event message in the message queue for an object having a facet with a redaction relevant attribute matching one of the data types in the redaction rules; and

redacting a data instance in the object indicated in the facet with the redaction relevant attribute matching one of the data types indicated in the redaction rules to redact.

18. The method of claim 17 , wherein a facet that indicates data to redact comprises at least one of sensitive data, personally identifiable information, and financial information.

19. The method of claim 17 , wherein the object subject to the redacting comprises a first object and the determined event message comprises a first event message, further comprising:

receiving an update on a new data type to redact;

determining a second event message in the message queue for a second object having a facet indicating a redaction relevant attribute matching the new data type; and

redacting a data instance in the second object the facet in the second event message associates with the redaction relevant attribute matching the new data type.

20. The method of claim 19 , further comprising:

adding the new data type to the redaction rules.

21. The method of claim 17 , further comprising:

receiving an update on a new data field to redact;

determining a facet in an event message in the message queue for an object indicating data for the new data field; and

redacting data for determined facet in the object for the new data field.

22. The method of claim 17 , further comprising:

receiving notification of an event message added to the message queue; and

reading the message queue to read the event message in response to receiving the notification.

23. The method of claim 22 , further comprising:

in response to adding an event message to the message queue, determining a consumer process subscribed to the message queue to which the event message was added; and

sending the notification to the determined consumer process to cause the determined consumer process to read the event message added to the message queue.