Data management platform
Some examples relate generally to a data management platform comprising: a storage device configured to store secondary data and one or more processors in communication with the storage device and configured to perform certain operations. The operations may include identifying an aspect of the secondary data stored in the storage device, the secondary data including a backup of respective primary data stored in a primary data source; identifying or receiving an indication of a target to receive data associated with the identified aspect of the secondary data; and transmitting the data associated with the aspect of the secondary data to the target.
1. A data management platform, comprising:
a storage device configured to store secondary data; and
one or more processors in communication with the storage device and configured to perform operations including:
identifying an aspect of the secondary data stored in the storage device, the secondary data including a backup of primary data stored in a primary data source, wherein the aspect defines a subset of the secondary data to be transmitted to a target;
identifying an indication of the target to receive data associated with the identified aspect of the secondary data;
receiving, from the primary data source, a snapshot of the primary data stored in the primary data source for updating the backup of the primary data as the secondary data;
identifying, in response to receiving the snapshot, a data difference between data of the snapshot and the backup of the secondary data stored in the storage device; and
transmitting data of the data difference and associated with the aspect of the secondary data to the target.
2. The data management platform of claim 1 , wherein the target includes one or more of an application, an NAS device, and an object store.
3. The data management platform of claim 1 , wherein the operations further comprise:
receiving an identification of the primary data source or aspect of the primary data.
4. The data management platform of claim 3 , wherein the received identification includes an identification of a subset of the primary data or the secondary data.
5. The data management platform of claim 3 , wherein the identification of the primary data source or the aspect of the primary data, or the identification of the subset of the primary data or the secondary data, is received from the target.
6. The data management platform of claim 3 , wherein the operations further comprise:
identifying, by the data management platform, a subset of the secondary data based on the received identification of the primary data source or the aspect of the primary data.
7. The data management platform of claim 4 , wherein the operations further comprise:
transmitting the data associated with the aspect of the secondary data to the target as a push transmission.
8. The data management platform of claim 7 , wherein the operations further comprise:
receiving, from the target or other entity, a configuration for the push transmission.
9. The data management platform of claim 8 , wherein the received identification of the subset of the primary data or the secondary data includes file metadata, the file metadata including one or more of a file type, a file name, a file path, a file size, and a user ID.
10. The data management platform of claim 9 , wherein the push transmission is based on or initiated by an identification of the data difference.
11. The data management platform of claim 10 , wherein the operations further comprise:
filtering, by the data management platform, the data difference based on the file metadata.
12. The data management platform of claim 11 , wherein the filtering performed by the data management platform is confined to the data difference.
13. The data management platform of claim 12 , wherein the filtering performed by the data management platform is initiated on a scheduled basis or triggered by an identification of the data difference.
14. The data management platform of claim 13 , wherein the operations further comprise:
performing data management operations subsequent to the push transmission.
15. The data management platform of claim 14 , wherein the data management operations include recording or identifying at least some attributes of the primary data, or at least some attributes of the secondary data included in the push transmission to the target.
16. The data management platform of claim 15 , wherein the at least some attributes of the primary data or the secondary data include one or more of an address of the target, an address of the secondary data, an address of the primary data, and file metadata.
17. A computer-implemented method at a data management platform, the data management platform including a storage device configured to store secondary data, the method comprising:
identifying an aspect of the secondary data stored in the storage device, the secondary data including a backup of primary data stored in a primary data source, wherein the aspect defines a subset of the secondary data to be transmitted to a target;
identifying an indication of the target to receive data associated with the identified aspect of the secondary data;
receiving, from the primary data source, a snapshot of the primary data stored in the primary data source for updating the backup of the primary data as the secondary data;
identifying, in response to receiving the snapshot, a data difference between data of the snapshot and the backup of the secondary data stored in the storage device; and
transmitting data of the data difference and associated with the aspect of the secondary data to the target.
18. The method of claim 17 , wherein the target includes one or more of an application, an NAS device, and an object store.
19. A non-transitory, machine-readable medium storing instructions which, when read by a machine, cause the machine to perform operations in a method at a data management platform, the data management platform including a storage device configured to store secondary data, the operations comprising, at least:
identifying an aspect of the secondary data stored in the storage device, the secondary data including a backup of primary data stored in a primary data source, wherein the aspect defines a subset of the secondary data to be transmitted to a target;
identifying an indication of the target to receive data associated with the identified aspect of the secondary data;
receiving, from the primary data source, a snapshot of the primary data stored in the primary data source for updating the backup of the primary data as the secondary data;
identifying, in response to receiving the snapshot, a data difference between data of the snapshot and the backup of the secondary data stored in the storage device; and
transmitting data of the data difference and associated with the aspect of the secondary data to the target.