Systems and methods for providing real-time discrepancies between disparate execution platforms
In accordance with embodiments of the present disclosure, each third party system of multiple third party systems can store files including datasets associated with one or more campaigns. A computing system can be in communication with the third party systems and including a first database and a second database. The computing system can be configured to receive the selection of the one or more third-party systems, store metadata associated with the at least one campaign in the first database, calculate at least one discrepant data value between the one or more third party systems, based on the datasets associated with the at least one campaign from each of the one or more third party systems.
1. A system to determine data discrepancies between disparate systems in real-time, the system in communication with a plurality of third party systems and including a first database and a second database, the plurality of third party systems configured to store a plurality of files including datasets associated with one or more campaigns, the plurality of third party systems including an ad server and a measurement server; the system comprising:
one or more processors; and
one or more computer-readable mediums storing instructions that, when executed by the one or more computer processors, cause the system to perform operations comprising:
receiving, from a user device, a user-selected date range and a user-selection of a plurality of third party systems, each of the third-party systems configured to store one or more files of the plurality of files, including datasets associated with at least one campaign of the one or more campaigns, the datasets associated with the least one campaign include one dataset from the ad server and one dataset from the measurement server for a same campaign, the dataset from the measurement server collected via applying a second tag to an advertisement code referencing a first tag from the ad server,
storing metadata associated with the at least one of the campaigns in the first database,
generating a workflow for each third-party system,
streaming the one or more files including the datasets associated with the at least one campaign from each of the third party systems, via each respective workflow,
storing the datasets associated with the at least one campaign from each of third party systems in the second database,
calculating at least one discrepant data value between the third party systems within the user-selected date range, based on the datasets associated with one of the campaigns between the third party systems, and
generating a graphical user interface including a report indicating the datasets associated with the campaign from each third party system and the at least one discrepant data value between the third party systems within the user-selected date range for the campaign.
2. The system of claim 1 , wherein the datasets included in the plurality of files further includes one or more types of datum.
3. The system of claim 2 , wherein the operations further comprising streaming each of the one or more files of the plurality of files to at least one topic of a plurality of topics based on the one or more types of datum in the datasets included in the one or more files.
4. The system of claim 1 , wherein the operations further comprise:
breaking down the datasets from the one or more files;
filtering the datasets;
tokenizing the datasets; and
normalizing the datasets.
5. The system of claim 4 , wherein the operations further comprise:
applying one or more tags to each of the plurality of third-party systems; and
generating one or more unique transaction IDs based on based on the one or more tags applied to each of the plurality of third-party systems;
associating the one or more transaction IDs with the datasets.
6. The system of claim 5 , wherein tokenizing datasets includes joining the datasets based on the one or more transaction IDs.
7. The system of claim 5 , wherein filtering the datasets includes removing at least one dataset associated with an invalid transaction ID.
8. The system of claim 1 , wherein at least one of the one or more files includes datasets associated with events.
9. The system of claim 8 , wherein the operations further comprise: capturing a URL associated with the events of the datasets from the at least one of the one or more files;
determining device and browser information associated with the events; and
determining a geographic location associated with the events.
10. The system of claim 1 , wherein the graphical user interface is rendered on a display of the user device.
11. A method to determine data discrepancies between disparate systems in real-time, the method comprising:
receiving, via a computing system processor, in communication with a plurality of third party systems and a user device and including a first database and a second database, a selection of a user-selected date range and the plurality of third party systems from the user device, each of the third-party systems configured to store a plurality of files including datasets associated with one or more campaigns, including datasets associated with at least one campaign of the one or more campaigns the plurality of third party systems including an ad server and a measurement server;
storing, via the computing system processor, metadata associated with the at least one campaign in the first database,
generating, via the computing system processor, a workflow for each third-party systems,
streaming, via the computing system processor, the one or more files including the datasets associated with the at least one campaign from each of the third party systems, via each respective workflow, the datasets associated with the least one campaign include one dataset from the ad server and one dataset from the measurement server for a same campaign, the dataset from the measurement server collected via applying a second tag to an advertisement code referencing a first tag from the ad server,
storing, via the computing system processor, the datasets associated with the at least one campaign from each of the third party systems in the second database,
calculating, via the computing system processor, at least one discrepant data value between the third party systems, based on the datasets associated with one of the campaigns across the third party systems and the user-selected date range, and
generating, via the computing system processor, a graphical user interface including a report indicating the datasets associated with the at least one campaign from each third party system and the at least one discrepant data value between the third party systems over the user-selected date range.
12. The method of claim 11 , wherein the datasets included in the plurality of files further includes one or more types of datum.
13. The method of claim 12 , further comprising streaming with the processor, each of the one or more files of the plurality of files to at least one topic of a plurality of topics based on the one or more types of datum in the datasets included in the one or more files.
14. The method of claim 11 , further comprising:
breaking down, via the computing system processor, the datasets from the one or more files;
filtering, via the computing system processor, the datasets;
tokenizing, via the computing system processor, the datasets; and
normalizing, via the computing system processor, the datasets.
15. The method of claim 14 , further comprising:
applying, via the computing system processor, one or more tags to each of the plurality of third party systems; and
generating, via the computing system processor, one or more unique transaction IDs based on based on the one or more tags applied to each of the plurality of third-party systems;
associating, via the computing system processor, the one or more transaction IDs with the datasets.
16. The method of claim 15 , further comprising tokenizing, via the computing system processor, datasets by joining the datasets based on the one or more transaction IDs.
17. The method of claim 15 , further comprising filtering, via the computing system processor, the datasets by removing at least one dataset associated with an invalid transaction ID.
18. The method of claim 11 , wherein at least one of the one or more files includes datasets associated with events.
19. The method of claim 18 , further comprising:
capturing, via the computing system processor, a URL associated with the events of the datasets from the at least one of the one or more files;
determining, via the computing system processor, device and browser information associated with the events; and
determining, via the computing system processor, a geographic location associated with the events.
20. A non-transitory computer readable medium storing instruction to determine data discrepancies between disparate systems in real-time, that, when executed by one or more computer processors of a computing system, cause the computer to perform operations comprising:
receive, via the computing system, in communication with a plurality of third party systems, a user device and including a first database and a second database, a selection of a user-selected date range and the plurality of third party systems from the user device, each of the third-party systems configured to store a plurality of files including datasets associated with one or more campaigns, including datasets associated with at least one campaign of the one or more campaigns, the plurality of third party systems including an ad server and a measurement server;
store, via the computing system, metadata associated with the campaigns in the first database,
generate, via the computing system, a workflow for each third-party,
stream, via the computing system, the one or more files including the datasets associated with the at least one campaign from each of the third party systems, via each respective workflow, the datasets associated with the least one campaign include one dataset from the ad server and one dataset from the measurement server for a same campaign, the dataset from the measurement server collected via applying a second tag to an advertisement code referencing a first tag from the ad server,
store, via the computing system, the datasets associated with the at least one campaign from each of the third party systems in the second database,
calculate, via the computing system, at least one discrepant data value between the third party systems across a single campaign, based on the datasets associated with the campaign from each of the third party systems and the user-selected date range, and
generate, via the computing system, a graphical user interface including a report indicating the datasets associated with the at least one campaign from each third party system and the at least one discrepant data value between the third party systems for the single campaign over the user-selected date range.