Geo, segment, uniques distributed computing system
A distributed computing system is configured to compute operational data for a video advertisement delivery system. Cloud-based resource are used to calculate operational parameters such as geographical data, unique advertisement delivery instances and segments of consumers that received the video advertisements.
1. A computer-implemented method, comprising:
processing, utilizing a first code base, a plurality of data files, comprising information about past delivery of one or more video advertisements to one or more viewer devices, through a pipeline of processing stages;
cross-checking the processing of the plurality of data files through the pipeline using a second code base that is different than the first code base utilized to process the plurality of data files through the pipeline to validate the processing of the plurality of data files through the pipeline using the first code base;
transferring the plurality of data files from a plurality of geographically distributed advertisement servers to a first storage resource in a distributed computing cloud, wherein the distributed computing cloud comprises a plurality of computers comprising a first computer, a second computer and a third computer, wherein the first computer comprises the first storage resource;
providing a script in a first programming language to the distributed computing cloud;
using a compiler that translates computer code in the first programming language to execute, using one or more resources from the second computer of the distributed computing cloud and one or more resources from the third computer of the distributed computing cloud, the script to perform analysis of the plurality of data files in the first storage resource of the first computer, wherein the executing comprises transforming the script into a series of jobs; and
storing results of the analysis on a second storage resource, wherein the results include at least one operational parameter of a video advertisement delivery system.
2. The computer-implemented method of claim 1 , wherein the operational parameter comprises geographic information related to the video advertisement delivery system.
3. The computer-implemented method of claim 1 , wherein the operational parameter comprises segment data for consumers of the video advertisement delivery system.
4. The computer-implemented method of claim 1 , wherein the operational parameter comprises unique instances of advertisement deliveries in the video advertisement delivery system.
5. The computer-implemented method of claim 1 , wherein each data file of the plurality of data files comprises a plurality of line items.
6. The computer-implemented method of claim 5 , wherein each line item of the plurality of line items corresponds to an ad delivery instance.
7. The computer-implemented method of claim 6 , wherein the ad delivery instance comprises a video advertisement delivery instance.
8. A system, comprising:
a processor configured to:
process, utilizing a first code base, a plurality of data files, comprising information about past delivery of one or more video advertisements to one or more viewer devices, through a pipeline of processing stages;
cross-check the processing of the plurality of data files through the pipeline using a second code base that is different than the first code base utilized to process the plurality of data files through the pipeline to validate the processing of the plurality of data files through the pipeline using the first code base;
transfer the plurality of data files from a plurality of geographically distributed advertisement servers to a first storage resource in a distributed computing cloud, wherein the distributed computing cloud comprises a plurality of computers comprising a first computer, a second computer and a third computer, wherein the first computer comprises the first storage resource;
provide a script in a first programming language to the distributed computing cloud;
use a compiler that translates computer code in the first programming language to execute, using one or more resources from the second computer of the distributed computing cloud and one or more resources from the third computer of the distributed computing cloud, the script to perform analysis of the plurality of data files in the first storage resource of the first computer, wherein the executing comprises transforming the script into a series of jobs; and
store results of the analysis on a second storage resource, wherein the results include at least one operational parameter of a video advertisement delivery system.
9. The system of claim 8 , wherein the operational parameter comprises geographic information related to the video advertisement delivery system.
10. The system of claim 8 , wherein the operational parameter comprises segment data for consumers of the video advertisement delivery system.
11. The system of claim 8 , wherein the operational parameter comprises unique instances of advertisement deliveries in the video advertisement delivery system.
12. The system of claim 8 , wherein each data file of the plurality of data files comprises a plurality of line items.
13. The system of claim 12 , wherein each line item of the plurality of line items corresponds to an ad delivery instance.
14. The system of claim 13 , wherein the ad delivery instance comprises a video advertisement delivery instance.
15. A computer program product comprising a computer-readable non-transitory medium having code stored thereon, the code, when executed by one or more processors, causing the one or more processors to implement a method, comprising:
processing, utilizing a first code base, a plurality of data files, comprising information about past delivery of one or more video advertisements to one or more viewer devices, through a pipeline of processing stages;
cross-checking the processing of the plurality of data files through the pipeline using a second code base that is different than the first code base utilized to process the plurality of data files through the pipeline to validate the processing of the plurality of data files through the pipeline using the first code base;
transferring the plurality of data files from a plurality of geographically distributed advertisement servers to a first storage resource in a distributed computing cloud, wherein the distributed computing cloud comprises a plurality of computers comprising a first computer, a second computer and a third computer, wherein the first computer comprises the first storage resource;
providing a script in a first programming language to the distributed computing cloud;
using a compiler that translates computer code in the first programming language to execute, using one or more resources from the second computer of the distributed computing cloud and one or more resources from the third computer of the distributed computing cloud, the script to perform analysis of the plurality of data files in the first storage resource of the first computer, wherein the executing comprises transforming the script into a series of jobs; and
storing results of the analysis on a second storage resource, wherein the results include at least one operational parameter of a video advertisement delivery system.
16. The computer program product of claim 15 , wherein the operational parameter comprises geographic information related to the video advertisement delivery system.
17. The computer program product of claim 15 , wherein the operational parameter comprises segment data for consumers of the video advertisement delivery system.
18. The computer program product of claim 15 , wherein the operational parameter comprises unique instances of advertisement deliveries in the video advertisement delivery system.
19. The computer program product of claim 15 , wherein each data file of the plurality of data files comprises a plurality of line items.
20. The computer program product of claim 19 , wherein each line item of the plurality of line items corresponds to an ad delivery instance and the ad delivery instance comprises a video advertisement delivery instance.