ONLINE CAMPAIGN MEASUREMENT ACROSS MULTIPLE THIRD-PARTY SYSTEMS
Disclosed is an online system providing a fair measurement platform for people-based measurement of performance of an online campaign across different third-party systems that eliminates bias for certain third-party systems. The online system determines the measurable portion of the online campaign, where this is a portion of the campaign for which the online system knows the identities of the users and the online system knows that the impressions were viewable. The online system extrapolates with a model out from the measurable portion of the campaign to provide a broader measurement for the campaign including impressions for which identify coverage is incomplete and for which viewability is not available to provide a full, unbiased measurement for the online campaign across various third-party systems, regardless of whether they account for viewability, have identity coverage, or detect fraud.
1 . A method comprising:
performing one or more tracking operations on a campaign in an online system from one or more third-party systems, the one or more tracking operations associated with a plurality of online events and based on one or more actions of one or more users of the online system;
removing one or more fraudulent events from the plurality of online events to create a plurality of non-fraudulent events;
determining, by the online system, one or more non-measurable events of the plurality of non-fraudulent events, comprising:
detecting one or more non-viewable events from the campaign, the non-viewable events not viewed by users of the online system; and
detecting one or more non-identifiable events from the campaign;
removing the one or more non-measurable events from the plurality of online events, resulting in a set of measurable events;
performing a modeling on at least some of the set of measurable events, the modeling process generating one or more models, the one or more models representing a subset of the set of measurable events; and
performing an extrapolation process on the set of measurable events using the one or more generated models to determine a number of valid events.
2 . The method of claim 1 , wherein the extrapolation process is based on a number of tracking conversions associated with the online system, the number determining the set of measurable events used for the modeling.
3 . The method of claim 1 , wherein the extrapolation process is based on a total number of click-throughs associated with the online system, the number determining the set of measurable events used for the modeling.
4 . The method of claim 1 , wherein the extrapolation process is trained on the one or more third-party systems based on a machine-learning model associated with the online system.
5 . The method of claim 4 , wherein the machine-learning model can be implemented on the one or more third-party systems.
6 . The method of claim 1 , wherein the modeling is based on a measurement of one or more users associated with the online system.
7 . The method of claim 1 , wherein determining one or more non-measurable events is based on a number of click-throughs associated with at least one of the users of the online system.
8 . The method of claim 1 , wherein determining one or more non-measurable events is based on an average click-through rate associated with at least one of the users of the online system.
9 . The method of claim 1 , wherein the online system performs the one or more tracking operations responsive to a request to run the campaign from one or more third-party systems.
10 . A computer program product comprising a non-transitory computer readable storage medium having instructions encoded therein that, when executed by a processor, cause the processor to:
perform one or more tracking operations on a campaign in an online system from one or more third-party systems, the one or more tracking operations associated with a plurality of online events and based on one or more actions of one or more users of the online system;
remove one or more fraudulent events from the plurality of online events to create a plurality of non-fraudulent events;
determine, by the online system, one or more non-measurable events of the plurality of non-fraudulent events, comprising:
detect one or more non-viewable events from the campaign, the non-viewable events not viewed by users of the online system;
detect one or more non-identifiable events from the campaign;
remove the one or more non-measurable events from the plurality of online events, resulting in a set of measurable events;
perform a modeling on at least some of the set of measurable events, the modeling process generating one or more models, the one or more models representing a subset of the set of measurable events; and
perform an extrapolation process on the set of measurable events using the one or more generated models to determine a number of valid events.
11 . The computer program product of claim 10 , wherein the extrapolation process is based on a number of tracking conversions associated with the online system, the number determining the set of measurable events used for the modeling.
12 . The computer program product of claim 10 , wherein the extrapolation process is based on a total number of click-throughs associated with the online system, the number determining the set of measurable events used for the modeling.
13 . The computer program product of claim 10 , wherein the extrapolation process is trained on the one or more third-party systems based on a machine-learning model associated with the online system.
14 . The computer program product of claim 13 , wherein the machine-learning model can be implemented on the one or more third-party systems.
15 . The computer program product of claim 10 , wherein the modeling is based on a measurement of one or more users associated with the online system.
16 . The computer program product of claim 10 , wherein determining one or more non-measurable events is based on a number of click-throughs associated with at least one of the users of the online system.
17 . The computer program product of claim 10 , wherein determining one or more non-measurable events is based on an average click-through rate associated with at least one of the users of the online system.
18 . The computer program product of claim 10 , wherein the online system performs the one or more tracking operations responsive to a request to run the campaign from one or more third-party systems.