System and method for improving the performance of electronic media advertising campaigns through multi-attribute analysis and optimization
Automated system, methods, algorithms, procedures, and computer software programs and computer program products for improving and optimizing the performance of messaging campaigns, particularly for marketing campaigns in which advertisements or other messages are distributed over an interactive measurable medium such as the Internet. Analysis and Optimization method and procedure, an automated system, and system and method that exploit the underlying multi-attribute structure, as well as other features and advantages. Optimization procedures allocate the ad alternatives or other message to the customer population to optimize business objectives such as maximizing the number of positive responses received. Procedure for generating message allocations that improve and attempt to optimize the campaign performance. Methods ensure that campaign constraints are not violated. Methods can be implemented on a computer that is programmed to retrieve message performance information and to generate recommended message allocations for each stage in a multi-stage messaging campaign to achieve messaging goals.
1 . A method of identifying a relative performance of a set of creatives, wherein a given creative has associated therewith two or more attributes, and each attribute has two or more values, comprising:
defining a set of multiattribute data structures and assigning the creatives to the set such that each creative is assigned to one and only one multiattribute data structure;
receiving data indicative of a performance of the creatives; and
using the performance data, estimating a set of multiattribute parameters β m jk for every attribute m and pair of attribute values j and k, such that if h and i are any pair of creatives, then, identifying β m jj =0 for every attribute m and attribute value j, the equation f(π h )−f(π i )=Σ m β m h(m)i(m) either holds as a given or defines an expectation of a difference f(π h )−f(π i );
wherein at least one or more of the steps are performed by one or more electronic processing devices.
2 . The method as described in claim 1 wherein for any attribute values j, k, and l of a common attribute m: β m jl =β m jk +β m kl .
3 . The method as described in claim 2 further including the step of selecting a given creative as a base, defining β 1 =f(π 1 ) and β m j =β m j1 for all attribute values j>1 and attributes m such that f(π i )=β 1 +Σ m β m i(m) for all creatives.
4 . The method as described in claim 3 further including processing f(π i ) into vector notation by creating column vectors f(π), with entries f(π i ) for each creative I, and β, with entries β 1 and β m j for each attribute m and attribute value j>1, such that f(π)=Xβ, where X is a multiattribute-mapping matrix and β is a vector of multiattribute parameters.
5 . A method of multiattribute analysis for providing automated measurements and reporting of an importance of attributes and attribute values of message alternatives, comprising:
generating a set of message alternatives, wherein each message alternative may be described in terms of the attributes and the attribute values, wherein an attribute is a component of a message alternative and an attribute value is a particular instantiation of the attribute, wherein a given message alternative includes two or more attributes each of which may be assigned two or more attribute values;
providing the message alternatives in response to requests;
determining an importance of the attributes and the attribute values to performance of the message alternatives provided in response to the requests;
providing one or more reports describing the performance of the message alternatives;
wherein at least one or more of the steps are performed by one or more electronic processing devices.
6 . The method as described in claim 5 wherein the message alternatives are described in at least one multiattribute data structure.
7 . The method as described in claim 5 wherein at least one report identifies a performance of a particular message alternative with respect to at least one other message alternative.
8 . The method as described in claim 5 wherein at least one report identifies a performance of a particular attribute of a particular message alternative with respect to at least one other attribute of the particular message alternative.
9 . The method as described in claim 5 wherein at least one report identifies a performance of a particular attribute value of an attribute of a particular message alternative with respect to at least one other attribute value of the attribute of the particular message alternative.
10 . The method as described in claim 5 further including the step of using the performance data to optimize campaign performance through allocation of message alternatives during a multi-stage message campaign.
11 . The method as described in claim 5 wherein a message alternative is a markup language page.
12 . The method as described in claim 11 wherein the attribute is a portion of the markup language page.
13 . A method of identifying a relative performance of a set of creatives, wherein a given creative has associated therewith two or more attributes, and each attribute has two or more values, comprising:
defining a set of multiattribute data structures and assigning the creatives to the set such that each creative is assigned to one and only one multiattribute data structure;
receiving data indicative of a performance of the creatives; and
using the performance data, estimating values of a set of multiattribute parameters for each of the multiattribute data structures, wherein the values of the set of multiattribute parameters define relative impact of the attribute values on performance of the creatives;
wherein at least one or more of the steps are performed by one or more electronic processing devices.
14 . The method as described in claim 13 further including the step of reducing the set of multiattribute data structures to a standard form prior to the estimating step.
15 . The method as described in claim 13 further including the step of processing the performance data by a given discounting function prior to the estimating step.
16 . The method as described in claim 13 wherein the performance data is associated with a prior stage of a multi-stage campaign and the estimating step is carried out prior to a next stage of the multi-stage campaign.
17 . The method as described in claim 13 wherein the multiattribute data structure is a collection of attributes and an attribute is a distinct element of a creative.
18 . The method as described in claim 13 wherein the estimating step comprises:
selecting a first creative as a base and setting the attribute values associated with the given creative to a given value;
using a given statistical technique to estimate the values of the multiattribute parameters;
if any values of the multiattribute parameters are negative values, identifying a previously-estimated worst creative as the base and repeating the statistical technique so that the values of the multiattribute parameters are non-negative.
19 . The method as described in claim 13 further including displaying a report comparing attributes in a multiattribute structure.
20 . The method as described in claim 19 wherein the report identifies a relative importance of an attribute in determining a given performance metric achieved by the creative.
21 . The method as described in claim 13 further including displaying a report comparing attribute values for a given attribute.
22 . The method as described in claim 21 wherein the report identifies a relative importance of each attribute value in determining a given performance metric achieved by the creative.