Granted Patent B2

US 10,013,701 · App. 14/508,896 · Granted Jul 3, 2018

Abstract

Claims (122)

1. A method, comprising:

at a server system comprising one or more processors and memory:

initiating delivery of a plurality of message campaigns to a plurality of users, wherein a respective message campaign of the plurality of message campaigns includes one or more messages addressed to at least a subset of the plurality of users;

receiving, from a plurality of client devices associated with the plurality of users, campaign-feedback data, wherein:

the campaign-feedback data is indicative of user interaction with the messages transmitted to the plurality of client devices as part of the plurality of message campaigns; and

the campaign-feedback data includes information that enables generation of campaign reports that provide quantitative information about one or more of the plurality of message campaigns;

after receiving the campaign-feedback data from the plurality of client devices, transmitting, to one or more remote storage systems, campaign-tracking data that is based on the campaign-feedback data;

after transmitting the campaign-tracking data to the one or more remote storage systems, receiving, from a requestor, a first request for analysis of campaign-feedback information; and

in response to receiving the first request for analysis of the campaign-feedback information:

obtaining a campaign report generated using the campaign-tracking data from the one or more remote storage systems; and

providing the campaign report to the requestor,

wherein a respective remote storage system of the one or more remote storage systems has a plurality of performance levels and the method further comprises:

while using the respective remote storage system at a first performance level, determining that a different performance level for the respective remote storage system is needed; and

in response to the determination that a different performance level for the respective remote storage system is needed, requesting a change in performance level of the respective remote storage system from the first performance level to a second, different performance level, wherein the performance level of the respective remote storage system includes values for one or more of:

an amount of storage space available at the respective remote storage system;

a speed of read access to the respective remote storage system;

a speed of write access to the respective remote storage system; and

shared use of storage servers at the remote storage system.

2. The method of claim 1 , wherein the campaign-tracking data includes fine grained information that enables analysis of the campaign-tracking data based on arbitrary analysis criteria that are conceived of or refined after one or more of the plurality of message campaigns were initiated.

3. The method of claim 1 , wherein the first request for analysis of the campaign-feedback information includes analysis criteria that were not available to the server system at the time that the campaign-tracking data was stored in the remote storage system.

4. The method of claim 1 , further comprising:

storing recent campaign-tracking data that is from before a respective date in a local storage system, wherein:

the recent campaign-tracking data stored at the local storage system enables the server system to execute queries that have a date range that does not extend beyond the respective date using data in the local storage system without retrieving data from the remote storage system; and

the campaign-tracking data transmitted to the remote storage system includes at least a portion of the recent campaign-tracking data and enables the server system to execute queries that have a date range that extends beyond the respective date.

5. The method of claim 1 , wherein the first request for analysis of the campaign-feedback information includes a request to generate a pivot table with one or more user-selected metrics and one or more user-selected dimensions.

6. The method of claim 5 , wherein the one or more user-selected metrics include a metric selected from the set consisting of:

a number of people targeted by a message campaign;

a number of invalid addresses in a message campaign;

a number of message delivery failures in a message campaign;

a message delivery failure rate in a message campaign;

a number of messages opened in a message campaign;

a message open rate in a message campaign;

a number of messages in which content was clicked on in a message campaign;

a message click rate in a message campaign;

a number of messages that were converted into sales in a message campaign;

a conversion rate at which messages were converted to sales in a message campaign;

an amount of revenue generated by a message campaign;

an average order value of orders placed in response to a message campaign;

a number of unsubscription requests received in response to a message campaign;

an unsubscription rate for users who received a message campaign;

a number of complaints received about a message campaign; and

a rate at which complaints were received in a message campaign.

7. The method of claim 5 , wherein the one or more user-selected dimensions include a dimension selected from the set consisting of:

time at which a message campaign was sent;

time at which responses to a message campaign were received;

message campaign identifier for a message campaign;

message campaign version for a message campaign;

email domain to which messages in a message campaign were sent;

target users to which a message campaign was sent;

message content regions in a message of a message campaign; and

audience segment of a message campaign.

8. The method of claim 1 , further comprising:

prior to receiving the campaign-feedback data, obtaining a set of analysis criteria;

while receiving the campaign-feedback data, aggregating at least a subset of the campaign-feedback data to generate aggregated campaign data in accordance with the set of analysis criteria;

storing the aggregated campaign data in a local storage system;

after storing the aggregated campaign data, receiving a second request for analysis of the campaign-feedback information; and

in response to receiving the second request for analysis of the campaign-feedback information:

in accordance with a determination that the second request can be satisfied using data aggregated in accordance with the set of analysis criteria, generating a campaign report that is responsive to the second request using the aggregated campaign data; and

in accordance with a determination that the second request cannot be satisfied using data aggregated in accordance with the set of analysis criteria, obtaining a campaign report generated using the campaign-tracking data from the one or more remote storage systems.

9. The method of claim 1 , wherein the respective message campaign includes messages sent using a plurality of different message types.

10. A server system, comprising:

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:

initiating delivery of a plurality of message campaigns to a plurality of users, wherein a respective message campaign of the plurality of message campaigns includes one or more messages addressed to at least a subset of the plurality of users;

receiving, from a plurality of client devices associated with the plurality of users, campaign-feedback data, wherein:

the campaign-feedback data is indicative of user interaction with the messages transmitted to the plurality of client devices as part of the plurality of message campaigns; and

the campaign-feedback data includes information that enables generation of campaign reports that provide quantitative information about one or more of the plurality of message campaigns;

after receiving the campaign-feedback data from the plurality of client devices, transmitting, to one or more remote storage systems, campaign-tracking data that is based on the campaign-feedback data;

after transmitting the campaign-tracking data to the one or more remote storage systems, receiving, from a requestor, a first request for analysis of the campaign-feedback information; and

in response to receiving the first request for analysis of campaign-feedback information:

obtaining a campaign report generated using the campaign-tracking data from the one or more remote storage systems; and

providing the campaign report to the requestor,

wherein a respective remote storage system of the one or more remote storage systems has a plurality of performance levels and the one or more programs further include instructions for:

while using the respective remote storage system at a first performance level, determining that a different performance level for the respective remote storage system is needed; and

in response to the determination that a different performance level for the respective remote storage system is needed, requesting a change in performance level of the respective remote storage system from the first performance level to a second, different performance level, wherein the performance level of the respective remote storage system includes values for one or more of:

an amount of storage space available at the respective remote storage system;

a speed of read access to the respective remote storage system;

a speed of write access to the respective remote storage system; and

shared use of storage servers at the remote storage system.

11. The server system of claim 10 , wherein the campaign-tracking data includes fine grained information that enables analysis of the campaign-tracking data based on arbitrary analysis criteria that are conceived of or refined after one or more of the plurality of message campaigns were initiated.

12. The server system of claim 10 , wherein the first request for analysis of the campaign-feedback information includes analysis criteria that were not available to the server system at the time that the campaign-tracking data was stored in the remote storage system.

13. The server system of claim 10 , wherein the one or more programs further include instructions for:

storing recent campaign-tracking data that is from before a respective date in a local storage system, wherein:

the recent campaign-tracking data stored at the local storage system enables the server system to execute queries that have a date range that does not extend beyond the respective date using data in the local storage system without retrieving data from the remote storage system; and

the campaign-tracking data transmitted to the remote storage system includes at least a portion of the recent campaign-tracking data and enables the server system to execute queries that have a date range that extends beyond the respective date.

14. The server system of claim 10 , wherein the first request for analysis of the campaign-feedback information includes a request to generate a pivot table with one or more user-selected metrics and one or more user-selected dimensions.

15. The server system of claim 14 , wherein the one or more user-selected metrics include a metric selected from the set consisting of:

a number of people targeted by a message campaign;

a number of invalid addresses in a message campaign;

a number of message delivery failures in a message campaign;

a message delivery failure rate in a message campaign;

a number of messages opened in a message campaign;

a message open rate in a message campaign;

a number of messages in which content was clicked on in a message campaign;

a message click rate in a message campaign;

a number of messages that were converted into sales in a message campaign;

a conversion rate at which messages were converted to sales in a message campaign;

an amount of revenue generated by a message campaign;

an average order value of orders placed in response to a message campaign;

a number of unsubscription requests received in response to a message campaign;

an unsubscription rate for users who received a message campaign;

a number of complaints received about a message campaign; and

a rate at which complaints were received in a message campaign.

16. The server system of claim 14 , wherein the one or more user-selected dimensions include a dimension selected from the set consisting of:

time at which a message campaign was sent;

time at which responses to a message campaign were received;

message campaign identifier for a message campaign;

message campaign version for a message campaign;

email domain to which messages in a message campaign were sent;

target users to which a message campaign was sent;

message content regions in a message of a message campaign; and

audience segment of a message campaign.

17. The server system of claim 10 , wherein the one or more programs further include instructions for:

prior to receiving the campaign-feedback data, obtaining a set of analysis criteria;

while receiving the campaign-feedback data, aggregating at least a subset of the campaign-feedback data to generate aggregated campaign data in accordance with the set of analysis criteria;

storing the aggregated campaign data in a local storage system;

after storing the aggregated campaign data, receiving a second request for analysis of the campaign-feedback information; and

in response to receiving the second request for analysis of the campaign-feedback information:

in accordance with a determination that the second request can be satisfied using data aggregated in accordance with the set of analysis criteria, generating a campaign report that is responsive to the second request using the aggregated campaign data; and

in accordance with a determination that the second request cannot be satisfied using data aggregated in accordance with the set of analysis criteria, obtaining a campaign report generated using the campaign-tracking data from the one or more remote storage systems.

18. The server system of claim 10 , wherein the respective message campaign includes messages sent using a plurality of different message types.

Assignments (13)