Configurable relevance service test platform
In general, embodiments of the present invention provide systems, methods and computer readable media for a configurable test environment within which a relevance service can be invoked to execute one or a combination of test scenarios, each test scenario respectively being configured to exercise one or a combination of features of the relevance service. In embodiments, a test scenario may be configured to use test data that can be simulated and/or be derived from one or a combination of user models and promotion models, and/or be based on aggregated data that has been collected from previous production runs of the relevance service. In embodiments, each test scenario is described as a set of test configuration data. In some embodiments, the test configuration data are represented in a data interchange format that is both human and machine-readable, e.g., JavaScript Object Notation (JSON).
1. A relevance test system comprising:
a relevance service configured to provide a program interface for receiving relevance service requests, wherein each relevance service request is associated with a user, and the relevance service is configured to process the relevance service request by identifying a set of promotions that are relevant to the user; and
a relevance test service platform comprising a relevance test driver layer, wherein the relevance test service platform is operable to interact with the relevance service using the program interface via a network using at least one relevance test driver from the relevance test driver layer, the relevance test service platform being configured to perform operations comprising receiving test configuration data describing a test scenario representing processing of a test relevance service request on behalf of at least one model user, wherein the test relevance service request is submitted as a direct invocation of the program interface of the relevance service by the at least one relevance test driver from the relevance test driver layer.
2. The system of claim 1 , wherein the test configuration data comprise model user input parameters describing the model user, model promotion input parameters describing one or more promotion attributes for selection by the relevance service of the set of promotions potentially available to the model user, and filtering workflow parameters describing at least one filtering workflow to be used while processing the test relevance service request.
3. The system of claim 2 , wherein the model user input parameters comprise at least one of a user email address, user location, user gender, set of data representing user consumer behavior, or set of data representing user-personalized themes and preferences.
4. The system of claim 2 , wherein the model user input parameters are derived from user model source data, and deriving the model user input parameters comprises:
retrieving stored user model source data from a user models source repository; and
deriving the model user input parameters based on the stored user model source data.
5. The system of claim 2 , wherein the model promotion input parameters comprise at least one of a promotion permalink, promotion type, promotion merchant identifier, promotion category, promotion subcategory, locations at which the promotion is offered, promotion sold-out status, or set of promotion performance data.
6. The system of claim 5 , wherein the model promotion input parameters are derived from promotion model source data, and wherein deriving the model promotion input parameters comprises:
retrieving stored promotion model source data from a promotion models source repository; and
deriving the model promotion input parameters based on the stored promotion model source data.
7. The system of claim 2 , wherein a filtering workflow comprises an ordered sequence of filters, and wherein a filter includes least one filtering algorithm or filtering rule.
8. A computer-implemented method for executing one or a combination of test scenarios, each test scenario respectively being configured to selectively exercise components of a relevance service, the method comprising, by one or more processors of a universal relevance test service:
employing at least one relevance test driver from a relevance test driver layer to interact with the relevance service using a program interface via a network, the relevance service being configured to process a relevance service request by identifying a set of promotions that are relevant to a user associated with the relevance service request; and
receiving, by a relevance test service platform comprising the relevance test driver layer, test configuration data describing a test scenario representing processing of a test relevance service request on behalf of at least one model user, wherein the test relevance service request is submitted as a direct invocation of the program interface of the relevance service by the at least one relevance test driver from the relevance test driver layer.
9. The method of claim 8 , wherein the test configuration data comprise model user input parameters describing the model user, model promotion input parameters describing one or more promotion attributes for selection by the relevance service of the set of promotions potentially available to the model user, and filtering workflow parameters describing at least one filtering workflow to be used while processing the test relevance service request.
10. The method of claim 9 , wherein the model user input parameters comprise at least one of a user email address, user location, user gender, set of data representing user consumer behavior, or set of data representing user-personalized themes and preferences.
11. The method of claim 9 , wherein the model user input parameters are derived from user model source data, and deriving the model user input parameters comprises:
retrieving stored user model source data from a user models source repository; and
deriving the model user input parameters based on the stored user model source data.
12. The method of claim 9 , wherein the model promotion input parameters comprise at least one of a promotion permalink, promotion type, promotion merchant identifier, promotion category, promotion subcategory, locations at which the promotion is offered, promotion sold-out status, or set of promotion performance data.
13. The method of claim 12 , wherein the model promotion input parameters are derived from promotion model source data, and wherein deriving the model promotion input parameters comprises:
retrieving stored promotion model source data from a promotion models source repository; and
deriving the model promotion input parameters based on the stored promotion model source data.
14. The method of claim 9 , wherein a filtering workflow comprises an ordered sequence of filters, and wherein a filter includes least one filtering algorithm or filtering rule.
15. A non-transitory computer readable medium for implementing a relevance test system executing one or a combination of test scenarios, each test scenario respectively being configured to selectively exercise one or more components of a relevance service, the computer readable medium including instructions that when executed by one or more processors configures the one or more processors to:
provide a relevance service configured to provide a program interface for receiving relevance service requests, wherein each relevance service request is associated with a user, and the relevance service is configured to process the relevance service request by identifying a set of promotions that are relevant to the user; and
provide a relevance test service platform comprising a relevance test driver layer, wherein the relevance test service platform is operable to interact with the relevance service using the program interface via a network using at least one relevance test driver from the relevance test driver layer, the relevance test service platform being configured to perform operations comprising receiving test configuration data describing a test scenario representing processing of a test relevance service request on behalf of at least one model user, wherein the test relevance service request is submitted as a direct invocation of the program interface of the relevance service by the at least one relevance test driver from the relevance test driver layer.
16. The non-transitory computer readable medium of claim 15 , wherein the test configuration data comprise model user input parameters describing the model user, model promotion input parameters describing one or more promotion attributes for selection by the relevance service of the set of promotions potentially available to the model user, and filtering workflow parameters describing at least one filtering workflow to be used while processing the test relevance service request.
17. The non-transitory computer readable medium of claim 16 , wherein the model user input parameters comprise at least one of a user email address, user location, user gender, set of data representing user consumer behavior, or set of data representing user-personalized themes and preferences.
18. The non-transitory computer readable medium of claim 16 , wherein the model user input parameters are derived from user model source data, and deriving the model user input parameters comprises:
retrieving stored user model source data from a user models source repository; and
deriving the model user input parameters based on the stored user model source data.
19. The non-transitory computer readable medium of claim 16 , wherein the model promotion input parameters comprise at least one of a promotion permalink, promotion type, promotion merchant identifier, promotion category, promotion subcategory, locations at which the promotion is offered, promotion sold-out status, or set of promotion performance data.
20. The non-transitory computer readable medium of claim 19 , wherein the model promotion input parameters are derived from promotion model source data, and wherein deriving the model promotion input parameters comprises:
retrieving stored promotion model source data from a promotion models source repository; and
deriving the model promotion input parameters based on the stored promotion model source data.