Test suite generation from metadata
Disclosed herein are system, method, and computer program product embodiments for providing the ability to generate unit tests for a web service from a logged interaction with the web service and an API specification for the web service. Rather than having to manually generate tests for the web service, a test developer may interact with the web service through a web browser and record a log of these interactions. The log is then matched to a definition of the API specification, and a test is created. The test developer can either run this test against the web service, or use the test as a foundation for developing and refining the test further.
1. A method, comprising:
receiving, by one or more computing devices, an interaction file comprising a request from a client to an application programming interface (API) on a web service, and a response to the request from the web service;
receiving, by the one or more computing devices, a specification of the API;
generating, by the one or more computing devices, a test request to the web service using the request from the interaction file configured to satisfy the specification of the API; and
generating, by the one or more computing devices, a test suite comprising the test request and a constraint, wherein the constraint is set using the response from the interaction file.
2. The method of claim 1 , further comprising:
executing, by the one or more computing devices, the test suite on the web service, wherein the test suite is configured to apply the constraint against a test response received from the web service.
3. The method of claim 1 , wherein the interaction file is generated by a web browser logging an interaction with the web service.
4. The method of claim 1 , wherein generating the test request comprises:
matching, by the one or more computing devices, the request from the interaction file to an API call defined by the specification of the API.
5. The method of claim 1 , further comprising:
providing, by the one or more computing devices, the test suite for manual editing.
6. The method of claim 1 , further comprising:
generating, by the one or more computing devices, an additional test request; and
including, by the one or more computing devices, the additional test request in the test suite.
7. The method of claim 1 , wherein the specification of the API is defined in a REpresentational State Transfer (REST)-ful API Modeling Language (RAML) file.
8. A system, comprising:
a memory configured to store operations; and
one or more processors configured to perform the operations, the operations comprising:
receiving an interaction file comprising a request from a client to an application programming interface (API) on a web service, and a response to the request from the web service,
receiving a specification of the API,
generating a test request to the web service using the request from the interaction file, configured to satisfy the specification of the API, and
generating a test suite comprising the test request and a constraint, wherein the constraint is set using the response from the interaction file.
9. The system of claim 8 , the operations further comprising:
executing the test suite on the web service, wherein the test suite is configured to apply the constraint against a test response received from the web service.
10. The system of claim 8 , wherein the interaction file is generated by a web browser logging an interaction with the web service.
11. The system of claim 8 , wherein generating the test request comprises:
matching the request from the interaction file to an API call defined by the specification of the API.
12. The system of claim 8 , the operations further comprising:
providing the test suite for manual editing.
13. The system of claim 8 , the operations further comprising:
generating an additional test request; and
including the additional test request in the test suite.
14. The system of claim 8 , wherein the specification of the API is defined in a Representational State Transfer (REST)-ful API Modeling Language (RAML) file.
15. A non-transitory computer readable storage device having instructions stored thereon, execution of which, by one or more processing devices, causes the one or more processing devices to perform operations comprising:
receiving an interaction file comprising a request from a client to an application programming interface (API) on a web service, and a response to the request from the web service;
receiving a specification of the API;
generating a test request to the web service using the request from the interaction file configured to satisfy the specification of the API; and
generating a test suite comprising the test request and a constraint, wherein the constraint is set using the response from the interaction file.
16. The non-transitory computer readable storage device of claim 15 , the operations further comprising:
executing the test suite on the web service, wherein the test suite is configured to apply the constraint against a test response received from the web service.
17. The non-transitory computer readable storage device of claim 15 , wherein the interaction file is generated by a web browser logging an interaction with the web service.
18. The non-transitory computer readable storage device of claim 15 , wherein generating the test request comprises:
matching the request from the interaction file to an API call defined by the specification of the API.
19. The non-transitory computer readable storage device of claim 15 , the operations further comprising:
providing the test suite for manual editing.
20. The non-transitory computer readable storage device of claim 15 , the operations further comprising:
generating an additional test request; and
including the additional test request in the test suite.