Performing comparative testing of quantum services
Performing comparative testing of quantum services is disclosed. In one example, a processor device of a quantum computing system (e.g., by executing a quantum testing service (QTS)) receives a first request for testing from a requestor, wherein the first request comprises an identifier of a quantum service. The quantum computing device retrieves a plurality of quantum service definitions corresponding to a plurality of different versions of the quantum service, based on the first request. A plurality of instances of the quantum service are then instantiated for parallel execution by the quantum computing device, wherein each instance is defined by a quantum service definition of the plurality of quantum service definitions. The quantum computing device next performs testing of each instance of the plurality of instances, based on the first request, and generates a testing result report based on the testing.
1. A method, comprising:
receiving, by a quantum computing device, a first request for testing from a requestor, wherein the first request comprises an identifier of a quantum service;
retrieving, by the quantum computing device, a plurality of quantum service definitions corresponding to a plurality of different versions of the quantum service, based on the first request;
instantiating a plurality of instances of the quantum service for parallel execution by the quantum computing device, wherein each instance is defined by a quantum service definition of the plurality of quantum service definitions;
performing testing of each instance of the plurality of instances, based on the first request; and
generating a testing result report based on the testing.
2. The method of claim 1 , wherein the first request comprises one or more of a retrieval indicator that indicates a count of the plurality of quantum service definitions to retrieve, a testing parameter, a load balancing parameter, and a performance metric indicator that indicates a performance metric to include in the testing result report.
3. The method of claim 1 , further comprising, prior to instantiating the plurality of instances of the quantum service:
determining, by the quantum computing device, a number of instances of the quantum service that the quantum computing device is capable of instantiating, based on the plurality of quantum service definitions; and
transmitting, to the requestor, a response comprising an indication of the number of instances of the quantum service that the quantum computing device is capable of instantiating.
4. The method of claim 3 , further comprising receiving, from the requestor, a second request comprising an instance indicator that indicates a count of instances of the quantum service to instantiate, based on the response.
5. The method of claim 3 , wherein determining the number of instances that the quantum computing device is capable of instantiating is based on one or more of available hardware resources of the quantum computing device and a count of available qubits of the quantum computing device.
6. The method of claim 1 , wherein performing testing of each instance of the plurality of instances comprises:
receiving a plurality of test requests directed to the quantum service;
forwarding each test request of the plurality of test requests to an instance of the plurality of instances; and
obtaining a measurement of a performance metric of the instance.
7. The method of claim 1 , wherein performing testing of each instance of the plurality of instances comprises:
generating, by the quantum computing device, a plurality of test requests directed to the quantum service;
forwarding each test request of the plurality of test requests to an instance of the plurality of instances; and
obtaining a measurement of a performance metric of the instance.
8. The method of claim 1 , further comprising transmitting the testing result report to the requestor.
9. The method of claim 1 , wherein each quantum service definition of the plurality of quantum service definitions comprises a Quantum Assembly Language (QASM) file.
10. A computing system, comprising:
a quantum computing device, comprising:
a system memory; and
a processor device coupled to the system memory, the processor device to:
receive a first request for testing from a requestor, wherein the first request comprises an identifier of a quantum service;
retrieve a plurality of quantum service definitions corresponding to a plurality of different versions of the quantum service, based on the first request;
instantiate a plurality of instances of the quantum service for parallel execution by the quantum computing device, wherein each instance is defined by a quantum service definition of the plurality of quantum service definitions;
perform testing of each instance of the plurality of instances, based on the first request; and
generate a testing result report based on the testing.
11. The computing system of claim 10 , wherein the first request comprises one or more of a retrieval indicator that indicates a count of the plurality of quantum service definitions to retrieve, a testing parameter, a load balancing parameter, and a performance metric indicator that indicates a performance metric to include in the testing result report.
12. The computing system of claim 10 , wherein the processor device is further to, prior to instantiating the plurality of instances of the quantum service:
determine a number of instances of the quantum service that the quantum computing device is capable of instantiating, based on the plurality of quantum service definitions; and
transmit, to the requestor, a response comprising an indication of the number of instances of the quantum service that the quantum computing device is capable of instantiating.
13. The computing system of claim 12 , wherein the processor device is further to receive, from the requestor, a second request comprising an instance indicator that indicates a count of instances of the quantum service to instantiate, based on the response.
14. The computing system of claim 12 , wherein to determine the number of instances that the quantum computing device is capable of instantiating is to determine the number of instances based on one or more of available hardware resources of the quantum computing device and a count of available qubits of the quantum computing device.
15. The computing system of claim 10 , wherein to perform testing of each instance of the plurality of instances is to:
receive a plurality of test requests directed to the quantum service;
forward each test request of the plurality of test requests to an instance of the plurality of instances; and
obtain a measurement of a performance metric of the instance.
16. The computing system of claim 10 , wherein to perform testing of each instance of the plurality of instances is to:
generate by the processor device, a plurality of test requests directed to the quantum service;
forward each test request of the plurality of test requests to an instance of the plurality of instances; and
obtain a measurement of a performance metric of the instance.
17. The computing system of claim 10 , wherein the processor device is further to transmit the testing result report to the requestor.
18. The computing system of claim 10 , wherein each quantum service definition of the plurality of quantum service definitions comprises a Quantum Assembly Language (QASM) file.
19. A non-transitory computer-readable medium having stored thereon computer-executable instructions that, when executed, cause one or more processor devices to:
receive a first request for testing from a requestor, wherein the first request comprises an identifier of a quantum service;
retrieve a plurality of quantum service definitions corresponding to a plurality of different versions of the quantum service, based on the first request;
instantiate a plurality of instances of the quantum service for parallel execution by a quantum computing device, wherein each instance is defined by a quantum service definition of the plurality of quantum service definitions;
perform testing of each instance of the plurality of instances, based on the first request; and
generate a testing result report based on the testing.
20. The non-transitory computer-readable medium of claim 19 , wherein the computer-executable instructions further cause the one or more processor devices to transmit the testing result report to the requestor.