IP Library Granted Patent US 12,387,130
Granted Patent B1
US 12,387,130 · App. 16/988,298 · Granted Aug 12, 2025

Automated synthesizing and compilation of quantum programs

Inventors: Muhammad Sohaib Alam (Emeryville, CA); Erik Joseph Davis (Berkeley, CA); Eric Christopher Peterson (Saint Helena, CA)
Assignee: Rigetti & Co, LLC
G06N10/80G06F8/30G06F8/41G06N3/08G06N7/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,387,130
App. No.
16/988,298
Granted
Aug 12, 2025
Kind
B1
Abstract

In a general aspect, a quantum program can be automatically synthesized or compiled. In some implementations, a discretized state space is obtained. The discretized state space includes a plurality of states for one or more qubits of a quantum processor. A discrete action space is obtained. The discrete action space includes a plurality of unitary operations for the one or more qubits of the quantum processor. A policy that uses the discretized state space and the discrete action space to generate quantum programs for quantum state preparation is defined. A dynamic programming process is used to improve the policy. An initial state and a target state of the one or more qubits is identified. The policy is used to generate a quantum program to produce the target state from the initial state. The quantum program include a subset of the unitary operations in the discrete action space.

Claims (41)

1. A method comprising:

obtaining, by one or more processors, a discretized state space, the discretized state space comprising a first plurality of unitary operations for one or more qubits of a quantum processor, wherein the first plurality of unitary operations are expressed in a high-level quantum programming language, and the quantum processor permits only a specified set of quantum logic gates;

obtaining, by one or more processors, a discrete action space, the discrete action space comprising a second plurality of unitary operations for the one or more qubits of the quantum processor, wherein the second plurality of unitary operations are expressed in a low-level quantum programming language and correspond to the specified set of quantum logic gates that are permitted by the quantum processor;

defining, by one or more processors, a neural network that uses the discretized state space and the discrete action space to compile quantum programs;

training, by one or more processors, the neural network using a dynamic programming process;

identifying, by one or more processors, a target unitary operation in the discretized state space;

generating, by one or more processors, a quantum program using the trained neural network, the quantum program being configured to perform the target unitary operation using a subset of the second plurality of unitary operations in the discrete action space; and

causing the quantum processor to execute the quantum program.

2. The method of claim 1 , wherein obtaining the discretized state space comprises:

determining a quaternion of each of the first plurality of unitary operations of the discretized state space; and

discretizing the quaternion.

3. The method of claim 2 , wherein discretizing the quaternions comprises:

discretizing four elements of the quaternion, wherein the four elements equal n i ·Δ, n i is an integer, i is a positive integer, and i=1, 2, 3, 4, 4 equals √{square root over (2)}k, k is a number of unitary operations in the quantum program, and is a positive integer.

4. The method of claim 1 , comprising:

for each unitary operation in the discrete action space, computing transition probabilities between unitary operations in the first plurality of unitary operations in the discretized state space; and

using the transition probabilities in the dynamic programming process to train the neural network.

5. The method of claim 1 , wherein training the neural network using the dynamic programming process comprises evaluating a reward based on a Euclidean distance, wherein the reward is configured to train the neural network to use one or more of the unitary operations in the second plurality of unitary operations in the discrete action space to perform the target unitary operation in the discretized state space.

6. The method of claim 5 , wherein the Euclidean distance is defined as an absolute difference between a target quaternion and an evolved quaternion, the target quaternion corresponds to the target unitary operation, and the evolved quaternion is prepared via one or more unitary operations in the second plurality of unitary operations.

7. The method of claim 1 , wherein obtaining the discrete action space comprises discretizing a single-qubit action space.

8. The method of claim 1 , comprising:

generating a plurality of quantum programs using the trained neural network to produce evolved quaternions;

selecting, from the plurality of quantum programs, the quantum program having a shortest length; and

using the selected quantum program to perform the target unitary operation, wherein the evolved quaternions are offset from a target quaternion by respective Euclidean distances, the Euclidean distances being less than a predetermined maximum distance.

9. The method of claim 1 , comprising:

generating a plurality of optimal quantum programs to perform respective target unitary operations;

forming gate compilation sequences by chaining the plurality of optimal quantum programs; and

providing the gate compilation sequences for execution on the quantum processor.

10. The method of claim 1 , wherein:

the quantum processor comprises a superconducting circuit comprising a plurality of qubit devices each comprising one or more Josephson junctions;

the second plurality of unitary operations correspond to quantum logic gates that are executable by specific hardware of the quantum processor; and

the method comprises executing the quantum program using the specific hardware of the quantum processor, wherein executing the quantum program comprises delivering control signals to the superconducting circuit to perform one or more of the second plurality of unitary operations.

11. A computing system comprising:

one or more processors; and

memory storing instructions that are configured, when executed by the one or more processors, to perform operations comprising:

obtaining a discretized state space, the discretized state space comprising a first plurality of unitary operations for one or more qubits of a quantum processor, wherein the first plurality of unitary operations is expressed in a high-level quantum programing language, and the quantum processor permits only a specified set of quantum logic gates;

obtaining a discrete action space, the discrete action space comprising a second plurality of unitary operations for the one or more qubits of the quantum processor, wherein the second plurality of unitary operations are expressed in a low-level quantum programing language and correspond to the specified set of quantum logic gates that are permitted by the quantum processor;

defining a neural network that uses the discretized state space and the discrete action space to compile quantum programs;

training the neural network using a dynamic programming process;

identifying a target unitary operation in the discretized state space;

generating a quantum program using the trained neural network, the quantum program being configured to perform the target unitary operation using a subset of the second plurality of unitary operations in the discrete action space; and

causing the quantum processor to execute the quantum program.

Assignments (4)
AMENDED AND RESTATED INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Jul 8, 2024
From: RIGETTI & CO, LLC; RIGETTI INTERMEDIATE LLC; RIGETTI COMPUTING, INC.
To: TRINITY CAPITAL INC.
Reel/Frame 068146/0416 →
CHANGE OF NAME Recorded Apr 12, 2023
From: RIGETTI & CO, INC.
To: RIGETTI & CO, LLC
Reel/Frame 063308/0804 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 21, 2021
From: ALAM, MUHAMMAD SOHAIB; DAVIS, ERIK JOSEPH; PETERSON, ERIC CHRISTOPHER
To: RIGETTI & CO, INC.
Reel/Frame 055989/0731 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Mar 10, 2021
From: RIGETTI & CO, INC.
To: TRINITY CAPITAL INC.
Reel/Frame 055557/0057 →
Continuity (2)
Provisional Application 62947365 · Dec 12, 2019
Provisional Application 62884272 · Aug 8, 2019
References Cited (73)
US 20150032994A1 · Chudak et al. · 2015 [cited by applicant]
US 20170177534A1 · Mohseni et al. · 2017 [cited by applicant]
US 20190042974A1 · Daraeizadeh et al. · 2019 [cited by applicant]
US 20190044542A1 · Hogaboam et al. · 2019 [cited by applicant]
US 20200410343A1 · Niu · 2020 [cited by examiner]
US 20230143652A1 · McKiernan et al. · 2023 [cited by applicant]
WO 2018223037 · 2018 [cited by applicant]
WO 2019152020 · 2019 [cited by applicant]
Kliuchnikov, Vadym, et al. “A framework for approximating qubit unitaries.” arXiv preprint arXiv:1510.03888 (2015). (Year: 2015). [cited by examiner]
Grice, Jon R., and David A. Meyer. “Discrete Quantum Control-State Preparation.” arXiv preprint arXiv:1204.6379 (2012). (Year: 2012). [cited by examiner]
An, Zheng, and D. L. Zhou. “Deep Reinforcement Learning for Quantum Gate Control.” arXiv preprint arXiv:1902.08418v2 (2019). (Year: 2019). [cited by examiner]
Niu , et al., “Universal quantum control through deep reinforcement learning”, AIAA Scitech 2019 Forum; 2019-0954, https://doi.org/10.2514/6.2019-0954, Apr. 23, 2019, 8 pgs. [cited by applicant]
Olmo , et al., “Swarm-based metaheuristics in automatic programming: a survey”, WIREs Data Mining Knowledge Discovery 4:445-469, 2014, 25 pgs. [cited by applicant]
Schulman , et al., “Proximal Policy Optimization Algorithms”, arXiv:1707.06347v2, Aug. 28, 2017, 12 pgs. [cited by applicant]
Smith, R. S., et al., “A Practical Quantum Instruction Set Architecture”, arXiv:1608.03355v2 [quant-ph], Feb. 17, 2017, 15 pages. [cited by applicant]
Smith , “Neural Networks for Combinatorial Optimization: A Review of More Than a Decade of Research”, INFORMS Journal on Computing, 1999, 20 pgs. [cited by applicant]
Steven , et al., “Can we teach a computer quantum mechanics? (Part II)”, downloaded Jan. 8, 2020, from https://towardsdatascience.com/can-we-tecah-a-computer-quantum-mechanics-part-ii-5e90ac96ef3a, Jul. 9, 2019, 9 pgs. [cited by applicant]
Sutton , et al., “Reinforcement Learning: An Introduction”, The MIT Press, 2018, 548 pgs. [cited by applicant]
Vinyals , et al., “Pointer Networks”, Advances in Neural Information Processing Systems, proceedings from Neural Information Processing Systems conference, 2015, 49 pgs. [cited by applicant]
Zhang , et al., “When reinforcement learning stands out in quantum control? A comparative study on state preparation”, arXiv:1902.02157v1, Feb. 6, 2019, 10 pgs. [cited by applicant]
KIPO, International Search Report and Written Opinion mailed Jun. 22, 2020, in PCT/US2020/018228, 10 pgs. [cited by applicant]
Proximal Policy Optimization, downloaded from https://openai.com/blog/openai-baselines-ppo/, dated Jul. 20, 2017, 7 pgs. [cited by applicant]
“A toolkit for developing and comparing reinforcement learning algorithms”, available at https://github.com/openai/gym at least as early as Feb. 14, 2019, 7 pgs. [cited by applicant]
“Classic control: Control theory problems from the classic RL literature”, available from https://gym.openai.com/envs/ at least as early as Feb. 13, 2019, 3 pgs. [cited by applicant]
“OpenAI Baselines: high quality implementations of reinforcement learning algorithms”, available at https://github.com/openai/baselines/ at least as early as Feb. 14, 2019, 5 pgs. [cited by applicant]
“PyTorch”, Wikipedia, last edited Feb. 13, 2019, https://en.wikipedia.org/w/index.php?title=PyTorch&oldid=883095788, 3 pgs. [cited by applicant]
“Stable-baselines: A fork of OpenAI Baselines, implementations of reinforcement learning algorithms”, accessed on Feb. 13, 2019, from https://github.com/hill-a/stable-baselines, 5 pgs. [cited by applicant]
“TensorFlow”, retrieved at least as early as Feb. 13, 2019, from https://en.wikipedia.org/w/index.php?title=TensorFlow&oldid=883095661, 4 pgs. [cited by applicant]
Albarran-Arriagada , et al., “Measurement-based adaptation protocol with quantum reinforcement learning”, Physical Review A 98, 042315, Oct. 11, 2018, 7 pgs. [cited by applicant]
Albarran-Arriagada , et al., “Reinforcement learning for semi-autonomous approximate quantum eigensolver”, arXiv:1906.06702v2 [quant-ph], Jun. 19, 2019, 10 pgs. [cited by applicant]
An , et al., “Deep Reinforcement Learning for Quantum Gate Control”, arXiv:1902.08418v2, Jul. 23, 2019, 7 pgs. [cited by applicant]
Arora , “On Non-Approximability for Quadratic Programs”, Proceedings of the 2005 46th Annual IEEE Symposium on Foundations of Computer Science (FOCS'05), 2005, 10 pgs. [cited by applicant]
Arora , et al., “Proof Verification and the Hardness of Approximation Problems”, Journal of the ACM, Sep. 2001, 55 pgs. [cited by applicant]
August , et al., “Taking Gradients Through Experiments: LSTMs and Memory Proximal Policy Optimization for Black-Box Quantum Control”, International Conference on High Performance Computing; Springer, 2018, 23 pgs. [cited by applicant]
Bello , et al., “Neural Combinatorial Optimization with Reinforcement Learning”, arXiv:1611.09940v2, Dec. 11, 2016, 14 pgs. [cited by applicant]
Bengio , et al., “Machine Learning for Combinatorial Optimization: a Methodological Tour d'Horizon”, arXiv:1811.06128v1, Nov. 15, 2018, 34 pgs. [cited by applicant]
Boussaid , et al., “A survey on optimization metaheuristics”, Information Sciences 237, Mar. 7, 2013, 36 pages. [cited by applicant]
Brockman , et al., “OpenAI Gym”, arXiv:1606.01540v1, Jun. 5, 2016, 4 pgs. [cited by applicant]
Bukov , “Reinforcement learning for autonomous preparation of Floquet-engineered states: Inverting the quantum Kapitza oscillator”, arXiv:1808.08910v2, Dec. 17, 2018, 20 pgs. [cited by applicant]
Bukov , et al., “Reinforcement Learning in Different Phases of Quantum Control”, Physical Review X 8, 031086, Sep. 27, 2018, 15 pgs. [cited by applicant]
Caldwell , et al., “Parametrically Activated Entangling Gates Using Transmon Qubits”, Physical Review Applied 10, 034050, Sep. 24, 2018, 8 pgs. [cited by applicant]
Charikar , et al., “Maximizing quadratic programs: extending Grothendieck's inequality”, Proceedings of the 45th Annual IEEE Symposium on Foundations of Computer Science (FOCS'04), 2004, 7 pgs. [cited by applicant]
Chen , et al., “Variational Quantum Circuits and Deep Reinforcement Learning”, arXiv:1907.00397v1, Jun. 30, 2019, 8 pgs. [cited by applicant]
Chen , et al., “Variational Quantum Circuits for Deep Reinforcement Learning”, arXiv:1907.00397v2 [cs.LG], Aug. 17, 2019, 12 pgs. [cited by applicant]
chuheng , “Generating 3 Qubit Quantum Circuits with Neural Networks”, Journal Club, Apr. 20, 2017, 24 pgs. [cited by applicant]
Das , et al., “Quantum Annealing and Related Optimization Methods”, vol. 679, Springer Science & Business Media, 2005, 382. [cited by applicant]
Didier , et al., “AC flux sweet spots in parametrically-modulated superconducting qubits”, arXiv:1807.01310v1, Jul. 3, 2018. [cited by applicant]
Dunning , et al., “What Works Best When? A Systematic Evaluation of Heuristics for Max-Cut and QUBO”, INFORMS Journal on Computing, 2018, 42 pgs. [cited by applicant]
Farhi, E. , et al., “A Quantum Approximate Optimization Algorithm”, arXiv:1411.4028v1 [quant-ph], Nov. 14, 2014, 16 pages. [cited by applicant]
Fösel , et al., “Reinforcement Learning with Neural Networks for Quantum Feedback”, PhysRevX 8, 031084, Sep. 27, 2018, 15 pgs. [cited by applicant]
Goemans , et al., “Improved Approximation Algorithms for Maximum Cut and Satisfiability Problems Using Semidefinite Programming”, Journal of the ACM 42.6, pp. 1115-1145, Nov. 1995, 31 pgs. [cited by applicant]
Hadfield , et al., “From the quantum approximate optimization algorithm to a quantum alternating operator ansatz”, Algorithms 12.2, p. 34, Feb. 12, 2019, 45 pgs. [cited by applicant]
Kant , “Recent advances in neural program synthesis”, arXiv:1802.02353, Feb. 7, 2018, 18 pgs. [cited by applicant]
Karp , “Reducibility Among Combinatorial Problems”, Complexity of Computer Computations, 1972, 19 pgs. [cited by applicant]
Kelsen , “A gym implementation of our Qiskit quantum circuit environment”, Jul. 5, 2019, from https://github.com/MaxKelsen/quantumcircuit_gym, 2 pgs. [cited by applicant]
Khairy , et al., “Learning to Optimize Variational Quantum Circuits to Solve Combinatorial Problems”, arXiv:1911.11071v1 [cs.LG], Nov. 25, 2019, 10 pgs. [cited by applicant]
Khairy , et al., “Reinforcement-Learning-Based Variational Quantum Circuits Optimization for Combinatorial Problems”, arXiv:1911.04574v1 [cs.LG], Nov. 11, 2019, 7 pgs. [cited by applicant]
Khalil , et al., “Learning combinatorial optimization algorithms over graphs”, Advances in Neural Information Processing Systems, 2017, 13 pgs. [cited by applicant]
Khot , et al., “Optimal Inapproximability Results for Max-Cut and Other 2-Variable CSPs?”, SIAM Journal on Computing 37.1, May 14, 2007, 39 pgs. [cited by applicant]
Kochenberger , et al., “The unconstrained binary quadratic programming problem: a survey”, J. Combinatorial Optimization 28, Apr. 18, 2014, 24 pgs. [cited by applicant]
Leopardi , “A partition of the unit sphere into regions of equal area and small diameter”, Electronic Transactions on Numerical Analysis; CiteSeer, Mar. 23, 2006, 21 pgs. [cited by applicant]
McClean, Jarrod R., et al., “The theory of variational hybrid quantum-classical algorithms”, arXiv:1509.04279v1 [quant-ph], Sep. 14, 2015, 20 pages. [cited by applicant]
McKiernan , et al., “Automated Quantum Programming via Reinforcement Learning for Combinatorial Optimization”, arXiv:1908.08054v1, Aug. 21, 2019, 15 pages. [cited by applicant]
Megretski , “Relaxations of Quadratic Programs in Operator Theory and System Analysis”, Systems, Approximation, Singular Integral Operators, and Related Topics, Birkhauser Verlag 2001, 2001, 28 pgs. [cited by applicant]
Moody , et al., “Discretization of SU(2) and the orthogonal group using icosahedral symmetries and the golden numbers”, arXiv:1705.04910v2, Aug. 23, 2017, 27 pgs. [cited by applicant]
Nazari , et al., “Reinforcement Learning for Solving the Vehicle Routing Problem”, Advances in Neural Information Processing Systems, pp. 9839-9849, Oct. 27, 2018, 13 pgs. [cited by applicant]
Nemirovski , et al., “On maximization of quadratic form over intersection of ellipsoids with common center”, Mathematical Programming 86.3, pp. 463-473, Sep. 1999, 12 pgs. [cited by applicant]
Nersisyan , et al., “Manufacturing low dissipation superconducting quantum processors”, arXiv:1901.08042v1, Jan. 23, 2019, 9 pgs. [cited by applicant]
Nesterov , “Global Quadratic Optimization via Conic Relaxation”, CORE Discussion Papers 1998060, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE)., Feb. 21, 1998, 23 pgs. [cited by applicant]
Nielsen , et al., “Quantum Computation and Quantum Information”, Cambridge Univ. Press, 2010, 704 pgs. [cited by applicant]
Zaheer , et al., “Deep Sets”, 31st Conf. on Neural Information Processing Systems (NIPS 2017), 2017, 11 pgs. [cited by applicant]
USPTO, Non-Final Office Action issued in U.S. Appl. No. 17/399,560 on Feb. 18, 2025, 65 pages. [cited by applicant]
Guerreschi, et al., “Practical optimization for hybrid quantum-classical algorithms”, arXiv:1701.01450v1, Jan. 5, 2017, 25 pages. [cited by applicant]
Cited By (1)
US 12,493,734