IP Library › Granted Patent US 10,282,513
Granted Patent B2
US 10,282,513 · App. 15/292,520 · Granted May 7, 2019

Methods and systems for 3D structure estimation

Inventors: Marcus Anthony Brubaker (Toronto, CA); Ali Punjani (Toronto, CA); David James Fleet (Toronto, CA)
G06F19/16
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,282,513
App. No.
15/292,520
Granted
May 7, 2019
Kind
B2
Abstract

Disclosed herein are systems and methods for efficient 3D structure estimation from images of a transmissive object, including cryo-EM images. The method generally comprises, receiving a set of 2D images of a target specimen from an electron microscope, carrying out a reconstruction technique to determine a likely molecular structure, and outputting the estimated 3D structure of the specimen. The described reconstruction technique comprises: establishing a probabilistic model of the target structure; optimizing using stochastic optimization to determine which structure is most likely; and, optionally utilizing importance sampling to minimize computational burden.

Claims (27)

1. A computer-implemented method for producing a 3D molecular structure reconstruction from a set of 2D Cryo-electron microscope particle images of at least one target to determine estimated 3D structures for the at least one target, the method executed on at least one processing unit, the method comprising:

determining a probabilistic generative model of a density distribution of the at least one target, the probabilistic generative model comprising:

a modulation by a contrast transfer function of the particle images;

a phase shift induced by particle image translation; and

a 3D spectrum of a 3D density for each respective target, the 3D density discretized on a 3D grid for each respective target, the 3D spectrum having coefficients in the Fourier domain;

determining a marginalized likelihood function over the coefficients in the Fourier domain for the probabilistic generative model;

performing a maximum-a-posteriori (MAP) density estimation of structure on the probabilistic generative model;

optimizing the probabilistic generative model utilizing Stochastic Average Gradient Descent (SAGD) to determine a most likely 3D structure of each target; and

outputting the optimized probabilistic generative model representing the estimated 3D structure of each target.

2. The method of claim 1 , wherein the most likely 3D structure comprises an estimate of the 3D density of each target.

3. The method of claim 1 , wherein the 3D pose and 2D position of each target in the respective particle images are treated as unknown latent variables.

4. The method of claim 1 , wherein the probabilistic model comprises a likelihood function marginalized over 3D orientations and 2D shifts of the at least one target in the particle images, the marginalization being effected on a generative model of the 3D density of the at least one target.

5. The method of claim 1 , wherein utilizing Stochastic Average Gradient Descent comprises, iteratively, selecting a mini batch of particle images, computing a gradient of the log of the likelihood function with respect to 3D density for the mini batch of particle images, and adding the gradient to a running total.

6. The method of claim 5 , wherein after a predetermined number of iterations have elapsed a line search is computed for tuning the optimization.

7. The method of claim 1 , wherein optimizing the probabilistic model utilizing Stochastic Gradient Average Descent further comprises applying importance sampling to efficiently marginalize over the unknown pose and position of each particle image.

8. The method of claim 7 , wherein importance sampling comprises applying two-component mixture models as importance distributions.

9. The method of claim 8 , wherein importance sampling comprises selecting particle images according to the importance distributions.

10. The method of claim 1 , wherein the size of the at least one target is as small as 100 Angstroms in diameter.

11. The method of claim 1 , wherein the at least one target comprises a protein or virus.

12. The method of claim 1 , wherein the at least one target comprises two or more targets, and the set of 2D Cryo-electron microscope particles images is heterogeneous, whereby each image provides an image of the 3D structure of one of the two or more targets.

13. The method of claim 1 , wherein optimizing the probabilistic generative model comprises:

initializing the density distribution;

initializing a gradient of the likelihood function;

initializing a gradient of the density; and

iteratively, for each data point in a set of data points on the particle images, determining the gradient of the likelihood function with respect to density.

14. The method of claim 13 , wherein determining the gradient of the likelihood function with respect to density comprises updating a sum with previously determined gradients of the likelihood function for other data points.

15. The method of claim 13 , wherein optimizing the probabilistic generative model further comprises determining a Lipschitz constant using a line search algorithm.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 6, 2026
From: THE GOVERNING COUNCIL OF THE UNIVERSITY OF TORONTO
To: STRUCTURA BIOTECHNOLOGY INC.
Reel/Frame 075550/0731 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 13, 2016
From: BRUBAKER, MARCUS ANTHONY; PUNJANI, ALI; FLEET, DAVID JAMES
To: THE GOVERNING COUNCIL OF THE UNIVERSITY OF TORONTO
Reel/Frame 040006/0094 →
Continuity (2)
Provisional Application 62284890 · Oct 13, 2015
Related Publication 20170103161A1 · Apr 13, 2017
Cited By (1)
US 12,361,839