IP Library › Granted Patent US 11,783,917
Granted Patent B2
US 11,783,917 · App. 16/826,126 · Granted Oct 10, 2023

Artificial intelligence-based base calling

Inventors: Kishore Jaganathan (San Francisco, CA); John Randall Gobbel (Brisbane, CA); Amirali Kia (San Mateo, CA)
G06K9/6218G06F16/907G06K9/628G06K9/6222G06K9/6232G06K9/6256G06K9/6262G06K9/6267G06K9/6277G06N3/04G06N3/08G06N3/084G06N7/005G06V10/751G06V10/82G16B40/00G06N5/046
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,783,917
App. No.
16/826,126
Filed
Mar 20, 2020
Granted
Oct 10, 2023
Kind
B2
Art Unit
2669
USPC
706/20
Abstract

The technology disclosed processes input data through a neural network and produces an alternative representation of the input data. The input data includes per-cycle image data for each of one or more sequencing cycles of a sequencing run. The per-cycle image data depicts intensity emissions of one or more analytes and their surrounding background captured at a respective sequencing cycle. The technology disclosed processes the alternative representation through an output layer and producing an output and base calls one or more of the analytes at one or more of the sequencing cycles based on the output.

Claims (59)

1. A computer-implemented method of base calling clusters, including:

processing input data through a neural network and producing an alternative representation of the input data,

wherein the input data includes (i) per-cycle data for each of one or more sequencing cycles of a sequencing run and (ii) supplemental distance information,

wherein the per-cycle data comprises pixels that depict intensity emissions indicative of one or more clusters and of a surrounding background captured at a respective one of the one or more sequencing cycles,

wherein the per-cycle data is accompanied with the supplemental distance information that identifies distances between the pixels of the per-cycle data;

wherein, during the processing of the pixels of the per-cycle data by the neural network, the supplemental distance information supplies additive bias that conveys to the neural network which of the pixels of the per-cycle data contain centers of clusters and which of the pixels of the per-cycle data are separated from the centers of the clusters;

processing the alternative representation through an output layer and producing an output; and

base calling one or more of the clusters at the one or more sequencing cycles based on the output.

2. The computer-implemented method of claim 1 , wherein the per-cycle data is indicative of a surrounding background at the respective one of the one or more sequencing cycles.

3. The computer-implemented method of claim 1 , wherein the additive bias improves accuracy of the base calling.

4. The computer-implemented method of claim 3 , wherein the neural network uses the supplemental distance information to assign a sequencing signal to its proper source cluster by attending to central cluster pixels, their neighboring pixels, and alternative representations derived from them more than perimeter cluster pixels, background pixels, and alternative representations derived from them.

5. The computer-implemented method of claim 1 , further including accompanying the per-cycle data with supplemental scaling information that assigns scaling values to the pixels of the per-cycle data.

6. The computer-implemented method of claim 1 , wherein the per-cycle data is indicative of a voltage change detected at a respective sequencing cycle.

7. The computer-implemented method of claim 1 , wherein the per-cycle data is indicative of an electric current signal measured at a respective sequencing cycle.

8. A neural network-implemented method of base calling clusters synthesized during a sequencing run comprising a plurality of sequencing cycles, the neural network-implemented method including:

convolving input data through a convolutional neural network to generate a convolved representation of the input data,

wherein the input data includes image patches extracted from one or more images in each of a current image set generated at a current sequencing cycle of the sequencing run, of one or more preceding image sets respectively generated at one or more sequencing cycles of the sequencing run preceding the current sequencing cycle, and of one or more succeeding image sets respectively generated at one or more sequencing cycles of the sequencing run succeeding the current sequencing cycle,

wherein each of the image patches depicts intensity emissions of a target cluster being base called, and

wherein the input data further includes distance information indicating respective distances of pixels of a image patch from a center pixel of the image patch;

processing the convolved representation through an output layer to produce an output; and

base calling the target cluster at the current sequencing cycle based on the output.

9. The neural network-implemented method of claim 8 , further including:

providing as input, to the convolutional neural network, position coordinates of centers of image regions representing respective clusters,

wherein the input is provided to a first layer of the convolutional neural network,

wherein the input is provided to one or more intermediate layers of the convolutional neural network, and

wherein the input is provided to a final layer of the convolutional neural network.

10. The neural network-implemented method of claim 8 , further including:

providing as input to the convolutional neural network an intensity scaling channel that has scaling values corresponding to pixels of the image patches, and

wherein the scaling values are based on a mean intensity of center pixels of the image patches that each contain a particular target cluster.

11. The neural network-implemented method of claim 10 , wherein the intensity scaling channel pixel-wise includes a same scaling value for all the pixels of the image patches.

12. The neural network-implemented method of claim 8 , wherein each image patch further comprises pixel distance data indicating a distance between respective pixels and a nearest one of a plurality of clusters, the nearest one of the plurality of clusters selected based on center-to-center distances between the pixel and each of the clusters.

13. The neural network-implemented method of claim 8 , wherein each image patch further comprises cluster distance data that identifies a distance of each cluster pixel from an assigned one of a plurality of clusters selected based on classifying each cluster pixel to only one of the clusters.

14. The neural network-implemented method of claim 8 , wherein convolving the input data through the convolutional neural network to generate the convolved representation of the input data comprises:

separately processing each per-cycle image patch set through a first convolutional subnetwork of the convolutional neural network to produce an intermediate convolved representation for each sequencing cycle, including applying convolutions that combine intensity and distance information and combine resulting convolved representations only within a sequencing cycle and not between sequencing cycles;

groupwise processing intermediate convolved representations for successive sequencing cycles in a series through a second convolutional subnetwork of the convolutional neural network to produce a final convolved representation for the series, including applying convolutions that combine the intermediate convolved representations and combine resulting convolved representations between the sequencing cycles;

and wherein processing the convolved representation through the output layer to produce the output comprises processing the final convolved representation through the output layer.

15. The neural network-implemented method of claim 8 , further including:

reframing the pixels of each image patch to center a center of the target cluster in a center pixel to generate reframed image patches; and

wherein convolving the input data through the convolutional neural network to generate the convolved representation of the input data comprises convolving the reframed image patches through the convolutional neural network to generate the convolved representation.

16. The neural network-implemented method of claim 15 , wherein the reframing further includes intensity interpolation of the pixels of each image patch to compensate for the reframing.

17. A neural network-implemented method of base calling, the neural network-implemented method including:

separately processing each per-cycle input data in a sequence of per-cycle input data through a cascade of convolution layers of a convolutional neural network, wherein

the sequence of per-cycle input data is generated for a series of sequencing cycles of a sequencing run, and

each per-cycle input data includes image channels that depict intensity emissions of one or more clusters and their surrounding background captured at a respective sequencing cycle;

for each sequencing cycle,

based on the separate processing, producing a convolved representation at each of the convolution layers, thereby producing a sequence of convolved representations,

mixing its per-cycle input data with its corresponding sequence of convolved representations and producing a mixed representation, and

flattening its mixed representation and producing a flattened mixed representation;

arranging flattened mixed representations of successive sequencing cycles as a stack;

processing the stack in forward and backward directions through a recurrent neural network that

convolves over a subset of the flattened mixed representations in the stack on a sliding window basis, with each sliding window corresponding to a respective sequencing cycle, and

successively produces a current hidden state representation at each time step for each sequencing cycle based on (i) the subset of the flattened mixed representations in a current sliding window over the stack and (ii) a previous hidden state representation; and

base calling each of the one or more clusters at each of the sequencing cycles based on results of processing the stack in forward and backward directions.

18. The neural network-implemented method of claim 17 , further including:

base calling each of the one or more clusters at a given sequencing cycle by:

combining forward and backward current hidden state representations of the given sequencing cycle on a time step-basis and producing a combined hidden state representation, wherein the combining includes concatenation or summation or averaging;

processing the combined hidden state representation through one or more fully-connected networks and producing a dense representation;

processing the dense representation through a softmax layer to produce likelihoods of bases incorporated in each cluster at the given sequencing cycle being A, C, T, and G; and

classifying the bases as A, C, T, or G based on the likelihoods.

Assignments (5)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 13, 2022
From: DUTTA, ANINDITA; KASHEFHAGHIGHI, DORNA; KIA, AMIRALI
To: ILLUMINA, INC.
Reel/Frame 062069/0758 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 13, 2022
From: KASHEFHAGHIGHI, DORNA; KIA, AMIRALI; DUTTA, ANINDITA
To: ILLUMINA, INC.
Reel/Frame 062069/0992 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 13, 2022
From: JAGANATHAN, KISHORE; GOBBEL, JOHN RANDALL; KIA, AMIRALI
To: ILLUMINA, INC.
Reel/Frame 062070/0412 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 13, 2022
From: JAGANATHAN, KISHORE; KASHEFHAGHIGHI, DORNA; KIA, AMIRALI; DUTTA, ANINDITA; GOBBEL, JOHN RANDALL
To: ILLUMINA, INC.
Reel/Frame 062070/0487 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 30, 2020
From: JAGANATHAN, KISHORE; KIA, AMIRALI; GOBBEL, JOHN RANDALL
To: ILLUMINA, INC.
Reel/Frame 052264/0666 →
Continuity (6)
Provisional Application 62821602 · Mar 21, 2019
Provisional Application 62821618 · Mar 21, 2019
Provisional Application 62821681 · Mar 21, 2019
Provisional Application 62821724 · Mar 21, 2019
Provisional Application 62821766 · Mar 21, 2019
Related Publication 20200302297A1 · Sep 24, 2020
Cited By (2)
US 12,217,831 US 12,525,320