IP Library Granted Patent US 12,367,263
Granted Patent B2
US 12,367,263 · App. 18/604,194 · Granted Jul 22, 2025

Intensity extraction for feature values in base calling

Inventors: Abde Ali Hunaid Kagalwalla (San Diego, CA); Eric Jon Ojard (San Francisco, CA); Rami Mehio (San Diego, CA); Gavin Derek Parnaby (Laguna Niguel, CA); Nitin Udpa (San Diego, CA); Bo Lu (San Diego, CA); John S. Vieceli (San Diego, CA)
Assignee: Illumina, Inc.
G06F18/23213G06F18/285G06V10/56
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,367,263
App. No.
18/604,194
Granted
Jul 22, 2025
Kind
B2
Abstract

The technology disclosed extracts intensities from sequencing images for base calling target clusters and attenuates spatial crosstalk from neighboring clusters. The technology disclosed accesses a particular section from a plurality of sections of an image output by a sensor, the particular section of the image including at least one pixel depicting intensity emission values from a target cluster and neighboring clusters located across the sensor, and convolves the particular section of the image with a corresponding convolution kernel in a plurality of convolution kernels, to generate a feature map comprising a plurality of feature values. The technology disclosed further assigns a corresponding feature value to the target cluster based on feature values in the plurality of feature values adjoining a center of the target cluster, and processes the corresponding feature value assigned to the target cluster, to base call the target cluster.

Claims (58)

1. A system comprising:

one or more processors coupled to memory; and

computer instructions that, when executed on the one or more processors, cause the system to:

access an image section of an image depicting intensity emission values from clusters of oligonucleotides;

filter, from the image section, a set of feature values for a feature map corresponding to the image section;

determine a corresponding feature value for a target cluster of oligonucleotides based on the set of feature values from the feature map; and

generate a base call for the target cluster of oligonucleotides by applying the corresponding feature value to a subset of intensity emission values for the target cluster of oligonucleotides.

2. The system of claim 1 , further comprising instructions that, when executed by the one or more processors, cause the system to determine the corresponding feature value for the target cluster of oligonucleotides by determining a weighted feature value for the target cluster of oligonucleotides based on neighboring feature values from the feature map that correspond to neighboring clusters of oligonucleotides that neighbor the target cluster of oligonucleotides.

3. The system of claim 1 , further comprising computer instructions that, when executed by the one or more processors, cause the system to:

access the image section of the image by accessing the image in an imaging channel of a sequencing instrument; and

generate the feature map for the image section in the imaging channel.

4. The system of claim 1 , further comprising computer instructions that, when executed by the one or more processors, cause the system to:

determine the corresponding feature value for the target cluster of oligonucleotides by interpolating one or more feature values from the set of feature values from the feature map for the image section of the image captured for a single sequencing cycle; and

generate the base call for the target cluster of oligonucleotides by applying the corresponding feature value to the subset of intensity emission values from the image captured for the single sequencing cycle.

5. The system of claim 1 , wherein the image section of the image comprises a sub-tile region for a sub-tile of a flow cell.

6. The system of claim 1 , further comprising instructions that, when executed by the one or more processors, cause the system to:

access an additional image section of the image depicting intensity emission values from one or more of the clusters of oligonucleotides;

filter, from the additional image section, an additional set of feature values for an additional feature map corresponding to the additional image section;

determine an additional corresponding feature value for an additional target cluster of oligonucleotides based on the additional set of feature values from the additional feature map; and

generate an additional base call for the additional target cluster of oligonucleotides by applying the additional corresponding feature value to intensity emission values for the additional target cluster of oligonucleotides.

7. The system of claim 1 , further comprising computer instructions that, when executed by the one or more processors, cause the system to filter the set of feature values for the feature map by extracting, utilizing a sharpening operation, one or more of the intensity emission values of the intensity emission values to generate one or more feature values of the set of feature values for the feature map.

8. The system of claim 1 , further comprising computer instructions that, when executed by the one or more processors, cause the system to generate the feature map by convolving the image section with a corresponding convolution kernel in a set of convolution kernels.

9. The system of claim 1 , further comprising computer instructions that, when executed by the one or more processors, cause the system to:

filter, utilizing a convolutional neural network, the set of feature values for the feature map corresponding to the image section; and

determine, utilizing the convolutional neural network, the corresponding feature value for the target cluster of oligonucleotides based on the set of feature values from the feature map.

10. A non-transitory computer readable storage medium storing computer instructions that, when executed by one or more processors, cause a system to:

access an image section of an image depicting intensity emission values from clusters of oligonucleotides;

filter, from the image section, a set of feature values for a feature map corresponding to the image section;

determine a corresponding feature value for a target cluster of oligonucleotides based on the set of feature values from the feature map; and

generate a base call for the target cluster of oligonucleotides by applying the corresponding feature value to a subset of intensity emission values for the target cluster of oligonucleotides.

11. The non-transitory computer readable storage medium of claim 10 , further storing computer instructions that, when executed by the one or more processors, cause the system to determine the corresponding feature value for the target cluster of oligonucleotides by determining a weighted feature value for the target cluster of oligonucleotides based on neighboring feature values from the feature map that correspond to neighboring clusters of oligonucleotides that neighbor the target cluster of oligonucleotides.

12. The non-transitory computer readable storage medium of claim 10 , further storing computer instructions that, when executed by the one or more processors, cause the system to:

access the image section of the image by accessing the image in an imaging channel of a sequencing instrument; and

generate the feature map for the image section in the imaging channel.

13. The non-transitory computer readable storage medium of claim 10 , further storing computer instructions that, when executed by the one or more processors, cause the system to:

determine the corresponding feature value for the target cluster of oligonucleotides by interpolating one or more feature values from the set of feature values from the feature map for the image section of the image captured for a single sequencing cycle; and

generate the base call for the target cluster of oligonucleotides by applying the corresponding feature value to the subset of intensity emission values from the image captured for the single sequencing cycle.

14. The non-transitory computer readable storage medium of claim 10 , wherein the image section of the image comprises a sub-tile region for a sub-tile of a flow cell.

15. The non-transitory computer readable storage medium of claim 10 , further storing computer instructions that, when executed by the one or more processors, cause the system to:

access an additional image section of the image depicting intensity emission values from one or more of the clusters of oligonucleotides;

filter, from the additional image section, an additional set of feature values for an additional feature map corresponding to the additional image section;

determine an additional corresponding feature value for an additional target cluster of oligonucleotides based on the additional set of feature values from the additional feature map; and

generate an additional base call for the additional target cluster of oligonucleotides by applying the additional corresponding feature value to intensity emission values for the additional target cluster of oligonucleotides.

16. A computer-implemented method comprising:

accessing an image section of an image depicting intensity emission values from clusters of oligonucleotides;

filtering, from the image section, a set of feature values for a feature map corresponding to the image section;

determining a corresponding feature value for a target cluster of oligonucleotides based on the set of feature values from the feature map; and

generating a base call for the target cluster of oligonucleotides by applying the corresponding feature value to a subset of intensity emission values for the target cluster of oligonucleotides.

17. The computer-implemented method of claim 16 , wherein filtering the set of feature values for the feature map comprises extracting, utilizing a sharpening operation, one or more of the intensity emission values of the intensity emission values to generate one or more feature values of the set of feature values for the feature map.

18. The computer-implemented method of claim 16 , further comprising generating the feature map by convolving the image section with a corresponding convolution kernel in a set of convolution kernels.

19. The computer-implemented method of claim 16 , further comprising:

filtering, utilizing a convolutional neural network, the set of feature values for the feature map corresponding to the image section; and

determining, utilizing the convolutional neural network, the corresponding feature value for the target cluster of oligonucleotides based on the set of feature values from the feature map.

20. The computer-implemented method of claim 16 , further comprising:

accessing an additional image section of the image depicting intensity emission values from one or more of the clusters of oligonucleotides;

filtering, from the additional image section, an additional set of feature values for an additional feature map corresponding to the additional image section;

determining an additional corresponding feature value for an additional target cluster of oligonucleotides based on the additional set of feature values from the additional feature map; and

generating an additional base call for the additional target cluster of oligonucleotides by applying the additional corresponding feature value to intensity emission values for the additional target cluster of oligonucleotides.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 7, 2024
From: KAGALWALLA, ABDE ALI HUNAID; OJARD, ERIC JON; MEHIO, RAMI; PARNABY, GAVIN DEREK; UDPA, NITIN; LU, BO; VIECELI, JOHN S.
To: ILLUMINA SOFTWARE, INC.
Reel/Frame 067333/0084 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 7, 2024
From: ILLUMINA SOFTWARE, INC.
To: ILLUMINA, INC.
Reel/Frame 067333/0145 →
Continuity (4)
Continuation 17902630 · Sep 2, 2022
Continuation 17511483 · Oct 26, 2021
Provisional Application 63223408 · Jul 19, 2021
Related Publication 20240362300A1 · Oct 31, 2024
References Cited (139)
US 5528050A · Miller et al. · 1996 [cited by applicant]
US 5641658A · Adams et al. · 1997 [cited by applicant]
US 5719391A · Kain · 1998 [cited by applicant]
US 6090592A · Adams et al. · 2000 [cited by applicant]
US 6266459B1 · Walt et al. · 2001 [cited by applicant]
US 6355431B1 · Chee et al. · 2002 [cited by applicant]
US 6598013B1 · Domnisoru et al. · 2003 [cited by applicant]
US 6770441B2 · Dickinson et al. · 2004 [cited by applicant]
US 6778692B1 · Yazici · 2004 [cited by applicant]
US 6859570B2 · Walt et al. · 2005 [cited by applicant]
US 6865301B1 · Harris · 2005 [cited by applicant]
US 7057026B2 · Barnes et al. · 2006 [cited by applicant]
US 7115400B1 · Adessi et al. · 2006 [cited by applicant]
US 7211414B2 · Hardin et al. · 2007 [cited by applicant]
US 7315019B2 · Turner et al. · 2008 [cited by applicant]
US 7329492B2 · Hardin et al. · 2008 [cited by applicant]
US 7405281B2 · Xu et al. · 2008 [cited by applicant]
US 7595882B1 · Chen et al. · 2009 [cited by applicant]
US 7622294B2 · Walt et al. · 2009 [cited by applicant]
US 8158926B2 · Feng et al. · 2012 [cited by applicant]
US 8241573B2 · Banerjee et al. · 2012 [cited by applicant]
US 8563477B2 · Smith et al. · 2013 [cited by applicant]
US 8778848B2 · Lin et al. · 2014 [cited by applicant]
US 8778849B2 · Bowen et al. · 2014 [cited by applicant]
US 8895249B2 · Shen et al. · 2014 [cited by applicant]
US 8965076B2 · Garcia et al. · 2015 [cited by applicant]
US 9012022B2 · George et al. · 2015 [cited by applicant]
US 9079148B2 · Rigatti et al. · 2015 [cited by applicant]
US 9483610B2 · McMillen · 2016 [cited by examiner]
US 9512422B2 · Barnard et al. · 2016 [cited by applicant]
US 10068053B2 · Kermani et al. · 2018 [cited by applicant]
US 10691775B2 · van Rooyen · 2020 [cited by examiner]
US 11188778B1 · Ojard et al. · 2021 [cited by applicant]
US 11455487B1 · Kagalwalla et al. · 2022 [cited by applicant]
US 20020034337A1 · Shekter · 2002 [cited by applicant]
US 20020055100A1 · Kawashima et al. · 2002 [cited by applicant]
US 20020150909A1 · Stuelpnagel et al. · 2002 [cited by applicant]
US 20040002090A1 · Mayer et al. · 2004 [cited by applicant]
US 20040096853A1 · Mayer · 2004 [cited by applicant]
US 20050064460A1 · Holliger et al. · 2005 [cited by applicant]
US 20050130173A1 · Leamon et al. · 2005 [cited by applicant]
US 20060020203A1 · Tamura · 2006 [cited by applicant]
US 20070128624A1 · Gormley et al. · 2007 [cited by applicant]
US 20070194249A1 · Gavrilov et al. · 2007 [cited by applicant]
US 20080009420A1 · Schroth et al. · 2008 [cited by applicant]
US 20080108082A1 · Rank et al. · 2008 [cited by applicant]
US 20080234136A1 · Drmanac et al. · 2008 [cited by applicant]
US 20080242560A1 · Gunderson et al. · 2008 [cited by applicant]
US 20090024331A1 · Tomaney et al. · 2009 [cited by applicant]
US 20090035779A1 · Kurnik et al. · 2009 [cited by applicant]
US 20090088327A1 · Rigatti et al. · 2009 [cited by applicant]
US 20100034444A1 · Emhoff et al. · 2010 [cited by applicant]
US 20100160172A1 · Erlich et al. · 2010 [cited by applicant]
US 20110059865A1 · Smith et al. · 2011 [cited by applicant]
US 20110256631A1 · Tomaney et al. · 2011 [cited by applicant]
US 20120015825A1 · Zhong et al. · 2012 [cited by applicant]
US 20120020537A1 · Garcia et al. · 2012 [cited by applicant]
US 20120270305A1 · Reed et al. · 2012 [cited by applicant]
US 20120316086A1 · Lin et al. · 2012 [cited by applicant]
US 20130023422A1 · Feng et al. · 2013 [cited by applicant]
US 20130079232A1 · Kain et al. · 2013 [cited by applicant]
US 20130109577A1 · Korlach et al. · 2013 [cited by applicant]
US 20130116153A1 · Bowen et al. · 2013 [cited by applicant]
US 20130184796A1 · Marzano et al. · 2013 [cited by applicant]
US 20130260372A1 · Buermann et al. · 2013 [cited by applicant]
US 20140153801A1 · Sárközy et al. · 2014 [cited by applicant]
US 20140221216A1 · Cope et al. · 2014 [cited by applicant]
US 20140243224A1 · Barnard et al. · 2014 [cited by applicant]
US 20150057167A1 · Kaiser et al. · 2015 [cited by applicant]
US 20150065353A1 · Turner et al. · 2015 [cited by applicant]
US 20150079596A1 · Eltoukhy et al. · 2015 [cited by applicant]
US 20150125053A1 · Vieceli et al. · 2015 [cited by applicant]
US 20150169824A1 · Kermani et al. · 2015 [cited by applicant]
US 20170152554A1 · Drmanac et al. · 2017 [cited by applicant]
US 20170318240A1 · Yu · 2017 [cited by applicant]
US 20180195953A1 · Langlois et al. · 2018 [cited by applicant]
US 20180260940A1 · Langlois et al. · 2018 [cited by applicant]
US 20180274023A1 · Belitz et al. · 2018 [cited by applicant]
US 20200234099A1 · Wang · 2020 [cited by examiner]
US 20200234124A1 · Park · 2020 [cited by examiner]
US 20200302223A1 · Dutta et al. · 2020 [cited by applicant]
US 20200302224A1 · Jaganathan et al. · 2020 [cited by applicant]
US 20200302225A1 · Dutta · 2020 [cited by examiner]
US 20200350037A1 · Mishra · 2020 [cited by applicant]
US 20200364496A1 · Kostem · 2020 [cited by applicant]
US 20200364565A1 · Kostem · 2020 [cited by applicant]
US 20210011896A1 · Huang · 2021 [cited by examiner]
US 20210118110A1 · Langlois et al. · 2021 [cited by applicant]
US 20210158512A1 · Sun · 2021 [cited by examiner]
US 20210264232A1 · Kim · 2021 [cited by examiner]
US 20210350163A1 · Ojard et al. · 2021 [cited by applicant]
CN 112203648A · 2021 [cited by applicant]
EP 3306566A1 · 2018 [cited by applicant]
JP 2020056677A · 2021 [cited by applicant]
RU 2291197C2 · 2007 [cited by applicant]
RU 2565550C2 · 2015 [cited by applicant]
WO 9106678A1 · 1991 [cited by applicant]
WO 0063437A1 · 2002 [cited by applicant]
WO 2004018493A1 · 2004 [cited by applicant]
WO 2004018497A3 · 2004 [cited by applicant]
WO 2005024010A1 · 2005 [cited by applicant]
WO 2005065814A1 · 2005 [cited by applicant]
WO 2005010145A3 · 2005 [cited by applicant]
WO 2006120433A1 · 2006 [cited by applicant]
WO 2007010251A2 · 2007 [cited by applicant]
WO 2007010252A1 · 2007 [cited by applicant]
WO 2008041002A2 · 2008 [cited by applicant]
WO 2007123744A3 · 2008 [cited by applicant]
WO 2012058096A1 · 2012 [cited by applicant]
WO 2015002813A1 · 2015 [cited by applicant]
WO 2016066586A1 · 2016 [cited by applicant]
WO 2017098013A1 · 2017 [cited by applicant]
WO 2020236945A1 · 2020 [cited by applicant]
Abbaszadegan, “An Encoder-Decoder Based Basecaller for Nanopore DNA Sequencing”, dated Feb. 2019, 112pgs. [cited by applicant]
Bentley et. al., Accurate Whole Human Genome Sequencing using Reversible Terminator Chemistry, Supplemental Information, Nature, dated Nov. 6, 2008, 55 pages, [retrieved on Jul. 21, 2021], retrieved from the internet [U… [cited by applicant]
Boza et. al, “DeepNano: Deep recurrent neural network for base calling in MinION nanopore reads”, dated Jun. 5, 2017, 13 pages. [cited by applicant]
Dressman et al., Transforming single DNA molecules into fluorescent magnetic particles for detection and enumeration of genetic variations, Proceedings of the National Academy of Science, vol. 100, No. 15, pp. 8817-8822… [cited by applicant]
Genome Analysis Wiki, “Base Caller Summaries”, date of last edit Mar. 12, 2010, 4 pages. [cited by applicant]
Huang et. al, “SACall: a neural network basecaller for Oxford Nanopore sequencing data based on self-attention mechanism”, dated 2020, 10 pages. [cited by applicant]
J. Shen, X. Tang, X. Dong and L. Shao, “Visual Object Tracking by Hierarchical Attention Siamese Network”, in IEEE Transactions on Cybernetics, vol. 50, No. 7, pp. 3068-3080, Jul. 2020, DOI: 10.1109/TCYB.2019.2936503. [cited by applicant]
Kao et. al., “BayesCall: A model-based base-calling algorithm”, dated Apr. 21, 2009, 13 pages. [cited by applicant]
Kircher et. al. “Improved base calling for the Illumina Genome Analyzer using machine learning strategies”, dated Aug. 14, 2009, 9 pages. [cited by applicant]
Konishi et. al., “Halcyon: an accurate basecaller exploiting an encoder-decoder model with monotonic attention”, dated Nov. 9, 2020. 7 pages. [cited by applicant]
Miculinic et. al, “MinCall—MinION end2end convolutional deep learning basecaller”, dated Apr. 22, 2019, 8 pages. [cited by applicant]
Oxford, Cacho et. al., “A comparison of Base-calling Algorithms for Illumina Sequencing Technology”, dated Oct. 5, 2015, 10 pages. [cited by applicant]
Peresini et. al, “Nanopore Base Calling on the Edge”, dated Nov. 9, 2020, 15 pages. [cited by applicant]
Rakocevic et al., Fast and Accurate Genomic Analyses using Genome Graphs, biorxiv URL [https://www.biorxiv.org/content/biorxiv/early/2018/03/194530.full.pdf], dated Mar. 20, 2018, 104 pages. [cited by applicant]
Ratkovic, Deep Learning Model for Base Calling of MinION Nanopore Reads, dated Mar. 3, 2017, 48 pages,. (University of Zagreb). [cited by applicant]
Thornley et. al., “Machine Learning in Basecalling—Decoding Trace Peak Behavior”, dated Oct. 2006, 9 pages. [cited by applicant]
University of Cambridge, “Artificial Intelligence for genomic medicine”, dated May 2020, 63 pages. [cited by applicant]
Wang et al “An adaptive decorrelation method removes Illumina DNA base-calling errors caused by crosstalk between adjacent clusters” Scientific Reports vol. 7, Article No. 41348 (2017) (Year: 2017). [cited by applicant]
Wang et. al., “WaveNano: a signal-level nanopore base caller simultaneous prediction of nucleotide labels and move abels through bi-directional WaveNets”, dated 2018, 10 pages. [cited by applicant]
Weissleder Ralph et al: “Automated molecular-image cytometry and analysis in modern oncology”, Nature Reviews Materials, Nature Publishing Group UK, London, vol. 5, No. 6, Mar. 5, 2020 (Mar. 5, 2020), pp. 409-422, XP037… [cited by applicant]
Wick et. al., “Performance of neural network basecalling tools for Oxford Nanopore sequencing”, dated 2019, 10 pages. [cited by applicant]
Wikipedia, Least Squares, 13 pages, retrieved on Mar. 7, 2022, retrieved from the internet [URL: https://en.wikipedia.org/w/index.php?title=Least_squares&oldid=951737821]. [cited by applicant]
Wikipedia, Ordinary Least Squares, 16 pages, retrieved on Mar. 7, 2022, retrieved from the internet [URL: https://en. Wikipedia .org/w/index. php?title=Ordinary _least squares&oldid=951770366]. [cited by applicant]
Wolowski, Vincent Roman “High-quality, high-throughput measurement of protein-DNA binding using HITS-FLIP”, Munich, Mar. 2, 2016, 251 pages. [cited by applicant]
Xuan Lv et. al., “An end-to-end Oxford Nanopore Basecaller Using Convolution-augmented Transformer”, dated 2020, 6 pages. [cited by applicant]
Zeng et. al, “Causalcall: Nanopore Basecalling Using a Temporal Convolutional Network”, dated Jan. 20, 2020, 11 pages. [cited by applicant]