IP Library Granted Patent US 12,264,360
Granted Patent B2
US 12,264,360 · App. 16/696,010 · Granted Apr 1, 2025

Analysis of nanopore signal using a machine-learning technique

Inventor: Timothy Lee Massingham (Oxford, GB)
Assignee: Oxford Nanopore Technologies PLC
C12Q1/6869G06F18/214G06N3/045G06N3/084G06N20/20G16B30/00G16B40/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,264,360
App. No.
16/696,010
Granted
Apr 1, 2025
Kind
B2
Abstract

Techniques for estimating a polymer sequence of a polymer based on a signal produced as a result of translocation of the polymer through a nanopore are described. The techniques may analyze portions of the signal to estimate whether there was a transition in the polymer sequence during each respective portion and which units of the sequence the transition was between. The techniques may comprise operation of one or more neural networks into which data from the signal may be input. The techniques may include generating a plurality of weights for a portion of the signal, wherein each weight is associated with a transition between labeled units of the polymer. The weights may be indicative of a likelihood that a transition occurred between a first of the labeled units to a second of the labeled units within the portion of the signal.

Claims (84)

1. A method of high rate sequencing of polymers using a nanopore measurement and analysis system, the method comprising:

placing a polymer into the nanopore measurement and analysis system; and

sequencing the polymer using the nanopore measurement and analysis system at least in part by:

translocating at least a portion of the polymer through a nanopore of the nanopore measurement and analysis system at a sequencing rate in the range of 10-1000 polymer units per second, wherein the sequencing rate comprises a rate at which the polymer translocates through the nanopore;

measuring, using the nanopore measurement and analysis system and at a sampling rate between 100 Hz and 30 KHz, electrical signals generated by the translocating of the polymer through the nanopore, wherein the sampling rate is greater than or equal to the sequencing rate;

generating a time-ordered series of measurements based on the measuring of the electrical signals generated by the translocating;

organizing the time-ordered series of measurements into a plurality of overlapping subsets of measurements;

generating a plurality of feature vectors from the plurality of overlapping subsets of measurements by processing the subsets of measurements using a convolutional neural network;

generating a plurality of sets of transition weights from the plurality of feature vectors using a recurrent neural network;

generating, using the plurality of sets of transition weights, a Hidden Markov Model (HMM);

determining, using the HMM, an estimate of a sequence of polymer units in the polymer; and

outputting the estimated sequence of polymer units,

wherein the recurrent neural network comprises a bidirectional recurrent layer, the bidirectional recurrent layer comprising:

a first unidirectional recurrent layer comprising a first plurality of long short-term memory (LSTM) units connected in a first direction; and

a second unidirectional recurrent layer comprising a second plurality of LSTM units connected in a second direction, opposite the first direction, wherein outputs of the first unidirectional recurrent layer are inputs into the second unidirectional recurrent layer,

wherein generating the plurality of sets of transition weights comprises:

updating state vectors of multiple LSTM units in the first unidirectional recurrent layer based on the feature vectors and state vectors of LSTM units preceding the multiple LSTM units in the first unidirectional recurrent layer; and

updating state vectors of multiple LSTM units in the second unidirectional recurrent layer based on outputs of the first unidirectional recurrent layer and state vectors of LSTM units preceding the multiple LSTM units in the second unidirectional recurrent layer; and

wherein each weight of a particular set of transition weights of the plurality of sets of transition weights is associated with respective first and second labels and is indicative of the likelihood that a transition between a polymer unit having the first label and a polymer unit having the second label occurred within a measurement period represented by a subset of measurements, of the plurality of overlapping subsets, associated with the particular set of transition weights.

2. The method of claim 1 , wherein a number of the measurements in a subset of the plurality of subsets of the time-ordered series of measurements is different than a number of a plurality of values of the feature vector.

3. The method of claim 1 ,

wherein each of the polymer units in the polymer is one of a finite, known group of polymer units, the group of polymer units consisting of N distinct polymer units,

wherein each of the first label and second label is one of a finite, known, group of labels, the group of labels consisting of M distinct labels, and

wherein M is greater than N.

4. The method of claim 3 , wherein a set of the plurality of sets of weights consists of M 2 weights.

5. The method of claim 3 , wherein M is equal to N+1, and wherein the group of labels consists of N labels each corresponding to respective ones of the group of polymer units, and a single label corresponding to a blank label, which represents a lack of a transition within the measurement period represented by an associated subset of the plurality of overlapping subsets of the time-ordered series of measurements.

6. The method of claim 3 , wherein M is equal to 2×N, and wherein the group of labels consists of N labels each corresponding to a first instance of respective ones of the group of polymer units, and N labels each corresponding to a second instance of the respective ones of the group of polymer units.

7. The method of claim 1 ,

wherein generating the HMM comprises determining emission and transition probabilities of the HMM using weights of the plurality of sets of weights; and

wherein determining the estimate of the sequence of polymer units comprises determining, using the HMM, a most likely sequence of polymer units within the polymer.

8. The method of claim 7 ,

wherein each of the first label and second label is one of a finite, known, group of labels, and

wherein determining the most likely sequence of polymer units within the polymer comprises determining the most likely sequence of labels of the group of labels using the HMM, and identifying polymer units that correspond to the labels of the group of labels.

9. The method of claim 1 , further comprising measuring a current through the nanopore during translocation of the polymer through the nanopore, thereby generating a current measurement signal.

10. The method of claim 9 , further comprising digitizing the current measurement signal, thereby producing the time-ordered series of measurements.

11. The method of claim 1 , wherein:

each of the polymer units in the polymer is one of a finite, known group of polymer units,

each polymer unit of the finite, known group of polymer units has a respective primary label and a respective secondary label, and

transitions, within the plurality of sets of transition weights, from any first label to a second label corresponding to the primary label of a particular polymer unit are allowed, and transitions, within the plurality of sets of transition weights, to any second label corresponding the secondary label of the particular polymer are only allowed from a first label corresponding to the primary or secondary label of the particular polymer unit.

12. The method of claim 1 , wherein the sampling rate is between one and ten times the sequencing rate.

13. A system for high rate sequencing of polymers, the system comprising:

a nanopore measurement and analysis system comprising:

a nanopore;

one or more processors; and

at least one non-transitory computer readable medium storing instructions;

wherein the nanopore measurement and analysis system is configured to sequence a polymer at least in part by:

translocating at least a portion of the polymer through the nanopore at a sequencing rate in the range of 10-1000 polymer units per second, wherein the sequencing rate comprises a rate at which the polymer translocates through the nanopore;

measuring, at a sampling rate between 100 Hz and 30Khz, electrical signals generated by the translocating of the polymer through the nanopore, wherein the sampling rate is greater than or equal to the sequencing rate;

generating a time-ordered series of measurements from electrical signals generated by the translocating of the polymer through the nanopore;

performing, by executing the instructions stored on the at least one non-transitory medium with the one or more processors:

organizing the time-ordered series of measurements into a plurality of overlapping subsets of measurements;

generating a plurality of feature vectors from the plurality of overlapping subsets of measurements by processing the subsets of measurements using a convolutional neural network;

generating a plurality of sets of transition weights from the plurality of feature vectors using a recurrent neural network;

generating, using the plurality of sets of transition weights, a Hidden Markov Model (HMM); and

determining, using the HMM, using the one or more processors, an estimate of the sequence of polymer units in the polymer; and

outputting the estimated sequence of polymer units,

wherein the recurrent neural network comprises a bidirectional recurrent layer, the bidirectional recurrent layer comprising:

a first unidirectional recurrent layer comprising a first plurality of long short-term memory (LSTM) units connected in a first direction; and

a second unidirectional recurrent layer comprising a second plurality of LSTM units connected in a second direction, opposite the first direction, wherein outputs of the first unidirectional recurrent layer are inputs into the second unidirectional recurrent layer;

wherein generating the plurality of sets of transition weights comprises:

updating state vectors of multiple LSTM units in the first unidirectional recurrent layer based on the feature vectors and state vectors of LSTM units preceding the multiple LSTM units in the first unidirectional recurrent layer; and

updating state vectors of multiple LSTM units in the second unidirectional recurrent layer based on outputs of the first unidirectional recurrent layer and state vectors of LSTM units preceding the multiple LSTM units in the second unidirectional recurrent layer; and

wherein each weight of a particular set of transition weights of the plurality of sets of transition weights is associated with respective first and second labels and is indicative of the likelihood that a transition between a polymer unit having the first label and a polymer unit having the second label occurred within a measurement period represented by a subset of measurements, of the plurality of overlapping subsets, associated with the particular set of transition weights.

14. The system of claim 13 , wherein a number of the measurements in a subset of the plurality of overlapping subsets of the time-ordered series of measurements is different than a number of a plurality of values of the feature vector.

15. The system of claim 13 ,

wherein each of the polymer units in the polymer is one of a finite, known group of polymer units, the group of polymer units consisting of N distinct polymer units,

wherein each of the first label and second label is one of a finite, known, group of labels, the group of labels consisting of M distinct labels, and

wherein M is greater than N.

16. The system of claim 15 , wherein a set of the plurality of sets of weights consists of M 2 weights.

17. The system of claim 15 , wherein M is equal to N+1, and wherein the group of labels consists of N labels each corresponding to respective ones of the group of polymer units, and a single label corresponding to a blank label, which represents a lack of a transition within the measurement period represented by an associated subset of the plurality of overlapping subsets of the time-ordered series of measurements.

18. The system of claim 15 , wherein M is equal to 2×N, and wherein the group of labels consists of N labels each corresponding to a first instance of respective ones of the group of polymer units, and N labels each corresponding to a second instance of the respective ones of the group of polymer units.

19. The system of claim 13 ,

wherein generating the HMM comprises determining emission and transition probabilities of the HMM using weights of the plurality of sets of weights; and

wherein determining the estimate of the sequence of polymer units comprises determining, using the HMM, a most likely sequence of polymer units within the polymer.

20. The system of claim 19 ,

wherein each of the first label and second label is one of a finite, known, group of labels, and

wherein determining the most likely sequence of polymer units within the polymer comprises determining the most likely sequence of labels of the group of labels using the HMM, and identifying polymer units that correspond to the labels of the group of labels.

21. The system of claim 13 , further comprising a measurement unit configured to measure a current through the nanopore during translocation of the polymer through the nanopore, thereby generating a current measurement signal.

22. The system of claim 21 , wherein the measurement unit is further configured to digitize the current measurement signal, thereby producing the time-ordered series of measurements, and to provide the time-ordered series of measurements to the analysis unit.

23. The system of claim 13 , wherein:

each of the polymer units in the polymer is one of a finite, known group of polymer units,

each polymer unit of the finite, known group of polymer units has a respective primary label and a respective secondary label, and

transitions, within the plurality of sets of transition weights, from any first label to a second label corresponding to the primary label of a particular polymer unit are allowed, and transitions, within the plurality of sets of transition weights, to any second label corresponding the secondary label of the particular polymer are only allowed from a first label corresponding to the primary or secondary label of the particular polymer unit.

24. The system of claim 13 , wherein the sampling rate is between one and ten times the sequencing rate.

Assignments (2)
CHANGE OF NAME Recorded Jan 14, 2022
From: OXFORD NANOPORE TECHNOLOGIES LIMITED
To: OXFORD NANOPORE TECHNOLOGIES PLC
Reel/Frame 058737/0664 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 30, 2020
From: MASSINGHAM, TIMOTHY LEE
To: OXFORD NANOPORE TECHNOLOGIES LTD.
Reel/Frame 051666/0013 →
Priority Claims (1)
GB 1819378 · Nov 28, 2018 · national
Continuity (1)
Related Publication 20200176082A1 · Jun 4, 2020
References Cited (59)
US 20150057948A1 · Reid · 2015 [cited by examiner]
US 20160162634A1 · Reid · 2016 [cited by examiner]
US 20170091427A1 · Massingham · 2017 [cited by examiner]
US 20170096703A1 · Dolan · 2017 [cited by examiner]
WO WO200028312A1 · 2000 [cited by applicant]
WO WO200079257A1 · 2000 [cited by applicant]
WO WO2005124888A1 · 2005 [cited by applicant]
WO WO2008102102A2 · 2008 [cited by applicant]
WO WO2009035647A1 · 2009 [cited by applicant]
WO WO2009077734A2 · 2009 [cited by applicant]
WO WO2010086603A1 · 2010 [cited by applicant]
WO WO2010086622A1 · 2010 [cited by applicant]
WO WO2010109197A2 · 2010 [cited by applicant]
WO WO2010122293A1 · 2010 [cited by applicant]
WO WO2011046706A1 · 2011 [cited by applicant]
WO WO2011067559A1 · 2011 [cited by applicant]
WO WO2012005857A1 · 2012 [cited by applicant]
WO WO2012033524A2 · 2012 [cited by applicant]
WO WO2012107778A2 · 2012 [cited by applicant]
WO WO2012138357A1 · 2012 [cited by applicant]
WO WO2013014451A1 · 2013 [cited by applicant]
WO WO2013041878A1 · 2013 [cited by applicant]
WO WO2013153359A1 · 2013 [cited by applicant]
WO WO2014064443A2 · 2014 [cited by applicant]
WO WO2014064444A1 · 2014 [cited by applicant]
WO WO2015140535A1 · 2015 [cited by applicant]
WO WO2015173587A1 · 2015 [cited by examiner]
WO WO2016034591A2 · 2016 [cited by applicant]
WO WO2016187519A2 · 2016 [cited by applicant]
WO WO2016181118A1 · 2016 [cited by applicant]
WO WO2018203084A1 · 2018 [cited by examiner]
WO WO2020049293A1 · 2020 [cited by applicant]
Matthew Landry and Stephen Winters-Hilt. Analysis of nanopore detector measurements using Machine-Learning methods, with application to single-molecule kinetic analysis. 2007. BMC Bioinformatics 2007, 8(Suppl 7):S12 (Ye… [cited by examiner]
Misiunas K, Ermann N, Keyser UF. QuipuNet: Convolutional Neural Network for Single-Molecule Nanopore Sensing. Nano Lett. Jun. 13, 2018;18(6):4040-4045. doi: 10.1021/acs.nanolett.8b01709. Epub Jun. 1, 2018. (Year: 2018). [cited by examiner]
Boža V, Brejová B, Vinař T. DeepNano: Deep recurrent neural networks for base calling in MinION nanopore reads. PLoS One. Jun. 5, 2017;12(6):e0178751. doi: 10.1371/journal.pone.0178751. eCollection 2017. (Year: 2017). [cited by examiner]
Teng H, Cao MD, Hall MB, Duarte T, Wang S, Coin LJM. Chiron: translating nanopore raw signal directly into nucleotide sequence using deep learning. Gigascience. May 1, 2018;7(5):giy037. doi: 10.1093/gigascience/giy037. … [cited by examiner]
International Search Report and Written Opinion for Application No. PCT/GB2019/053334, mailed Feb. 27, 2020. [cited by applicant]
International Preliminary Report on Patentability for Application No. PCT/GB2019/053334, mailed Jun. 10, 2021. [cited by applicant]
Boza et al., DeepNano: Deep recurrent neural networks for base calling in MinION nanopore reads. PLoS One. Jun. 5, 2017;12(6):e0178751. doi: 10.1371/journal.pone.0178751. [cited by applicant]
Butler et al., Single-molecule DNA detection with an engineered MspA protein nanopore. Proc Natl Acad Sci U S A. Dec. 30, 2008;105(52):20647-52. doi: 10.1073/pnas.0807514106. Epub Dec. 19, 2008. [cited by applicant]
Gers et al., Recurrent nets that time and count. In Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millenni… [cited by applicant]
Gonzalez-Perez et al., Biomimetic triblock copolymer membrane arrays: a stable template for functional membrane proteins. Langmuir. Sep. 15, 2009;25(18):10447-50. doi: 10.1021/la902417m. [cited by applicant]
Graves et al., Connectionist temporal classification: labelling unsegmented sequence data with recurrent neural networks. In Proceedings of the 23rd international conference on Machine learning Jun. 25, 2006 (pp. 369-37… [cited by applicant]
Heron et al., Simultaneous measurement of ionic current and fluorescence from single protein pores. J Am Chem Soc. Feb. 11, 2009;131(5):1652-3. doi: 10.1021/ja808128s. [cited by applicant]
Hochreiter et al., Long short-term memory. Neural Comput. Nov. 15, 1997;9(8):1735-80. doi: 10.1162/neco.1997.9.8.1735. [cited by applicant]
Ivanov et al., DNA tunneling detector embedded in a nanopore. Nano Lett. Jan. 12, 2011;11(1):279-85. doi: 10.1021/nl103873a. Epub Dec. 6, 2010. [cited by applicant]
Lafferty et al., Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data. In Proceedings of the International Conference on Machine Learning, 2001, 10 pages. [cited by applicant]
Landry et al., Analysis of nanopore detector measurements using Machine-Learning methods, with application to single-molecule kinetic analysis. BMC Bioinformatics. Nov. 1, 2007;8 Suppl 7(Suppl 7):S12. doi: 10.1186/1471-… [cited by applicant]
Li et al., DeepSimulator: a deep simulator for Nanopore sequencing. Bioinformatics. Sep. 1, 2018;34(17):2899-2908. doi: 10.1093/bioinformatics/bty223. [cited by applicant]
Lieberman et al., Processive replication of single DNA molecules in a nanopore catalyzed by phi29 DNA polymerase. J Am Chem Soc. Dec. 22, 2010;132(50):17961-72. doi: 10.1021/ja1087612. Epub Dec. 1, 2010. Author Manuscri… [cited by applicant]
Luan et al., Base-by-base ratcheting of single stranded DNA through a solid-state nanopore. Phys Rev Lett. Jun. 11, 2010;104(23):238103. doi: 10.1103/PhysRevLett.104.238103. Epub Jun. 10, 2010. Author Manuscript, 9 page… [cited by applicant]
McCallum et al., Maximum entropy Markov models for information extraction and segmentation. In Icml Jun. 29, 2000 (vol. 17, No. 2000, pp. 591-598). [cited by applicant]
Soni et al., Synchronous optical and electrical detection of biomolecules traversing through solid-state nanopores. Rev Sci Instrum. Jan. 2010;81(1):014301. doi: 10.1063/1.3277116. [cited by applicant]
Stoddart et al., Multiple base-recognition sites in a biological nanopore: two heads are better than one. Angew Chem Int Ed Engl. 2010;49(3):556-9. doi: 10.1002/anie.200905483. Author Manuscript, 8 pages. [cited by applicant]
Stoddart et al., Nucleobase recognition in ssDNA at the central constriction of the alpha-hemolysin pore. Nano Lett. Sep. 8, 2010;10(9):3633-7. doi: 10.1021/nl101955a. Author Manuscript, 11 pages. [cited by applicant]
Stoddart et al., Single-nucleotide discrimination in immobilized DNA oligonucleotides with a biological nanopore. Proc Natl Acad Sci U S A. May 12, 2009;106(19):7702-7. doi: 10.1073/pnas.0901054106. Epub Apr. 20, 2009. [cited by applicant]
Stoiber et al., BasecRAWller: Streaming nanopore basecalling directly from raw signal. BioRxiv. Jan. 1, 2017:133058. doi: 10.1101/133058. Retrieved from the Internet: URL:https://www.biorxiv.org/content/biorxiv/early/20… [cited by applicant]
Teng et al., Chiron: translating nanopore raw signal directly into nucleotide sequence using deep learning. Gigascience. May 1, 2018;7(5):giy037. doi: 10.1093/gigascience/giy037. Erratum in: Gigascience. May 1, 2019;8(5… [cited by applicant]
Boufounos et al., Basecalling using hidden Markov models. Journal of the Franklin Institute. Jan. 1, 2004;341(1-2):23-36. [cited by applicant]