IP Library › Granted Patent US 12,272,048
Granted Patent B2
US 12,272,048 · App. 17/062,907 · Granted Apr 8, 2025

Automated detection and repositioning of micro-objects in microfluidic devices

Inventors: Fenglei Du (Fremont, CA); Paul M. Lundquist (San Francisco, CA); John A. Tenney (Piedmont, CA); Troy A. Lionberger (Berkeley, CA)
G06T7/0012G01N15/1433G01N15/1434G01N15/1484G01N21/6456G01N27/453G06T5/50B01L3/502761G01N2015/0038G01N15/01G01N2015/1006G01N2015/1445G01N2015/1486G01N2015/1493G01N2015/1497G01N2021/056G01N2021/1765G01N2201/0635G01N2201/127G06T2207/30024G06T2207/30101
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,272,048
App. No.
17/062,907
Granted
Apr 8, 2025
Kind
B2
Abstract

Methods are provided for the automated detection of micro-objects in a microfluidic device. In addition, methods are provided for repositioning micro-objects in a microfluidic device. In addition, methods are provided for separating micro-objects in a spatial region of the microfluidic device.

Claims (35)

1. A method for determining a number density of micro-objects disposed within a predetermined area of a microfluidic device, the method comprising:

capturing a digital image of a region in the microfluidic device that contains a micro-object of interest;

determining periodic structures in the digital image using a Fourier transform;

generating a filtered image or a differential image by removing the periodic structures from the digital image;

identifying a micro-object of interest based on the filtered or differential image; and

calculating the number density of micro-objects in the pre-determined area of that region of the microfluidic device using the filtered or differential image.

2. The method of claim 1 , wherein the periodic structures correspond to one or more microfluidic device features.

3. The method of claim 2 , wherein the one or more microfluidic device features include an array of phototransistors and/or walls of sequestration pens.

4. The method of claim 1 , further comprising:

determining a set of light intensity values for one or more pixels corresponding to the filtered image; and

generating a set of positive-value pixels based on the filtered image.

5. The method of claim 4 , further comprising:

analyzing the set of positive-value pixels to identify one or more sets of pixel clusters, wherein each pixel cluster comprises one or more pixels;

determining, for each of the one or more sets of pixel clusters, a feature set comprising information representing one or more of an area of the set of pixel clusters, a circumference of the set of pixel clusters, a global morphology of the set of pixel clusters, a local morphology of the set of pixel clusters and a light intensity value associated with the set of pixel clusters; and

identifying, for each of the one or more sets of pixel clusters, whether the set of pixel clusters corresponds to the micro-object of interest, wherein the identification is based on the feature set determined for the set of pixel clusters.

6. The method of claim 1 , wherein a filtered image is generated, and said filtered image is generated prior to identifying a micro-object of interest.

7. The method of claim 1 , wherein a differential image is generated, and said differential image is generated using a first image and a second image.

8. The method of claim 7 , wherein the first image is taken without removing any features of the microfluidic device.

9. The method of claim 7 , wherein the second image is taken after inducing movement of fluid within the microfluidic device.

10. The method of claim 8 , wherein the second image is taken after the position of the microfluidic device is shifted relative to the imaging device.

11. The method of claim 7 , wherein the differential image is generated by subtracting the first image from the second image.

12. The method of claim 11 , wherein the first and second images are aligned computationally prior to subtracting the first image from the second image, and wherein pixels identified as positive-value pixels represent the current location of a micro-object.

13. The method of claim 7 , wherein the differential image is generated by subtracting the second image from the first image, and wherein pixels identified as positive-value pixels represent the former location of a micro-object and pixels identified as negative-value pixels represent the current location of the micro-object.

14. The method of claim 1 , wherein a light intensity value Li is defined for each pixel Pi (i=1 to n), wherein n is the number of pixels in the image.

15. The method of claim 14 , further comprising analyzing the filtered or differential image wherein analyzing comprises identifying each pixel Pi that has a negative light intensity value Li as being a positive-value pixel and identifying each pixel Pi that has a negative light intensity value Li as a negative value pixel.

16. The method of claim 15 , wherein analyzing further comprises comparing the light intensity value Li of each pixel Pi to a predetermined threshold light intensity value Lo; and identifying each pixel Pi having an Li greater than Lo as a positive-value pixel and each pixel Pi having an Li less than −1*Lo as a negative value pixel.

17. The method of claim 16 , wherein the threshold light intensity value Lo is the average light intensity value Lavg of the set of light intensity values Li obtained from the set of pixels Pi (i=1 to n).

18. The method of claim 16 , wherein the generated image is a differential image, and the differential image is analyzed for pairs of positive-value and negative-value pixels or clusters of pixels.

19. The method of claim 1 , wherein the Fourier Transform is a Discrete Fourier Transform, and one or more pixels corresponding to the frequency domain are filtered out of the filtered or differential image.

20. The method of claim 19 , wherein an inverse Discrete Fourier Transform is applied to produce the filtered or differential image.

21. The method of claim 1 , wherein the pre-determined area of the microfluidic circuit comprises a channel, a sequestration pen, or a trap of the microfluidic device.

22. The method of claim 1 , wherein identifying the micro-object of interest further comprises detecting production of an analyte.

23. The method of claim 22 , wherein the micro-object of interest is a biological micro-object that produces the analyte.

24. The method of claim 23 , wherein the image of the region in the microfluidic device comprising the biological micro-object of interest further comprises one or more micro-objects each comprising a bead configured to produce a localized reaction with the analyte.

25. The method of claim 24 , further comprising correlating the localized reaction with a location of the biological micro-object of interest within the region, thereby identifying the biological micro-object of interest.

Assignments (4)
MERGER Recorded Apr 9, 2026
From: BRUKER CELLULAR ANALYSIS, INC.
To: BRUKER SPATIAL BIOLOGY, INC.
Reel/Frame 075375/0517 →
MERGER AND CHANGE OF NAME Recorded Nov 30, 2023
From: PHENOMEX INC.; BIRD MERGERSUB CORPORATION
To: BRUKER CELLULAR ANALYSIS, INC.
Reel/Frame 065726/0624 →
CHANGE OF NAME Recorded Sep 20, 2023
From: BERKELEY LIGHTS, INC.
To: PHENOMEX INC.
Reel/Frame 064961/0794 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 7, 2020
From: DU, FENGLEI; LUNDQUIST, PAUL M.; TENNEY, JOHN A.; LIONBERGER, TROY A.
To: BERKELEY LIGHTS, INC.
Reel/Frame 053995/0558 →
Continuity (5)
Division 16000385 · Jun 5, 2018
Continuation 14963230 · Dec 8, 2015
Provisional Application 62259522 · Nov 24, 2015
Provisional Application 62089613 · Dec 9, 2014
Related Publication 20210090252A1 · Mar 25, 2021
References Cited (102)
US 5548661A · Price et al. · 1996 [cited by applicant]
US 5854674A · Lin · 1998 [cited by examiner]
US 6197503B1 · Vo-Dinh et al. · 2001 [cited by applicant]
US 6294063B1 · Becker et al. · 2001 [cited by applicant]
US 6448064B1 · Vo-Dinh · 2002 [cited by examiner]
US 6916584B2 · Sreenivasan · 2005 [cited by examiner]
US 6942776B2 · Medoro · 2005 [cited by applicant]
US 7090759B1 · Seul · 2006 [cited by applicant]
US 7842246B2 · Wohlstadter · 2010 [cited by examiner]
US 7956339B2 · Ohta et al. · 2011 [cited by applicant]
US 8021848B2 · Straus · 2011 [cited by examiner]
US 9744533B2 · Breinlinger · 2017 [cited by examiner]
US 11396016B2 · Italiano · 2022 [cited by examiner]
US 20030008364A1 · Wang et al. · 2003 [cited by applicant]
US 20030016874A1 · Lefler · 2003 [cited by examiner]
US 20030080442A1 · Unger · 2003 [cited by applicant]
US 20030170613A1 · Straus · 2003 [cited by examiner]
US 20030224528A1 · Chiou et al. · 2003 [cited by applicant]
US 20040072278A1 · Chou et al. · 2004 [cited by applicant]
US 20040191789A1 · Manaresi et al. · 2004 [cited by applicant]
US 20050051429A1 · Shapiro · 2005 [cited by examiner]
US 20050112548A1 · Segawa et al. · 2005 [cited by applicant]
US 20050175981A1 · Voldman et al. · 2005 [cited by applicant]
US 20050282175A1 · Taylor · 2005 [cited by examiner]
US 20060057557A1 · Deutsch · 2006 [cited by examiner]
US 20060091015A1 · Lau · 2006 [cited by applicant]
US 20070095669A1 · Lau et al. · 2007 [cited by applicant]
US 20080013092A1 · Maltezos · 2008 [cited by examiner]
US 20080014575A1 · Nelson · 2008 [cited by examiner]
US 20080075380A1 · Dube · 2008 [cited by examiner]
US 20080182136A1 · Arnold · 2008 [cited by examiner]
US 20080302732A1 · Soh et al. · 2008 [cited by applicant]
US 20090075828A1 · Fisher · 2009 [cited by examiner]
US 20090170186A1 · Wu et al. · 2009 [cited by applicant]
US 20090190121A1 · Hegyi et al. · 2009 [cited by applicant]
US 20090324089A1 · Morita · 2009 [cited by examiner]
US 20100003666A1 · Lee et al. · 2010 [cited by applicant]
US 20100101960A1 · Ohta et al. · 2010 [cited by applicant]
US 20100110177A1 · Yamada et al. · 2010 [cited by applicant]
US 20100224026A1 · Brennan Fournet · 2010 [cited by examiner]
US 20100285490A1 · Dees · 2010 [cited by examiner]
US 20110117634A1 · Halamish et al. · 2011 [cited by applicant]
US 20120024708A1 · Chiou et al. · 2012 [cited by applicant]
US 20120118740A1 · Garcia et al. · 2012 [cited by applicant]
US 20120148140A1 · Di Carlo · 2012 [cited by examiner]
US 20120325665A1 · Chiou et al. · 2012 [cited by applicant]
US 20130115606A1 · Hansen et al. · 2013 [cited by applicant]
US 20130118905A1 · Morimoto et al. · 2013 [cited by applicant]
US 20130171628A1 · Di Carlo et al. · 2013 [cited by applicant]
US 20130190212A1 · Handique et al. · 2013 [cited by applicant]
US 20130204076A1 · Han et al. · 2013 [cited by applicant]
US 20130296196A1 · Fowler · 2013 [cited by examiner]
US 20140017709A1 · Lowe · 2014 [cited by examiner]
US 20140113324A1 · Di Carlo · 2014 [cited by examiner]
US 20140116881A1 · Chapman et al. · 2014 [cited by applicant]
US 20140376816A1 · Lagae · 2014 [cited by examiner]
US 20150151298A1 · Hobbs et al. · 2015 [cited by applicant]
US 20150151307A1 · Breinlinger et al. · 2015 [cited by applicant]
US 20150165436A1 · Chapman et al. · 2015 [cited by applicant]
US 20150247190A1 · Ismagilov · 2015 [cited by examiner]
US 20160171686A1 · Du et al. · 2016 [cited by applicant]
US 20160193604A1 · McFarland et al. · 2016 [cited by applicant]
US 20190374944A1 · Lundquist et al. · 2019 [cited by applicant]
US 20190384963A1 · Kim et al. · 2019 [cited by applicant]
US 20220056002A1 · Soper · 2022 [cited by examiner]
CA 2257895C · 2005 [cited by applicant]
CA 2895638A1 · 2014 [cited by applicant]
CN 101548004A · 2009 [cited by applicant]
CN 102215966A · 2011 [cited by applicant]
CN 102285630A · 2011 [cited by applicant]
CN 1774623B · 2012 [cited by applicant]
CN 102471752A · 2012 [cited by applicant]
CN 103649720B · 2017 [cited by applicant]
JP H06242013A · 1994 [cited by applicant]
JP S6447950B · 1997 [cited by applicant]
SG 128054A1 · 2007 [cited by applicant]
WO 1999001985A1 · 1999 [cited by applicant]
WO 2001004683A1 · 2001 [cited by applicant]
WO 2001057785A1 · 2001 [cited by applicant]
WO 2005121864A2 · 2005 [cited by applicant]
WO 2005011947A9 · 2006 [cited by applicant]
WO 2011003073A1 · 2011 [cited by applicant]
WO 2012152769A1 · 2012 [cited by applicant]
WO 2019232473A2 · 2019 [cited by applicant]
Chen et al., Microfluidic approaches for cancer cell detection, characterization, and separation, Lab on a Chip 12:1753 (2012). [cited by applicant]
Chiou et al., “Massively parallel manipulation of single cells and microparticles using optical images,” Nature, vol. 436 (Jul. 21, 2005), pp. 370-372. [cited by applicant]
Fuchs et al., “Electronic sorting and recovery of single live cells from microlitre sized samples” Lab on a Chip 6:121-26 (2006). [cited by applicant]
Hirono, T, Okawa, S, Yamada, Y, & Arimoto, H (2008). Microfluidic image cytometry for measuring number and sizes of biological cells flowing through a microchannel using the micro-PIV technique. Measurement Science and … [cited by applicant]
Lagally et al., Parallel microfluidic arrays for SPRI detection, Proceedings of SPIE, vol. 7759, p. 77590J (2010). [cited by applicant]
Manaresi et al., “A CMOS Chip for Individual Cell Manipulation and Detection,” IEEE Journal of Solid-State Circuits, vol. 38, No. 12 (Dec. 2003), pp. 2297-2305. [cited by applicant]
Nguyen, N-T et al., “Flow Rate Measurement in Microfluidics Using Optical Sensors”, 1st International Conference on Sensing Technology, Nov. 21-23, 2005, Palmerston North, New Zealand. [cited by applicant]
Shin, Yong Kyun et al: “Automated microfluidic system for orientation control of mouse embryos”, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems, IEEE, Nov. 3, 2013 (Nov. 3, 2013), pp. 496-501. [cited by applicant]
Valley et al., Optoelectronic Tweezers as a Tool for Parallel Single-Cell Manipulation and Simulation, IEEE Transactions on Biomedical Circuits and Systems, vol. 3, No. 6 (Dec. 2009), pp. 424-431. [cited by applicant]
Wu, Ming C. “Optoelectronic Tweezers for Nanomanipulation” Nano-Optoelectronic Workshop 2007. [cited by applicant]
Z Report_International Search Report and Written Opinion for PCT Application Serial No. PCT/US2015/064575 (Jun. 30, 2016), 24 pages. [cited by applicant]
Zhang, Xu Ping et al.: “Controlled Aspiration and Positioning of Biological Cells in a Micropipette” IEEE Transactions on Biomedical Engineering, IEEE Service Center, vol. 59, No. 4, Apr. 2012 (Apr. 2012), pp. 1032-1040. [cited by applicant]
JPS6447950 Machine Translation, Feb. 22, 1989, 7 pages. [cited by applicant]
Office Action for Chinese Application No. 2021103273617, Oct. 19, 2023, 11 pages. [cited by applicant]
English Translation of Office Action for Chinese Application No. 2021103273617, Oct. 19, 2023, 6 pages. [cited by applicant]
JPH06242013A Machine Translation, Jul. 19, 2024, 7 pages. [cited by applicant]
Office Action for Chinese Application No. 202110327361.7, Jul. 13, 2024, 12 pages. [cited by applicant]
English Translation of Office Action for Chinese Application No. 202110327361.7, Jul. 13, 2024, 21 pages. [cited by applicant]