IP Library Granted Patent US 12,375,815
Granted Patent B2
US 12,375,815 · App. 18/581,051 · Granted Jul 29, 2025

Automated application of drift correction to sample studied under electron microscope

Inventors: Franklin Stampley Walden, II (Raleigh, NC); John Damiano, Jr. (Holly Springs, NC); David P. Nackashi (Raleigh, NC); Daniel Stephen Gardiner (Wake Forest, NC); Mark Uebel (Morrisville, NC); Alan Philip Franks (Durham, NC); Benjamin Jacobs (Apex, NC)
Assignee: Protochips, Inc.
H04N23/695G06T7/215G06T7/337G06T2207/10061
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,375,815
App. No.
18/581,051
Granted
Jul 29, 2025
Kind
B2
Abstract

Control system configured for sample tracking in an electron microscope environment registers a movement associated with a region of interest located within an active area of a sample under observation with an electron microscope. The registered movement includes at least one directional constituent. The region of interest is positioned within a field of view of the electron microscope. The control system directs an adjustment of the electron microscope control component to one or more of dynamically center and dynamically focus the view through the electron microscope of the region of interest. The adjustment comprises one or more of a magnitude element and a direction element.

Claims (35)

1. A computing system configured for automated drift correction of a sample under observation by an electron microscope, the computing system comprising:

one or more hardware processors

is configured to:

receive input data from the electron microscope, wherein the input data includes images of the sample under observation;

register movement of the sample under observation based on the input data received from the electron microscope,

wherein the movement is registered by comparing the images of the sample under observation against a reference template;

and

send one or more signals to cause the electron microscope to re-center a field of view based on the registered movement of the sample under observation.

2. The computing system of claim 1 , wherein the one or more hardware processors are further configured to calculate an electron dose for the sample under observation based on the input data received from the electron microscope and the registered movement of the sample under observation.

3. The computing system of claim 1 , wherein the one or more signals to cause the electron microscope to re-center the field of view include signals to cause movement to one or more of a mechanical stage of the electron microscope, a goniometer of the electron microscope, a piezo of the electron microscope, or a beam of the electron microscope.

4. The computing system of claim 1 , wherein the one or more hardware processors are further configured to:

display, on a graphical user interface, an image of positions of the sample under observation in a heatmap form; and,

automatically adjust the displayed image to in response to a change in one or more of a sample position and a magnification level, wherein the adjustment is based on the change.

5. The computing system of claim 1 , wherein the one or more hardware processors are further configured to track the movement of the sample under observation over time based on the input data received from the electron microscope.

6. The computing system of claim 1 , wherein the one or more hardware processors are further configured to measure an impact of an electron beam on one or more of: a shape of the sample under observation, a composition of the sample under observation, a density of the sample under observation, an electrical characteristic of the sample under observation, a morphology of the sample under observation, and a microstructure of the sample under observation.

7. The computing system of claim 1 , wherein the one or more hardware processors are further configured to display on a graphical user interface a listing of at least some of the images of the sample under observation, wherein the listing of images includes images that were previously observed by a user.

8. The computing system of claim 2 , one or more hardware processors are further configured to display on a graphical user interface a listing of at least some of the images of the sample under observation, wherein the listing of images includes images that were previously observed by a user along with the electron dose associated with each listed image.

9. The computing system of claim 1 , wherein the input data received from the electron microscope further includes metadata associated with each of the images of the sample under observation.

10. The computing system of claim 1 , wherein the one or more hardware processors are further configured to perform predictive drift correction based on the registered movement of the sample under observation.

11. A computer-implemented method of system configured for automated drift correction of a sample under observation by an electron microscope, the computer-implemented method comprising:

receiving input data from the electron microscope, wherein the input data includes images of the sample under observation;

registering movement of the sample under observation based on the input data received from the electron microscope,

wherein the movement is registered by comparing the images of the sample under observation against a reference template; and

sending one or more signals to cause the electron microscope to re-center a field of view based on the registered movement of the sample under observation.

12. The computer-implemented method of claim 11 , further comprising calculating an electron dose for the sample under observation based on the input data received from the electron microscope and the registered movement of the sample under observation.

13. The computer-implemented method of claim 11 , wherein the one or more signals to cause the electron microscope to re-center the field of view include signals to cause movement to one or more of a mechanical stage of the electron microscope, a goniometer of the electron microscope, a piezo of the electron microscope, or a beam of the electron microscope.

14. The computer-implemented method of claim 11 , further comprising:

displaying, on a graphical user interface, an image of positions of the sample under observation in a heatmap form; and,

automatically adjusting the displayed image to in response to a change in one or more of a sample position and a magnification level, wherein the adjustment is based on the change.

15. The computer-implemented method of claim 11 , further comprising tracking the movement of the sample under observation over time based on the input data received from the electron microscope.

16. The computer-implemented method of claim 11 , further comprising measuring an impact of an electron beam on one or more of: a shape of the sample under observation, a composition of the sample under observation, a density of the sample under observation, an electrical characteristic of the sample under observation, a morphology of the sample under observation, and a microstructure of the sample under observation.

17. The computer-implemented method of claim 11 , further comprising displaying on a graphical user interface a listing of at least some of the images of the sample under observation, wherein the listing of images includes images that were previously observed by a user.

18. The computer-implemented method of claim 12 , further comprising displaying on a graphical user interface a listing of at least some of the images of the sample under observation, wherein the listing of images includes images that were previously observed by a user along with the electron dose associated with each listed image.

19. The computer-implemented method of claim 11 , wherein the input data received from the electron microscope further includes metadata associated with each of the images of the sample under observation.

20. The computer-implemented method of claim 11 , further comprising performing predictive drift correction based on the registered movement of the sample under observation.

Assignments (2)
SECURITY INTEREST Recorded Mar 25, 2025
From: PROTOCHIPS, INC.
To: SALEM INVESTMENT PARTNERS IV, LIMITED PARTNERSHIP
Reel/Frame 070620/0055 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 23, 2024
From: WALDEN, FRANKLIN STAMPLEY, II; DAMIANO, JOHN, JR.; NACKASHI, DAVID P.; GARDINER, DANIEL STEPHEN; UEBEL, MARK; FRANKS, ALAN PHILIP; JACOBS, BENJAMIN
To: PROTOCHIPS, INC.
Reel/Frame 066546/0546 →
Continuity (7)
Continuation 17822237 · Aug 25, 2022
Continuation 17545651 · Dec 8, 2021
Continuation 17210702 · Mar 24, 2021
Continuation 16951297 · Nov 18, 2020
Continuation PCTUS2020045937 · Aug 12, 2020
Provisional Application 62888309 · Aug 16, 2019
Related Publication 20240196094A1 · Jun 13, 2024
References Cited (55)
US 5912462A · Takami · 1999 [cited by applicant]
US 6539106B1 · Gallarda · 2003 [cited by examiner]
US 11902665B2 · Walden, II · 2024 [cited by applicant]
US 20030201393A1 · Tsuneta et al. · 2003 [cited by applicant]
US 20040106862A1 · Kohama · 2004 [cited by applicant]
US 20050035302A1 · Morrison · 2005 [cited by applicant]
US 20050232493A1 · Satou et al. · 2005 [cited by applicant]
US 20060076492A1 · Taniguchi et al. · 2006 [cited by applicant]
US 20070023651A1 · Ishitani et al. · 2007 [cited by applicant]
US 20080073533A1 · Makino et al. · 2008 [cited by applicant]
US 20080135751A1 · Nishiyama · 2008 [cited by applicant]
US 20110233403A1 · Own · 2011 [cited by applicant]
US 20120104253A1 · Tsuneta et al. · 2012 [cited by applicant]
US 20140022600A1 · Phaneuf et al. · 2014 [cited by applicant]
US 20140226003A1 · Phaneuf · 2014 [cited by examiner]
US 20140231666A1 · Akima · 2014 [cited by applicant]
US 20140380531A1 · Ukraintsev et al. · 2014 [cited by applicant]
US 20150116470A1 · Ovod · 2015 [cited by applicant]
US 20150371102A1 · Yang · 2015 [cited by examiner]
US 20160064187A1 · Tomimatsu et al. · 2016 [cited by applicant]
US 20160172154A1 · Kakinuma et al. · 2016 [cited by applicant]
US 20170278664A1 · Sato et al. · 2017 [cited by applicant]
US 20180039054A1 · Hattori · 2018 [cited by applicant]
US 20180074306A1 · Visscher et al. · 2018 [cited by applicant]
US 20180204704A1 · Suzuki et al. · 2018 [cited by applicant]
US 20180204705A1 · Tomimatsu et al. · 2018 [cited by applicant]
US 20180286630A1 · Takekoshi · 2018 [cited by applicant]
US 20190017811A1 · Watanabe · 2019 [cited by examiner]
US 20190304745A1 · Suzuki et al. · 2019 [cited by applicant]
US 20210112203A1 · Walden, II · 2021 [cited by applicant]
US 20210134555A1 · Tanokuchi · 2021 [cited by applicant]
US 20210299665A1 · Drahotsky · 2021 [cited by applicant]
US 20220377244A1 · Walden, II · 2022 [cited by applicant]
US 20240267628A1 · Walden, II · 2024 [cited by applicant]
CN 108780729A · 2018 [cited by applicant]
JP 63202834A · 1988 [cited by applicant]
JP 2001118535A · 2001 [cited by applicant]
KR 1020180119699A · 2018 [cited by applicant]
KR 101964529B1 · 2019 [cited by applicant]
WIPO, International Preliminary Report on Patentability for corresponding International Patent Application No. PCT/US2023/061348 dated Jul. 30, 2024, 9 pages. [cited by applicant]
ISA/KR; International Search Report and Written Opinion for International Patent Application No. PCT/US2020/045937 dated Mar. 30, 2021, 18 pages. [cited by applicant]
USPTO; Non-Final Office Action for U.S. Appl. No. 16/951,297 dated Feb. 2, 2021, 11 pages. [cited by applicant]
USPTO; Non-Final Office Action for U.S. Appl. No. 17/210,702 dated Jan. 21, 2022, 8 pages. [cited by applicant]
USPTO; Non-Final Office Action for U.S. Appl. No. 17/545,651 dated Feb. 14, 2022, 7 pages. [cited by applicant]
WIPO; International Preliminary Report on Patentability for International Patent Application No. PCT/US2020/045937 dated Mar. 3, 2022, 13 pages. [cited by applicant]
JPO; Office Action for Japanese Patent Application No. 2021-568360 dated Apr. 19, 2022, 10 pages (includes translation). [cited by applicant]
CNIPA; Office Action for Chinese Patent Application No. 202080040044.0 dated Jun. 17, 2022, 8 pages (includes translation of first 2 pages). [cited by applicant]
EPO, Extended European Search Report for corresponding European Patent Application No. 20854644.0, mailed Aug. 5, 2022, 16 pages. [cited by applicant]
Marturi, N. et al.: “Fast image drift compensation in scanning electron microscope using image registration”, 2013 IEEE International Conference on Automation Science and Engineering (CASE), IEEE, Aug. 17, 2013 (Aug. 17… [cited by applicant]
JPO; Office Action for Japanese Patent Application No. 2021-568360 dated Jul. 26, 2022, 5 pages (includes translation). [cited by applicant]
JPO, Decision of Refusal for corresponding Japanese Patent Application No. 2021-568360, mailed Nov. 22, 2022, 5 pages. [cited by applicant]
EPO, Office Action for corresponding European Patent Application No. 20854644.0 mailed Jun. 20, 2023, 7 pages. [cited by applicant]
ISA/US; International Search Report and Written Opinion for corresponding International Patent Application No. PCT/US2023/061348, mailed Sep. 29, 2023, 12 pages. [cited by applicant]
USPTO, Non-Final Office Action for corresponding U.S. Appl. No. 18/437,770, mailed Aug. 30, 2024, 10 pages. [cited by applicant]
EPO, Partial European Search Report for corresponding European Patent Application No. 24182694.0, mailed Nov. 19, 2024, 17 pages. [cited by applicant]