IP Library Granted Patent US 12,010,430
Granted Patent B2
US 12,010,430 · App. 17/822,237 · Granted Jun 11, 2024

Automated application of drift correction to sample studied under electron microscope

Inventors: Franklin Stampley Walden, II (Raleigh, NC); John Damiano, Jr. (Holly Springs, NC); David P. Nackashi (Raleigh, NC); Daniel Stephen Gardiner (Wake Forest, NC); Mark Uebel (Morrisville, NC); Alan Philip Franks (Durham, NC); Benjamin Jacobs (Apex, NC)
Assignee: Protochips, Inc.
H04N23/695G06T7/215G06T7/337G06T2207/10061
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,010,430
App. No.
17/822,237
Granted
Jun 11, 2024
Kind
B2
Abstract

Control system configured for sample tracking in an electron microscope environment registers a movement associated with a region of interest located within an active area of a sample under observation with an electron microscope. The registered movement includes at least one directional constituent. The region of interest is positioned within a field of view of the electron microscope. The control system directs an adjustment of the electron microscope control component to one or more of dynamically center and dynamically focus the view through the electron microscope of the region of interest. The adjustment comprises one or more of a magnitude element and a direction element.

Claims (35)

1. A control system configured for tracking a sample under observation during an experimental session in an electron microscope, the control system comprising:

a memory; and

a processor;

wherein the processor of the control system is configured for:

tracking movement of the sample under observation as the sample changes during the experimental session,

wherein the movement of the sample is tracked within a region of interest positioned within a field of view of the electron microscope,

wherein the movement of the sample is tracked by comparing a live image of the sample against a template image of the region of interest;

determining a drift vector of the sample based on the tracked movement, wherein the drift vector includes an X-direction component and a Y-direction component;

adjusting the region of interest to correct for drift of the sample during the experimental session using the determined drift vector; and

morphing the template image to approximate the live image of the sample under observation using image filters.

2. The control system of claim 1 , wherein the processor of the control system is further configured for adjusting a plurality of settings of the electron microscope in response to the determined drift vector to improve the live image of the sample.

3. The control system of claim 1 , wherein the template image is morphed using frame averaging over the region of interest.

4. The control system of claim 1 , wherein the processor of the control system is further configured for recording the movement of the sample over a period of time during the experimental session to generate a map of the movement.

5. The control system of claim 4 , wherein the generated map is a two-dimensional map of a history of movements occurring in the region of interest.

6. The control system of claim 4 , wherein the generated map is a three-dimensional map of a history of movements occurring in the region of interest.

7. The control system of claim 1 , wherein the drift vector further includes a Z-direction component.

8. The control system of claim 7 , wherein the processor of the control system is further configured for adjusting a focus level of the electron microscope in the Z-direction to an optimal focus height for the region of interest in response to the determined drift vector.

9. The control system of claim 1 , wherein the processor of the control system is further configured for analyzing variance of pixel intensities in the live image to determine a focus score for the region of interest.

10. The control system of claim 9 , wherein the focus score is determined using at least one of the following: a Fast Fourier Transform calculation of the pixel intensities, a contrast transfer function analysis of the pixel intensities, and a beam tilt analysis of the pixel intensities.

11. A method of tracking a sample under observation during an experimental session in an electron microscope, the method comprising:

tracking movement of the sample under observation as the sample changes during the experimental session,

wherein the movement of the sample is tracked within a region of interest positioned within a field of view of the electron microscope,

wherein the movement of the sample is tracked by comparing a live image of the sample against a template image of the region of interest;

determining a drift vector of the sample based on the tracked movement, wherein the drift vector includes an X-direction component and a Y-direction component;

adjusting the region of interest to correct for drift of the sample during the experimental session using the determined drift vector; and

morphing the template image to approximate the live image of the sample under observation using image filters.

12. The method of claim 11 , further comprising adjusting a plurality of settings of the electron microscope in response to the determined drift vector to improve the live image of the sample.

13. The method of claim 11 , wherein the template image is morphed using frame averaging over the region of interest.

14. The method of claim 11 , further comprising recording the movement of the sample over a period of time during the experimental session to generate a map of the movement.

15. The method of claim 14 , wherein the generated map is a two-dimensional map of a history of movements occurring in the region of interest.

16. The method of claim 14 , wherein the generated map is a three-dimensional map of a history of movements occurring in the region of interest.

17. The method of claim 11 , wherein the drift vector further includes a Z-direction component.

18. The method of claim 17 , further comprising adjusting a focus level of the electron microscope in the Z-direction to an optimal focus height for the region of interest in response to the determined drift vector.

19. The method of claim 11 , further comprising analyzing variance of pixel intensities in the live image to determine a focus score for the region of interest.

20. The method of claim 19 , wherein the focus score is determined using at least one of the following: a Fast Fourier Transform calculation of the pixel intensities, a contrast transfer function analysis of the pixel intensities, and a beam tilt analysis of the pixel intensities.

Assignments (2)
SECURITY INTEREST Recorded Feb 23, 2024
From: PROTOCHIPS, INC.
To: SALEM INVESTMENT PARTNERS IV, LIMITED PARTNERSHIP
Reel/Frame 066548/0117 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 25, 2022
From: WALDEN, FRANKLIN STAMPLEY, II; DAMIANO, JOHN, JR.; NACKASHI, DAVID P.; GARDINER, DANIEL STEPHEN; UEBEL, MARK; FRANKS, ALAN PHILIP; JACOBS, BENJAMIN
To: PROTOCHIPS, INC.
Reel/Frame 060899/0430 →
Continuity (6)
Continuation 17545651 · Dec 8, 2021
Continuation 17210702 · Mar 24, 2021
Continuation 16951297 · Nov 18, 2020
Continuation PCTUS2020045937 · Aug 12, 2020
Provisional Application 62888309 · Aug 16, 2019
Related Publication 20220408024A1 · Dec 22, 2022