IP Library Granted Patent US 10,356,391
Granted Patent B1
US 10,356,391 · App. 15/986,796 · Granted Jul 16, 2019

Computer generated three-dimensional models of microstructural features based on stereomicroscopy

Inventors: Benjamin P. Eftink (Santa Fe, NM); Stuart Andrew Maloy (Albuquerque, NM)
Assignee: Triad National Security, LLC
H04N13/207G06T7/74H01J37/20H01J37/222H01J37/244H01J2237/20207H01J2237/2802
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,356,391
App. No.
15/986,796
Granted
Jul 16, 2019
Kind
B1
Abstract

3D information may be extracted from two 2D images by capturing a first image of a sample at a first orientation. The sample may be titled at a second or different orientation, resulting in a second image of the titled sample to be captured. Third dimension of information may be extracted from the images.

Claims (56)

1. A computer-implemented method for extracting three-dimensional (3D) data to create a 3D representation from two two-dimensional (2D) images, the method comprising:

capturing a first image of a sample at a first orientation;

capturing a second image at a second or different orientation from that of the first orientation;

extracting 3D information using the first captured image and the second captured image to create a 3D representation;

incorporating crystallographic information into the 3D representation, wherein the incorporating of the crystallographic information comprises

determining a direction of each diffraction vector by subtracting pixel position of a transmitted beam with that of a diffracted beam and taking a z-direction to be zero;

transforming the direction of each diffraction vector to a zero-tilt orientation such that each diffraction vector direction is in a same frame of reference as points of features when the z-direction is in a direction of the foil thickness; and

using coordinate transformations to align x, y, and z coordinates of the positions with crystallographic directions.

2. The method of claim 1 , wherein the capturing of the first image comprises

using a transmission electron microscopy (TEM) to emit electrons from one side of the sample through an opposite side of the sample such that the electrons land on the detector.

3. The method of claim 1 , wherein the capturing of the second image comprises

tilting the sample with respect to an electron beam emitted from a transmission electron microscopy (TEM) to capture the second image.

4. The method of claim 1 , wherein the extracting of the 3D information comprises

extracting 3D position information from an amount of tilt between the captured first image and the second captured image and x and y coordinates in each of the first image and the second image.

5. The method of claim 4 , wherein the extracting of the 3D position information comprises

at two values of the tilt, measuring the x and y coordinates of each point corresponding to features in the captured first image and the captured second image.

6. The method of claim 5 , wherein the extracting of the 3D position information comprises

calculating a position of the second through last point individually with respect to the first point using the measured x and y coordinates with a calculated z coordinate.

7. The method of claim 1 , further comprising:

manipulating calculated coordinates for each point with coordinate transformations to determine a foil thickness, wherein the manipulating comprises

performing two rotations of the calculated coordinates, such that a z-direction is in a direction of the foil thickness and represents a zero-tilt frame of reference.

8. A non-transitory computer-readable medium comprising a computer program configured to extract 3D information from two 2D images, wherein the computer program, when executed by at least one processor, is configured to

capture a first image of a sample at a first orientation;

capture a second image at a second or different orientation from that of the first orientation;

extract 3D information using the first captured image and the second captured image to create a 3D representation from the 2D images;

index two diffraction vectors;

determine a direction of each diffraction vector by subtracting pixel position of a transmitted beam with that of a diffracted beam and taking a z-direction to be zero;

transform the direction of each diffraction vector to a zero-tilt orientation such that each diffraction vector direction is in a same frame of reference as points of features is the zero-tilt frame of reference; and

use coordinate transformations to align x, y, and z coordinates of the positions with crystallographic directions.

9. The non-transitory computer-readable medium of claim 8 , wherein the computer program is further configured to

use a transmission electron microscopy (TEM) to emit electrons from one side of the sample through an opposite side of the sample such that the electrons land on the detector.

10. The non-transitory computer-readable medium of claim 8 , wherein the computer program is further configured to

tilt the sample with respect to an electron beam emitted from a transmission electron microscopy (TEM) to capture the second image.

11. The non-transitory computer-readable medium of claim 8 , wherein the computer program is further configured to

extract 3D position information from an amount of tilt between the captured first image and the second captured image and x and y coordinates in each of the first image and the second image.

12. The non-transitory computer-readable medium of claim 11 , wherein the computer program is further configured to

at two values of the tilt, measure the x and y coordinates of each point corresponding to features in the captured first image and the captured second image.

13. The non-transitory computer-readable medium of claim 12 , wherein the computer program is further configured to

calculate a position of the second through last point individually with respect to the first point using the measured x and y coordinates with a calculated z coordinate.

14. The non-transitory computer-readable medium of claim 8 , wherein the computer program is further configured to

manipulate calculated coordinates for each point with coordinate transformations to determine a foil thickness, wherein the manipulating comprises

performing two rotations of the calculated coordinates, such that a z-direction is in a direction of the foil thickness and corresponds to a zero-tilt sample orientation in the microscope.

15. An apparatus configured to extract three-dimensional (3D) data to create a 3D representation from a two-dimensional (2D) image, the method comprising:

at least one processor;

memory comprising a set of instructions, wherein

the set of instructions are configured to cause the processor to

capture a first image of a sample at a first orientation;

capture a second image at a second or different orientation from that of the first orientation;

extract 3D information using the first captured image and the second captured image to create a 3D representation from the 2D images;

index two diffraction vectors;

determine a direction of each diffraction vector by subtracting pixel position of a transmitted beam with that of a diffracted beam and taking a z-direction to be zero;

transform the direction of each diffraction vector to a zero-tilt orientation such that each diffraction vector direction is in a same frame of reference as points of features is the zero-tilt frame of reference; and

use coordinate transformations to align x, y, and z coordinates of the positions with crystallographic directions.

16. The apparatus of claim 15 , wherein the set of instructions are further configured to cause the processor to use a transmission electron microscopy (TEM) to emit electrons from one side of the sample through an opposite side of the sample such that the electrons land on the detector.

17. The method of claim 15 , wherein the set of instructions are further configured to cause the processor to tilt the sample with respect to an electron beam emitted from a transmission electron microscopy (TEM) to capture the second image.

18. The method of claim 15 , wherein the set of instructions are further configured to cause the processor extract 3D position information from an amount of tilt between the captured first image and the second captured image and x and y coordinates in each of the first image and the second image.

Assignments (3)
CONFIRMATORY LICENSE Recorded May 18, 2020
From: TRIAD NATIONAL SECURITY, LLC
To: U.S. DEPARTMENT OF ENERGY
Reel/Frame 052683/0788 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 1, 2018
From: LOS ALAMOS NATIONAL SECURITY, LLC
To: TRIAD NATIONAL SECURITY, LLC
Reel/Frame 047396/0489 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 22, 2018
From: EFTINK, BENJAMIN P; MALOY, STUART ANDREW
To: LOS ALAMOS NATIONAL SECURITY, LLC
Reel/Frame 045877/0340 →
Continuity (1)
Provisional Application 62519357 · Jun 14, 2017