IP Library › Granted Patent US 12,525,428
Granted Patent B1
US 12,525,428 · App. 18/165,757 · Granted Jan 13, 2026

Sparse sampling using a programmatically randomized signal modulating a carrier signal

Inventors: Edward Principe (Melbourne Beach, FL); Andrew Stevens (Southlake, TX); Conan Weiland (Manorville, NY); Jeffrey Hagen (Independence, MN); Brian Kempshall (Cocoa, FL); Kirk Scammon (Cocoa, FL); Zachary Russell (Boone, NC); Shane Didona (Durham, NC); Mathieu Therezien (Vancouver, CA); Tomas McIntee (Chapel Hill, NC)
Assignee: Synchrotron Research, Inc.
H01J37/265H01J37/28H01J2237/2487
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,525,428
App. No.
18/165,757
Granted
Jan 13, 2026
Kind
B1
Abstract

A system including a sparse sampling system having a processor and a non-transitory computer-readable medium. The sparse sampling system generates, a first programmable primary carrier signal and a first secondary programmable signal that modulates the first programmable primary carrier signal through a first randomized modulation that defines X-coordinates of a set of scan pattern coordinates of an object scan, a second programmable primary carrier signal and a second secondary programmable signal that modulates the second programmable primary carrier signal through a second randomized modulation that defines Y-coordinates of the set of scan pattern coordinates of the object scan, and a third programmable output signal that defines Z-coordinates of the set of scan pattern coordinates of the object scan based on a predetermined rule. The sparse sampling system also transmits the generated signals to a scanning probe device.

Claims (41)

1 . A system comprising:

a sparse sampling system having a processor and a non-transitory computer-readable medium, the sparse sampling system configured to generate:

a first programmable primary carrier signal and a first secondary programmable signal that modulates the first programmable primary carrier signal through a first randomized modulation that defines X-coordinates of a set of scan pattern coordinates of an object scan;

a second programmable primary carrier signal and a second secondary programmable signal that modulates the second programmable primary carrier signal through a second randomized modulation that defines Y-coordinates of the set of scan pattern coordinates of the object scan, wherein each of the first and second programmable primary carrier signals comprises X-Y components of a at least two-dimensional space-filling curve, and wherein a resultant randomized modulation produced by combined action of the first and second secondary programmable signals is independent of the at least two-dimensional space-filling curve;

a third programmable output signal that defines Z-coordinates of the set of scan pattern coordinates of the object scan based on a predetermined rule, and

wherein the sparse sampling system is further configured to transmit the generated first and second programmable primary carrier signals, the first and second secondary programmable signals, and the third programmable output signal to a scanning probe device.

2 . The system of claim 1 and wherein the X-coordinates and the Y-coordinates of the set of scan pattern coordinates of the object scan sample less than 100% of a predetermined set of addressable picture elements of the object scan.

3 . The system of claim 1 and wherein the X-coordinates, Y-coordinates and Z-coordinates of the set of scan pattern coordinates of the object scan sample less than 100% of a predetermined set of addressable picture elements of the object scan.

4 . The system of claim 1 and wherein the third programmable primary carrier signal comprises Z-components of a three-dimensional space-filling curve.

5 . The system of claim 1 and wherein:

the first programmable primary carrier signal is divided into different sub-divisions, and wherein each of the different sub-divisions is modulated by the first secondary programmable signal through the first randomized modulation to provide different subsets of X-coordinates that together define the X-coordinates of the set of scan pattern coordinates of the object scan; and

the second programmable primary carrier signal is divided into different sub-divisions, and wherein each of the different sub-divisions is modulated by the second secondary programmable signal through the second randomized modulation to provide different subsets of Y-coordinates that together define the Y-coordinates of the set of scan pattern coordinates of the object scan.

6 . The system of claim 1 and wherein the predetermined rule comprises defining the Z-coordinates of the set of scan pattern coordinates of the object scan by a third programmable primary carrier signal and a third secondary programmable signal that modulates the third programmable primary carrier signal through a third randomized modulation, wherein the third programmable primary carrier signal and the third secondary programmable signal constitute the third programmable output signal.

7 . The system of claim 6 and wherein:

the first programmable primary carrier signal is divided into different sub-divisions, and wherein each of the different sub-divisions is modulated by the first secondary programmable signal through the first randomized modulation to provide different subsets of X-coordinates that together define the X-coordinates of the set of scan pattern coordinates of the object scan;

the second programmable primary carrier signal is divided into different sub-divisions, and wherein each of the different sub-divisions is modulated by the second secondary programmable signal through the second randomized modulation to provide different subsets of Y-coordinates that together define the Y-coordinates of the set of scan pattern coordinates of the object scan; and

the third programmable primary carrier signal is divided into different sub-divisions, and wherein each of the different sub-divisions is modulated by the third secondary programmable signal through the third randomized modulation to provide different subsets of Z-coordinates that together define the Z-coordinates of the set of scan pattern coordinates of the object scan.

8 . The system of claim 6 and wherein the third programmable primary carrier signal comprises Z-components of a three-dimensional space-filling curve.

9 . The system of claim 8 and wherein the three-dimensional space-filling curve comprises a three-dimensional Hilbert space-filling curve.

10 . The system of claim 1 and wherein the predetermined rule comprises the Z-coordinates of the set of scan pattern coordinates of the object scan defined as discretized on at least two pre-defined Z-planes, such that different non-overlapping subsets of the Z-coordinates lie on different Z-planes of the at least two pre-defined Z-planes.

11 . The system of claim 10 and wherein the X-coordinates and Y-coordinates form pairs of X-Y coordinates, and wherein each different pre-defined Z-plane of the at least two different pre-defined Z-planes comprises a different non-overlapping subset of the pairs of X-Y coordinates.

12 . The system of claim 1 and wherein the predetermined rule comprises defining Z-coordinates as being modulated randomly in positive or negative directions relative to at least two pre-defined Z planes, such that a first non-overlapping subset of the Z-coordinates is modulated randomly in the positive or negative directions relative to a first pre-defined Z-plane of the at least two pre-defined Z-planes, and a second non-overlapping subset of the Z-coordinates is modulated randomly in the positive or negative directions relative to a second pre-defined Z-plane of the at least two pre-defined Z-planes, and wherein a modulation magnitude is equal to or less than half a distance between the first pre-defined Z-pane and the second pre-defined Z-plane.

13 . The system of claim 1 and wherein the predetermined rule comprises defining the Z-coordinates of the set of scan pattern coordinates of the object scan by a third programmable primary carrier signal and a third secondary programmable signal that modulates the third programmable primary carrier signal through a third randomized modulation in a positive or a negative Z-direction.

14 . The system of claim 1 and wherein the sparse sampling system comprises a controller and a signal converter coupled to the controller, and wherein the signal converter comprises at least one digital-to-analog converter (DAC), and wherein the controller is configured to provide the first and second programmable primary carrier signals and the first and second secondary programmable signals to the signal converter.

15 . The system of claim 1 and wherein the sparse sampling system comprises a controller configured to provide the first and second programmable primary carrier signals and the first and second secondary programmable signals to digital signal inputs on the scanning probe device.

16 . The system of claim 1 and wherein the Z-coordinates of the set of scan pattern coordinates of the object scan are defined by a third programmable primary carrier signal and a third secondary programmable signal that modulates the third programmable primary carrier signal through a third randomized modulation, and wherein the sparse sampling system comprises a controller and a signal converter coupled to the controller, and wherein the signal converter comprises at least one digital-to-analog converter (DAC), and wherein the controller is configured to provide the third programmable primary carrier signal and the third secondary programmable signal to the signal converter.

17 . The system of claim 1 and wherein the sparse sampling system comprises a controller configured to provide signals that define Z-coordinates of the scan pattern coordinates of the object scan to digital signal inputs on the scanning probe device.

18 . A method comprising:

generating, by a sparse sampling system having a processor and a non-transitory computer-readable medium, a first programmable primary carrier signal and a first secondary programmable signal that modulates the first programmable primary carrier signal through a first randomized modulation that defines X-coordinates of a set of scan pattern coordinates of an object scan;

generating, by the sparse sampling system, a second programmable primary carrier signal and a second secondary programmable signal that modulates the second programmable primary carrier signal through a second randomized modulation that defines Y-coordinates of the set of scan pattern coordinates of the object scan, wherein each of the first and second programmable primary carrier signals comprises X-Y components of a at least two-dimensional space-filling curve, and wherein a resultant randomized modulation produced by combined action of the first and second secondary programmable signals is independent of the at least two-dimensional space-filling curve;

generating, by the sparse sampling system, a third programmable output signal that defines Z-coordinates of the set of scan pattern coordinates of the object scan based on a predetermined rule, and

transmitting, by the sparse sampling system, the generated first and second programmable primary carrier signals, the first and second secondary programmable signals, and the third programmable output signal to a scanning probe device.

19 . An apparatus comprising:

a sparse sampling pattern generator configured to generate:

a first programmable primary carrier signal and a first secondary programmable signal that modulates the first primary carrier signal through a first randomized modulation that defines X-coordinates of a set of scan pattern coordinates of an object scan; and

a second programmable primary carrier signal and a second secondary programmable signal that modulates the second primary carrier signal through a second randomized modulation that defines Y-coordinates of the set of scan pattern coordinates of the object scan; and

a third programmable output signal that defines Z-coordinates of the set of scan pattern coordinates of the object scan based on a predetermined rule;

a controller coupled to the sparse sampling pattern generator and configured to provide the first and second programmable primary carrier signal, the first and second secondary programmable signal, and the third programmable output signal to scan inputs of a scanning probe device configured to scan an object;

at least one object signal response converter configured to receive analog scan response signals from at least one object response detector that detects a response of the object to scan probe signals directed at the object by the scanning probe device, the at least one object response converter coupled to the controller and configured to convert the analog scan response signals to digital scan response signals; and

a sampling reconstruction system communicatively coupled to the controller, the sampling reconstruction system configured to receive the digital scan response signals from the controller, and responsively reconstruct an amalgamate image of the object scanned by the scanning probe device from the sampled object response signals.

20 . The apparatus of claim 19 , and wherein the sampling reconstruction system is configured to reconstruct the amalgamate image using adaptive real-time inpainting.

Continuity (1)
Continuation In Part 17394704 · Aug 5, 2021
References Cited (48)
US 5543935A · Harrington · 1996 [cited by applicant]
US 5866300A · Satoh et al. · 1999 [cited by applicant]
US 6008489A · Elings et al. · 1999 [cited by applicant]
US 6057907A · Satoh et al. · 2000 [cited by applicant]
US 6628322B1 · Cerruti · 2003 [cited by applicant]
US 7312448B2 · Principe · 2007 [cited by applicant]
US 7755645B2 · Sun · 2010 [cited by examiner]
US 8178838B2 · Principe · 2012 [cited by applicant]
US 9620330B2 · Potocek et al. · 2017 [cited by applicant]
US 10002742B2 · Potocek et al. · 2018 [cited by applicant]
US 10109453B2 · Stevens et al. · 2018 [cited by applicant]
US 10170274B2 · Stevens et al. · 2019 [cited by applicant]
US 10224175B2 · Stevens et al. · 2019 [cited by applicant]
US 10256072B2 · Stevens et al. · 2019 [cited by applicant]
US 10541109B2 · Stanfill et al. · 2020 [cited by applicant]
US 10580614B2 · Stevens et al. · 2020 [cited by applicant]
US 20080106654A1 · Benner · 2008 [cited by applicant]
US 20100302086A1 · Dudgeon et al. · 2010 [cited by applicant]
US 20120038786A1 · Kelly · 2012 [cited by examiner]
US 20150371815A1 · Potocek et al. · 2015 [cited by applicant]
US 20160118219A1 · Potocek et al. · 2016 [cited by applicant]
US 20160275639A1 · Holub · 2016 [cited by examiner]
US 20180025887A1 · Kovarik · 2018 [cited by examiner]
US 20200411278A1 · Nagai · 2020 [cited by applicant]
US 20220239384A1 · Hill et al. · 2022 [cited by applicant]
CN 103090971A · 2013 [cited by applicant]
JP H0974060A · 1997 [cited by applicant]
JP 2016004785A · 2016 [cited by applicant]
JP 2016085966A · 2016 [cited by applicant]
JP 2020501130A · 2020 [cited by examiner]
WO 2012078415A2 · 2012 [cited by applicant]
WO WO2020242778A1 · 2020 [cited by examiner]
WO WO2013052535A1 · 2021 [cited by examiner]
Willett, Rebecca, Smooth Continuous Trajectory Errata, “Errata: Sampling Trajectories for Sparse Image Recovery”, Duke University, 2011, 12 pages. [cited by applicant]
Willett, Rebecca, Trajectory Errata, “Errata: Sampling Trajectories for Sparse Image Recovery”, Duke University, 2011, 12 pages. [cited by applicant]
Stevens, Andrew et al., “Subsampled STEM-Ptychography”, Jul. 5, 2018, 5 pages. [cited by applicant]
Stevens, Andrew, “Compressive Sensing in Transmission Electron Microscopy”, Dissertation submitted in partial fulllment of the requirements for the degree of Doctor of Philosophy in the Department of Electrical & Comput… [cited by applicant]
Stevens, A. et al., “A sub-sampled approach to extremely low-dose STEM”, Citation: Appl. Phys. Lett. 112, 043104 (2018); View online: https://doi.org/10.1063/1.5016192; View Table of Contents: http://aip.scitation.org/t… [cited by applicant]
Kovarik, L. et al., “Implementing an accurate and rapid sparse sampling approach for low-dose atomic resolution STEM imaging”, Cite as: Appl. Phys. Lett. 109, 164102 (2016); https://doi.org/10.1063/1.4965720; Submitted:… [cited by applicant]
Willett, Rebecca M., “Smooth Sampling Trajectories for Sparse Recovery in MRI”, Department of Electrical and Computer Engineering, Duke University, Durham, NC 27708, 978-1-4244-4128-0/11/$25.00 © 2011 IEEE, 1044, ISBI 2… [cited by applicant]
Hujsak, Karl et al., “Suppressing Electron Exposure Artifacts: An Electron Scanning Paradigm with Bayesian Machine Learning”, Microsc. Microanal., p. 1 of 11, doi: 10.1017/S1431927616011417, © Microscopy Society of Amer… [cited by applicant]
Béché, A. et al., “Development of a fast electromagnetic beam blanker for compressed sensing in scanning transmission electron microscopy”, Cite as: Appl. Phys. Lett. 108, 093103 (2016); https://doi.org/10.1063/1.494308… [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2022/38700, dated Jan. 3, 2023, 8 pages. [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2023/012550, dated May 23, 2023, 14 pages. [cited by applicant]
European search report for European patent application No. 22853726.2, dated Sep. 13, 2024, 5 pages. [cited by applicant]
Communication pursuant to Article 94(3) EPC for European patent application No. 22853726.2, dated Sep. 25, 2024, 7 pages. [cited by applicant]
Invitation pursuant to Rule 62a(1) EPC, for European Patent Application No. 22 853 726.2, dated Jul. 19, 2024, 2 pages. [cited by applicant]
Notice of Reasons for Rejection, for Japanese Patent Application No. 2024-506175, dated Jun. 18, 2024, 8 pages. [cited by applicant]