IP Library Granted Patent US 12,130,858
Granted Patent B2
US 12,130,858 · App. 18/244,587 · Granted Oct 29, 2024

Systems and methods of metadata and image management for reviewing data from transmission electron microscope (TEM) sessions

Inventors: Franklin Stampley Walden, II (Raleigh, NC); John Damiano, Jr. (Holly Springs, NC); David P. Nackashi (Raleigh, NC); Daniel Stephen Gardiner (Wake Forest, NC); Mark Uebel (Morrisville, NC); Alan Philip Franks (Durham, NC); Joshua Friend (Raleigh, NC); Katherine Elizabeth Marusak (Cary, NC)
Assignee: Protochips, Inc.
G06F16/535G06F16/51G06F16/538G06F16/5866G06T1/0007G06T7/20G06T11/60G06T2200/24G06T2207/10061
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,130,858
App. No.
18/244,587
Granted
Oct 29, 2024
Kind
B2
Abstract

Disclosed herein are methods and systems of metadata management for reviewing data from microscopy experimental sessions. Image data from an experimental session is stored in an archive at one or more filepath locations, either locally or on a network. Metadata associated with the image data is stored in a database with a reference to the filepath where the raw image is stored, such that the metadata is associated in the database with the image data. A user can perform post-experimental filtering, sorting, and searching of the underlying image data using the metadata, which allows the image data to be analyzed without duplication of the image data and without manual review of each individual image. The filtered data is presented in an interactive timeline format.

Claims (51)

1. A system for managing metadata from an experimental session on an electron microscope, the system comprising:

an electron microscope; and

a computer system communicatively coupled to the electron microscope, the computer system comprising:

a memory;

a database; and

at least one processor configured for:

receiving, from the electron microscope, metadata associated with the experimental session performed using the electron microscope;

receiving, from the electron microscope, image data comprising a plurality of images captured during the experimental session;

storing the metadata;

storing the image data;

associating at least some of the metadata with one or more images of the plurality of images in the image data;

filtering the image data based on the associated metadata; and

generating a visual representation of the filtered image data.

2. The system of claim 1 , wherein the at least one processor is further configured for generating additional metadata based on the image data or the metadata received from the electron microscope.

3. The system of claim 2 , wherein the additional metadata is generated by performing image processing of at least some of the image data, wherein the image processing is performed as the image data is captured by the electron microscope or as part of post-processing after the image data has been captured by the electron microscope.

4. The system of claim 1 , wherein the metadata includes session data associated with the experimental session rather than a specific image from the plurality of images.

5. The system of claim 1 , wherein the metadata includes measurements taken during the experimental session.

6. The system of claim 1 , wherein the metadata includes a note input by a user related to the image data or the experimental session.

7. The system of claim 1 , wherein the metadata includes a determined focus score associated with a specific image from the plurality of images.

8. The system of claim 1 , wherein the metadata is received separately from the image data.

9. The system of claim 1 , wherein metadata associated with a specific image from the plurality of images is received separately from a specific image the metadata is associated with.

10. A computer system for managing metadata from an experimental session on an electron microscope, the computer system comprising:

a memory;

a database; and

at least one processor configured for:

receiving, from the electron microscope, metadata associated with the experimental session performed using the electron microscope;

receiving, from the electron microscope, image data comprising a plurality of images captured during the experimental session;

storing the metadata;

storing the image data;

associating at least some of the metadata with one or more images of the plurality of images in the image data;

generating a visual representation of at least one image of the plurality of images in the image data,

wherein the visual representation includes an interactive timeline, the at least one image of the plurality of images, and metadata associated with the at least one image of the plurality of images; and

updating the visual representation of the at least one image of the plurality of images and the associated metadata for the interactive timeline.

11. The computer system of claim 10 , wherein the at least one processor is further configured for generating additional metadata based on the image data or the metadata received from the electron microscope.

12. The computer system of claim 11 , wherein the additional metadata is generated by performing image processing of at least some of the image data, wherein the image processing is performed as the image data is captured by the electron microscope or as part of post-processing after the image data has been captured by the electron microscope.

13. The computer system of claim 10 , wherein the metadata includes session data associated with the experimental session rather than a specific image from the plurality of images.

14. The computer system of claim 10 , wherein the metadata includes measurements taken during the experimental session.

15. The computer system of claim 10 , wherein the metadata includes a note input by a user related to the image data or the experimental session.

16. The computer system of claim 10 , wherein the metadata includes a determined focus score associated with a specific image from the plurality of images.

17. The computer system of claim 10 , wherein the metadata is received separately from the image data.

18. The computer system of claim 10 , wherein metadata associated with a specific image from the plurality of images is received separately from a specific image the metadata is associated with.

19. A non-transitory computer-readable storage medium, the non-transitory computer-readable storage medium storing instructions to be implemented on at least one computing device including at least one processor, the instructions when executed by the at least one processor cause the at least one computing device to perform a method of managing metadata from an experimental session on an electron microscope, the method comprising:

receiving, from the electron microscope, metadata associated with the experimental session performed using the electron microscope;

receiving, from the electron microscope, image data comprising a plurality of images captured during the experimental session;

storing the metadata;

storing the image data;

associating at least some of the received metadata with one or more images of the plurality of images in the image data;

filtering the image data based on the metadata;

generating a collection of filtered image data; and

associating at least one metadata tag with the collection of filtered image data.

20. The non-transitory computer-readable storage medium of claim 19 , wherein the instructions further cause the at least one computing device to generate additional metadata based on the image data or the metadata received from the electron microscope.

Assignments (2)
SECURITY INTEREST Recorded Mar 25, 2025
From: PROTOCHIPS, INC.
To: SALEM INVESTMENT PARTNERS IV, LIMITED PARTNERSHIP
Reel/Frame 070620/0055 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 11, 2023
From: WALDEN, FRANKLIN STAMPLEY, II; DAMIANO, JOHN, JR.; NACKASHI, DAVID P.; GARDINER, DANIEL STEPHEN; UEBEL, MARK; FRANKS, ALAN PHILIP; FRIEND, JOSHUA; MARUSAK, KATHERINE ELIZABETH
To: PROTOCHIPS, INC.
Reel/Frame 064861/0858 →
Continuity (5)
Continuation 17931466 · Sep 12, 2022
Continuation 17715831 · Apr 7, 2022
Continuation PCTUS2022023892 · Apr 7, 2022
Provisional Application 63171692 · Apr 7, 2021
Related Publication 20230418863A1 · Dec 28, 2023
Cited By (1)
US 12,700,247