Granted Patent B2

US 12,602,775 · App. 17/742,463 · Granted Apr 14, 2026

Inventors: Sanjay M. Joshi (Andover, MA); Arjang Noushin (Nashua, NH); Neil Crawford (Chandler, AZ)

Assignee: Globus Medical Inc.

G06T7/0012A61B34/20G06T3/10G06T7/55G06T7/73G06T17/20G06V10/26A61B2034/2055G06T2207/10081G06T2207/10088G06T2207/10116G06T2207/20081G06T2207/20084

Abstract

Claims (48)

1 . A system configured to generate a medical image, the system comprising:

a neural network pre-trained with a set of images containing internal tissue of an anatomical object of a plurality of patients, the neural network including:

a pre-trained encoder configured to receive an input image and generate a content vector as an output, the content vector representing what features of the anatomical object are present in the input image; and

a pre-trained decoder configured to receive the content vector to generate an interpolated image as an output;

processing circuitry coupled to the neural network; and

memory coupled to the processing circuitry and having instructions stored therein that are executable by the processing circuitry to cause the system to perform operations including:

obtaining a first two-dimensional image of an anatomical object;

using the encoder, extracting first information associated with the anatomical object from the first image, the first information containing the content vector of the first image;

obtaining a second two-dimensional image of the anatomical object;

using the encoder, extracting second information associated with the anatomical object from the second image, the second information containing the content vector of the second image;

interpolating the first and second information to generate an interpolated content vector;

using the decoder, generating the medical image based on the interpolated content vector.

2 . The system of claim 1 , wherein the first information and second information each include an attribute of a characteristic of the anatomical object, and wherein the predetermined information includes characteristics of the anatomical objects.

3 . The system of claim 1 , the operations further comprising:

interpolated content vector and the predetermined information that is associated with images of anatomical objects of a type that is a type of the anatomical object.

4 . The system of claim 3 , wherein the first image is an image of the anatomical object from a first position and a first pose,

wherein the second image is an image of the anatomical object from a second position and a second pose, the second position being different than the first position and/or the second pose being different than the first pose,

wherein interpolating includes:

generating a plurality of interpolations between the first information and second information, each interpolation of the plurality of interpolations being generated by assigning a different weight to the first information relative to the second information; and

selecting an interpolation of the plurality of interpolations as the interpolated content vector based on a feature of the anatomical object being represented better by the interpolation than another interpolation of the plurality of interpolations.

5 . The system of claim 3 , wherein the predetermined information includes a globally-optimized style vector, the style vector representing where the features are located in the input image.

6 . The system of claim 3 , the operations further comprising:

determining the predetermined information based on a feature of the object that is desired to be better illustrated in the medical image.

7 . The system of claim 3 , wherein the predetermined information includes an indication of a way of segmenting anatomical objects, highlighting portions of the anatomical object, and labeling parts of the anatomical object, and

wherein the medical image includes a segmented version of the anatomical object, with portions of the anatomical object highlighted, and parts of the anatomical object labeled based on the predetermined information.

8 . The system of claim 1 , further comprising:

an x-ray detector coupled to the processing circuitry,

wherein obtaining the first image includes capturing, by the x-ray detector, the first image, and

wherein obtaining the second image includes capturing, by the x-ray detector, the second image.

9 . The system of claim 1 , the operations further comprising at least one of:

displaying the medical image;

providing the medical image to a robotic surgery system.

10 . A system configured to generate a medical image, the system comprising:

a neural network pre-trained with a set of non-optical images containing an anatomical object of a plurality of patients, the neural network including:

a pre-trained encoder configured to receive an input image and generate a content vector as an output, the content vector representing what features of the anatomical object are present in the input image; and

a pre-trained decoder configured to receive the content vector to generate an interpolated image as an output;

processing circuitry coupled to the neural network; and

memory storing the neutral network and coupled to the processing circuitry, the processing circuitry programmed to execute the following instructions:

obtaining a first non-optical image of an anatomical object containing internal features under a skin;

using the pre-trained encoder of the neural network, extracting the content vector associated with the anatomical object from the first image;

obtaining a second non-optical image of the anatomical object containing internal features under a skin;

using the pre-trained encoder of the neural network, extracting second information associated with the anatomical object from the second image, the second information containing the content vector of the second image;

interpolating the first and second information to generate an interpolated content vector;

using the pre-trained decoder of the neural network, generating the medical image based on the interpolated content vector.

11 . The system of claim 10 , wherein the first and second images are 2-dimensional x-ray images and the generated medical image is an x-ray image which has been interpolated from the first and second x-ray images.

12 . The system of 11 , the processing circuitry further programmed to execute the following instructions:

repeating the instructions of generating the medical image for M sets of first and second images to generate N medical images;

using the N sets of first and second images and N medical images, generating a 3-dimensional CT image for purposes of reducing x-ray exposure to the patient.

Assignments (1)

Continuity (1)

References Cited (400)