IP Library › Granted Patent US 12,514,653

Granted Patent B2

US 12,514,653 · App. 18/662,863 · Granted Jan 6, 2026

Systems, methods, and devices for generating a hybrid image

Inventors: Stephanie Elizabeth Wiegel (Lafayette, CO); Aditya R. Dalvi (Broomfield, CO); Andrew J. Koert (Golden, CO)

Assignee: Medtronic Navigation, Inc.

A61B34/20 A61B6/5247 G06T11/60 A61B2034/2063 G06T2210/41

View Patent ↗

Loading inventors, assignments & file history…

Monitor This Case

Get email alerts when status or documents change.

Order Certified Copies

Most orders are placed with the USPTO same day — all within 24 business hours.

Order via The Patent Place →

Pre-filled with this patent's details

Quick Facts

Patent No.: US 12,514,653
App. No.: 18/662,863
Filed: May 13, 2024
Granted: Jan 6, 2026
Kind: B2
Examiner: BRUTUS, JOEL F
Art Unit: 3798
USPC: 600/424

External Links

USPTO Patent Center↗ Full Patent PDF↗

Abstract

Systems, methods, and devices for generating a hybrid image are provided. A preoperative image may be received. A first intraoperative image may be received from an imaging device. The preoperative image and the first intraoperative image may be input into a hybrid model that combines the first intraoperative image with the preoperative image. A hybrid image comprising the preoperative image combined with the first intraoperative image may be generated with an output of the hybrid model.

Claims (65)

1 . A system for generating a hybrid image comprising:

an imaging device;

a processor; and

a memory storing data for processing by the processor, the data, when processed, causing the processor to:

receive a preoperative image depicting at least one anatomical element;

receive a first intraoperative image from the imaging device, the first intraoperative image depicting the at least one anatomical element;

input the preoperative image and the first intraoperative image into a hybrid model, the hybrid model configured to combine the first intraoperative image with the preoperative image;

generate, with a first output of the hybrid model, a hybrid image comprising the preoperative image combined with the first intraoperative image;

receive a second intraoperative image depicting the at least one anatomical element;

compare the second intraoperative image to the first intraoperative image;

detect movement of the at least one anatomical element based on the comparison;

input the preoperative image and the second intraoperative image into the hybrid model in response to detecting the movement of the at least one anatomical element; and

generate, with a second output of the hybrid model, an updated hybrid image comprising the preoperative image and the second intraoperative image which replaces the first intraoperative image.

2 . The system of claim 1 , wherein the preoperative image comprises an x-ray image and the second intraoperative image comprises an ultrasound image.

3 . The system of claim 1 , wherein the memory stores further data for processing by the processor that, when processed, causes the processor to:

receive pose information of the imaging device, the pose information correlating to one or more poses of the imaging device when the second intraoperative image was obtained; and

generate a three-dimensional representation of the at least one anatomical element based on the preoperative image, the second intraoperative image, and the pose information.

4 . The system of claim 3 , wherein the memory stores further data for processing by the processor that, when processed, causes the processor to:

generate a preoperative three-dimensional representation of the at least one anatomical element using only the preoperative image; and

combine the preoperative three-dimensional representation with the three-dimensional representation.

5 . The system of claim 1 , wherein the memory stores further data for processing by the processor that, when processed, causes the processor to:

generate instructions for navigating at least one surgical instrument based on the updated hybrid image.

6 . The system of claim 1 , wherein the updated hybrid image is generated by at least one of merging the second intraoperative image with the preoperative image or by overlaying the second intraoperative image onto the preoperative image.

7 . The system of claim 1 , wherein the hybrid model is trained using historical preoperative images and historical intraoperative images.

8 . The system of claim 1 , wherein the preoperative image comprises hard tissue information and the second intraoperative image comprises soft tissue information, wherein the updated hybrid image comprises a first set of pixels representing the hard tissue information and a second set of pixels representing the soft tissue information, and wherein the first set of pixels is distinguishable from the second set of pixels within the updated hybrid image.

9 . A device for generating a hybrid image comprising:

a processor; and

a memory storing data for processing by the processor, the data, when processed, causing the processor to:

receive a preoperative image depicting at least one anatomical element;

receive a first intraoperative image from an imaging device, the first intraoperative image depicting the at least one anatomical element;

input the preoperative image and the first intraoperative image into a hybrid model, the hybrid model configured to combine the first intraoperative image with the preoperative image;

generate, with a first output of the hybrid model, a hybrid image comprising the preoperative image combined with the first intraoperative image;

receive a second intraoperative image depicting the at least one anatomical element;

compare the second intraoperative image to the first intraoperative image;

detect movement of the at least one anatomical element based on the comparison;

input the preoperative image and the second intraoperative image into the hybrid model in response to detecting the movement of the at least one anatomical element; and

generate, with a second output of the hybrid model, an updated hybrid image comprising the preoperative image and the second intraoperative image which replaces the first intraoperative image.

10 . The device of claim 9 , wherein the preoperative image comprises an x-ray image and the second intraoperative image comprises an ultrasound image.

11 . The device of claim 9 , wherein the memory stores further data for processing by the processor that, when processed, causes the processor to:

receive pose information of the imaging device, the pose information correlating to one or more poses of the imaging device when the second intraoperative image was obtained; and

generate a three-dimensional representation of the at least one anatomical element based on the preoperative image, the second intraoperative image, and the pose information.

12 . The device of claim 11 , wherein the memory stores further data for processing by the processor that, when processed, causes the processor to:

generate a preoperative three-dimensional representation of the at least one anatomical element using only the preoperative image; and

combine the three-dimensional representation with the preoperative three-dimensional representation.

13 . The device of claim 9 , wherein the updated hybrid image is generated by at least one of merging the second intraoperative image with the preoperative image or by overlaying the second intraoperative image onto the preoperative image.

14 . The device of claim 9 , wherein the hybrid model is trained using historical preoperative images and historical intraoperative images.

15 . The device of claim 9 , wherein the preoperative image comprises hard tissue information and the second intraoperative image comprises soft tissue information, and wherein the updated hybrid image comprises first pixels representing the hard tissue information and second pixels representing the soft tissue information and that contrast with the first pixels.

16 . A system for navigating using a hybrid image comprising:

an imaging device;

a navigation system;