IP Library Granted Patent US 11,628,018
Granted Patent B2
US 11,628,018 · App. 17/847,763 · Granted Apr 18, 2023

Systems and methods for displaying guidance images with spatial annotations during a guided medical procedure

Inventors: Andrew Kula (Richmond Hill, CA); Elena Berman (Concord, CA); Adrian Mariampillai (Toronto, CA); Peter Siegler (Toronto, CA); Michael Leung (Markham, CA); Beau Anthony Standish (Toronto, CA); Victor X. D. Yang (North York, CA)
Assignee: 7D SURGICAL ULC
A61B34/20A61B34/25A61B17/1757A61B2034/2055
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,628,018
App. No.
17/847,763
Granted
Apr 18, 2023
Kind
B2
Abstract

The present disclosure provides systems and methods for generating spatial annotations within guidance images that are displayed during a guided medical procedure, where the spatial annotations provide spatial graduations indicating known length measures. The spatial measures may be employed to visually assess the sizes of anatomical and/or functional features displayed in the guidance images.

Claims (69)

1. A surgical navigation system comprising:

computer hardware operatively connectable to a tracking system, said computer hardware comprising at least one processor and memory, the memory comprising instructions executable by said at least one processor for performing operations comprising:

receiving, from the tracking system, signals from one or more fiducial markers associated with a medical instrument;

processing the signals to determine a position and an orientation of the medical instrument;

employing a coordinate transformation to represent pre-operative image data and the position and orientation of the medical instrument within a common frame of reference; and

generating and displaying a navigation user interface comprising:

anatomical and/or functional features associated with the pre-operative image data;

a plurality of virtual spatial annotations positioned at prescribed locations along a longitudinal axis of the medical instrument relative to the position of the medical instrument, each virtual spatial annotation having a transverse spatial extent indicating a corresponding different absolute transverse length measure, the transverse spatial extent being determined in a direction orthogonal to the longitudinal axis; and

numeric values of the different absolute transverse length measures that correspond to the virtual spatial annotations, the virtual spatial annotations thereby enabling a visual representation of the size of anatomical and/or functional features proximal to the longitudinal axis.

2. The system according to claim 1 further comprising the tracking system.

3. The system according to claim 1 wherein said computer hardware is configured to generate a virtual representation of the medical instrument in the navigation user interface.

4. The system according to claim 1 wherein said computer hardware is configured such that at least a subset of the virtual spatial annotations are displayed at respective locations along an elongate portion of the medical instrument.

5. The system according to claim 1 wherein said computer hardware is configured such that at least a subset of the virtual spatial annotations are displayed at respective locations that reside beyond a distal end of the medical instrument.

6. The system according to claim 5 wherein said computer hardware is configured such that the distance, along the longitudinal axis, between each virtual spatial annotation and the distal end of the medical instrument, is selected such that when the distal end of the medical instrument contacts a bone surface at a suitable entry point associated with a medical procedure, each virtual spatial annotation is displayed proximal to a subregion of interest.

7. The system according to claim 6 wherein said computer hardware is configured such that the subregion of interest comprises a pedicle of a spine.

8. The system according to claim 7 wherein said computer hardware is configured such that each absolute transverse length measure represents a different tool diameter, thereby permitting the selection of a suitable tool diameter by visual comparison of the virtual spatial annotations with the anatomical and/or functional features.

9. The system according to claim 1 wherein said computer hardware is configured such that at least two of the plurality of virtual spatial annotations are spatially distributed along the longitudinal axis.

10. The system according to claim 9 wherein said computer hardware is configured such that each virtual spatial annotation has a different spatial extent and represents a different respective absolute transverse length measure, and wherein the virtual spatial annotations that are spatially distributed along the longitudinal axis are displayed along the longitudinal axis in an ordered configuration according to an increasing or decreasing size of the respective absolute transverse length measures.

11. The system according to claim 10 wherein said computer hardware is configured such that the virtual spatially annotation having the largest absolute transverse length measure is displayed nearest to a proximal end of the medical instrument.

12. The system according to claim 1 wherein said computer hardware is configured to generate and display a plurality of navigation images, each navigation image including the plurality of virtual spatial annotations, wherein the location of one or more virtual spatial annotations is varied as a function of time relative to the position of the medical instrument during the display of the plurality of navigation images.

13. The system according to claim 1 wherein said computer hardware is configured to perform the following operations prior to generating and presenting the navigation user interface comprising the virtual spatial annotations:

determining a speed of the medical instrument;

comparing the speed of the medical instrument to a pre-selected threshold; and

determining that the speed of the medical instrument is below the pre-selected threshold.

14. The system according to claim 1 wherein said computer hardware is further configured to perform operations comprising:

determining a speed of the medical instrument;

comparing the speed of the medical instrument to a pre-selected threshold; and

increasing a magnification of the annotations.

15. The system according to claim 1 wherein said computer hardware is configured such that the navigation user interface includes a legend associating each virtual spatial annotation with its respective absolute transverse length measure.

16. The system according to claim 1 wherein said computer hardware is configured such that the navigation user interface comprises a visual representation of the longitudinal axis.

17. The system according to claim 16 wherein said computer hardware is configured to display a set of spatial graduations along the longitudinal axis.

18. The system according to claim 1 wherein said computer hardware is configured such that the navigation user interface is a two-dimensional representation of a two-dimensional region, the two-dimensional region including the longitudinal axis.

19. The system according to claim 1 wherein said computer hardware is configured such that the navigation user interface is a two-dimensional representation of a three-dimensional region, the three-dimensional region including the longitudinal axis.

20. The system according to claim 19 wherein said computer hardware is configured such that the virtual spatial annotations have a circular shape.

21. The system according to claim 1 wherein said computer hardware is configured such that each virtual spatial annotation has a different spatial extent and represents a different respective absolute transverse length measure.

22. The system according to claim 1 wherein said computer hardware is configured to perform the following operations prior to generating and presenting the navigation user interface comprising the virtual spatial annotations:

determining a time duration over which the medical instrument resides within a pre-selected spatial range;

comparing the time duration to a pre-selected time window; and

determining that the time duration is below the pre-selected time window.

23. The system according to claim 1 wherein said computer hardware is configured to perform operations comprising:

determining a time duration over which the medical instrument resides within a pre-selected spatial range;

comparing the time duration to a pre-selected time window;

determining that the time duration is below the pre-selected time window; and

increasing a magnification of the annotations.

24. A surgical navigation system comprising:

computer hardware operatively connectable to a tracking system, said computer hardware comprising at least one processor and memory, the memory comprising instructions executable by said at least one processor for performing operations comprising:

receiving, from the tracking system, signals from one or more fiducial markers associated with a medical instrument;

processing the signals to determine a position and an orientation of the medical instrument;

employing a coordinate transformation to represent pre-operative image data and the position and orientation of the medical instrument within a common frame of reference; and

generating and displaying a navigation user interface comprising:

anatomical and/or functional features associated with the pre-operative image data;

a virtual spatial annotation positioned at a prescribed location along a longitudinal axis relative to the position of the medical instrument, the virtual spatial annotation having a transverse spatial extent indicating a corresponding absolute transverse length measure, the transverse spatial extent being determined in a direction orthogonal to the longitudinal axis; and

a numeric value of the absolute transverse length measure that corresponds to the virtual spatial annotation, the virtual spatial annotation thereby enabling a visual assessment of the size of anatomical and/or functional features proximal to the longitudinal axis.

25. A non-transitory computer-readable storage medium having stored therein data representing instructions executable by a processor for providing surgical navigation, the storage medium comprising instructions for performing operations including:

receiving, from a tracking system, signals from one or more fiducial markers associated with a medical instrument;

processing the signals to determine a position and an orientation of the medical instrument;

employing a coordinate transformation to represent pre-operative image data and the position and orientation of the medical instrument within a common frame of reference; and

generating and displaying a navigation user interface comprising:

anatomical and/or functional features associated with the pre-operative image data;

a plurality of virtual spatial annotations positioned at prescribed locations along a longitudinal axis of the medical instrument relative to the position of the medical instrument, each virtual spatial annotation having a transverse spatial extent indicating a corresponding different absolute transverse length measure, the transverse spatial extent being determined in a direction orthogonal to the longitudinal axis; and

numeric values of the different absolute transverse length measures that correspond to the spatial annotations, the virtual spatial annotations thereby enabling a visual representation of the size of anatomical and/or functional features proximal to the longitudinal axis.

26. A non-transitory computer-readable storage medium having stored therein data representing instructions executable by a processor for providing surgical navigation, the storage medium comprising instructions for performing operations including:

receiving, from a tracking system, signals from one or more fiducial markers associated with a medical instrument;

processing the signals to determine a position and an orientation of the medical instrument;

employing a coordinate transformation to represent pre-operative image data and the position and orientation of the medical instrument within a common frame of reference; and

generating and displaying a navigation user interface comprising:

anatomical and/or functional features associated with the pre-operative image data;

a virtual spatial annotation positioned at a prescribed location along a longitudinal axis relative to the position of the medical instrument, the virtual spatial annotation having a transverse spatial extent indicating a corresponding absolute transverse length measure, the transverse spatial extent being determined in a direction orthogonal to the longitudinal axis; and

a numeric value of the absolute transverse length measure that corresponds to the virtual spatial annotation, the virtual spatial annotation thereby enabling a visual assessment of the size of anatomical and/or functional features proximal to the longitudinal axis.

Assignments (4)
SECURITY INTEREST Recorded Jan 14, 2025
From: 7D SURGICAL ULC
To: OXFORD FINANCE LLC, AS AGENT
Reel/Frame 069861/0322 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 23, 2022
From: KULA, ANDREW; BERMAN, ELENA; MARIAMPILLAI, ADRIAN; SIEGLER, PETER; LEUNG, MICHAEL; STANDISH, BEAU ANTHONY; YANG, VICTOR X. D.
To: 7D SURGICAL INC.
Reel/Frame 060295/0270 →
CHANGE OF NAME Recorded Jun 23, 2022
From: PROJECT MAPLE LEAF ACQUISITION ULC
To: 7D SURGICAL ULC
Reel/Frame 060295/0470 →
CERTIFICATE OF AMALGAMATION Recorded Jun 23, 2022
From: 7D SURGICAL INC.
To: PROJECT MAPLE LEAF ACQUISITION ULC
Reel/Frame 060438/0740 →