IP Library Granted Patent US 10,789,739
Granted Patent B2
US 10,789,739 · App. 16/510,078 · Granted Sep 29, 2020

System and method for generating partial surface from volumetric data for registration to surface topology image data

Inventors: Adrian Linus Dinesh Mariampillai (Toronto, CA); Peter Siegler (Toronto, CA); Michael Leung (Markham, CA); Beau Anthony Standish (Toronto, CA); Victor X. D. Yang (Toronto, CA)
Assignee: 7D SURGICAL INC.
G06T11/005A61B5/055A61B6/03A61B6/032A61B6/0492A61B6/505A61B6/5241G06T3/0068G06T7/33A61B5/1077G06T2207/10028G06T2207/10072G06T2207/10081G06T2207/30012
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,789,739
App. No.
16/510,078
Granted
Sep 29, 2020
Kind
B2
Abstract

The present disclosure relates to the generation of partial surface models them volumetric datasets for subsequent registration of such partial surface models to surface topology datasets. Specifically, given an object that is imaged using surface topology imaging and another volumetric modality, the volumetric dataset is processed in combination with an approach viewpoint to generate one or more partial surfaces of the object that will be visible to the surface topology imaging system. This procedure can eliminate internal structures from the surfaces generated from volumetric datasets, thus increases the similarity of the dataset between the two different modalities, enabling improved and quicker registration.

Claims (39)

1. A method of performing intraoperative image registration between volumetric image data associated with a subject and surface topology image data associated with the subject, wherein the surface topology image data is obtained by a surface topology imaging system, the method comprising:

processing the volumetric image data to generate a partial surface; and

employing the partial surface to perform image registration between the volumetric image data and the surface topology image data, thereby identifying an intraoperative transformation between the volumetric image data and the surface topology image data;

wherein the partial surface is selected such that surface data hidden from the surface topology imaging system is excluded during image registration.

2. The method according to claim 1 further comprising:

receiving, from a user, input identifying an orientation of the surface topology imaging system relative to the subject; and

employing the orientation when processing the volumetric image data to generate the partial surface.

3. The method according to claim 2 wherein the input is received from the user by:

displaying, on a user interface, a three-dimensional image showing at least a portion of a surface of the subject; and

receiving, from the user, the input, wherein the input is indicative of the orientation of the surface topology imaging system relative to the three-dimensional image.

4. The method according to claim 3 wherein the user interface is configured to rotate a camera angle relative to the three-dimensional image, and wherein the input comprises a selected camera angle that is selected by the user, the selected camera angle identifying the orientation of the surface topology imaging system relative to the subject.

5. The method according to claim 3 wherein the three-dimensional image is generated based on a three-dimensional model of the subject.

6. The method according to claim 5 wherein the three-dimensional model is a three-dimensional model of a selected anatomical region of the subject.

7. The method according to claim 5 wherein the three-dimensional model is generated by processing volumetric image data associated with the subject.

8. The method according to claim 2 wherein the input is employed to determine an approach viewpoint associated with the orientation of the surface topology imaging system relative to the subject, and wherein the approach viewpoint is employed when processing the volumetric image data to generate the partial surface.

9. The method according to claim 2 wherein the input received from the user identifies a plurality of approach viewpoints that correspond to a range of possible intraoperative orientations of the surface topology imaging system relative to the subject during a surgical procedure, and wherein the partial surface is generated based on the range of possible intraoperative orientations of the surface topology imaging system relative to the subject.

10. The method according to claim 2 wherein the orientation is a planned intraoperative orientation of the surface topology imaging system relative to the subject, and wherein the surface topology imaging system is oriented according to the planned orientation prior to employing the surface topology imaging system to obtain the surface topology image data during a surgical procedure.

11. A method of performing image registration between volumetric image data associated with an object and surface topology image data associated with the object, wherein the surface topology image data is obtained by a surface topology imaging system, the method comprising:

processing the volumetric image data to generate a partial surface; and

employing the partial surface to perform image registration between the volumetric image data and the surface topology image data, thereby identifying a transformation between the volumetric image data and the surface topology image data;

wherein the partial surface is selected such that surface data hidden from the surface topology imaging system is excluded during image registration.

12. The method according to claim 11 further comprising:

receiving, from a user, input identifying an orientation of the surface topology imaging system relative to the object; and

employing the orientation when processing the volumetric image data to generate the partial surface.

13. The method according to claim 12 wherein the input is received from the user by:

displaying, on a user interface, a three-dimensional image showing at least a portion of a surface of the object; and

receiving, from the user, the input, wherein the input is indicative of the orientation of the surface topology imaging system relative to the three-dimensional image.

14. The method according to claim 13 wherein the user interface is configure to rotate a camera angle relative to the three-dimensional image, and wherein the input comprises a selected camera angle that is selected by the user, the selected camera angle identifying the orientation of the surface topology imaging system relative to the object.

15. The method according to claim 13 wherein the three-dimensional image is generated based on a three-dimensional model of the object.

16. The method according to claim 15 wherein the three-dimensional model is generated by processing volumetric image data associated with the object.

17. The method according to claim 12 wherein the orientation is employed to determine an approach viewpoint associated with the orientation of the surface topology imaging system relative to the object.

18. The method according to claim 12 wherein the input received from the user identifies a plurality of approach viewpoints that correspond to a range of possible orientations of the surface topology imaging system relative to the object, and wherein the partial surface is generated based on the range of possible orientations of the surface topology imaging system relative to the object.

19. The method according to claim 12 wherein the orientation is a planned orientation of the surface topology imaging system relative to the object, and wherein the surface topology imaging system is oriented according to the planned orientation prior to employing the surface topology imaging system to obtain the surface topology image data.

20. A system for performing intraoperative image registration between volumetric image data associated with a subject and surface topology image data associated with the subject,

a surface topology imaging system; and

control and processing circuitry operatively coupled to said surface topology imaging system, said control and processing circuitry comprising at least one processor and associated memory, said memory storing instructions executable by said at least one processor for performing operations comprising:

processing the volumetric image data to generate a partial surface; and

employing the partial surface to perform intraoperative image registration between the volumetric image data and the surface topology image data, thereby identifying an intraoperative transformation between the volumetric image data and the surface topology image data;

the partial surface being generated such that surface data hidden from the surface topology imaging system is excluded during image registration.

Assignments (6)
SECURITY INTEREST Recorded Jan 14, 2025
From: 7D SURGICAL ULC
To: OXFORD FINANCE LLC, AS AGENT
Reel/Frame 069861/0322 →
RELEASE OF SECURITY INTEREST Recorded Jan 9, 2023
From: WELLS FARGO BANK, NATIONAL ASSOCIATION
To: SEASPINE HOLDINGS CORPORATION; SEASPINE ORTHOPEDICS CORPORATION; SEASPINE, INC.; ISOTIS, INC.; SEASPINE SALES LLC; ISOTIS ORTHOBIOLOGICS, INC.; THEKEN SPINE, LLC; SEASPINE ORTHOPEDICS INTERMEDIATECO, INC.; 7D SURGICAL USA INC.
Reel/Frame 062336/0593 →
SECOND AMENDMENT TO PATENT SECURITY AGREEMENT Recorded Jul 18, 2022
From: SEASPINE HOLDINGS CORPORATION; SEASPINE ORTHOPEDICS CORPORATION; SEASPINE, INC.; ISOTIS, INC.; SEASPINE SALES LLC; ISOTIS ORTHOBIOLOGICS, INC.; THEKEN SPINE, LLC; SEASPINE ORTHOPEDICS INTERMEDIATECO, INC.; 7D SURGICAL USA INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 060715/0395 →
CHANGE OF NAME Recorded Jul 21, 2021
From: PROJECT MAPLE LEAF ACQUISITION ULC
To: 7D SURGICAL ULC
Reel/Frame 056933/0176 →
CERTIFICATE OF AMALGAMATION Recorded Jul 21, 2021
From: 7D SURGICAL INC.
To: PROJECT MAPLE LEAF ACQUISITION ULC
Reel/Frame 056933/0416 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 15, 2019
From: MARIAMPILLAI, ADRIAN; SIEGLER, PETER; LEUNG, MICHAEL; STANDISH, BEAU ANTHONY; YANG, VICTOR X.D.
To: 7D SURGICAL INC.
Reel/Frame 049749/0635 →