IP Library Granted Patent US 11,928,828
Granted Patent B2
US 11,928,828 · App. 17/603,280 · Granted Mar 12, 2024

Deformity-weighted registration of medical images

Inventor: Sebastian Stopp (Munich, DE)
Assignee: BRAINLAB AG
G06T7/337A61B34/10A61B2034/105G06T2207/10081G06T2207/10088G06T2207/30004
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,928,828
App. No.
17/603,280
Granted
Mar 12, 2024
Kind
B2
Abstract

Disclosed is a computer-implemented method of determining a spatial relationship between planning image data and current surface data which leads to improved surface registration accuracy by considering the elasticity and deformability of the tissue. The knowledge about the tissue can be estimated based on type of tissue and atlas information. For the process of generating surface registration points on specific anatomical regions, e.g. the face or forehead, are acquired with a classical navigated pointer or laser pointer. It is also possible to acquire points with surface scanners. Confidence values defining a probability for certain parts of the surface registration points being deformed in comparison to a planning image are read from atlas data and used to compensate for the deformation in the registration between the surface registration points and the planning image in order to render the registration valid.

Claims (52)

1. A computer-implemented medical method of determining a spatial relationship between planning image data and current surface data, the method comprising the following steps:

acquiring planning image data which describes a three-dimensional medical image of an anatomical body part having an external surface;

acquiring current surface data which describes a current surface scan describing the external surface;

acquiring atlas data which describes a model of the external surface and confidence values for elements of the external surface which describe a probability for the geometry of the external surface to be subject to a change;

determining confidence assignment data based on the atlas data and the current surface data, wherein the confidence assignment data describes an assignment of the confidence values for elements of the external surface described by the atlas data to the corresponding elements of the external surface described by the current surface scan;

determining registration data based on the planning image data and the current surface data and the confidence assignment data;

wherein the registration data describes a spatial relationship between the external surface described by the planning image data and the external surface described by the current surface data; and further

wherein the spatial relationship is weighted for the elements of the external surface according to the confidence value assigned to the respective element.

2. The method according to claim 1 , wherein the change is due to at least one of positioning a patient, gravity, swelling of tissue included in the external surface, or elastic deformation of tissue included in the external surface.

3. The method according to claim 1 , wherein the probability depends on whether the geometry of the external surface is at least substantially defined by the hardness of tissue included in or lying closely below the external surface.

4. The method according to claim 3 , wherein the probability is higher the lower the hardness of the tissue included in or lying closely below the external surface.

5. The method according to claim 1 , wherein:

the confidence values depend on a time interval lying in between a point in time at which the registration data has been determined and the point in time at which the anatomical body part will be re-positioned, or

the confidence values depend on an imaging modality used to generate the current surface data.

6. The method according to claim 1 , wherein the confidence values have been determined by at least one of the following:

determining a typical deformation of the external surface determined from a plurality of comparisons of planning image data with current surface data acquired for different patients;

using pre-defined confidence values derived from expert knowledge as the confidence values; and

using a physical property of tissue included in or lying closely below the external surface as a basis for computing the confidence values.

7. The method according to claim 1 , wherein the confidence assignment data is determined by:

determining preliminary confidence assignment data based on the atlas data and the planning image data;

wherein the preliminary confidence assignment data describes an assignment of the confidence values for elements of the external surface described by the atlas data to the corresponding elements of the external surface described by the current surface scan; and

wherein the registration data is determined by:

establishing the spatial relationship between the external surface described by the planning image data and the external surface described by the current surface data; and

applying the confidence values to the spatial relationship for the respective element of the external surface to which the confidence value is assigned and for which the spatial relationship has been or is being established, whereby the spatial relationship is weighted for that element by the confidence value assigned to that element.

8. The method according to claim 1 , wherein the atlas data describes a direction and a distance in which the elements of the external surface move when the geometry of the external surface is subject to the change, and wherein the spatial relationship is determined by compensating for that movement.

9. The method according to claim 1 , wherein the spatial relationship between the external surface described by the planning image data and the external surface described by the current surface data is determined by computing a norm between each point defining the current surface scan and the external surface described by the planning image data, or by applying an iterative closest point algorithm to the planning image data and the current surface data.

10. The method according to claim 1 , wherein the planning image data has been generated by applying magnetic resonance tomography imaging or computed x-ray tomography imaging to the anatomical body part.

11. The method according to claim 1 , wherein the current surface data has been generated by

acquiring positional information using a tracked pointing instrument to describing the position of the external surface, or

applying a surface scanning imaging modality including use of at least one of a range camera, thermographic camera, structured light camera or time-of-flight camera.

12. A computer implemented method which, when running on at least one processor on at least one computer, causes the at least one processor to:

acquire planning image data which describes a three-dimensional medical image of an anatomical body part having an external surface;

acquire current surface data which describes a current surface scan describing the external surface;

acquire atlas data which describes a model of the external surface and confidence values for elements of the external surface which describe a probability for the geometry of the external surface to be subject to a change;

determine confidence assignment data based on the atlas data and the current surface data, wherein the confidence assignment data describes an assignment of the confidence values for elements of the external surface described by the atlas data to the corresponding elements of the external surface described by the current surface scan;

determine registration data based on the planning image data and the current surface data and the confidence assignment data;

wherein the registration data describes a spatial relationship between the external surface described by the planning image data and the external surface described by the current surface data; and further

wherein the spatial relationship is weighted for the elements of the external surface according to the confidence value assigned to the respective element.

13. A medical system, comprising:

at least one processor on at least one computer which when executing instructions, causes the at least one processor to:

acquire planning image data which describes a three-dimensional medical image of an anatomical body part having an external surface;

acquire current surface data which describes a current surface scan describing the external surface;

acquire atlas data which describes a model of the external surface and confidence values for elements of the external surface which describe a probability for the geometry of the external surface to be subject to a change;

determine confidence assignment data based on the atlas data and the current surface data, wherein the confidence assignment data describes an assignment of the confidence values for elements of the external surface described by the atlas data to the corresponding elements of the external surface described by the current surface scan;

determine registration data based on the planning image data and the current surface data and the confidence assignment data;

wherein the registration data describes a spatial relationship between the external surface described by the planning image data and the external surface described by the current surface data; and further

wherein the spatial relationship is weighted for the elements of the external surface according to the confidence value assigned to the respective element;

at least one electronic data storage device storing at least planning surface data and atlas data; and

a surface acquiring device for acquiring the current surface data,

wherein the at least one computer is operably coupled to:

the at least one electronic data storage device for acquiring, from the at least one electronic data storage device, at least the planning image data and the atlas data; and

the surface acquiring device for acquiring, from the surface acquiring device, the current surface data.

Assignments (2)
CHANGE OF NAME Recorded Dec 3, 2025
From: BRAINLAB AG
To: BRAINLAB SE
Reel/Frame 073827/0005 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 12, 2021
From: STOPP, SEBASTIAN
To: BRAINLAB AG
Reel/Frame 058095/0384 →
Continuity (1)
Related Publication 20220189045A1 · Jun 16, 2022