IP Library › Granted Patent US 11,478,212
Granted Patent B2
US 11,478,212 · App. 15/883,328 · Granted Oct 25, 2022

Method for controlling scanner by estimating patient internal anatomical structures from surface data using body-surface and organ-surface latent variables

Inventors: Vivek Kumar Singh (Princeton, NJ); Andreas Krauss (Bubenreuth, DE); Birgi Tamersoy (Erlangen, DE); Terrence Chen (Princeton, NJ); Kai Ma (Princeton, NJ)
Assignee: Siemens Healthcare GmbH
A61B6/545A61B5/0035A61B5/0064A61B5/055A61B5/1077A61B5/7267A61B5/7278A61B6/032A61B6/5217A61B6/542G01R33/543G01R33/5608G06T7/12A61B2560/029A61B2576/00G01R33/283
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,478,212
App. No.
15/883,328
Granted
Oct 25, 2022
Kind
B2
Abstract

A method for controlling a scanner comprises: sensing an outer surface of a body of a subject to collect body surface data, using machine learning to predict a surface of an internal organ of the subject based on the body surface data, and controlling the scanner based on the predicted surface of the internal organ.

Claims (34)

1. A method for controlling a scanner, comprising

sensing an outer surface of a body of a subject, the sensing providing body surface data comprising a skin surface of the subject;

using a machine-trained predictor to predict a surface of an internal organ of the subject based on the body surface data, the machine-trained predictor including a regressor that receives as input to the regressor a representation of the skin surface and outputs, in response to the input and by the regressor, a representation of the surface predicted as a mesh or volume mask output by the machine-trained predictor, wherein the predicting includes:

encoding the body surface data into body surface principal coordinates;

predicting a set of organ principal coordinates representing the surface of the internal organ; and

decoding the set of organ principal coordinates to predict the surface of the internal organ, wherein the encoding is performed by a first autoencoder, predicting the set of organ principal coordinates is performed by Hall the regressor, and the decoding is performed by a second autoencoder, the method further comprising, before the sensing:

training the first autoencoder using a first plurality of body surfaces;

training the second autoencoder using a first plurality of organ surfaces; and

training the regressor using a plurality of body-surface, organ-surface sets, each body-surface, organ-surface set including a plurality of body-surface latent variable values and a plurality of organ-surface latent variable values corresponding to the body-surface latent variable values; and

controlling the scanner based on the predicted surface of the internal organ, the scanner controlled for scan range or coil placement.

2. The method of claim 1 , wherein using the machine-trained predictor to predict the surface includes:

reducing dimensionality of the body surface data;

predicting a compact representation of the surface of the internal organ based on the reduced dimensionality body surface data; and

expanding the compact representation.

3. The method of claim 2 , wherein the regressor is a sparse linear regressor.

4. The method of claim 2 , wherein the regressor is a least absolute shrinkage and selection operator (LASSO) regressor.

5. The method of claim 2 , wherein the regressor is a deep neural network.

6. The method of claim 1 , wherein the scanner is a magnetic resonance (MR) scanner, and the controlling includes selecting the coil placements of a plurality of coils of the MR scanner.

7. The method of claim 1 , wherein the scanner is a computed tomography (CT) scanner, and the controlling includes selecting the scan range of the CT scanner.

8. A method for controlling a scanner, comprising

sensing an outer surface of a body of a subject, the sensing providing body surface data comprising a skin surface of the subject;

using a machine-trained predictor to predict a surface of an internal organ of the subject based on the body surface data, wherein using the machine-trained predictor to predict the surface includes: reducing dimensionality of the body surface data by a machine-trained encoder of the machine-trained predictor, predicting a compact representation of the surface of the internal organ as output of a machine-trained regressor in response to input to the machine-trained regressor of the reduced dimensionality body surface data, and expanding the compact representation by a machine-trained decoder of the machine-trained predictor, wherein the predicting includes:

encoding the body surface data into body surface principal coordinates;

predicting a set of organ principal coordinates representing the surface of the internal organ; and

decoding the set of organ principal coordinates to predict the surface of the internal organ, wherein the encoding is performed by a first autoencoder as the machine-trained encoder, predicting the set of organ principal coordinates is performed by the machine-trained regressor, and the decoding is performed by a second autoencoder, the method further comprising, before the sensing:

training the first autoencoder using a first plurality of body surfaces;

training the second autoencoder using a first plurality of organ surfaces; and

training the regressor using a plurality of body-surface, organ-surface sets, each body-surface, organ-surface set including a plurality of body-surface latent variable values and a plurality of organ-surface latent variable values corresponding to the body-surface latent variable values; and

controlling the scanner based on the predicted surface of the internal organ.

9. A method for controlling a scanner, comprising

sensing an outer surface of a body of a subject, the sensing providing body surface data comprising a skin surface of the subject;

using a machine-trained model to predict a surface of an internal organ of the subject based on the body surface data, wherein the predicting includes encoding the body surface data into body surface principal coordinates by a first machine-trained autoencoder, predicting a set of organ principal coordinates representing the surface of the internal organ as an output by a machine-trained correlator in response to input of the body surface principal coordinates to the machine-trained correlator, and decoding the set of organ principal coordinates to predict the surface of the internal organ by a second machine-trained autoencoder, the first autoencoder having been trained using a first plurality of body surfaces, the second autoencoder having been trained using a first plurality of organ surfaces, and the machine-trained correlator having been trained using a plurality of body-surface, organ-surface sets, each body-surface, organ-surface set including a plurality of body-surface latent variable values and a plurality of organ-surface latent variable values corresponding to the body-surface latent variable values; and

controlling the scanner based on the predicted surface of the internal organ.

10. The method of claim 9 wherein using the machine-trained model to predict the surface includes: reducing dimensionality of the body surface data, predicting a compact representation of the surface of the internal organ based on the reduced dimensionality body surface data, and expanding the compact representation.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 20, 2023
From: SIEMENS HEALTHCARE GMBH
To: SIEMENS HEALTHINEERS AG
Reel/Frame 066267/0346 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 8, 2018
From: SIEMENS MEDICAL SOLUTIONS USA, INC.
To: SIEMENS HEALTHCARE GMBH
Reel/Frame 045139/0824 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 28, 2018
From: SINGH, VIVEK KUMAR; CHEN, TERRENCE; MA, KAI
To: SIEMENS MEDICAL SOLUTIONS USA, INC.
Reel/Frame 045058/0170 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 28, 2018
From: KRAUSS, ANDREAS; TAMERSOY, BIRGI
To: SIEMENS HEALTHCARE GMBH
Reel/Frame 045058/0247 →
Continuity (2)
Provisional Application 62459651 · Feb 16, 2017
Related Publication 20180228460A1 · Aug 16, 2018
Cited By (3)
US 12,555,688 US 12,725,709 US 12,744,116