Training a machine learning algorithm using digitally reconstructed radiographs

1. A computer-implemented method of training a machine learning model for determining position of an image representation of an annotated anatomical structure in a two-dimensional x-ray image, the method comprising the following steps:

acquiring atlas data which describes a three-dimensional shape of the anatomical structure and at least one projection parameter for generating two-dimensional x-ray images of the anatomical structure;

acquiring image training data which describes the two-dimensional x-ray images being digitally reconstructed radiographs and including an image representation of the anatomical structure, wherein the two-dimensional x-ray images are generated based on the at least one projection parameter that is described in the atlas data for the anatomical structure;

acquiring annotation data which describes an annotation for the anatomical structure; and

determining model parameter data which describes model parameters of the machine learning model for establishing a relation between the anatomical structure in the two-dimensional x-ray images and the annotation,

wherein the model parameter data is determined by training the model parameter data through inputting the image training data and the annotation data into a function which establishes the relation, the function being part of the machine learning model.

2. The method according to claim 1 , wherein

the atlas data describes an image-based model of the anatomical structure, and

the annotation data is determined based on the image training data and the atlas data.

3. The method according to claim 1 , wherein the annotation data is determined from metadata included in the image training data.

4. The method according to claim 1 , wherein the function establishes a relation between a position of the anatomical structure in the two-dimensional x-ray images and a position for displaying the annotation in the two-dimensional x-ray images.

5. The method according to claim 1 , comprising the following steps:

acquiring medical image data which describes three-dimensional medical images including an image representation of the anatomical structure,

wherein the image training data is determined by

determining an image value threshold associated with the image representation of the anatomical structure in the three-dimensional medical images and

defining a corresponding intensity mapping function and generating the image representation of the anatomical structure in each of the synthesized two-dimensional x-ray images from the image representation of the anatomical structure in one of the three-dimensional medical images based on the intensity mapping function.

6. The method according to claim 1 , wherein the machine learning model comprises a machine learning algorithm.

7. The method according to claim 1 , wherein a convolutional neural network is part of the machine learning model.

8. The method according to claim 1 , wherein the model parameters define learnable parameters of the machine learning model.

9. A computer-implemented method of determining a relation between an anatomical structure represented in a two-dimensional medical image and an annotation for the anatomical structure, the method comprising:

acquiring patient image data which describes a two-dimensional x-ray image including an image representation of the anatomical structure of a patient; and

determining structure annotation prediction data which describes, according to a certain likelihood determined by a trained machine learning model, a position of the image representation of the anatomical structure in the two-dimensional x-ray image described by the patient image data and the annotation for the anatomical structure,

wherein the structure annotation prediction data is determined by inputting the patient image data into a function which establishes a relation between the image representation of the anatomical structure in the two-dimensional x-ray image and the annotation for the anatomical structure, the function being part of the trained machine learning model, and

wherein the machine learning model is trained using two-dimensional x-ray images generated based on a projection parameter described in atlas data for the anatomical structure, the atlas data describing a three-dimensional shape of the anatomical structure.

10. The method according to claim 9 , wherein the patient image data has been generated by synthesizing the two-dimensional x-ray image from a three-dimensional image of the anatomical structure, or wherein the patient image data has been generated by applying a fluoroscopic imaging modality to the anatomical structure.

11. The method according to claim 9 , wherein the function establishes a relation between a position of the anatomical structure in the two-dimensional x-ray image described by the patient image data and a position for displaying the annotation in the two-dimensional x-ray image described by the patient image data, and wherein the structure annotation prediction data describes a relation between the position of the image representation of the anatomical structure in the two-dimensional x-ray image described by the patient image data and a position for displaying the annotation for the anatomical structure in the two-dimensional x-ray image described by the patient image data.

12. A system for determining a relation between an anatomical structure represented in a two-dimensional medical image and an annotation for the anatomical structure, comprising:

at least one computer having memory with instructions stored thereon operable to:

acquire patient image data which describes a two-dimensional x-ray image including an image representation of an anatomical structure of a patient; and

determine structure annotation prediction data which describes, according to a certain likelihood determined by a machine learning model, a position of the image representation of the anatomical structure in the two-dimensional x-ray image described by the patient image data and an annotation for the anatomical structure,

wherein the structure annotation prediction data is determined by inputting the patient image data into a function which establishes a relation between the image representation of the anatomical structure in the two-dimensional x-ray image and the annotation for the anatomical structure, the function being part of the machine learning model, and

wherein the machine learning model is trained using two-dimensional x-ray images generated based on a projection parameter described in atlas data for the anatomical structure, the atlas data describing a three-dimensional shape of the anatomical structure;

at least one electronic data storage device storing the patient image data;

wherein the at least one computer is operably coupled to

the at least one electronic data storage device for acquiring, from the at least one electronic data storage device, the patient image data, and for storing, in the at least one electronic data storage device, at least the structure annotation prediction data; and

program storage medium for acquiring, the data defining model parameters of the machine learning model.

13. A non-transitory computer storage medium comprising instructions for determining a relation between an anatomical structure represented in a two-dimensional medical image and an annotation for the anatomical structure, the instructions operable to cause at least one processor to:

acquire patient image data which describes a two-dimensional x-ray image including an image representation of an anatomical structure of a patient; and

determine structure annotation prediction data which describes, according to a certain likelihood determined by a machine learning model, a position of the image representation of the anatomical structure in the two-dimensional x-ray image described by the patient image data and an annotation for the anatomical structure,

wherein the structure annotation prediction data is determined by inputting the patient image data into a function which establishes a relation between the image representation of the anatomical structure in the two-dimensional x-ray image and the annotation for the anatomical structure, the function being part of the machine learning model, and

wherein the machine learning model is trained using two-dimensional x-ray images generated based on a projection parameter described in atlas data for the anatomical structure, the atlas data describing a three-dimensional shape of the anatomical structure.