Patient position determination system, method, and program
A radiotherapy system includes X-ray imaging apparatuses that obtain an X-ray image of the patient on a reference plane, and a position determination apparatus. The position determination apparatus calculates parameters of a region estimation model, using, as input data, a reference fluoroscopic image obtained before radiotherapy, and also using, as teacher data, a reference ROI image obtained with respect to the reference fluoroscopic image before radiotherapy. During radiotherapy, the position determination apparatus estimates a region of interest with respect to the X-ray image and a DRR image, based on the parameters and the X-ray image, determines a degree of matching between the X-ray image and the DRR image for the region of interest while virtually changing a relative position/orientation relationship between a CT image and the reference plane, and determines an amount of deviation in position/orientation between the patient and the CT image.
1. A patient position determination system comprising:
an X-ray imaging apparatus that obtains an X-ray image of a patient on a reference plane; and
an arithmetic processing apparatus, wherein
the arithmetic processing apparatus estimates a region of interest with respect to the X-ray image and to a DRR image, based on a parameter of a region estimation model and on the X-ray image or the DRR image created by virtually projecting a three-dimensional image of the patient obtained before radiotherapy onto the reference plane, and obtains an amount of deviation in position/orientation between the patient and the three-dimensional image, based on the three-dimensional image, the X-ray image, and the region of interest, and wherein
the parameter of the region estimation model is a parameter calculated by using, as input data, a reference fluoroscopic image obtained before radiotherapy, and also using, as teacher data, a reference ROI image obtained with respect to the reference fluoroscopic image before radiotherapy.
2. The patient position determination system according to claim 1 , comprising a couch driver that sets a position and an orientation of a couch bearing the patient laying thereon, based on the amount of deviation in position/orientation.
3. The patient position determination system according to claim 1 , comprising a display device that displays an initial ROI image and the X-ray image or the DRR image, the initial ROI image indicating the region of interest estimated by the arithmetic processing apparatus, wherein
the arithmetic processing apparatus corrects the region of interest estimated by the arithmetic processing apparatus, in accordance with a user's operation of correcting the region of interest, the user's operation being carried out when the initial ROI image and the X-ray image or the DRR image are displayed, and obtains the amount of deviation in position/orientation for the region of interest corrected.
4. The patient position determination system according to claim 1 , comprising a display device that displays an ROI image indicating the region of interest, the X-ray image, the DRR image, and the amount of deviation in position/orientation, wherein
the arithmetic processing apparatus corrects the region of interest in accordance with a user's operation of correcting the region of interest, the user's operation being carried out when the ROI image, the X-ray image, the DRR image, and the amount of deviation in position/orientation are displayed, and obtains the amount of deviation in position/orientation for the region of interest corrected.
5. The patient position determination system according to claim 3 , wherein
the display device displays a corrected ROI image indicating the region of interest corrected, the X-ray image, the DRR image, and the amount of deviation in position/orientation that is obtained based on the region of interest corrected, and wherein
the arithmetic processing apparatus further corrects the region of interest in accordance with a user's operation of correcting the region of interest, the user's operation being carried out when the corrected ROI image, the X-ray image, the DRR image, and the amount of deviation in position/orientation that is obtained based on the region of interest corrected are displayed, and obtains the amount of deviation in position/orientation for the region of interest corrected.
6. The patient position determination system according to claim 5 , comprising a storage device storing a dataset having the reference fluoroscopic image and the reference ROI image associated with each other, wherein
the arithmetic processing apparatus judges whether or not to execute a storage process of storing the dataset in the storage device, according to a number of times of execution of a correction operation on the region of interest, and executes the storage process according to a result of the judgement, and wherein
the storage process includes a process of associating the X-ray image or the DRR image and an image indicating the region of interest, the image being a source image from which the amount of deviation in position/orientation is obtained, with each other, as the reference fluoroscopic image and the reference ROI image, respectively, and defining the reference fluoroscopic image and the reference ROI image as the dataset.
7. The patient position determination system according to claim 1 , comprising a storage device storing a dataset having the reference fluoroscopic image and the reference ROI image associated with each other, wherein
the arithmetic processing apparatus associates the X-ray image or the DRR image and an image indicating the region of interest with each other, as the reference fluoroscopic image and the reference ROI image, respectively, and stores the reference fluoroscopic image and the reference ROI image as the dataset, in the storage device.
8. The patient position determination system according to claim 7 , wherein
the arithmetic processing apparatus additionally associates success/failure information with the reference fluoroscopic image and the reference ROI image, the success/failure information being information indicating whether the amount of deviation in position/orientation has been determined properly and being information corresponding to a user's operation, and stores the reference fluoroscopic image, the reference ROI image, and the success/failure information as the dataset, in the storage.
9. The patient position determination system according to claim 7 , wherein
the arithmetic processing apparatus additionally associates treatment site information with the reference fluoroscopic image and the reference ROI image, the treatment site information indicating a treatment site and being inputted by a user, and stores the reference fluoroscopic image, the reference ROI image, and the treatment site information as the dataset, in the storage device.
10. The patient position determination system according to claim 7 , comprising a display device that displays an image indicating the region of interest, the X-ray image, the DRR image, and the amount of deviation in position/orientation, wherein
the arithmetic processing apparatus stores the dataset in the storage device according to a user's operation that is carried out when the display device displays the image indicating the region of interest, the X-ray image, the DRR image, and the amount of deviation in position/orientation.
11. A patient position determination method comprising:
causing an X-ray imaging apparatus to obtain an X-ray image of a patient on a reference plane;
estimating a region of interest with respect to the X-ray image and to a DRR image, based on a parameter of a region estimation model and on the X-ray image or the DRR image created by virtually projecting a three-dimensional image of the patient obtained before radiotherapy onto the reference plane;
determining an amount of deviation in position/orientation between the patient and the three-dimensional image, based on the three-dimensional image, the X-ray image, and the region of interest; and
calculating the parameter of the region estimation model using, as input data, a reference fluoroscopic image obtained before radiotherapy, and also using, as teacher data, the reference ROI image obtained with respect to the reference fluoroscopic image before radiotherapy.
12. A patient position determination program read by a position determination system including: an X-ray imaging apparatus that obtains an X-ray image of a patient on a reference plane; and an arithmetic processing apparatus, the patient position determination program causing the arithmetic processing apparatus to carry out the processes of:
estimating a region of interest with respect to the X-ray image and to a DRR image, based on a parameter of a region estimation model and on the X-ray image or the DRR image created by virtually projecting a three-dimensional image of the patient obtained before radiotherapy onto the reference plane; and
determining an amount of deviation in position/orientation between the patient and the three-dimensional image, based on the three-dimensional image, the X-ray image, and the region of interest, wherein
the parameter of the region estimation model is a parameter calculated by using, as input data, a reference fluoroscopic image obtained before radiotherapy, and also using, as teacher data, a reference ROI image obtained with respect to the reference fluoroscopic image before radiotherapy.
13. The patient position determination system according to claim 4 , wherein
the display device displays a corrected ROI image indicating the region of interest corrected, the X-ray image, the DRR image, and the amount of deviation in position/orientation that is obtained based on the region of interest corrected, and wherein
the arithmetic processing apparatus further corrects the region of interest in accordance with a user's operation of correcting the region of interest, the user's operation being carried out when the corrected ROI image, the X-ray image, the DRR image, and the amount of deviation in position/orientation that is obtained based on the region of interest corrected are displayed, and obtains the amount of deviation in position/orientation for the region of interest corrected.
14. The patient position determination system according to claim 13 , comprising a storage device storing a dataset having the reference fluoroscopic image and the reference ROI image associated with each other, wherein
the arithmetic processing apparatus judges whether or not to execute a storage process of storing the dataset in the storage device, according to a number of times of execution of a correction operation on the region of interest, and executes the storage process according to a result of the judgement, and wherein
the storage process includes a process of associating the X-ray image or the DRR image and an image indicating the region of interest, the image being a source image from which the amount of deviation in position/orientation is obtained, with each other, as the reference fluoroscopic image and the reference ROI image, respectively, and defining the reference fluoroscopic image and the reference ROI image as the dataset.