Device, method, and system for image guided surgical resection
The present disclosure relates to an image processing device, an image processing method, and a surgical system with which more accurate surgical resection can be performed in a shorter time. An identifying unit identifies the type of tissue degeneration in a mid-surgery image. In accordance with the identified type of the tissue degeneration, a drawing unit draws auxiliary information for the operator, the auxiliary information being to be superimposed on the mid-surgery image. The present disclosure can be applied to an endoscopic surgical system or the like that includes a display device, a camera control unit (CCU), a light source device, a treatment tool device, a pneumoperitoneum apparatus, a recorder, a printer, an endoscope, an energetic treatment tool, forceps, trocars, a foot switch, and a patient's bed, for example.
1. An image processing device comprising:
processing circuitry configured to
identify a type of tissue degeneration in a mid-surgery image in accordance with feature information regarding at least one degenerated region of the mid-surgery image,
draw auxiliary information for an operator based on the identified type of the tissue degeneration, the auxiliary information being displayed on the mid-surgery image, wherein,
when the feature information indicates the at least one degenerated region is a plurality of discontinuous degenerated regions, the tissue degeneration is identified as caused by a burn and the drawn auxiliary information is based on locations of the plurality of discontinuous degenerated regions, and,
when the feature information indicates the at least one degenerated region is a single continuous degenerated region, the tissue degeneration is identified as caused by a discoloring and the drawn auxiliary information is based on a contour of the single continuous degenerated region.
2. The image processing device according to claim 1 , wherein the drawn auxiliary information is a line drawn in accordance with the identified type of the tissue degeneration.
3. The image processing device according to claim 2 , wherein the line drawn in accordance with the identified type of the tissue degeneration is a line extending through the locations of the plurality of discontinuous degenerated regions.
4. The image processing device according to claim 2 , wherein the line drawn in accordance with the identified type of the tissue degeneration is based on the contour of the single continuous degenerated region.
5. The image processing device according to claim 1 , wherein the processing circuitry is further configured to
draw the auxiliary information for the operator in accordance with the at least one degenerated region of the tissue degeneration and a parallax image corresponding to the mid-surgery image.
6. The image processing device according to claim 1 , wherein the processing circuitry is further configured to
detect the at least one degenerated region of the tissue degeneration in the mid-surgery image based on a pre-degeneration mid-surgery image and a mid-surgery image generated after the tissue degeneration occurs, and
draw the auxiliary information for the operator in accordance with the detected at least one degenerated region of the tissue degeneration.
7. The image processing device according to claim 6 , wherein the processing circuitry is further configured to
track temporal changes in the detected at least one degenerated region of the tissue degeneration in the mid-surgery image, and
update, intraoperatively, the auxiliary information drawn for the operator based on the tracked temporal changes in the detected at least one degenerated region of the tissue degeneration.
8. The image processing device according to claim 6 , wherein the processing circuitry is further configured to
correct the detected at least one degenerated region of the tissue degeneration in accordance with a parallax image corresponding to the mid-surgery image generated after the tissue degeneration occurs.
9. The image processing device according to claim 1 , wherein the processing circuitry is further configured to
draw the auxiliary information for the operator in accordance with information obtained from an image generated by a medical device before or during surgery.
10. The image processing device according to claim 1 , wherein the processing circuitry is further configured to
draw the auxiliary information for the operator in accordance with detection information about a surgical tool in the mid-surgery image.
11. An image processing method comprising:
identifying, by processing circuitry, a type of tissue degeneration in a mid-surgery image in accordance with feature information regarding at least one degenerated region of the mid-surgery image; and
drawing, by the processing circuitry, auxiliary information for an operator based on the identified type of the tissue degeneration, the auxiliary information being displayed on the mid-surgery image, wherein,
when the feature information indicates the at least one degenerated region is a plurality of discontinuous degenerated regions, the tissue degeneration is identified as caused by a burn and the drawn auxiliary information is based on locations of the plurality of discontinuous degenerated regions, and,
when the feature information indicates the at least one degenerated region is a single continuous degenerated region, the tissue degeneration is identified as caused by a discoloring and the drawn auxiliary information is based on a contour of the single continuous degenerated region.
12. A surgical system comprising:
a treatment device configured to degenerate a current object on which surgery is to be performed;
an imaging device configured to generate a mid-surgery image of the current object; and
an image processing device configured to perform image processing on the mid-surgery image, the image processing device including processing circuitry configured to
identify a type of tissue degeneration in the mid-surgery image in accordance with feature information regarding at least one degenerated region of the mid-surgery image; and
draw auxiliary information for an operator based on the identified type of the tissue degeneration, the auxiliary information being displayed on the mid-surgery image, wherein,
when the feature information indicates the at least one degenerated region is a plurality of discontinuous degenerated regions, the tissue degeneration is identified as caused by a burn and the drawn auxiliary information is based on locations of the plurality of discontinuous degenerated regions, and,
when the feature information indicates the at least one degenerated region is a single continuous degenerated region, the tissue degeneration is identified as caused by a discoloring and the drawn auxiliary information is based on a contour of the single continuous degenerated region.