Image processing apparatus, method of controlling image processing apparatus, program, and storage medium

1. An image processing apparatus which processes an image of a target object, comprising:

a computer processor configured to:

acquire a series of first images with a first imaging modality and a series of second images with a second imaging modality of the target object, wherein each of the series of the first images and the series of the second images are scanned both at a first pull-back speed and at a second pull-back speed faster than the first pull-back speed;

correlate the series of the first images, which are scanned at the second pull-back speed, with the series of the second images, which are scanned at the second pull-back speed;

correlate one of the first images, which are scanned at the first pull-back speed, with one of the first images, which are scanned at the second pull-back speed; and

correlate and align the series of the first images which are scanned at the first pull-back speed and the series of the second images which are scanned at the second pull-back speed based on a result of the correlation of the one of the first images which are scanned at the first pull-back speed and the one of the first images which are scanned at the second pull-back speed and a result of the correlation of the series of the first images which are scanned at the second pull-back speed and the series of the second images which are scanned at the second pull-back speed; and

a display apparatus configured to display the images based on a result of the correlation and alignment of the series of the first images which are scanned at the first pull-back speed and the series of the second images which are scanned at the second pull-back speed.

2. The image processing apparatus according to claim 1 , wherein the computer processor is configured to:

display the series of the first images which are scanned at the first pull-back speed and the series of the first images which are scanned at the second pull-back speed, on the display apparatus;

receive a selection of the first images which are scanned at the first pull-back speed and the first images which are scanned at the second pull-back speed, from the images displayed on the display apparatus, from a user; and

perform the correlation based on the selection.

3. The image processing apparatus according to claim 1 , wherein

the first images are ultrasound tomographic images of the target object; and

the second images are optical tomographic images of the target object.

4. The image processing apparatus according to claim 1 , wherein

the first images are optical tomographic images of the target object;

the second images are ultrasound tomographic images of the target object; and

the first images are acquired by performing a flush operation during scanning at the first pull-back speed.

5. The image processing apparatus according to claim 1 , wherein the target object is a blood vessel.

6. An image processing apparatus which processes an image of a target object, comprising:

a computer processor configured to:

acquire a series of first images of the target object with a first imaging modality and a series of second images with a second imaging modality of the target object, wherein each of the series of the first images and the series of the second images are scanned both at a first pull-back speed and at a second pull-back speed faster than the first pull-back speed;

acquire a series of third images with a third imaging modality of the target object which are scanned in synchronization with the series of the first images and the series of the second images;

correlate one of the third images, which are scanned at the first pull-back speed, with one of the third images, which are scanned at the second pull-back speed; and

correlate and align the series of the first images which are scanned at the first pull-back speed and the series of the second images which are scanned at the second pull-back speed based on a result of the correlation of the one of the third images which are scanned at the first pull-back speed and the one of the third images which are scanned at the second pull-back speed; and

a display apparatus configured to display the images based on a result of the correlation and alignment of the series of the first images which are scanned at the first pull-back speed and the series of the second images which are scanned at the second pull-back speed.

7. The image processing apparatus according to claim 6 , wherein the computer processor is configured to:

display the series of the third images which are scanned at the first pull-back speed and the series of the third images which are scanned at the second pull-back speed, on the display apparatus;

receive a selection of the third images which are scanned at the first pull-back speed and the corresponding third images which are scanned at the second pull-back speed, from the images displayed on the display apparatus, from a user; and

perform the correlation based on the selection.

8. The image processing apparatus according to claim 6 , wherein

the first images are ultrasound tomographic images of the target object;

the second images are optical tomographic images of the target object; and

the third images are radiation images of the target object.

9. The image processing apparatus according to claim 6 , wherein

the first images are optical tomographic images of the target object;

the second images are ultrasound tomographic images of the target object; and

the third images are radiation images of the target object.

10. The image processing apparatus according to claim 8 , wherein

the radiation images of the target object include a marker which is provided in an imaging core which scans the ultrasound tomographic images and the optical tomographic images of the target object.

11. The image processing apparatus according to claim 6 , wherein the target object is a blood vessel.

12. A method of controlling an image processing apparatus which processes an image of a target object, the method comprising:

acquiring a series of first images with a first imaging modality and a series of second images with a second imaging modality of the target object, wherein each of the series of the first images and the series of the second images are scanned both at a first pull-back speed and at a second pull-back speed faster than the first pull-back speed;

correlating the series of the first images, which are scanned at the second pull-back speed, with the series of the second images, which are scanned at the second pull-back speed;

correlating one of the first images, which are scanned at the first pull-back speed, with one of the first images, which are scanned at the second pull-back speed;

correlating and aligning the series of the first images which are scanned at the first pull-back speed and the series of the second images which are scanned at the second pull-back speed based on a result of the correlation of the one of the first images which are scanned at the first pull-back speed and the one of the first images which are scanned at the second pull-back speed and a result of the correlation of the series of the first images which are scanned at the second pull-back speed and the series of the second images which are scanned at the second pull-back speed; and

displaying the images on a display apparatus, based on a result of the correlation and alignment of the series of the first images which are scanned at the first pull-back speed and the series of the second images which are scanned at the second pull-back speed.

13. The method of controlling the image processing apparatus according to claim 12 , comprising:

displaying the series of the first images which are scanned at the first pull-back speed and the series of the first images which are scanned at the second pull-back speed, on the display apparatus;

receiving a selection of the first images which are scanned at the first pull-back speed and the first images which are scanned at the second pull-back speed, from the images displayed on the display apparatus, from a user; and

performing the correlation based on the selection.

14. The method of controlling the image processing apparatus according to claim 12 , wherein the target object is a blood vessel.

15. A non-transitory computer readable medium having a program for causing a computer to execute each step of the method of controlling the image processing apparatus according to claim 12 .

16. A method of controlling an image processing apparatus which processes an image of a target object, the method comprising:

acquiring a series of first images with a first imaging modality of the target object and a series of second images with a second imaging modality of the target object, wherein each of the series of the first images and the series of the second images are scanned both at a first pull-back speed and at a second pull-back speed faster than the first pull-back speed, and a series of third images with a third imaging modality of the target object which are scanned in synchronization with the series of the first images and the series of the second images;

correlating one of the third images, which are scanned at the first pull-back speed, with one of the third images, which are scanned at the second pull-back speed;

correlating and aligning the series of the first images which are scanned at the first pull-back speed and the series of the second images which are scanned at the second pull-back speed based on a result of the correlation of the one of the third images which are scanned at the first pull-back speed and the one of the third images which are scanned at the second pull-back speed; and

displaying the images on a display apparatus, based on a result of the correlation and alignment of the series of the first images which are scanned at the first pull-back speed and the series of the second images which are scanned at the second pull-back speed.

17. The method of controlling the image processing apparatus according to claim 16 , comprising:

displaying the series of the third images which are scanned at the first pull-back speed and the series of the third images which are scanned at the second pull-back speed, on the display apparatus;

receiving a selection of the third images which are scanned at the first pull-back speed and the third images which are scanned at the second pull-back speed, from the images displayed on the display apparatus, from a user; and

performing the correlation based on the selection.

18. The method of controlling the image processing apparatus according to claim 16 , wherein the target object is a blood vessel.

19. A non-transitory computer readable medium having a program for causing a computer to execute each step of the method of controlling the image processing apparatus according to claim 16 .

20. A non-transitory computer-readable storage medium in which the method of controlling the image processing apparatus according to claim 16 is stored.