Feature recognition and depth guidance using intraoperative OCT
An apparatus for processing image data is disclosed. The apparatus includes one or more processors. The apparatus determines a feature in a cross-sectional image of a live tissue. The apparatus determines a superimposed image by superimposing a reference on the cross-sectional image or a subsequent cross-sectional image of the live tissue. The reference is based on the determined feature. An output interface outputs image data of the superimposed image for display.
1 . An apparatus for processing image data, comprising:
one or more processors configured to:
generate a cross-sectional image and a subsequent cross-sectional image of a live tissue;
determine a feature in the cross-sectional image of the live tissue;
determine a superimposed image by superimposing a first reference and a second reference on the cross-sectional image or the subsequent cross-sectional image of the live tissue, the first reference being determined based on the determined feature and the second reference being determined based on an offset from the first reference;
identify a stable region and an unstable region of the determined feature, the unstable region corresponding to an area of surgical activity; and
update the first reference in the subsequent cross-sectional image by tracking a position of the stable region, while disregarding changes in the unstable region; and
an output interface configured to output image data of the superimposed image for displaying the superimposed image.
2 . The apparatus of claim 1 , wherein the offset is in a depth direction.
3 . The apparatus of claim 2 , wherein the second reference is offset from the first reference by 20-500 μm.
4 . The apparatus of claim 1 , wherein the first reference includes a first plurality of points along a line.
5 . The apparatus of claim 4 , wherein the apparatus is configured to accept user input for adjusting at least one of the first reference or the second reference, including at least one of:
offsetting the first plurality of points, offsetting a second plurality of points of the second reference, adjusting a first curvature of the first plurality of points, adjusting a second curvature of the second plurality of points, adjusting a first path of the first plurality of points, or adjusting a second path of the second plurality of points.
6 . The apparatus of claim 1 , wherein the apparatus is further configured to:
receive real time data, and
determine the subsequent cross-sectional image based on the real time data.
7 . The apparatus of claim 1 , wherein the apparatus is further configured to:
move at least one of the first reference or the second reference, based on user input.
8 . The apparatus of claim 1 , wherein the apparatus is configured to determine the feature based on at least one of: image recognition, machine learning, threshold determination, or edge detection.
9 . The apparatus of claim 1 , wherein the apparatus is configured to:
receive real time data from at least one of optical coherence or ultrasound, and
update at least one of the cross-sectional image or the subsequent cross-sectional image in real time.
10 . The apparatus of claim 1 , further comprising:
a display for displaying the superimposed image, the display including a user interface.
11 . The apparatus of claim 10 , wherein at least one of the first reference and the second reference includes:
a curved line segment, and
at least one highlighted point on the curved line segment;
wherein the at least one highlighted point is configured to receive user input for adjusting at least one of the respective first and second references.
12 . A non-destructive imaging device, comprising:
the apparatus of claim 1 ,
wherein the non-destructive imaging device is configured to determine the cross-sectional image and the subsequent cross-sectional image of the live tissue.
13 . A surgical microscope, comprising:
the non-destructive imaging device of claim 12 ,
wherein the non-destructive imaging device includes an optical coherence imaging device configured to determine the cross-sectional image of the live tissue.
14 . A method of image guidance, comprising:
determining a feature in a cross-sectional image of a live tissue;
determining a superimposed image by superimposing a first reference and a second reference on the cross-sectional image or a subsequent cross-sectional image of the live tissue, the first reference being determined based on the determined feature and the second reference being determined based on an offset from the first reference;
identifying a stable region and an unstable region of the determined feature, the unstable region corresponding to an area of surgical activity;
updating the first reference in the subsequent cross-sectional image by tracking a position of the stable region, while disregarding changes in the unstable region; and
outputting image data of the superimposed image for displaying the superimposed image.