Method and system for providing surgical site measurement
A system for measuring distances within a surgical site includes a camera positionable to capture 3D image data corresponding to a treatment site. Using the image data, the system determines the relative 3D positions of identified measurement points at the treatment site captured in the images, and it estimates or determines the distance between the measurement points. Output is generated communicating the measured distances to the user. The measurement taken follows the 3D topography of the tissue positioned between the measurement points.
1. A system for measuring distances within a surgical site, comprising:
a camera positionable in a body cavity to capture real time 3D images corresponding to a treatment site, the treatment site including a tissue surface having a topography;
a display configured to display the real time 3D images in real time with the tissue surface and topography visible on the display;
at least one processor and at least one memory, the at least one memory storing instructions executable by said at least one processor to:
identify, using computer vision analysis of the images, a predetermined portion of a first surgical instrument that is positioned in the body cavity at the treatment site and determine a 3D position of said predetermined portion of the first surgical instrument,
display a first overlay on the display in known proximity to the predetermined part of the first surgical instrument, such that the first overlay moves on the display to track movement of the predetermined part of the first surgical instrument, wherein a 3D position of the first overlay comprises a first measurement point;
determine a 3D position of a second measurement point in the treatment site captured in the images,
receive, while displaying the first overlay, input from a user observing the displayed real time images in real time, the input instructing the system to display a plane containing the first measurement point and the second measurement point,
display a graphical plane overlay over the displayed real time 3D images, the graphical plane overlay graphically representing the plane containing the first measurement point and the second measurement point, the displayed graphical plane overlay transecting the topography of the tissue surface visible on the display, and graphically depicting a measurement pathway where the plane transects the tissue surface,
estimate or determine a distance between the first measurement point and the second measurement point along the measurement pathway, and
generate output communicating the distance to the user.
2. The system of claim 1 , wherein the distance is a geodesic distance following the topography of tissue surfaces between the first measurement point and the second measurement point.
3. The system of claim 1 , wherein the output includes generating an overlay displaying the measured distances.
4. The system of claim 1 , wherein:
the processor is further configured to
identify, using computer vision analysis of the images, a predetermined part of a second surgical instrument positioned at the treatment site and determine a 3D position of said predetermined part of the second surgical instrument,
display a second overlay on the display in known proximity to the predetermined part of the second surgical instrument, such that the second overlay moves on the display to track movement of the predetermined part of the second surgical instrument, wherein a 3D position of the second overlay comprises the second measurement point.
5. The system of claim 4 , wherein the instructions are executable by said at least one processor to:
receive user input to rotate the graphical plane overlay along a line extending between the first measurement point and the second measurement point;
rotate the displayed graphical plane overlay relative to the displayed real time 3D image to a rotated orientation on the display in response to the user input to rotate the graphical plane, and graphically depict a second measurement pathway on the rotated plane along the tissue surface where the graphical plane overlay in the rotated orientation transects the tissue surface; and
estimate or determine the distance between the first measurement point and the second measurement point along the tissue surface where the graphical plane overlay in the rotated orientation transects the tissue.
6. The system of claim 1 , wherein the instructions are further executable by said at least one processor to receive input from the user identifying the second measurement point using a user input device.
7. The system of claim 1 , wherein the instructions are further executable by said at least one processor to identify the second measurement point using computer vision.
8. The system of claim 1 , wherein the first measurement point is on or a predetermined distance from the predetermined part of the surgical instrument disposed at the treatment site.
9. The system of claim 8 , wherein the first measurement point is a point offset from a distal end of the first surgical instrument by a predetermined distance.
10. The system of claim 1 , wherein the instructions are executable by said at least one processor to:
receive user input to rotate the graphical plane overlay along a line extending between the first measurement point and the second measurement point;
rotate the displayed graphical plane overlay relative to the displayed real time 3D image to a rotated orientation on the display in response to the user input to rotate the graphical plane, and graphically depict a second measurement pathway on the rotated plane along the tissue surface where the graphical plane overlay in the rotated orientation transects the tissue surface; and
estimate or determine the distance between the first measurement point and the second measurement point along the tissue surface where the graphical plane overlay in the rotated orientation transects the tissue.
11. The system of claim 10 , wherein the instructions are executable by said at least one processor to display an overlay showing points of transection between the graphical plane overlay and the tissue surface.
12. The system of claim 1 , wherein the instructions are executable by said at least one processor to receive user input specifying a location for the second measurement point.
13. The system of claim 12 , wherein the instructions are executable by said at least one processor to display a second overlay on the display at a location corresponding to the 3D location of the second measurement point.