Granted Patent B2

US 12,303,220 · App. 17/585,089 · Granted May 20, 2025

Inventors: Evan Arsham Hosseini (Eden Prairie, MN); Nathan J. Knutson (Long Lake, MN)

Assignee: Covidien LP

A61B34/30A61B1/018A61B1/05A61B1/2676A61B2034/107A61B2034/2065A61B2034/301

Abstract

Claims (45)

1. A system for performing a surgical procedure, comprising:

a controller operably coupled to a camera, the controller including a memory and a processor, the memory storing instructions, which when executed by the processor cause the processor to:

receive a color image captured by the camera;

convert the color image to a grayscale image;

generate a segmented image by applying a first threshold value to the grayscale image captured by the camera;

identify a lumen within the segmented image;

determine a centroid of the lumen within the segmented image;

overlay the segmented image on the grayscale image, wherein the identified lumen of the segmented image is depicted as a translucent color; and

articulate a portion of a surgical device operably coupled to the controller to align the portion of the surgical device with the centroid of the lumen.

2. The system according to claim 1 , wherein the segmented image is generated using dynamic binary thresholding.

3. The system according to claim 1 , further including a surgical device, wherein the camera is disposed on a distal portion of the surgical device, wherein the surgical device is navigable within a portion of a patient's anatomy.

4. The system according to claim 3 , further including a robotic surgical system operably coupled to the surgical device.

5. The system according to claim 4 , wherein the instructions, when executed by the processor, cause the robotic surgical system to align the surgical device with the centroid of the identified lumen.

6. The system according to claim 5 , wherein the instructions, when executed by the processor, cause the processor to generate a pathway to a target tissue.

7. The system according to claim 6 , wherein the instructions, when executed by the processor, cause the processor to identify a lumen within the image corresponding to the pathway to the target tissue.

8. The system according to claim 7 , wherein the instruction, when executed by the processor, cause the robotic surgical system to advance the surgical device within the lumen within the image corresponding to the pathway to the target tissue.

9. The system according to claim 8 , wherein the instructions, when executed by the processor, cause the processor to determine a centroid of the identified lumen within the segmented image in real-time.

10. The system according to claim 9 , wherein the instructions, when executed by the processor, cause the robotic surgical system to maintain alignment of the distal portion of the surgical device with the centroid of the identified lumen within the segmented image as the surgical device is advanced within the identified lumen.

11. A method of performing a surgical procedure, comprising:

receiving a color image of a patient's anatomy from a camera operably coupled to a surgical device;

convert the color image to a grayscale image;

generating a segmented image by applying a first threshold value to the grayscale image;

identifying a lumen within the segmented image;

determining a centroid of the lumen within the segmented image;

overlay the segmented image on the grayscale image, wherein the identified lumen of the segmented image is depicted as a translucent color; and

articulating the surgical device to align the surgical device with the centroid of the lumen.

12. The method according to claim 11 , wherein generating the segmented image includes applying dynamic binary thresholding utilizing the first threshold value to generate the segmented image.

13. The method according to claim 12 , further comprising applying a second threshold value to the segmented image.

14. The method according to claim 12 , further comprising generating a binary image from the segmented image.

15. The method according to claim 11 , further comprising generating a pathway through a patient's anatomy to a target tissue.

16. The method according to claim 15 , further comprising advancing the surgical device through the patient's anatomy following the centroid of the identified lumen and the pathway through the patient's anatomy.

17. A system for performing a surgical procedure, comprising: a robotic surgical system, comprising:

an endoscope including a camera, the camera disposed on a portion of the endoscope; and

a drive mechanism operably coupled to the endoscope; and

a controller operably coupled to the robotic surgical system, the controller including a memory and a processor, the memory storing instructions, which when executed by the processor cause the processor to:

receive a color image captured by the camera;

convert the color image to a grayscale image;

generate a segmented image by applying a first threshold value to the grayscale image captured by the camera;

identify a lumen within the segmented image;

determine a centroid of the lumen;

overlay the segmented image on the grayscale image, wherein the identified lumen of the segmented image is depicted as a translucent color; and

cause the drive mechanism to articulate a distal end portion of the endoscope to align the distal portion of the endoscope with the centroid of the lumen.

18. The system according to claim 17 , wherein the instructions, when executed by the processor, cause the processor to generate a pathway to a target tissue located within a patient's anatomy.

19. The system according to claim 18 , wherein the instructions, when executed by the processor, cause the processor to cause the drive mechanism to advance the distal end portion of the endoscope along the pathway.

20. The system according to claim 19 , wherein the instructions, when executed by the processor, cause the processor to continuously update the centroid of the identified lumen as the endoscope is advanced along the pathway.

Assignments (1)

Continuity (1)

References Cited (339)