IP Library › Granted Patent US 12,245,823
Granted Patent B2
US 12,245,823 · App. 18/163,686 · Granted Mar 11, 2025

System and method for automated trocar and robot base location determination

Inventors: Yash Evalekar (Princeton, NJ); Yuanfeng Mao (Princeton, NJ); Guo-Qing Wei (Plainsboro, NJ); Li Fan (Belle Mead, NJ); Xiaolan Zeng (Princeton, NJ); Jianzhong Qian (Princeton Junction, NJ)
Assignee: EDDA TECHNOLOGY, INC.
A61B34/10A61B17/3403A61B17/3423A61B17/3476B25J9/1605A61B2017/3409A61B2034/104A61B2034/105A61B2034/107G05B2219/45117
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,245,823
App. No.
18/163,686
Granted
Mar 11, 2025
Kind
B2
Abstract

The present teaching relates to automated trocar/robot base location determination. An input related to a surgical operation includes a three-dimensional (3D) model for an organ with cut points on the organ forming a surgical trajectory. A surgical instrument is controlled by a robot to reach the cut points to carry out the operation. An insertion location for inserting the surgical instrument is identified. Based on the identified insertion location, a robot base location is determined with respect to the identified insertion location to deploy the robot for controlling the surgical instrument to reach the cut points. Signals for configuring the surgical setting are then generated based on the insertion location for the surgical instrument and the base location for the robot.

Claims (84)

1. A method implemented on at least one processor, a memory, and a communication platform, comprising:

receiving input related to a surgical operation, including a three-dimensional (3D) model of an organ, wherein the 3D model includes a list of cut points on the organ forming a planned surgical trajectory, wherein a surgical instrument controlled by a robot is used to reach each of the cut points to carry out the surgical operation;

identifying an insertion location on skin of a patient for inserting the surgical instrument, wherein the surgical instrument inserted at the insertion location is controlled by the robot to reach each of the list of cut points;

identifying, with respect to the insertion location, a robot base location, where the robot is to be stationed and operates to control movement of the surgical instrument to reach each of the list of cut points; and

generating control signals for configuring a surgical setting for the surgical operation based on the insertion location for the surgical instrument and the base location for the robot.

2. The method of claim 1 , wherein the step of identifying an insertion location comprises:

determining a plurality of candidate insertion locations for inserting the surgical instrument;

determining performance evaluation parameters for each of the candidate insertion locations; and

selecting the insertion location from the candidate insertion locations based on the performance evaluation parameters for each of the candidate insertion locations.

3. The method of claim 2 , wherein the performance evaluation parameters for each of the candidate insertion locations include at least one of:

a first access map obtained by determining an area on the organ that the surgical instrument inserted from the candidate insertion location is able to reach;

a coverage indicating a portion of the list of cut points that that fall within the first access map;

a distance from the candidate insertion location to the surgery trajectory projected on the organ;

an angle between a surface norm associated with one cut point selected from the list of cut points and a line formed between the candidate insertion point and the cut point; and

an indication of any collision with other anatomical structure in reaching any of the cut points from the insertion location.

4. The method of claim 2 , wherein the step of selecting the insertion location is based on an insertion location optimization model obtained via machine learning based on training data collected from past historic surgery data.

5. The method of claim 1 , wherein the step of identifying the base location for the robot with respect to the insertion location comprises:

determining an operating space of the robot based on the optimal insertion location;

creating an operating space grid, according to a resolution, wherein each unit in the operating space grid corresponds to a candidate base location;

determining, for each candidate base location in the operating space grid, evaluation parameters; and

selecting the base location from the candidate base locations based on the evaluation parameters of each of the candidate base locations.

6. The method of claim 5 , wherein the evaluation parameters for each candidate base location include at least one of:

a second access map specifying an area on the organ that the robot stationed at the candidate base location is able to control the surgical instrument to reach;

a coverage indicating a portion of a first access map associated with the optimal insertion location that overlaps with the second access map;

a distance from the candidate base location to the optimal insertion location;

an angle between a surface norm at the optimal insertion location and a line formed between the robot stationed at the candidate base location and the optimal insertion location; and

a proximity to singularity of the robot determined based on kinematic parameter configurations needed for the robot to control the surgical instrument to reach the list of cut points.

7. The method of claim 5 , wherein the step of selecting the base location is based on a robot base location optimization model obtained via machine learning based on training data collected from past historic surgery data.

8. Machine readable and non-transitory medium having information recorded thereon, wherein the information, when read by the machine, causes the machine to perform the following steps:

receiving input related to a surgical operation, including a three-dimensional (3D) model of an organ, wherein the 3D model includes a list of cut points on the organ forming a planned surgical trajectory, wherein a surgical instrument controlled by a robot is used to reach each of the cut points to carry out the surgical operation;

identifying an insertion location on skin of a patient for inserting the surgical instrument, wherein the surgical instrument inserted at the insertion location is controlled by the robot to reach each of the list of cut points;

identifying, with respect to the insertion location, a robot base location, where the robot is to be stationed and operates to control movement of the surgical instrument to reach each of the list of cut points; and

generating control signals for configuring a surgical setting for the surgical operation based on the insertion location for the surgical instrument and the base location for the robot.

9. The medium of claim 8 , wherein the step of identifying an insertion location comprises:

determining a plurality of candidate insertion locations for inserting the surgical instrument;

determining performance evaluation parameters for each of the candidate insertion locations; and

selecting the insertion location from the candidate insertion locations based on the performance evaluation parameters for each of the candidate insertion locations.

10. The medium of claim 9 , wherein the performance evaluation parameters for each of the candidate insertion locations include at least one of:

a first access map obtained by determining an area on the organ that the surgical instrument inserted from the candidate insertion location is able to reach;

a coverage indicating a portion of the list of cut points that that fall within the first access map;

a distance from the candidate insertion location to the surgery trajectory projected on the organ;

an angle between a surface norm associated with one cut point selected from the list of cut points and a line formed between the candidate insertion point and the cut point; and

an indication of any collision with other anatomical structure in reaching any of the cut points from the insertion location.

11. The medium of claim 9 , wherein the step of selecting the insertion location is based on an insertion location optimization model obtained via machine learning based on training data collected from past historic surgery data.

12. The medium of claim 9 , wherein the step of identifying the base location for the robot with respect to the insertion location comprises:

determining an operating space of the robot based on the insertion location;

creating an operating space grid, according to a resolution, wherein each unit in the operating space grid corresponds to a candidate base location;

determining, for each candidate base location in the operating space grid, evaluation parameters; and

selecting the base location from the candidate base locations based on the evaluation parameters of each of the candidate base locations.

13. The medium of claim 12 , wherein the evaluation parameters for each candidate base location include at least one of:

a second access map specifying an area on the organ that the robot stationed at the candidate base location is able to control the surgical instrument to reach;

a coverage indicating a portion of a first access map associated with the optimal insertion location that overlaps with the second access map;

a distance from the candidate base location to the optimal insertion location;

an angle between a surface norm at the optimal insertion location and a line formed between the robot stationed at the candidate base location and the optimal insertion location; and

a proximity to singularity of the robot determined based on kinematic parameter configurations needed for the robot to control the surgical instrument to reach the list of cut points.

14. The medium of claim 12 , wherein the step of selecting the base location is based on a robot base location optimization model obtained via machine learning based on training data collected from past historic surgery data.

15. A system, comprising:

a sequential optimization framework implemented by a processor and configured for receiving input related to a surgical operation, including a three-dimensional (3D) model of an organ, wherein the 3D model includes a list of cut points on the organ forming a planned surgical trajectory, wherein a surgical instrument controlled by a robot is used to reach each of the cut points to carry out the surgical operation;

an insertion location optimizer implemented by a processor and configured for identifying an insertion location on skin of a patient for inserting the surgical instrument, wherein the surgical instrument inserted at the insertion location is controlled by the robot to reach each of the list of cut points;

a robot base location optimizer implemented by a processor and configured for identifying, with respect to the insertion location, a robot base location, where the robot is to be stationed and operates to control movement of the surgical instrument to reach each of the list of cut points; and

a surgery setting configuration unit implemented by a processor and configured for generating control signals for configuring a surgical setting for the surgical operation based on the insertion location for the surgical instrument and the base location for the robot.

16. The system of claim 15 , wherein the insertion location optimizer comprises:

a candidate insertion location generator implemented by a processor and configured for determining a plurality of candidate insertion locations for inserting the surgical instrument;

an evaluation parameter determiner implemented by a processor and configured for determining performance evaluation parameters for each of the candidate insertion locations; and

a location optimizer implemented by a processor and configured for selecting the insertion location from the candidate insertion locations based on the performance evaluation parameters for each of the candidate insertion locations.

17. The system of claim 16 , wherein the performance evaluation parameters for each of the candidate insertion locations include at least one of:

a first access map obtained by determining an area on the organ that the surgical instrument inserted from the candidate insertion location is able to reach;

a coverage indicating a portion of the list of cut points that that fall within the first access map;

a distance from the candidate insertion location to the surgery trajectory projected on the organ;

an angle between a surface norm associated with one cut point selected from the list of cut points and a line formed between the candidate insertion point and the cut point; and

an indication of any collision with other anatomical structure in reaching any of the cut points from the insertion location.

18. The system of claim 16 , wherein the location optimizer selects the insertion location is based on an insertion location optimization model obtained via machine learning based on training data collected from past historic surgery data.

19. The system of claim 15 , wherein the robot base location optimizer comprises:

a robot operating space determiner implemented by a processor and configured for determining an operating space of the robot based on the optimal insertion location;

an operating space grid generator implemented by a processor and configured for creating an operating space grid, according to a resolution, wherein each unit in the operating space grid corresponds to a candidate base location;

a grid based evaluation parameter generator implemented by a processor and configured for determining, for each candidate base location in the operating space grid, evaluation parameters; and

an optimal base location selector implemented by a processor and configured for selecting the base location from candidate base locations based on the evaluation parameters of each of the candidate base locations.

20. The system of claim 19 , wherein the evaluation parameters for each candidate base location include at least one of:

a second access map specifying an area on the organ that the robot stationed at the candidate base location is able to control the surgical instrument to reach;

a coverage indicating a portion of a first access map associated with the optimal insertion location that overlaps with the second access map;

a distance from the candidate base location to the optimal insertion location;

an angle between a surface norm at the optimal insertion location and a line formed between the robot stationed at the candidate base location and the optimal insertion location; and

a proximity to singularity of the robot determined based on kinematic parameter configurations needed for the robot to control the surgical instrument to reach the list of cut points.

21. The system of claim 19 , wherein the optimal base location selector selects the base location is based on a robot base location optimization model obtained via machine learning based on training data collected from past historic surgery data.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 2, 2023
From: EVALEKAR, YASH; MAO, YUANFENG; WEI, GUO-QING; FAN, LI; ZENG, XIAOLAN; QIAN, JIANZHONG
To: EDDA TECHNOLOGY, INC.
Reel/Frame 063511/0871 →
Continuity (1)
Related Publication 20240261028A1 · Aug 8, 2024
References Cited (39)
US 6728599B2 · Wang · 2004 [cited by examiner]
US 10973597B2 · Mccormick · 2021 [cited by examiner]
US 20100234857A1 · Itkowitz · 2010 [cited by examiner]
US 20110146676A1 · Dallam · 2011 [cited by examiner]
US 20110306986A1 · Lee et al. · 2011 [cited by applicant]
US 20140227132A1 · Neister · 2014 [cited by examiner]
US 20140378995A1 · Kumar et al. · 2014 [cited by applicant]
US 20170042730A1 · He · 2017 [cited by examiner]
US 20190343589A1 · Kim et al. · 2019 [cited by applicant]
US 20200113635A1 · Ida et al. · 2020 [cited by applicant]
US 20200383734A1 · Dahdouh · 2020 [cited by examiner]
US 20210068908A1 · Thienphrapa et al. · 2021 [cited by applicant]
US 20210196384A1 · Shelton, IV et al. · 2021 [cited by applicant]
US 20210315637A1 · Ida et al. · 2021 [cited by applicant]
US 20210378752A1 · Paul et al. · 2021 [cited by applicant]
US 20220104822A1 · Shelton, IV et al. · 2022 [cited by applicant]
US 20220331022A1 · Troxell et al. · 2022 [cited by applicant]
US 20220361968A1 · Noonan et al. · 2022 [cited by applicant]
US 20220370139A1 · Kaouk et al. · 2022 [cited by applicant]
US 20220378524A1 · Schreiber · 2022 [cited by examiner]
US 20220406452A1 · Shelton, IV · 2022 [cited by applicant]
US 20230020476A1 · Junio et al. · 2023 [cited by applicant]
US 20230346493A1 · Hallen · 2023 [cited by examiner]
US 20240261045A1 · Evalekar · 2024 [cited by examiner]
KR 1049507B1 · 2011 [cited by applicant]
WO 2022119754A1 · 2022 [cited by applicant]
Hussain et al., Development of Simulator for Robot Assisted Surgical Platform for Cholecystectomy Training, 2019, IEEE, p. 1-5 (Year: 2019). [cited by examiner]
Laribi et al., A design of slave surgical robot based on motion capture, 2012, IEEE, p. 600-605 (Year: 2012). [cited by examiner]
Basdogan et al., aptics in minimally invasive surgical simulation and training, 2004, IEEE, p. 56-64 (Year: 2004). [cited by examiner]
Vitiello et al., Emerging Robotic Platforms for Minimally Invasive Surgery, 2013, IEEE, p. 111-126 (Year: 2013). [cited by examiner]
Yip et al., A Vision-Assisted Semi-Automatic Uterus Manipulation Approach Based on a Pose Estimating Trocar, 2019, IEEE, p. 169-174 (Year: 2019). [cited by examiner]
International Search Report and Written Opinion mailed on May 17, 2024 in International Patent Application No. PCT/US2024/014171. [cited by applicant]
International Search Report and Written Opinion mailed on May 20, 2024 in International Patent Application No. PCT/US2024/014179. [cited by applicant]
Sundaram et al., “Task-specific robot base pose optimization for robot-assisted surgeries.” Frontiers in Robotics and AI, Biomedical Robotics, Dec. 2, 2022, pp. 1-17, Institute of Robotics and Mechatronics, German Aeros… [cited by applicant]
International Search Report and Written Opinion mailed on May 23, 2024 in International Patent Application No. PCT/US2024/014178. [cited by applicant]
Mountney et al., “Three-Dimensional Tissue Deformation Recovery and Tracking”, Introducing techniques bsed on laparoscopic or endoscopic images, IEEE Signal Processing Magazine, Jun. 14, 2010, pp. 14-24, vol. 27, Issue … [cited by applicant]
Joerger et al., “Global Laparoscopy Positioning System with a Smart Trocar”, Proceedings—2017 IEEE 17th International Conference on Bioinformatics and Bioengineering, Oct. 23, 2017-Oct. 25, 2017, pp. 359-366, IEEE Compu… [cited by applicant]
Selha et al., “Dexterity optimization by port placement in robot-assisted minimally invasive surgery”, 2001 SPIE International Symposium on Intelligent Systems and Advanced Manufacturing, Oct. 28, 2001-Oct. 31, 2001, pp… [cited by applicant]
Hayashi et al., “Optimal port placement planning method for laparoscopic gastrectomy”, Anstract, International Journal of Computer Assisted Radiology and Surgery, Mar. 7, 2017, 1 Page, vol. 12, Springer, United States o… [cited by applicant]