IP Library Granted Patent US 12,201,373
Granted Patent B2
US 12,201,373 · App. 15/563,825 · Granted Jan 21, 2025

Determining a configuration of a medical robotic arm

Inventors: Wolfgang Steinle (Munich, DE); Christoffer Hamilton (Aschheim, DE); Nils Frielinghaus (Heimstetten, DE)
Assignee: Brainlab AG
A61B34/20A61B34/10A61B34/30A61B90/37A61B90/50B25J9/1666B25J9/1676G06T7/0012G06T7/70G06T11/001A61B2034/105A61B2034/107A61B2034/2055A61B2090/364A61B2090/365A61N5/1049A61N2005/1059G06T2207/10024G06T2207/10028G06T2207/10081G06T2207/10088G06T2207/30024G06T2207/30241
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,201,373
App. No.
15/563,825
Granted
Jan 21, 2025
Kind
B2
Abstract

A computer implemented method for determining a configuration of a medical robotic arm, wherein the configuration comprises a pose of the robotic arm and a position of a base of the robotic arm, comprising the steps of: acquiring treatment information data representing information about the treatment to be performed by use of the robotic arm; acquiring patient position data representing the position of a patient to be treated; and calculating the configuration from the treatment information data and the patient position data.

Claims (52)

1. A computer implemented method for determining a configuration of a medical robotic arm, the configuration of the medical robotic arm comprising a pose of the medical robotic arm and a position of a base of the medical robotic arm, the method comprising:

detecting, based on live data captured from the environment, a change in the environment and acquiring changed environment data describing at least a change in positions of persons or a change in equipment, wherein the changed environment data being indicative of a workflow step for a workflow which uses the medical robotic arm and wherein the workflow includes a plurality of workflow steps;

acquiring constraint information data associated with the workflow step based on the changed environment data and the live data, wherein respective constraint information is assigned to each workflow step of the workflow, and wherein the constraint information includes one or more of: (i) people data describing positions of persons involved in a treatment, (ii) equipment data describing equipment used for the treatment other than the medical robotic arm, (iii) room data describing a room in which the treatment is performed, and (iv) robot data describing properties of the medical robotic arm;

transforming the constraint information data into spatial constraint data, the spatial constraint data representing space in which the medical robotic arm is constrained for the workflow step; and

determining the configuration of the medical robotic arm for the workflow step based on the spatial constraint data.

2. The method of claim 1 , further comprising acquiring patient position data representing a position of an associated patient, wherein the calculation of the configuration of the medical robotic arm is further based on the patient position data.

3. The method of claim 1 , further comprising acquiring a current configuration of the medical robotic arm, wherein the current configuration of the medical robotic arm is used as the configuration of the medical robotic arm when the current configuration of the medical robotic arm does not interfere with the change in the environment.

4. The method of claim 1 , wherein the changed environment data is acquired from a medical tracking system and includes the position of an object tracked by the medical tracking system.

5. The method of claim 1 , wherein the changed environment data includes movement data representing a movement of a device other than the medical robotic arm.

6. The method of claim 1 , wherein the configuration of the medical robotic arm further comprises work space data representing a work space that the medical robotic arm is allowed to occupy.

7. The method according to claim 1 , further comprising:

acquiring treatment information data representing information about a treatment to be performed on an associated patient by use of the medical robotic arm,

wherein the calculating the configuration of the medical robotic arm is further based on the treatment information data.

8. The method of claim 1 , further comprising controlling the medical robotic arm in accordance with the configuration in response to the indicated beginning of the workflow step.

9. A non-transitory computer readable storage medium storing a program for determining a configuration of a medical robotic arm, the configuration of the medical robotic arm comprising a pose of the medical robotic arm and a position of a base of the medical robotic arm, the computer program, which, when running on a computer, or loaded onto the computer, causes the computer to:

detect, based on live data captured from the environment, a change in the environment and acquire changed environment data describing at least a change in positions of persons or a change in equipment, wherein the changed environment data being indicative of a workflow step for a workflow which uses the medial robotic arm and wherein the workflow includes a plurality of workflow steps;

acquire constraint information data associated with the workflow step based on the changed environment data and the live data, wherein respective constraint information is assigned to each workflow step of the workflow, and wherein the constraint information includes one or more of: (i) people data describing positions of persons involved in a treatment, (ii) equipment data describing equipment used for the treatment other than the medical robotic arm, (iii) room data describing a room in which the treatment is performed, and (iv) robot data describing properties of the medical robotic arm;

transform the constraint information data into spatial constraint data, the spatial constraint data representing space in which the medical robotic arm is constrained for the workflow step; and

determine the configuration of the medical robotic arm for the workflow step based on the spatial constraint data.

10. The non-transitory computer readable storage medium of claim 9 , the program further causing the computer to control the medical robotic arm in accordance with the configuration in response to the indicated beginning of the workflow step.

11. A system for determining a configuration of a medical robotic arm, the configuration of the medical robotic arm comprising a pose of the medical robotic arm and a position of a base of the medical robotic arm, the system comprising:

a medical robotic arm; and

a computer configured to:

detect, based on live data captured from an environment, a change in the environment and acquire changed environment data describing at least a change in positions of persons or a change in equipment, wherein the changed environment data being indicative of a workflow step for a workflow which uses the medical robotic arm and wherein the workflow includes a plurality of workflow steps;

acquire constraint information data associated with the workflow step based on the changed environment data and the live data, wherein respective constraint information is assigned to each workflow step of the workflow, and wherein the constraint information includes one or more of: (i) people data describing positions of persons involved in a treatment, (ii) equipment data describing equipment used for the treatment other than the medical robotic arm, (iii) room data describing a room in which the treatment is performed, and (iv) robot data describing properties of the medical robotic arm;

transform constraint information data into spatial constraint data, the spatial constraint data representing space in which the medical robotic arm is constrained for the workflow step; and

determine the configuration of the medical robotic arm for the workflow step based on the spatial constraint data.

12. The system according to claim 11 , wherein the computer is further configured to acquire patient position data representing a position of an associated patient, wherein the calculation of the configuration of the medical robotic arm is further based on the patient position data.

13. The system according to claim 11 , wherein the computer is further configured to acquire a current configuration of the medical robotic arm, wherein the current configuration of the medical robotic arm is used as the configuration of the medical robotic arm when the current configuration of the medical robotic arm does not interfere with the change in the environment.

14. The system according to claim 11 , further comprising:

a medical tracking system,

wherein the changed environment data is acquired from the medical tracking system and includes the position of an object tracked by the medical tracking system.

15. The system according to claim 11 , further comprising:

a device other than the medical robotic arm,

wherein the changed environment data includes movement data representing a movement of the device other than the medical robotic arm.

16. The system according to claim 11 , wherein the configuration of the medical robotic arm further comprises work space data representing a work space that the medical robotic arm is allowed to occupy.

17. The system according to claim 11 , wherein the position of the base of the medical robotic arm moves to a calculated position based on the calculated configuration of the medical robotic arm.

18. The system according to claim 11 , wherein the computer is further configured to:

acquire treatment information data representing information about a treatment to be performed on an associated patient by use of the medical robotic arm, and

calculate the configuration of the medical robotic arm further based on the treatment information data.

19. The system of claim 11 , wherein the computer is further configured to control the medical robotic arm in accordance with the configuration in response to the indicated beginning of the workflow step.

20. A computer implemented method for determining a configuration of a medical robotic arm, the configuration of the medical robotic arm comprising a pose of the medical robotic arm and a position of a base of the medical robotic arm, the method comprising:

acquiring treatment information data representing information indicating a medical procedure to be performed by use of the robotic arm and a disease to be treated, wherein the disease to be treated indicated within the treatment information data is identified by a particular disease classification of a plurality of disease classifications, wherein the treatment information indicates a workflow for the medical procedures including a plurality of workflow steps;

retrieving from a database which associates diseases to be treated with locations or regions within a patient's body, a location or region within a patient's body corresponding to the disease to be treated for respective workflow steps, wherein the location or region is defined with respect to the patient's body;

detecting, based on live data captured from the environment, a change in positions of persons or a change in equipment, the changes being indicative of a workflow step of the plurality of workflow steps;

transforming constraint information associated with the workflow step and the treatment information data, into spatial constraint data indicating space in which movement of the medical robotic arm is to be constrained;

retrieving a model that describes the robotic arm in terms of possible joint positions;

acquiring patient position data representing a position of the patient to be treated, wherein the patient position data defines the position of the patient relative to at least one reference point of both the physical environment of the user and the robot;

calculating a configuration that the medical robotic arm shall assume from the location or region within the patient's body corresponding to the workflow step and based upon the disease to be treated in the treatment information data, the patient position data, the spatial constraint data, and the model which describes the robotic arm such that the configuration is a starting point from which all poses of the robotic arm required during the treatment can be reached,

wherein calculating the configuration includes ensuring positions to be reached by the free end of the robotic arm include the locations or regions within the patient's body corresponding to the workflow step and the disease to be treated, and further includes determining a position of the base, wherein the base is movable, and

wherein the position of the base is determined relative to the at least one reference point of the physical environment of both the user and the robot; and

providing control signals to a controller of the robotic arm based upon the calculated configuration allowing the robotic arm to assume a pose defined by the calculated configuration.

Assignments (2)
CHANGE OF NAME Recorded Jan 22, 2026
From: BRAINLAB AG
To: BRAINLAB SE
Reel/Frame 073550/0318 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 2, 2017
From: STEINLE, WOLFGANG; HAMILTON, CHRISTOFFER; FRIELINGHAUS, NILS
To: BRAINLAB AG
Reel/Frame 043758/0426 →
Priority Claims (2)
WO PCT/EP2015/069037 · Aug 19, 2015 · international
WO PCT/EP2015/070153 · Sep 3, 2015 · international
Continuity (1)
Related Publication 20180085175A1 · Mar 29, 2018
References Cited (148)
US 5544282A · Chen · 1996 [cited by examiner]
US 7176795B2 · Roed · 2007 [cited by examiner]
US 7723057B1 · Snow · 2010 [cited by examiner]
US 8571710B2 · Coste-Maniere · 2013 [cited by examiner]
US 9956042B2 · Simaan · 2018 [cited by examiner]
US 10394327B2 · Chizeck · 2019 [cited by examiner]
US 10740866B2 · Katouzian · 2020 [cited by examiner]
US 11141859B2 · Steinle · 2021 [cited by examiner]
US 11642182B2 · Ecke · 2023 [cited by examiner]
US 20010013764A1 · Blumenkranz · 2001 [cited by examiner]
US 20030050527A1 · Fox · 2003 [cited by examiner]
US 20030083903A1 · Myers · 2003 [cited by examiner]
US 20030109780A1 · Coste-Maniere · 2003 [cited by examiner]
US 20030236476A1 · Inman · 2003 [cited by examiner]
US 20050159987A1 · Rosenfeld · 2005 [cited by examiner]
US 20050177400A1 · Rosenfeld · 2005 [cited by examiner]
US 20050223176A1 · Peters, II · 2005 [cited by examiner]
US 20060241718A1 · Tyler · 2006 [cited by examiner]
US 20070250119A1 · Tyler · 2007 [cited by examiner]
US 20080009772A1 · Tyler · 2008 [cited by examiner]
US 20090089081A1 · Haddad · 2009 [cited by examiner]
US 20090177081A1 · Joskowicz · 2009 [cited by examiner]
US 20090183740A1 · Sheffer · 2009 [cited by examiner]
US 20090271035A1 · Lurz · 2009 [cited by examiner]
US 20090306741A1 · Hogle · 2009 [cited by examiner]
US 20090312817A1 · Hogle · 2009 [cited by examiner]
US 20110184558A1 · Jacob · 2011 [cited by examiner]
US 20110190790A1 · Summerer · 2011 [cited by examiner]
US 20130178980A1 · Chemouny · 2013 [cited by examiner]
US 20130211531A1 · Steines · 2013 [cited by examiner]
US 20130317369A1 · Bryant-Greenwood · 2013 [cited by examiner]
US 20130345718A1 · Crawford · 2013 [cited by examiner]
US 20140058407A1 · Tsekos · 2014 [cited by examiner]
US 20140058755A1 · Macoviak · 2014 [cited by examiner]
US 20140163368A1 · Rousso · 2014 [cited by examiner]
US 20140180703A1 · Mansker · 2014 [cited by examiner]
US 20140188440A1 · Donhowe · 2014 [cited by examiner]
US 20140222206A1 · Mead · 2014 [cited by examiner]
US 20140228644A1 · Ikenaga · 2014 [cited by examiner]
US 20140264081A1 · Walker · 2014 [cited by examiner]
US 20140277726A1 · Nakamura · 2014 [cited by examiner]
US 20140316436A1 · Bar · 2014 [cited by examiner]
US 20150025549A1 · Kilroy · 2015 [cited by examiner]
US 20150046137A1 · Zeilinger · 2015 [cited by examiner]
US 20150161331A1 · Oleynik · 2015 [cited by examiner]
US 20150190204A1 · Popovi · 2015 [cited by examiner]
US 20150223832A1 · Swaney · 2015 [cited by examiner]
US 20150290454A1 · Tyler · 2015 [cited by examiner]
US 20150351860A1 · Piron · 2015 [cited by examiner]
US 20150374446A1 · Malackowski · 2015 [cited by examiner]
US 20160000633A1 · An · 2016 [cited by examiner]
US 20160361034A1 · Hayashi · 2016 [cited by examiner]
US 20170020615A1 · Koenig · 2017 [cited by examiner]
US 20170197313A1 · Nishino · 2017 [cited by examiner]
US 20170333137A1 · Roessler · 2017 [cited by examiner]
US 20180001475A1 · Steinle · 2018 [cited by examiner]
US 20180014891A1 · Krebs · 2018 [cited by examiner]
US 20180071029A1 · Srimohanarajah · 2018 [cited by examiner]
US 20180085175A1 · Steinle · 2018 [cited by examiner]
US 20180092615A1 · Sakaguchi · 2018 [cited by examiner]
US 20180125591A1 · Camarillo · 2018 [cited by examiner]
US 20180177383A1 · Noonan · 2018 [cited by examiner]
US 20180177556A1 · Noonan · 2018 [cited by examiner]
US 20180211385A1 · Imai · 2018 [cited by examiner]
US 20180214005A1 · Ebata · 2018 [cited by examiner]
US 20180221240A1 · Yu · 2018 [cited by examiner]
US 20180250352A1 · Conner · 2018 [cited by examiner]
US 20180289432A1 · Kostrzewski · 2018 [cited by examiner]
US 20180295327A1 · Yearwood · 2018 [cited by examiner]
US 20180325608A1 · Kang · 2018 [cited by examiner]
US 20190000578A1 · Yu · 2019 [cited by examiner]
US 20190005838A1 · Yu · 2019 [cited by examiner]
US 20190005848A1 · Garcia Kilroy · 2019 [cited by examiner]
US 20190090966A1 · Kang · 2019 [cited by examiner]
US 20190091864A1 · Matsudaira · 2019 [cited by examiner]
US 20190125361A1 · Shelton, IV · 2019 [cited by examiner]
US 20190125454A1 · Stokes · 2019 [cited by examiner]
US 20190125455A1 · Shelton, IV · 2019 [cited by examiner]
US 20190125459A1 · Shelton, IV · 2019 [cited by examiner]
US 20190133689A1 · Johnson · 2019 [cited by examiner]
US 20190184198A1 · Mori · 2019 [cited by examiner]
US 20190201136A1 · Shelton, IV · 2019 [cited by examiner]
US 20190206562A1 · Shelton, IV · 2019 [cited by examiner]
US 20190206565A1 · Shelton, IV · 2019 [cited by examiner]
US 20200100830A1 · Henderson · 2020 [cited by examiner]
US 20200118265A1 · Igarashi · 2020 [cited by examiner]
US 20200211713A1 · Shadforth · 2020 [cited by examiner]
US 20200405403A1 · Shelton, IV · 2020 [cited by examiner]
US 20210158218A1 · Machida · 2021 [cited by examiner]
US 20210161588A1 · Fujisawa · 2021 [cited by examiner]
US 20210169578A1 · Calloway · 2021 [cited by examiner]
US 20210169605A1 · Calloway · 2021 [cited by examiner]
US 20210275260A1 · Kang · 2021 [cited by examiner]
US 20220028550A1 · Ng · 2022 [cited by examiner]
US 20220104822A1 · Shelton, IV · 2022 [cited by examiner]
US 20220233119A1 · Shelton, IV · 2022 [cited by examiner]
US 20220273291A1 · Shelton, IV · 2022 [cited by examiner]
US 20220344025A1 · Bort · 2022 [cited by examiner]
US 20230029239A1 · Tsujimoto · 2023 [cited by examiner]
US 20230148847A1 · Gono · 2023 [cited by examiner]
US 20230165649A1 · Fitzsimons · 2023 [cited by examiner]
US 20230180998A1 · Mizutani · 2023 [cited by examiner]
US 20230190378A1 · Khurana · 2023 [cited by examiner]
US 20230219231A1 · Okada · 2023 [cited by examiner]
US 20230222666A1 · Takenouchi · 2023 [cited by examiner]
US 20230225747A1 · Gogarty · 2023 [cited by examiner]
US 20230255442A1 · Masaki · 2023 [cited by examiner]
US 20230263581A1 · Forsyth · 2023 [cited by examiner]
US 20230277259A1 · Kang · 2023 [cited by examiner]
US 20230329813A1 · Abbasi · 2023 [cited by examiner]
US 20230363826A1 · Russell · 2023 [cited by examiner]
US 20230380669A1 · Zhao · 2023 [cited by examiner]
US 20230380670A1 · Tavakkolmoghaddam · 2023 [cited by examiner]
US 20240025032A1 · López Del Pueyo · 2024 [cited by examiner]
US 20240041549A1 · Tanimoto · 2024 [cited by examiner]
US 20240081918A1 · Nishihara · 2024 [cited by examiner]
US 20240081927A1 · Kodama · 2024 [cited by examiner]
US 20240138941A1 · Zeng · 2024 [cited by examiner]
US 20240180639A1 · Kang · 2024 [cited by examiner]
CN 104780849B · 2018 [cited by examiner]
CN 111670014A · 2020 [cited by examiner]
CN 114631892A · 2022 [cited by examiner]
EP 0335314A2 · 1989 [cited by applicant]
EP 1355765A2 · 2003 [cited by applicant]
EP 3212109B1 · 2020 [cited by examiner]
EP 3414736B1 · 2020 [cited by examiner]
EP 3628262B1 · 2021 [cited by examiner]
JP 2009207677A · 2009 [cited by examiner]
JP 2011217904A · 2011 [cited by examiner]
JP 2020156800A · 2020 [cited by examiner]
JP 2021509332A · 2021 [cited by examiner]
JP 2021509507A · 2021 [cited by examiner]
KR 20210104190A · 2021 [cited by examiner]
WO 02060653A2 · 2002 [cited by applicant]
WO 2006075331A2 · 2006 [cited by applicant]
WO 2008130355A1 · 2008 [cited by applicant]
WO 2010140074A1 · 2010 [cited by applicant]
WO WO2013018983A1 · 2013 [cited by examiner]
WO WO2014008929A1 · 2014 [cited by examiner]
WO 2015087335A1 · 2015 [cited by applicant]
WO WO2018050207A1 · 2018 [cited by examiner]
WO WO2020236937A1 · 2020 [cited by examiner]
“Robot-assisted RF ablation with interactive planning and mixed reality guidance;” Rong Wen, Chin-Boon Chng, Chee-Kong Chui, Kah-Bin Lim, Sim-Heng Ong, Chang, S.K.-Y; 2012 IEEE/SICE International Symposium on System Int… [cited by examiner]
“A Perspective on Medical Robotics;” R.H. Taylor; Proceedings of the IEEE (vol. 94, Issue: 9, pp. 1652-1664); Sep. 1, 2006. [cited by examiner]
European Patent Office, International Search Report and Written Opinion from corresponding International Application No., PCT/EP2015/075427, mail date, Jun. 7, 2016, 1-11pages. [cited by applicant]
Lasser, Michael S., et al., “Dedicated robotics team reduces pre-surgical preparation time”, Indian Journal of Urology, (2012), vol. 28, Issue 3, pp. 263-266. [cited by applicant]
Chaumette, Francois, et al., “Visual servo control, Part I: Basic approaches”, IEEE Robotics and Automation Magazine, Institute of Electrical and Electronics Engineers, (2006), 13 (4), pp. 82-90. [cited by applicant]
Office Action for corresponding European Application No. 19202230.9, dated Jan. 7, 2020. 4 Pages. [cited by applicant]