IP Library Granted Patent US 12,544,163
Granted Patent B2
US 12,544,163 · App. 18/527,806 · Granted Feb 10, 2026

Roboticized surgery system with improved control

Inventors: Damien Brasset (Busnago, IT); Paolo Invernizzi (Milan, IT); Emilio Ruiz Morales (Milan, IT)
Assignee: KARL STORZ SE & Co. KG
A61B34/30A61B17/00G06F3/013G06F3/0482G06F3/04842G06F3/04847G06V40/19A61B3/113A61B5/11A61B2017/00216A61B34/37A61B90/361
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,544,163
App. No.
18/527,806
Granted
Feb 10, 2026
Kind
B2
Abstract

A robotized surgery system comprises at least one robot arm which acts under the control of a control console intended for the surgeon. The console comprises an eye tracking system for detecting the direction of the surgeon's gaze and for entering commands depending on the directions of the gaze detected. The console comprises advantageously a screen with at least one zone for viewing the operating field and, among the commands which can be performed depending on the gaze directions.

Claims (30)

1 . A method of using a surgical robotic system, comprising:

providing a surgical system comprising

a first robotic arm carrying a surgical instrument;

a second robotic arm carrying an endoscopic camera,

a surgeon console including

a display;

an eye tracking system, and

a manipulator moveable by a user's hands;

displaying an image from the endoscopic camera on the display;

causing movement of the first robotic arm in response to movement of the manipulator by a user; and

during movement of the first robotic arm in response to movement of the manipulator, enlarging or diminishing the image on the screen in response to detected movement of the user's eyes towards or away from the screen.

2 . The method of claim 1 , wherein the method further includes causing the second robotic arm to move the camera in response to a determined direction of the user's gaze towards the display.

3 . The method of claim 1 , further including deactivating the first and second robotic arms in response to signals from the eye tracking system indicating that the estimated direction of the user's gaze is outside an area of the display.

4 . The method of claim 1 , wherein displaying the image includes displaying a stereoscopic image.

5 . A method of using a surgical robotic system, comprising:

providing a surgical system comprising

a first robotic arm carrying a surgical instrument;

a second robotic arm carrying an endoscopic camera,

a surgeon console including

a display;

an eye tracking system, and

a manipulator moveable by a user's hands;

positioning a user in a working position at the surgeon console, wherein in the working position the user's eyes are at least 40 cm from the display;

displaying an image from the endoscopic camera on the display;

causing movement of the first robotic arm in response to movement of the manipulator by a user; and

enlarging or diminishing the image on the screen in response to detected movement of the user's eyes towards or away from the screen.

6 . The method of claim 5 , wherein the method further includes causing the second robotic arm to move the camera in response to a determined direction of the user's gaze towards the display.

7 . The method of claim 5 , further including deactivating the first and second robotic arms in response to signals from the eye tracking system indicating that the estimated direction of the user's gaze is outside an area of the display.

8 . The method of claim 5 , wherein displaying the image includes displaying a stereoscopic image.

9 . The method of claim 8 , wherein positioning the user includes positioning 3D viewing glasses on a face of the user.

Assignments (3)
SECURITY INTEREST Recorded Dec 31, 2024
From: ASENSUS SURGICAL, INC.; ASENSUS SURGICAL US, INC.; ASENSUS SURGICAL EUROPE S.À R.L.; ASENSUS SURGICAL ITALIA S.R.L.
To: KARL STORZ SE & CO. KG
Reel/Frame 069795/0381 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 1, 2024
From: MORALES, EMILIO RUIZ; BRASSET, DAMIEN; INVERNIZZI, PAOLO
To: SOFAR SPA
Reel/Frame 066961/0534 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 1, 2024
From: SOFAR SPA
To: TRANSENTERIX ITALIA S.R.L.
Reel/Frame 066963/0167 →
Priority Claims (1)
IT MI2010A000579 · Apr 7, 2010 · national
Continuity (5)
Continuation 17566596 · Dec 30, 2021
Continuation 16378820 · Apr 9, 2019
Continuation 15149512 · May 9, 2016
Continuation 13639809
Related Publication 20240099791A1 · Mar 28, 2024
References Cited (47)
US 6847336B1 · Lemelson et al. · 2005 [cited by applicant]
US 9360934B2 · Ruiz Morales et al. · 2016 [cited by applicant]
US 10152141B1 · Lohse et al. · 2018 [cited by applicant]
US 10251713B2 · Ruiz Morales · 2019 [cited by examiner]
US 11083601B1 · Leonard et al. · 2021 [cited by applicant]
US 11087271B1 · Guan et al. · 2021 [cited by applicant]
US 11224489B2 · Ruiz Morales et al. · 2022 [cited by applicant]
US 20030109857A1 · Sanchez · 2003 [cited by applicant]
US 20060074307A1 · Igarashi et al. · 2006 [cited by applicant]
US 20060109237A1 · Morita et al. · 2006 [cited by applicant]
US 20070083098A1 · Stern et al. · 2007 [cited by applicant]
US 20070279591A1 · Wezowski et al. · 2007 [cited by applicant]
US 20080027591A1 · Lenser et al. · 2008 [cited by applicant]
US 20080253519A1 · Bonfiglio et al. · 2008 [cited by applicant]
US 20090245600A1 · Hoffman · 2009 [cited by examiner]
US 20090248036A1 · Hoffman · 2009 [cited by examiner]
US 20090307601A1 · Kumhyr et al. · 2009 [cited by applicant]
US 20100205667A1 · Anderson et al. · 2010 [cited by applicant]
US 20110118748A1 · Itkowitz · 2011 [cited by applicant]
US 20120069166A1 · Kunz et al. · 2012 [cited by applicant]
US 20120154564A1 · Hoffman et al. · 2012 [cited by applicant]
US 20130096575A1 · Olson · 2013 [cited by applicant]
US 20140024889A1 · Xiaoli · 2014 [cited by applicant]
US 20140049452A1 · Maltz · 2014 [cited by applicant]
US 20140055578A1 · Wu et al. · 2014 [cited by applicant]
US 20140171964A1 · Yang et al. · 2014 [cited by applicant]
US 20140275760A1 · Lee et al. · 2014 [cited by applicant]
US 20240007737A1 · Takahashi · 2024 [cited by examiner]
US 20240172940A1 · Vaziri · 2024 [cited by examiner]
US 20240185546A1 · Etwaru · 2024 [cited by examiner]
DE 10226539A1 · 2004 [cited by applicant]
DE 102006011233A1 · 2007 [cited by applicant]
DE 102009010263A1 · 2010 [cited by applicant]
WO 2004029786A1 · 2004 [cited by applicant]
WO WO2005074303A1 · 2005 [cited by examiner]
WO 2006087689A2 · 2006 [cited by applicant]
WO 2007088208A1 · 2007 [cited by applicant]
WO 2008048898A1 · 2008 [cited by applicant]
WO 2008088206A1 · 2008 [cited by applicant]
WO 2010021447A1 · 2010 [cited by applicant]
WO 2011125007A1 · 2011 [cited by applicant]
“Computer Ergonomics: Workstation Layout and Lighting”. Ontario Ministry of Labour. 2004 (Year: 2004). [cited by examiner]
S. M. Ali et al., “Eye gaze tracking for endoscopic camera positioning: an application of a hardware/software interface developed to automate Aesop”, Studies in Health Technology and Informatics. pp. 4-7 (2008). [cited by applicant]
Chung, A. J. et al., “Extraction of Visual Features with Eye Tracking for Saliency Driven 2D/3D Registration”, Image and Vision Computing. vol. 23, No. 11, pp. 999-1008. (Oct. 2005). [cited by applicant]
Italian Search Report, Oct. 21, 2010, Munich, IO 14151, IT MI20100579, 11 Pages. [cited by applicant]
Noonan, D. P. et al., “Gaze Contingent Articulated Robot Control for Robot Assisted Minimally Invasive Surgery”, Intelligent Robots and Systems, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems, … [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/IL2011/051397 issued on Aug. 19, 2011, 10 pages. [cited by applicant]