IP Library Granted Patent US 12,426,964
Granted Patent B2
US 12,426,964 · App. 18/003,147 · Granted Sep 30, 2025

Time-spaced robotic reference frames

Inventors: Aviv Ellman (Caesarea, IL); Dany Junio (Caesarea, IL); Katherine M. Puckett (Louisville, CO)
Assignee: Mazor Robotics Ltd.
A61B34/30A61B34/20A61B2034/2059A61B2034/305
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,426,964
App. No.
18/003,147
Granted
Sep 30, 2025
Kind
B2
Abstract

A robotic navigation system includes a robot base ( 140 ); a robotic arm ( 144 ) comprising a proximal portion secured to the robot base, a distal portion movable relative to the proximal portion, and a tracking marker ( 156 ) secured to the robotic arm proximate the distal portion; at least one processor; a navigation system including a tracking marker sensor configured to identify positions of the tracking marker in a first coordinate space; and a memory. The memory stores instructions that cause the at least one processor to: cause the robotic arm ( 144 ) to move to a plurality of different poses; receive information relating to a position of the tracking marker ( 156 ) in a second coordinate space when the robotic arm is in each of the plurality of different poses; and compare the positions of the tracking marker in the first coordinate space to the positions of the tracking marker in the second coordinate space.

Claims (54)

1. A surgical robotic navigation system comprising:

a robot base;

a robotic arm comprising:

a proximal portion secured to the robot base;

a distal portion movable relative to the proximal portion; and

a tracking marker secured to the robotic arm proximate the distal portion;

at least one processor;

a navigation system including a tracking marker sensor configured to identify positions of the tracking marker in a first coordinate space; and

a memory storing instructions for execution by the at least one processor that, when executed, cause the at least one processor to:

cause the robotic arm to move to a plurality of different poses;

receive information relating to a position of the tracking marker in a second coordinate space when the robotic arm is in each of the plurality of different poses, wherein the navigation system is configured to detect a first position of the tracking marker at a first time during a surgical procedure when the robotic arm is in a first pose of the plurality of different poses, and to detect a second position of the tracking marker at a second time during the surgical procedure when the robotic arm is in a second pose of the plurality of different poses, and wherein at least one of the first pose and the second pose correspond to a pose in which the robotic arm is in contact with a designated location; and

compare the positions of the tracking marker in the first coordinate space to the positions of the tracking marker in the second coordinate space.

2. The surgical robotic navigation system of claim 1 , wherein the plurality of different poses creates a time-spaced robotic reference frame.

3. The surgical robotic navigation system of claim 1 , wherein at least one of the plurality of different poses corresponds to a maximum extension of the robotic arm.

4. The surgical robotic navigation system of claim 1 , wherein the robotic arm comprises a plurality of tracking markers secured thereto, wherein each tracking marker in the plurality of tracking markers is configured to emit or reflect light that is detectable by the tracking marker sensor.

5. The surgical robotic navigation system of claim 1 , wherein the tracking marker is a first tracking marker configured to emit or reflect light with a first wavelength, and wherein the robotic arm comprises a second tracking marker configured to emit or reflect light with a second wavelength that is different than the first wavelength.

6. The surgical robotic navigation system of claim 1 , wherein the tracking marker is a first tracking marker configured to emit light in pulses at a first frequency, and wherein the robotic arm comprises a second tracking member configured to emit light in pulses at a second frequency that is different than the first frequency.

7. The surgical robotic navigation system of claim 1 , wherein the robotic arm is a first robotic arm, wherein the tracking marker is a first tracking marker, and wherein:

the surgical robotic navigation system further comprises a second robotic arm that includes a second tracking marker;

the navigation system is configured to identify positions of the second tracking marker in the first coordinate space; and

the memory includes instructions for execution by the at least one processor that, when executed, cause the at least one processor to compare the positions of the second tracking marker in the first coordinate space to positions of the second tracking marker in the second coordinate space.

8. The surgical robotic navigation system of claim 1 , wherein the robotic arm is a first robotic arm, wherein the tracking marker is a first tracking marker, and wherein:

the surgical robotic navigation system further comprises a second robotic arm that includes a second tracking marker;

the navigation system is configured to identify positions of the second tracking marker in a third coordinate space different than the first coordinate space and the second coordinate space; and

the memory includes instructions for execution by the at least one processor that, when executed, cause the at least one processor to compare the positions of the second tracking marker in the first coordinate space to positions of the second tracking marker in the third coordinate space.

9. The surgical robotic navigation system of claim 8 , wherein the second time is after the first time and the second position is different than the first position, wherein the designated location corresponds to a specific location on a patient, and wherein the third coordinate space comprises a patient space.

10. The surgical robotic navigation system of claim 9 , wherein the memory stores additional instructions for execution by the processor that, when executed, cause the at least one processor to:

register the first coordinate space to the second coordinate space and the third coordinate space based at least on the detected first position, the detected second position, the designated location, and the information.

11. The surgical robotic navigation system of claim 1 , wherein the received information is obtained independently of the tracking marker sensor.

12. A method of surgical navigation utilizing a time-spaced robotic reference frame, comprising:

receiving, from a tracking marker sensor, first information about positions of a tracking marker over a plurality of different times during a surgical procedure, the tracking marker secured to a robotic arm of a robot and the first information collectively defining a unique shape in a navigation coordinate system, wherein the robotic arm is in contact with a designated location for at least one time in the plurality of different times;

receiving, from a robotic system, second information corresponding to positions of the tracking marker in a robotic coordinate system at the plurality of different times during the surgical procedure; and

comparing the robotic coordinate system to a navigation coordinate system based on the first information and the second information, wherein comparing the robotic coordinate system to the navigation coordinate system based on the first information and the second information includes registering the robotic coordinate system to the navigation coordinate system.

13. The method of claim 12 , wherein the robotic system is configured to move the robotic arm to a first pose at a first one of the plurality of different times, wherein the first pose corresponds to an extension of the robotic arm in a first direction, wherein the robotic system is configured to move the robotic arm to a second pose at a second one of the plurality of different times, and wherein the second pose corresponds to an extension of the robotic arm in a second direction different than the first direction.

14. The method of claim 13 , wherein the first direction is orthogonal to the second direction.

15. The method of claim 12 , wherein each of the plurality of different times occurs during a continuous movement of the robotic arm.

16. The method of claim 12 , wherein the tracking marker sensor receives information about positions of a plurality of tracking markers over the plurality of different times, wherein the plurality of tracking markers are secured to the robotic arm of the robot.

17. The method of claim 16 , wherein the registering is not based on any information about any tracking marker not fixed to the robotic arm.

18. The method of claim 12 , wherein the second information comprises information about a position at which the tracking marker is fixedly secured to the robotic arm.

19. The method of claim 12 , further comprising:

operating the robot based on the comparison.

20. A device for surgical navigation utilizing a time-spaced robotic reference frame, comprising:

at least one communication interface for receiving information from a robot;

at least one tracking marker sensor configured to detect a tracking marker on a robotic arm of the robot;

at least one processor; and

at least one memory storing instructions for execution by the at least one processor that, when executed, cause the at least one processor to:

receive, from the robot, information corresponding to a pose of the robotic arm at each of a plurality of different times during a surgical procedure, wherein the robotic arm is in contact with a designated location for at least one pose of the robotic arm;

receive, from the at least one tracking marker sensor, data corresponding to a detected position of the tracking marker at each of the plurality of different times during the surgical procedure; and

combine the information and the data to generate a custom, time-spaced reference frame.

21. The device of claim 20 , wherein the at least one memory stores additional instructions for execution by the at least one processor that, when executed, further cause the at least one processor to:

confirm a position of an object in a predetermined coordinate space based on creation of the custom, time-spaced reference frame.

22. The device of claim 20 , wherein the at least one memory stores additional instructions for execution by the at least one processor that, when executed, further cause the at least one processor to determine the pose of the robotic arm at each of the plurality of different times in which each pose is configured to avoid collisions with external objects near the robotic arm.

23. The device of claim 20 , wherein the at least one tracking marker sensor is configured to detect a tracking marker on each of a plurality of robotic arms, the information corresponds to a pose of each of the plurality of robotic arms at each of the plurality of different times, and the data corresponds to a detected position of the tracking marker at each of the plurality of different times.

24. The device of claim 20 , wherein the information corresponds to a predicted pose of the robotic arm at each of the plurality of different times.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 22, 2022
From: ELLMAN, AVIV; JUNIO, DANY; PUCKETT, KATHERINE M.
To: MAZOR ROBOTICS LTD.
Reel/Frame 062192/0001 →
Continuity (2)
Provisional Application 63046393 · Jun 30, 2020
Related Publication 20230255699A1 · Aug 17, 2023
References Cited (102)
US 7781724B2 · Childers et al. · 2010 [cited by applicant]
US 7907166B2 · Lamprecht et al. · 2011 [cited by applicant]
US 8108072B2 · Zhao et al. · 2012 [cited by applicant]
US 8392022B2 · Ortmaier et al. · 2013 [cited by applicant]
US 8409098B2 · Olson · 2013 [cited by applicant]
US 9050728B2 · Ban et al. · 2015 [cited by applicant]
US 9211164B2 · Moctezuma de la Barrera et al. · 2015 [cited by applicant]
US 9259276B2 · Mintz et al. · 2016 [cited by applicant]
US 9259282B2 · Azizian et al. · 2016 [cited by applicant]
US 9307894B2 · von Grunberg et al. · 2016 [cited by applicant]
US 9402689B2 · Prisco et al. · 2016 [cited by applicant]
US 9687307B2 · Wu · 2017 [cited by applicant]
US 9734589B2 · Yu · 2017 [cited by examiner]
US 9767608B2 · Lee et al. · 2017 [cited by applicant]
US 9969090B2 · Warashina et al. · 2018 [cited by applicant]
US 10028788B2 · Kang · 2018 [cited by applicant]
US 10165981B2 · Schoepp · 2019 [cited by applicant]
US 10231791B2 · LeBoeuf, II et al. · 2019 [cited by applicant]
US 10299880B2 · Ramirez Luna et al. · 2019 [cited by applicant]
US 10368054B2 · Panescu et al. · 2019 [cited by applicant]
US 10668625B2 · Kuroda et al. · 2020 [cited by applicant]
US 11116576B2 · Theodore · 2021 [cited by examiner]
US 11298196B2 · Crawford · 2022 [cited by examiner]
US 11864839B2 · Decker · 2024 [cited by examiner]
US 20030059097A1 · Abovitz · 2003 [cited by examiner]
US 20070106307A1 · Bodduluri et al. · 2007 [cited by applicant]
US 20090076655A1 · Blondel et al. · 2009 [cited by applicant]
US 20100168562A1 · Zhao et al. · 2010 [cited by applicant]
US 20110087238A1 · Wang et al. · 2011 [cited by applicant]
US 20130274921A1 · Aiso · 2013 [cited by applicant]
US 20140179997A1 · Grunberg et al. · 2014 [cited by applicant]
US 20140253684A1 · Kumar et al. · 2014 [cited by applicant]
US 20140288710A1 · Ikenaga · 2014 [cited by examiner]
US 20140330114A1 · Navab · 2014 [cited by examiner]
US 20150025683A1 · Amano · 2015 [cited by applicant]
US 20150209119A1 · Theodore · 2015 [cited by examiner]
US 20160015468A1 · Piron · 2016 [cited by examiner]
US 20160256225A1 · Crawford · 2016 [cited by examiner]
US 20170245944A1 · Crawford et al. · 2017 [cited by applicant]
US 20170258535A1 · Crawford · 2017 [cited by examiner]
US 20170265774A1 · Johnson · 2017 [cited by examiner]
US 20180014888A1 · Bonny · 2018 [cited by examiner]
US 20180055577A1 · Barral et al. · 2018 [cited by applicant]
US 20180064497A1 · Hussain et al. · 2018 [cited by applicant]
US 20180140223A1 · Kheradpir · 2018 [cited by examiner]
US 20180147018A1 · Crawford · 2018 [cited by examiner]
US 20180185100A1 · Weinstein · 2018 [cited by examiner]
US 20180214221A1 · Crawford · 2018 [cited by examiner]
US 20180256264A1 · McLachlin · 2018 [cited by examiner]
US 20180296283A1 · Crawford · 2018 [cited by examiner]
US 20190000561A1 · Decker · 2019 [cited by examiner]
US 20190000569A1 · Crawford et al. · 2019 [cited by applicant]
US 20190000571A1 · Johnson · 2019 [cited by examiner]
US 20190029765A1 · Crawford · 2019 [cited by examiner]
US 20190038366A1 · Johnson · 2019 [cited by examiner]
US 20190117313A1 · Crawford · 2019 [cited by examiner]
US 20190357986A1 · Morgan · 2019 [cited by examiner]
US 20190374299A1 · Peine · 2019 [cited by applicant]
US 20190380794A1 · Al Jewad · 2019 [cited by examiner]
US 20190388161A1 · Cicchini · 2019 [cited by examiner]
US 20190388164A1 · Gruionu · 2019 [cited by examiner]
US 20200015806A1 · Scheib et al. · 2020 [cited by applicant]
US 20200038116A1 · Toporek et al. · 2020 [cited by applicant]
US 20200170730A1 · Cameron · 2020 [cited by examiner]
US 20200222122A1 · Snyder et al. · 2020 [cited by applicant]
US 20200222127A1 · Snyder et al. · 2020 [cited by applicant]
US 20200261160A1 · Peine et al. · 2020 [cited by applicant]
CN 100496429 · 2009 [cited by applicant]
CN 107533634 · 2018 [cited by applicant]
CN 109551518 · 2019 [cited by applicant]
CN 110834333 · 2020 [cited by applicant]
CN 110897717 · 2020 [cited by applicant]
CN 111317572 · 2020 [cited by applicant]
EP 1096268 · 2006 [cited by applicant]
EP 2594197 · 2013 [cited by applicant]
EP 2783814A2 · 2014 [cited by applicant]
EP 2996615 · 2019 [cited by applicant]
EP 3476358 · 2019 [cited by applicant]
EP 3212104 · 2019 [cited by applicant]
EP 3613544A1 · 2020 [cited by applicant]
WO WO9501757 · 1995 [cited by applicant]
WO WO2017147596 · 2017 [cited by applicant]
WO WO2018081136A2 · 2018 [cited by applicant]
WO WO2019071189 · 2019 [cited by applicant]
WO WO2020016312 · 2020 [cited by applicant]
“Robotic Assisted Systems,” Intuitive Surgical, Jul. 2019, 5 pages. [cited by applicant]
Abdelaal et al. “A multi-camera, multi-view system for training and skill assessment for robot-assisted surgery,” International Journal of Computer Assisted Radiology and Surgery, May 2020, vol. 15, pp. 1369-1377. [cited by applicant]
Boctor et al. “A Dual-Armed Robotic System for Intraoperative Ultrasound Guided Hepatic Ablative Therapy: A Prospective Study,” IEEE, Proceedings of the 2004 IEEE International Conference on Robotics & Automation, New O… [cited by applicant]
He et al. “A Multi-Function Force Sensing Instrument for Variable Admittance Robot Control in Retinal Microsurgery,” 2014 IEEE International Conference on Robotics and Automation (ICRA), 2014, pp. 1411-1418. [cited by applicant]
Joskowicz “Computer-aided surgery meets predictive, preventive, and personalized medicine,” EPMA Journal, 2017, vol. 8, 4 pages. [cited by applicant]
Khandalavala “Emerging surgical robotic technology: a progression toward microbots,” Annals of Laparoscopic and Endoscopic Surgery, Jan. 2020, vol. 5, Article 3, 18 pages. [cited by applicant]
Kim et al. “Robot-Assisted Cardiac Surgery Using the Da Vinci Surgical System: A Single Center Experience,” Korean Journal of Thoracic and Cardiovascular Surgery, 2015, vol. 48, pp. 99-104. [cited by applicant]
Kong et al. “Da Vinci Tool Torque Mapping over 50,000 Grasps and its Implications on Grip Force Estimation Accuracy,” 2018 International Symposium on Medical Robotics (ISMR), 2018, 6 pages. [cited by applicant]
Kumar et al. “Emerging role of robotics in urology,” Journal of Minimal Access Surgery, Oct. 2005, vol. 1, No. 4, pp. 202-210. [cited by applicant]
Li et al. “Design of a Multi-Arm Surgical Robotic System for Dexterous Manipulation,” Journal of Mechanisms and Robotics, Dec. 2016, vol. 8, article 061017, 10 pages. [cited by applicant]
Seibold “An Advanced Force Feedback Tool Design for Minimally Invasive Robotic Surgery,” Technische Universität München, May 15, 2012, Doctoral Engineers dissertation, 218 pages. [cited by applicant]
Staub “Micro Endoscope based Fine Manipulation in Robotic Surgery,” Technische Universitat Munchen Lehrstuhl Robotic und Echtzeitsysteme, Dissertation, Apr. 2013, 146 pages. [cited by applicant]
Tian et al. “A Robot-Assisted Surgical System Using a Force-Image Control Method for Pedicle Screw Insertion,” PLOS One, Jan. 2014, vol. 9, No. 1, article e86346, 9 pages. [cited by applicant]
Vivek et al. “Study of Neuroarm and Force Sensing Grippers in Robo-Assisted Neurosurgery,” International Journal of Current Engineering and Technology, Mar. 2016, Special Issue 4, pp. 444-447. [cited by applicant]
International Search Report and Written Opinion for International (PCT) Patent Application No. PCT/US2021/035667, dated Sep. 23, 2023, 16 pages. [cited by applicant]
International Search Report for PCT/IL2021/050804 date of completion is Oct. 8, 2021 (3 pages). [cited by applicant]
Official Action with English Summary for China Patent Application No. 202180046779.9, dated Jul. 12, 2025, 20 pages. [cited by applicant]