IP Library Granted Patent US 12,527,633
Granted Patent B2
US 12,527,633 · App. 18/221,913 · Granted Jan 20, 2026

Method for confirming registration of tracked bones

Inventors: Joel Zuhars (Fremont, CA); Daniel P. Bonny (Fremont, CA); Saleh Tabandeh (Fremont, CA)
Assignee: Think Surgical, Inc.
A61B34/20A61B2034/2055
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,527,633
App. No.
18/221,913
Granted
Jan 20, 2026
Kind
B2
Abstract

A system for confirming registration of a bone involved in a joint replacement procedure is provided. The system includes a three-dimensional (3-D) bone model of the bone registered to a bone location, a visible light camera, and a display. The visible light camera captures images of the bone in the camera's field-of-view (FOV). The display is configured to display the captured images of the FOV and an image of the 3-D bone model, where the displayed location of the image of the 3-D bone model corresponds to the location of the 3-D bone model registered to the bone location. The registration may be confirmed if the displayed location of the image of the bone as captured by the visible light camera corresponds to the displayed location of the 3-D bone model.

Claims (29)

1 . A system for confirming registration of a bone, comprising:

a three-dimensional (3-D) bone model registered to a bone location;

a camera for capturing video of the bone; and

a display for displaying the captured video of the bone and an image of the 3-D bone model, or an outline of the 3-D bone model, wherein a displayed location of the image of the 3-D bone model, or the outline of the 3-D bone model, corresponds to a location of the 3-D bone model as registered to the bone location, and wherein the display updates the displayed location of the image of the 3-D bone model, or the outline of the 3-D bone model, according to tracked movements of the bone.

2 . The system of claim 1 further comprising a computer input for receiving confirmation of correct registration of the 3-D bone model to the bone location when the displayed location of the image of the 3-D bone model, or the outline of the 3-D bone model, corresponds to the location of the bone in the captured video of the bone.

3 . The system of claim 2 wherein the computer input comprises at least one of: a mouse; a keyboard; a joystick; a pendant; a touchscreen display; or a microphone.

4 . The system of claim 1 wherein the display further displays a prompt to: a) confirm or not confirm correct registration of the 3-D bone model to the bone location.

5 . The system of claim 1 further comprising a tracking system for tracking movement of the bone.

6 . The system of claim 5 further comprising a computer comprising a processor configured to determine a calibration between a coordinate frame of the tracking system and a coordinate frame of the camera.

7 . The system of claim 6 wherein the location of the 3-D bone model registered to the bone location is determined in the coordinate frame of the tracking system.

8 . The system of claim 7 wherein the location of the 3-D bone model registered to the bone location is determined in the coordinate frame of the camera using: i) the calibration; and ii) the determined location of the 3-D bone model registered to the bone location in the coordinate frame of the tracking system.

9 . The system of claim 1 wherein the camera is a video camera.

10 . A system, comprising:

a three-dimensional (3-D) bone model registered to a bone location;

a digitizer;

a tracking system for tracking movement of the digitizer;

a camera for capturing video of the bone;

a computer comprising a processor configured to:

record positions of the digitizer as the digitizer is moved about the bone; and

project the recorded positions onto the 3-D bone model registered at the bone location; and

a display for displaying the captured video, and a video of the recorded positions projected onto the 3-D bone model.

11 . The system of claim 10 wherein the recorded positions form a three-dimensional (3-D) contour and the display displays an image of the 3-D contour.

12 . The system of claim 11 wherein the 3-D contour represents edges of a soft tissue to bone interface.

13 . The system of claim 10 wherein the computer is further configured to segment, in the captured video of the bone, a soft tissue covering or surrounding the bone.

14 . The system of claim 13 wherein the computer is further configured to remove the segmented soft tissue from the captured video.

15 . The system of claim 13 wherein the computer is configured to segment the soft tissue using the recorded positions of the digitizer tip.

16 . The system of claim 10 wherein the camera is a video camera.

17 . The system of claim 10 wherein the display is further configured to display an image of the 3-D bone model, or an outline of the 3-D bone model, wherein the displayed location of the image of the 3-D bone model, or an outline of the 3-D bone model, corresponds to the location of the 3-D bone model registered to the bone location.

18 . The system of claim 10 further comprising a computer input for receiving confirmation of correct registration of the 3-D bone model to the bone location when the displayed location of the video of the recorded positions projected onto the 3-D bone model corresponds to the displayed location of the image of the recorded positions.

Assignments (2)
SECURITY INTEREST Recorded Jun 12, 2026
From: THINK SURGICAL, INC.
To: SYMBIOTIC CAPITAL AGENCY LLC, AS COLLATERAL AGENT
Reel/Frame 075736/0843 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 14, 2023
From: ZUHARS, JOEL; BONNY, DANIEL P.; TABANDEH, SALEH
To: THINK SURGICAL, INC.
Reel/Frame 064253/0104 →
Continuity (4)
Continuation In Part 17148612 · Jan 14, 2021
Continuation 15769040
Provisional Application 62255618 · Nov 16, 2015
Related Publication 20230355317A1 · Nov 9, 2023
References Cited (62)
US 5086401A · Glassman et al. · 1992 [cited by applicant]
US 5282770A · Shibata · 1994 [cited by applicant]
US 5880976A · DiGioia, III et al. · 1999 [cited by applicant]
US 6033415A · Mittelstadt et al. · 2000 [cited by applicant]
US 6061644A · Leis · 2000 [cited by examiner]
US 6205411B1 · DiGioia, III · 2001 [cited by examiner]
US 6322567B1 · Mittelstadt et al. · 2001 [cited by applicant]
US 6529765B1 · Franck · 2003 [cited by examiner]
US 7206626B2 · Quaid, III · 2007 [cited by examiner]
US 7302288B1 · Schellenberg · 2007 [cited by applicant]
US 8774900B2 · Buly · 2014 [cited by examiner]
US 8876830B2 · Hodorek et al. · 2014 [cited by applicant]
US 8961536B2 · Nikou et al. · 2015 [cited by applicant]
US 10905496B2 · Zuhars · 2021 [cited by examiner]
US 11717353B2 · Zuhars · 2023 [cited by examiner]
US 20040111183A1 · Sutherland · 2004 [cited by examiner]
US 20050245820A1 · Sarin · 2005 [cited by applicant]
US 20070073136A1 · Metzger · 2007 [cited by examiner]
US 20100256504A1 · Moreau-Gaudry · 2010 [cited by examiner]
US 20110069867A1 · Buehner · 2011 [cited by examiner]
US 20110257652A1 · Hughes et al. · 2011 [cited by applicant]
US 20130060146A1 · Yang · 2013 [cited by examiner]
US 20130060278A1 · Bozung et al. · 2013 [cited by applicant]
US 20130211232A1 · Murphy et al. · 2013 [cited by applicant]
US 20140171962A1 · Kang · 2014 [cited by applicant]
US 20140180290A1 · Otto · 2014 [cited by examiner]
US 20140188121A1 · Lavallee · 2014 [cited by examiner]
US 20140200621A1 · Malackowski · 2014 [cited by examiner]
US 20140303493A1 · Karawaki et al. · 2014 [cited by applicant]
US 20150109427A1 · Wood · 2015 [cited by examiner]
US 20170258532A1 · Shalayev et al. · 2017 [cited by applicant]
US 20180049622A1 · Ryan · 2018 [cited by examiner]
US 20180168740A1 · Ryan · 2018 [cited by examiner]
US 20190076195A1 · Shalayev · 2019 [cited by examiner]
US 20190090955A1 · Singh · 2019 [cited by examiner]
US 20190105514A1 · Amstutz · 2019 [cited by examiner]
US 20190175283A1 · Bonny · 2019 [cited by examiner]
US 20190199915A1 · Coiseur · 2019 [cited by examiner]
US 20190282123A1 · Crawford · 2019 [cited by examiner]
US 20190289284A1 · Smith · 2019 [cited by examiner]
US 20200008881A1 · Marti · 2020 [cited by examiner]
US 20200129240A1 · Singh · 2020 [cited by examiner]
US 20200237441A1 · Zuhars · 2020 [cited by examiner]
US 20210128252A1 · Zuhars · 2021 [cited by examiner]
US 20210290315A1 · Lampert · 2021 [cited by examiner]
US 20230355317A1 · Zuhars · 2023 [cited by examiner]
CN 102727309A · 2012 [cited by applicant]
CN 102933163A · 2013 [cited by applicant]
JP 2002524192 · 2002 [cited by applicant]
JP 2007535373 · 2007 [cited by applicant]
WO 2014045119A2 · 2014 [cited by applicant]
WO 2014077192A1 · 2014 [cited by applicant]
WO 2015006721A1 · 2015 [cited by applicant]
WO 2015044246A1 · 2015 [cited by applicant]
Office Action issued in JP 2018-514805, dated Sep. 7, 2020. [cited by applicant]
Office Action issued in corresponding Chinese Patent Appln. No. 201680065323.6, dated Jun. 3, 2020. [cited by applicant]
Extended European Search Report, dated Apr. 10, 2019. [cited by applicant]
Besl, Paul J. and McKay, Neil D., “A Method for Registration of 3-D Shapes”, IEEE Transactions on Pattern Analysis and Machine Intelligence, Feb. 1992, pp. 239-256, vol. 14, Issue 2, © 1992 IEEE; DOI: 10.1109/34.121791. [cited by applicant]
Cohan, Steve, “Robodoc Achieves Pinless Registration”, Industrial Robot: An International Journal, 2001, pp. 381-386, vol. 28, Issue 5, © MCB UP Limited (2001); DOI: 10.1108/01439910110401277. [cited by applicant]
Godest, A.C. et al., “Simulation of a Knee Joint Replacement During a Gait Cycle Using Explicit Finite Element Analysis”, Journal of Biomechanics, Feb. 2002, pp. 267-275, vol. 35, Issue 2, © 2002 Elsevier Science Ltd.; … [cited by applicant]
Madera, Francisco, “An Introduction to the Collision Detection Algorithms”, Abstraction & Application, 2011, pp. 7-18, vol. 5; Facultad de Matematicas, Uady; [email protected]. [cited by applicant]
International Search Report dated Mar. 8, 2017 for International Application No. PCT/US2016/062008 filed Nov. 15, 2016. [cited by applicant]