IP Library Granted Patent US 12,582,480
Granted Patent B2
US 12,582,480 · App. 18/516,482 · Granted Mar 24, 2026

Digital image analysis for robotic installation of surgical implants

Inventors: Jeffrey Roh (Seattle, WA); Justin Esterberg (Mesa, AZ); John Cronin (Jericho, VT); Seth Cronin (Essex Junction, VT); Michael John Baker (Georgia, VT)
Assignee: IX Innovation LLC
A61B34/10A61B34/37B25J9/1671G06T7/11A61B2034/102A61B2034/105A61B2034/107A61B2034/108G06T2207/30052
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,582,480
App. No.
18/516,482
Filed
Nov 21, 2023
Granted
Mar 24, 2026
Kind
B2
Art Unit
3657
USPC
700/246
Abstract

Computer-implemented digital image analysis methods, apparatuses, and systems for robotic installation of surgical implants are disclosed. A disclosed apparatus plans a route within an anatomy of a patient from an incision site to a surgical implant site for robotic installation of a surgical implant. The apparatus uses digital imaging data to identify less-invasive installation paths and determine the dimensions of the surgical implant components being used. The apparatus segments the surgical implant into surgical implant subcomponents and modifies the surgical implant subcomponents, such that they can be inserted using the identified less-invasive installation paths.

Claims (77)

1 . A computer-implemented method comprising:

generating an extended reality (XR) surgical simulation environment that includes a digital anatomical model and a three-dimensional (3D) virtual implant model of a surgical implant;

identifying at least one incision site and an implant site on the digital anatomical model in the XR surgical simulation environment;

simulating delivery of virtual components of the virtual implant model using a virtual surgical robot under control of a user, wherein the delivery of virtual components of the 3D virtual implant model are delivered, via the virtual surgical robot, along corresponding ones of multiple delivery paths in the digital anatomical model for delivery to the implant site in the digital anatomical model within the XR surgical simulation environment;

selecting a set of the multiple delivery paths for delivery of physical components of the surgical implant based on a simulated outcome score for the set of the multiple delivery paths being above a threshold;

robotically delivering, using a surgical robot, the physical components of the surgical implant using the set of the multiple delivery paths; and

robotically assembling the surgical implant using the physical components positioned in a patient.

2 . The method of claim 1 , wherein the XR surgical simulation environment is configured to enable at least one user to:

virtually perform one or more surgical steps associated with the delivery of the virtual implant components; and

view, using an XR device, the one or more surgical steps, the virtual implant model, and/or the digital anatomical model within the XR surgical simulation environment.

3 . The method of claim 1 , comprising:

retrieving modeling parameters for generating the digital anatomical model;

generating the digital anatomical model according to the modeling parameters;

identifying anatomical features within the digital anatomical model; and

assigning anatomical characteristics to the identified anatomical features for viewing.

4 . The method of claim 1 , comprising modifying the at least one incision site and the implant site based on simulating the delivery of the virtual components of the virtual implant model in the XR surgical simulation environment.

5 . The method of claim 1 , comprising:

for each delivery path,

predicting a patient outcome based on simulating the delivery of the virtual components of the virtual implant model to the implant site in the digital anatomical model within the XR surgical simulation environment; and

determining a score for the predicted patient outcome.

6 . The method of claim 5 , wherein one of the multiple delivery paths is selected based on at least one of simulating the delivery of the virtual components of the virtual implant model or the score for the predicted patient outcome.

7 . The method of claim 5 , comprising:

ranking scores for the predicted patient outcomes, wherein the scores for the predicted patient outcomes indicate at least one of:

a likelihood of a favorable outcome,

a likelihood of completing one or more surgical steps within a time period, or

a likelihood of avoiding an intraoperative life-threatening adverse event; and

using the ranking to select one of the multiple delivery paths.

8 . A computer system comprising:

one or more computer processors; and

a non-transitory-computer-readable storage medium storing computer instructions, which when executed by the one or more computer processors cause the computer system to:

generate an extended reality (XR) surgical simulation environment that includes a digital anatomical model and a three-dimensional (3D) virtual implant model of a surgical implant;

identify at least one incision site and an implant site on the digital anatomical model in the XR surgical simulation environment;

simulate delivery of virtual components of the virtual implant model using a virtual surgical robot under control of a user, wherein the delivery of virtual components of the 3D virtual implant model are delivered, via the virtual surgical robot, along corresponding ones of multiple delivery paths in the digital anatomical model for delivery to the implant site in the digital anatomical model within the XR surgical simulation environment;

select a set of the multiple delivery paths for delivery of physical components of the surgical implant based on a simulated outcome score for the set of the multiple delivery paths being above a threshold; and

robotically deliver, using a surgical robot, the physical components of the surgical implant using the set of the multiple delivery paths; and

robotically assemble the surgical implant using the physical components positioned in a patient.

9 . The computer system of claim 8 , wherein the XR surgical simulation environment is configured to enable at least one user to:

virtually perform one or more surgical steps associated with the delivery of the virtual implant model; and

view, using an XR device, the one or more surgical steps, the virtual implant model, and/or the digital anatomical model within the XR surgical simulation environment.

10 . The computer system of claim 8 , wherein the computer instructions cause the computer system to:

retrieve modeling parameters for generating the digital anatomical model;

generate the digital anatomical model according to the modeling parameters;

identify anatomical features within the digital anatomical model; and

assign anatomical characteristics to the identified anatomical features for viewing.

11 . The computer system of claim 8 , wherein the computer instructions cause the computer system to modify the at least one incision site and the implant site based on simulating the delivery of the virtual components of the virtual implant model in the XR surgical simulation environment.

12 . The computer system of claim 8 , wherein the computer instructions cause the computer system to:

for each delivery path,

determine a predicted patient outcome based on simulating the delivery of the virtual components of the virtual implant model to the implant site in the digital anatomical model within the XR simulation environment; and

determine a score for the predicted patient outcome.

13 . The computer system of claim 12 , wherein one of the multiple delivery paths is selected based on at least one of simulating the delivery of the virtual components of the virtual implant model or the score for the predicted patient outcome.

14 . The computer system of claim 12 , wherein the computer instructions cause the computer system to:

rank scores for predicted patient outcomes, wherein the scores for the predicted patient outcomes indicate at least one of:

a likelihood of a favorable outcome,

a likelihood of completing one or more surgical steps within a time period, or

a likelihood of avoiding an intraoperative life-threatening adverse event; and

use the ranking to select one of the multiple delivery paths.

15 . A non-transitory-computer-readable storage medium storing computer instructions, which when executed by one or more computer processors cause the one or more computer processors to:

generate an extended reality (XR) surgical simulation environment that includes a digital anatomical model and a three-dimensional (3D) virtual implant model of a surgical implant;

identify at least one incision site and an implant site on the digital anatomical model in the XR surgical simulation environment;

simulate delivery of virtual components of the virtual implant model using a virtual surgical robot under control of a user, wherein the delivery of virtual components of the 3D virtual implant model are delivered, via the virtual surgical robot, along corresponding ones of multiple delivery paths in the digital anatomical model for delivery to the implant site in the digital anatomical model within in the XR surgical simulation environment;

select a set of the multiple delivery paths for delivery of physical components of the surgical implant based on a simulated outcome score for the set of the multiple delivery paths being above a threshold; and

robotically deliver, using a surgical robot, the physical components of the surgical implant using the set of the multiple delivery paths; and

robotically assemble the surgical implant using the physical components positioned in a patient.

16 . The non-transitory-computer-readable storage medium of claim 15 , wherein the XR surgical simulation environment is configured to enable at least one user to:

virtually perform one or more surgical steps associated with the delivery of the virtual components; and

view, using an XR device, the one or more surgical steps, the virtual implant model, and/or the digital anatomical model within the XR surgical simulation environment.

17 . The non-transitory-computer-readable storage medium of claim 15 , wherein the computer instructions cause the one or more computer processors to:

retrieve modeling parameters for generating the digital anatomical model;

generate the digital anatomical model according to the modeling parameters;

identify anatomical features within the digital anatomical model; and

assign anatomical characteristics to the identified anatomical features for viewing.

18 . The non-transitory-computer-readable storage medium of claim 15 , wherein the computer instructions cause the one or more computer processors to modify the at least one incision site and the implant site based on simulating the delivery of the virtual components of the virtual implant model in the XR surgical simulation environment.

19 . The non-transitory-computer-readable storage medium of claim 15 , wherein the computer instructions cause the one or more computer processors to:

for each delivery path,

determine a predicted patient outcome based on simulating the delivery of the virtual components of the virtual implant model to the implant site in the digital anatomical model within the XR surgical simulation environment; and

determine a score for the predicted patient outcome.

20 . The non-transitory-computer-readable storage medium of claim 19 , wherein one of the multiple delivery paths is selected based on at least one of simulating the delivery of the virtual components of the virtual implant model or the score for the predicted patient outcome.

Continuity (3)
Continuation In Part 18150546 · Jan 5, 2023
Continuation 17879979 · Aug 3, 2022
Related Publication 20240156538A1 · May 16, 2024
References Cited (47)
US 9820818B2 · Malackowski et al. · 2017 [cited by applicant]
US 9848778B2 · Soykan et al. · 2017 [cited by applicant]
US 10105168B2 · Blau · 2018 [cited by applicant]
US 10426560B2 · Bowling et al. · 2019 [cited by applicant]
US 10806517B2 · Bonny et al. · 2020 [cited by applicant]
US 10987175B2 · Britton et al. · 2021 [cited by applicant]
US 10987176B2 · Poltaretskyi et al. · 2021 [cited by applicant]
US 11045958B2 · Bowling et al. · 2021 [cited by applicant]
US 11160580B2 · Hua · 2021 [cited by applicant]
US 11179210B2 · Bowling et al. · 2021 [cited by applicant]
US 11298244B2 · Schultz et al. · 2022 [cited by applicant]
US 11304760B1 · Roh et al. · 2022 [cited by applicant]
US 11432828B1 · Lang · 2022 [cited by applicant]
US 11439469B2 · Poltaretskyi et al. · 2022 [cited by applicant]
US 11471232B2 · Bowling et al. · 2022 [cited by applicant]
US 11478310B2 · Poltaretskyi et al. · 2022 [cited by applicant]
US 11547486B1 · Roh et al. · 2023 [cited by applicant]
US 11571266B1 · Roh · 2023 [cited by examiner]
US 11645531B2 · Moore · 2023 [cited by examiner]
US 20160242931A1 · Wong et al. · 2016 [cited by applicant]
US 20180098704A1 · Soykan et al. · 2018 [cited by applicant]
US 20190380792A1 · Poltaretskyi et al. · 2019 [cited by applicant]
US 20200306011A1 · Chekhonin et al. · 2020 [cited by applicant]
US 20200405148A1 · Tran · 2020 [cited by applicant]
US 20210085220A1 · Poltaretskyi et al. · 2021 [cited by applicant]
US 20210093329A1 · Poltaretskyi et al. · 2021 [cited by applicant]
US 20210093389A1 · Poltaretskyi et al. · 2021 [cited by applicant]
US 20210093391A1 · Poltaretskyi et al. · 2021 [cited by applicant]
US 20210093395A1 · Chaoui et al. · 2021 [cited by applicant]
US 20210093410A1 · Gaborit et al. · 2021 [cited by applicant]
US 20210093414A1 · Moore · 2021 [cited by examiner]
US 20210097880A1 · Kuester et al. · 2021 [cited by applicant]
US 20210097886A1 · Kuester et al. · 2021 [cited by applicant]
US 20210104325A1 · Chaoui et al. · 2021 [cited by applicant]
US 20210186614A1 · Forstein et al. · 2021 [cited by applicant]
US 20210282858A1 · Hill et al. · 2021 [cited by applicant]
US 20210308872A1 · Bowling et al. · 2021 [cited by applicant]
US 20210391058A1 · Kostrzewski et al. · 2021 [cited by applicant]
US 20220248955A1 · Tran · 2022 [cited by applicant]
US 20220273450A1 · Steines et al. · 2022 [cited by applicant]
US 20220338886A1 · Bonny et al. · 2022 [cited by applicant]
US 20230023440A1 · Casey et al. · 2023 [cited by applicant]
US 20230181258A1 · Roh · 2023 [cited by examiner]
US 20230270562A1 · Roh · 2023 [cited by examiner]
US 20240156538A1 · Roh · 2024 [cited by examiner]
WO WO2019245848A1 · 2019 [cited by examiner]
Image-Guided Robotic Dental Implantation With Natural-Root Formed Implants (Year: 2012). [cited by examiner]