Artificial Intelligence Intra-Operative Surgical Guidance System and Method of Use
The inventive subject matter is directed to an artificial intelligence intra-operative surgical guidance system and method of use. The artificial intelligence intra-operative surgical guidance system is made of a computer executing one or more automated artificial intelligence models trained on data layer datasets collections to calculate surgical decision risks and provide autonomously executing intra-operative surgical guidance; and a display configured to provide visual guidance to a user.
1 . A computer implemented method comprising:
providing a computing platform comprised of a non-transitory computer-readable storage medium coupled to a microprocessor, wherein the non-transitory computer-readable storage medium is encoded with computer-readable instructions that implement functionalities of a plurality of modules, wherein the computer-readable instructions are executed by a microprocessor;
receiving an at least one intraoperative image of the subject by the computing platform;
automatically detecting a plurality of anatomical landmarks in the intraoperative image using an Image Processing Module;
estimating a three-dimensional shape of a structure in the at least one intraoperative image of the subject
automatically mapping an alignment grid to the annotated image features using an Image Registration Module to form a composite image of the at least one intraoperative image of the subject and the three-dimensional shape of a structure in the at least one intraoperative image of the subject; and
displaying the composite image on a graphical user interface.
2 . The method of claim 1 , wherein the three-dimensional shape of a structure is estimated based on statistical shape modeling.
3 . The method of claim 1 , wherein the computing platform is comprised of an at least one image processing algorithm for the classification of a plurality of intra-operative medical images, the computing platform configured to execute one or more automated artificial intelligence models, wherein the one or more automated artificial intelligence models comprises a neural network model, wherein the one or more automated artificial intelligence models are trained on data from a data layer to identify a plurality of anatomical structures, wherein said Image Processing Module applies said neural network model to detect a plurality of anatomical landmarks.
4 . The method of claim 1 , wherein the structure is anatomical.
5 . The method of claim 4 , wherein the anatomical structure is selected from the group consisting of: a femur, a tibia, a spine, an ankle, a knee, a hip; a pelvis and a shoulder.
6 . The method of claim 5 , wherein the anatomical structure is selected from the group consisting of: a humerus and a wrist.
7 . The method of claim 1 , wherein the structure is selected from the group consisting of: an implant, a nail, a plate, a guidewire, a drill guide, a screw, a surgical instrument and a cutting block.
8 . The method of claim 1 , wherein the structure is selected from the group consisting of: a joint replacement component and a geometrical shaped fiducial.
9 . The method of claim 1 further providing automated surgical guidance to a user.
10 . The method of claim 1 further providing automated navigation to a device.
11 . A system for the automation of a plurality of intraoperative workflows, comprising:
a processor configured to execute a plurality of artificial intelligence algorithms;
a memory module for storing instructions and data related to the plurality of intraoperative workflows;
a communication module for receiving input data and transmitting output data;
a software module comprised of a data layer, an algorithm layer and an application layer, wherein an algorithm layer is comprised of an artificial intelligence module configured to analyze input data, identify the plurality of intraoperative workflows and generate corresponding automation instructions;
a control module configured to autonomously execute and manage the plurality of intraoperative workflows and
a feedback mechanism for receiving feedback data from the execution the plurality of intraoperative workflows and updating the artificial intelligence module based on the feedback to provide prediction outputs.
12 . The system of claim 11 further comprising the steps of automatic navigation of a system wherein the system is selected from the group consisting of:
augmented reality tracking, robotic surgical, sensor-based systems, and CAS navigation.
13 . A computer-implemented method for automation of a plurality of intraoperative workflows comprising the steps of:
receiving, by a processor, an input of workflow data related to an orthopedic procedure for a subject;
analyzing said data by a sequential image processing module to identity at least one intraoperative workflow;
generating at least one corresponding automation instruction to a control module;
autonomously executing the plurality of intraoperative workflows;
receiving feedback data from the execution the plurality of intraoperative workflow; and
updating the sequential image processing module based on said feedback.
14 . The method of claim 13 , wherein the step of autonomously executing is comprised of tracking instruments.
15 . The method of claim 13 , wherein the step of autonomously executing is comprised of navigating instruments.
16 . The method of claim 13 , wherein the step of autonomously executing is comprised of navigating implants.
17 . The method of claim 13 , wherein the step of autonomously executing is comprised of positioning a grid on an intraoperative image of the subject.
18 . The method of claim 13 , wherein the step of autonomously executing is comprised of providing a user with visual guidance for intraoperative placement of an implant the subject.
19 . The method of claim 13 , wherein the step of autonomously executing is comprised of providing a user with visual guidance for a reduction procedure in the subject.
20 . The method of claim 13 , wherein the step of autonomously executing is comprised of providing a user with guidance for placement of an implant.
21 . A computer-implemented method for automation of a plurality of intraoperative workflows comprising the steps of:
receiving, by a processor, an input of workflow data related to an orthopedic procedure for a subject;
analyzing said data by a sequential image processing module to identity at least one intraoperative workflow;
generating at least one corresponding automation instruction to a control module, autonomously managing the plurality of intraoperative workflows;
receiving feedback data from the execution the plurality of intraoperative workflow; and
updating the software module based on said feedback.
22 . The method of claim 21 wherein the step of autonomously managing is comprised of providing a first image scene to a second scene automated image interpretation.
23 . The method of claim 21 , wherein the step of autonomously managing is comprised of providing surgical state identification.
24 . The method of claim 21 , wherein the step of autonomously managing is comprised of providing workflow step identification.
26 . The method of claim 21 , wherein the step of autonomously managing is comprised of planning at least one virtual element.
27 . The method of claim 26 , wherein the planning is comprised of determining the trajectory projection from a guidewire.