IP Library › Granted Patent US 11,361,678
Granted Patent B2
US 11,361,678 · App. 14/896,166 · Granted Jun 14, 2022

Portable camera aided simulator (PortCAS) for minimally invasive surgical training

Inventors: Ka-Chun Siu (Omaha, NE); Carl Nelson (Lincoln, NE); Mohsen Zahiri (Lincoln, NE); Dmitry Oleynikov (Omaha, NE)
Assignee: Board of Regents of the University of Nebraska
G09B23/285G09B23/28G09B23/281G09B23/283G09B9/00G09B19/24
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,361,678
App. No.
14/896,166
Filed
Dec 4, 2015
Granted
Jun 14, 2022
Kind
B2
Art Unit
3715
USPC
434/262
Abstract

The present disclosure is directed to a system and method for surgical training with low cost, reusable materials and a highly customizable virtual environment for skill-building. According to various embodiments, a surgical training tool is usable in conjunction with a support structure configured to at least partially constrain the tool movement. Meanwhile, the tool is tracked in real-time with off-tool detectors to generate a tool path driving a virtual rendering of the surgical training tool in an operative environment. The virtual rendering may be visually observable via a display device and may include a customizable and/or selectable operative environment with one or more structures that can be operated on by the virtual surgical training tool. By tracking the virtual tool interaction with the virtual structures, a task path may be established for documenting and/or objectively assessing the performance of one or more operative tasks.

Claims (43)

1. A system for surgical training, comprising:

a surgical training tool, the surgical training tool including one or more fiducials;

a support structure for receiving the surgical training tool to constrain manipulation of the surgical training tool within a volume;

at least two off-tool detectors configured to detect the position of the one or more fiducials within the volume;

at least one processor in communication with the at least two off-tool detectors;

a tool path generated by the at least one processor based on the detected position of the one or more fiducials;

a virtual rendering of the surgical training tool in a virtual operative environment, the virtual rendering of the surgical training tool being visually observable via a display device, an operative task being performed within the virtual operative environment utilizing the virtual surgical training tool presented by the display device, the virtual surgical training tool being manipulated based on the tool path; and

at least one time, space, and event based task path generated and graphically represented by the at least one processor based on the tool path, the at least one task path describing a path of the virtual surgical training tool in the virtual operative environment, the at least one task path including a plot of position coordinates of the virtual surgical training tool relative to position coordinates of one or more structures being operated on by the virtual surgical training tool in the virtual operative environment over time, the at least one task path further including time-indexed events based on the tool path, wherein the time-indexed events include performed operative tasks and detected errors indicated with markings at respective x, y, and z coordinates relative to time on the at least one task path in addition to a graphically represented plot of the position coordinates of the virtual surgical training tool relative to the position coordinates of one or more structures being operated on by the virtual surgical training tool in the virtual operative environment over time, wherein the time-indexed events include at least a first event and a second event each comprising a performed operative task and/or detected error, wherein a first time interval for the first event requires a first set of spatial boundaries for the at least one task path and a second time interval for the second event requires a second set of spatial boundaries for the at least one task path that is different from the first set of spatial boundaries, and wherein a first error threshold is established for the first time interval and a second error threshold is established for the second time interval;

wherein the markings are distinguishable from the plot of the position coordinates.

2. The system of claim 1 , wherein the detected errors include one or more of: a dropped object, a misaligned cut, or a deviation beyond a spatial threshold.

3. The system of claim 1 , wherein the at least one processor is further configured to:

assess the performance of the operative task based upon the at least one task path by evaluating time-indexed events within a time interval for the operative task to determine performance or non-performance of events required by the operative task and based on an error threshold for the operative task.

4. The system of claim 3 , wherein the assessment is performed continuously or periodically.

5. The system of claim 3 , wherein the assessment is performed after the performance of the operative task.

6. The system of claim 1 , further comprising:

a storage medium configured to store the at least one task path or a recording of the virtual surgical training tool being manipulated within the virtual operative environment.

7. The system of claim 1 , further comprising:

a communication link configured to transfer the at least one task path or a recording of the virtual surgical training tool being manipulated within the virtual operative environment to a remote server for assessing the performance of the operative task based upon the at least one task path or the recording of the virtual surgical training tool being manipulated within the virtual operative environment.

8. The system of claim 7 , further comprising:

a web portal observable on the display, the web portal including one or more access links to the virtual rendering of the surgical training tool in the virtual operative environment.

9. The system of claim 8 , wherein the web portal further includes a continuous, periodic, or event-triggered assessment of the performance of the operative task based upon the at least one task path or a recording of the virtual surgical training tool being manipulated within the virtual operative environment.

10. The system of claim 1 , wherein the surgical training tool comprises a laparoscopic tool or a model of a laparoscopic tool.

11. The system of claim 1 , wherein the at least two off-tool detectors include two or more cameras configured for stereoscopic imaging.

12. The system of claim 1 , wherein the at least two off-tool detectors are positionable relative to the support structure.

13. The system of claim 1 , wherein the support structure is collapsible or capable of being disassembled.

14. The system of claim 1 , further comprising:

a portable container configured to store the support structure, the surgical training tool, and the at least two off-tool detectors.

15. The system of claim 1 , wherein the one or more fiducials include one or more traceable markers or recognizable features included in or coupled to the surgical training tool.

16. The system of claim 1 , further comprising:

at least a second surgical training tool, the second surgical training tool including one or more fiducials, wherein the at least two off-tool detectors are further configured to detect the position of the one or more fiducials of the second surgical training tool within the volume;

a second tool path generated by the at least one processor based on the detected position of the one or more fiducials of the second surgical training tool; and

a virtual rendering of the second surgical training tool in the virtual operative environment, the second virtual surgical training tool being manipulated based on the second tool path.

17. The system of claim 1 , wherein the markings intersect the plot of the position coordinates.

18. The system of claim 1 , wherein the markings comprise vertical lines disposed at respective x, y, and z coordinates relative to time on the at least one task path.

19. A system for surgical training, comprising:

a surgical training tool, the surgical training tool including one or more fiducials;

a collapsible support structure for receiving the surgical training tool to constrain manipulation of the surgical training tool within a volume, the collapsible support structure including a top surface and a bottom surface connected to one another by cross bars in a scissor-like arrangement, wherein the cross bars are configured to actuate the top surface towards the bottom surface when the cross bars are transitioned from an open position to a closed position;

at least two off-tool detectors configured to detect the position of the one or more fiducials within the volume;

at least one processor in communication with the at least two off-tool detectors;

a tool path generated by the at least one processor based on the detected position of the one or more fiducials;

a virtual rendering of the surgical training tool in a virtual operative environment, the virtual rendering of the surgical training tool being visually observable via a display device, an operative task being performed within the virtual operative environment utilizing the virtual surgical training tool presented by the display device, the virtual surgical training tool being manipulated based on the tool path; and

at least one time, space, and event based task path generated and graphically represented by the at least one processor based on the tool path, the at least one task path describing a path of the virtual surgical training tool in the virtual operative environment, the at least one task path including a plot of position coordinates of the virtual surgical training tool relative to position coordinates of one or more structures being operated on by the virtual surgical training tool in the virtual operative environment over time, the at least one task path further including time-indexed events based on the tool path, wherein the time-indexed events include performed operative tasks and detected errors indicated with markings at respective x, y, and z coordinates relative to time on the at least one task path in addition to a graphically represented plot of the position coordinates of the virtual surgical training tool relative to the position coordinates of one or more structures being operated on by the virtual surgical training tool in the virtual operative environment over time, wherein the time-indexed events include at least a first event and a second event each comprising a performed operative task and detected error, wherein a first time interval for the first event requires a first set of spatial boundaries for the at least one task path and a second time interval for the second event requires a second set of spatial boundaries for the at least one task path that is different from the first set of spatial boundaries, and wherein a first error threshold is established for the first time interval and a second error threshold is established for the second time interval;

wherein the markings are distinguishable from the plot of the position coordinates.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 12, 2016
From: SIU, KA-CHUN; NELSON, CARL; ZAHIRI, MOHSEN; OLEYNIKOV, DMITRY
To: BOARD OF REGENTS OF THE UNIVERSITY OF NEBRASKA
Reel/Frame 037468/0666 →
Continuity (2)
Provisional Application 61831884 · Jun 6, 2013
Related Publication 20160133158A1 · May 12, 2016