Multisensory wound simulation
A Tactile-Visual Wound (TVW) simulation unit is a physical device designed to help simulate a wound on a human being or human surrogate (e.g., a medical manikin) for instructing a trainee to learn or practice wound-related treatment skills. For the trainee, the TVW would feel (to the touch) like a real wound, look like a real wound when viewed using an Augmented Reality (AR) system, and appear to behave like a real wound when manipulated.
1. A tactile, augmented reality wound simulation system comprising:
a corporeal object comprising a simulated wound, wherein the corporeal object is deformable by physical manipulation simulating physical, tactile and dimensional features of the wound, wherein the wound is on a body surface of the corporeal object, the corporeal object initially in a first physical state;
a visual graphic enhancement of the wound on the body surface of the corporeal object, the visual graphic enhancement renderable via an augmented reality mechanism selected from the group consisting of video see-through headsets, optical see-through headsets, handheld augmented reality devices, and spatial augmented reality devices, the augmented reality mechanism producing an augmented reality rendering;
whereby the visual graphic enhancement overlays the wound visually on the corporeal object via the augmented reality mechanism;
one or more reference indicia detectable by an optical sensor, the indicia fixed to the surface of the corporeal object; and
a computer processor communicatively coupled to the optical sensor and the augmented reality mechanism, the computer processor executing a software process using the indicia on the corporeal object to dynamically locate, size and orient the visual graphic enhancement rendering of the wound on the corporeal object whereby changes to positions or orientations of the one or more reference indicia caused by physical manipulation of the corporeal object to a second state invoke the software process to reconstruct spatial and dimensional parameters of the visual graphic enhancement so that there is a synchronization of the augmented reality rendering to the second state of the corporeal object.
2. The system of claim 1 further comprising a plurality of predefined physical states of the corporeal object detectable by position of the indicia by the optical sensor wherein a first visual graphic enhancement within a plurality of visual graphic enhancements is associated with the first state of the corporeal object and a second visual graphic enhancement is associated with the second state of the corporeal object whereby the transition from first to second visual graphic enhancements aligns with physiological characteristics of the wound responsive to deformation of the corporeal object.
3. The system of claim 1 wherein the physical manipulation is selected from the group consisting of rotation, elevation, articulation, compression, expansion, stretching, and pulling, the physical manipulation changing the location or orientation of the indicia whereby the software process, using the indicia, adapts the visual graphic enhancement to a new topology of the corporeal object responsive to the physical manipulation.
4. The system of claim 1 further comprising a plurality of predefined physical states of the corporeal object detectable by one or more sensors on or within the corporeal object, the sensors communicatively coupled to the computer processor wherein a first visual graphic enhancement within a plurality of visual graphic enhancements is associated with the first state of the corporeal object and a second visual graphic enhancement is associated with the second state of the physical corporeal object whereby the transition from first to second visual graphic enhancements is consistent with physiological characteristics of the wound responsive to sensor data.
5. The system of claim 4 wherein the one or more sensors on or within the corporeal object detects a value selected from the group consisting of user proximity, mechanical pressure, temperature, sound, articulation and light.
6. The system of claim 1 further comprising a computer processor-controlled physical response to changes of the indicia positions or indicia orientations caused by the physical manipulation of the corporeal object, the physical response invoked by an electronically actuated device causing the physical response selected from the group consisting of movement, sound, and fluid flow.
7. The system of claim 5 further comprising a computer processor-controlled physical response to changes in the sensor value, the physical response invoked by an electronically actuated device causing the physical response selected from the group consisting of movement, sound, and fluid flow.
8. The system of claim 1 further comprising a 3D model of the corporeal object accessible by the computer processor wherein the software process reconstructs the spatial and dimensional parameters of both the visual graphic enhancement and the 3D model of the corporeal object for the augmented reality mechanism wherein an optical image of the corporeal object is spatially and dimensionally aligned to the 3D model wherein the 3D model is rendered opaque or semi-transparent via the augmented reality mechanism.
9. The system of claim 1 further comprising a glove indicium on a trainee-worn glove that engage the corporeal object and wound, the computer processor further accessing a 3D glove model wherein the glove indicium conveys the orientation, location and articulation of a trainee hand wearing the glove to dynamically align the 3D glove model with the trainee hand, wherein the computer processor chroma-keys the trainee-worn glove so that an optical image opacity for the 3D glove model is modified.
10. The system of claim 1 further comprising glove indicia on the glove that engages the corporeal object and wound, the computer processor further generating a visual graphic enhancement over the glove simulating fluid.
11. The system of claim 1 further comprising a vital sign readout wherein the first and second states of the wounds simulation system comprise a change in the vital sign readout.
12. The system of claim 1 further comprising a computer processor-controlled response by the physical corporeal object to a sensor-detected action.
13. The system of claim 5 wherein a response by the physical corporeal object is selected from the group consisting of movement, sound, and fluid flow.