Virtual Pointer and Annotations Through Real Time Communications
An apparatus, system, and method, is described for the capturing and processing of virtual annotations that identify features on medical devices; the annotations may be captured using mobile computing devices, such as smartphones, and displayed on mobile display devices, such as, tablets; and communicated across a network using standard internet protocols.
1 . An apparatus for the virtual annotation of medical devices comprising:
an image frame grabber, the image frame grabber capable of receiving and processing a multiplicity of sequential images captured by an image sender;
a transmitting display device, the transmitting display device electronically connected to the image frame grabber capable of receiving images from the image sender;
an image annotator, the image annotator capable of tagging a multiplicity of target points on the images transmitted by the image frame grabber;
a reference point coordinator, the reference point coordinator capable of storing a multiplicity of reference points that are correlated to the multiplicity of instruments;
a reference point overlayer, that the reference point overlayer operably coupled to a receiving display device;
such that the sequential images of the image sender are visually presented on the receiving display with the reference points overlaid on the receiving display device.
2 . The apparatus in claim 1 where the image frame grabber is a camera that is incorporated within the transmitting display device.
3 . The apparatus in claim 1 where the image annotator is a stylus that physically interacts with the transmitting display device.
4 . The apparatus of claim 1 where the image annotator transmits a multiplicity of X, Y JSON coordinates from the transmitting display device to the receiving display device.
5 . The apparatus of claim 1 where the image annotator displays the annotation in the form a visual display.
6 . The apparatus of claim 1 where the visual display can be modified to show any desired dimensional changes.
7 . The apparatus of claim 1 in which the transmitting display device and receiver display device communicate using an internet enabled communication protocol.
8 . The apparatus of claim 5 in which the internet enabled communication protocol is WebRTC.
9 . A system for the storage of virtual annotations that identify features on medical devices comprising:
a means for capturing and electronically communicating through a cloud-based network series of user annotated surgical instrument feature overlays captured from a sender; and
a means for retrieving from the sender the series of user annotated surgical instrument features and displaying on a receiver captured from the sender;
so that the images that are displayed on the receiver are similar to those that are displayed on the sender with the user annotated surgical instrument feature overlays.
10 . The system of claim 7 whereby the cloud-based database interacts with the sender and the receiver using WebRTC.
11 . The system of claim 7 whereby the cloud-based database uses X, Y JSON coordinates.
12 . A method for the virtual annotation of medical devices comprising:
capturing, storing, and displaying a series of image frames on a first mobile display device by an integrated camera;
receiving user annotations on the first mobile display device of the image frames that identify and correlate features on the image frames;
reprojecting and overlaying those annotations on the first mobile display device;
storing on the first mobile display device or the second mobile display device the series of image frames and the annotations;
transmitting the series of image frames and annotations to a second mobile display device;
displaying the series of image frames and annotations on a second mobile display device;
so that a viewer of the second mobile display device observes in near real time the series of image frames that were captured by the integrated camera.
13 . The method of claim 10 , in which the user annotations are stored as X, Y JSON coordinates.
14 . The method of claim 11 , in which the second mobile display device is continuously monitoring for X, Y JSON coordinate changes.
15 . The method of claim 11 in which the second mobile display device can take one or more still image snapshots of one or more image frames that were captured by the integrated camera of the first mobile display device.
16 . The method of claim 11 in which the second mobile display device can take one or more still image snapshots of one or more image frames that were captured by the integrated camera of the second mobile display device.
17 . The method of claim 11 in which the still image snapshots are stored and may be further annotated on the second mobile display device.
18 . The method of claim 11 in which the image frames appear sequentially on the second mobile display device.
19 . The method of claim 11 in which one or more still image snapshots of one or more image frames and the annotations can be saved on to an image sequence.
20 . The method of claim 11 in which the image reel with the annotated images are erased after a session.