System and method for controlling and selecting sources in a room on a network
A system and method for controlling and selecting sources in a room on a network. The system allows a remote viewer to create a virtual presence within the room by providing the available displays, corresponding to the sources, to the remote viewer. The system includes a standardizing technique for improving the communication and overall switching of data for streaming on a network. The system can include a recording server for performing dual recording of the video files in each of a local database and a remote database. A graphical user interface (GUI) display is provided to guide a local user through a medical procedure in the standardized system.
1 . A medical telepresence system for controlling access of a remote user to imaging from a first imaging device and a second imaging device and a local monitor located at an imaging location that is remote from the remote user, the system comprising:
a controller coupled to the first imaging device, the second imaging device, and the local monitor, wherein the controller is configured to:
receive a display request, the display request including a request to display at least one of a video stream from the first imaging device, or a video stream from the second imaging device;
responsive to the display request, select and locally display on the local monitor a local video stream, the local video stream including a video stream from the first imaging device or the second imaging device;
receive a second display request, the second display request including a request to display at least one of the local video stream, the video stream from the first imaging device, or the video stream from the second imaging device on a remote device;
provide, in response to the second display request, a graphical user interface (GUI) for remote display at the remote device;
transmit at least one of: the locally displayed video stream, the video stream from the first imaging device, or the video stream from the second imaging device to the GUI at the remote device; and
change the GUI at the remote device to adjust which of at least one of the locally displayed video stream, the video stream from the first imaging device, or the video stream from the second imaging device is displayed on the remote device based on a context of a room in which a medical procedure is being performed, wherein the context is automatically determined based on at least one of patient, procedure, equipment status, or medical staff information received via one or more medical environment network messages, and wherein the controller automatically determines available content based on the information from the one or more medical environment network messages.
2 . The medical telepresence system of claim 1 , wherein the controller is configured to:
change at least one of the locally displayed video stream, the video stream from the first imaging device, or the video stream from the second imaging device on the remote device based on a status; and
normalize one or more data fields from the one or more medical environment network messages to correlate with data required by a medical facility.
3 . The medical telepresence system of claim 2 , wherein the status includes at least one of: a state of a human or animal subject, a state of the first imaging device, a state of the second imaging device, or a state of a medical procedure.
4 . The medical telepresence system of claim 1 , wherein the controller is configured to record the locally displayed video stream and wherein the recorded locally displayed video stream is a continuous loop recording.
5 . The medical telepresence system of claim 4 , comprising at least one of:
a local database, located at a same location as the controller; or
a remote database, located at a remote facility;
wherein the recorded locally displayed video stream is stored in at least one of the local database or the remote database.
6 . The medical telepresence system of claim 1 , wherein the first imaging device includes a medical videoscope configured to provide an internal video stream of an internal view from within a human or animal subject during a medical procedure, and wherein the second imaging device includes an external camera configured to provide an external video stream of an external view outside of the human or animal subject during the medical procedure.
7 . The medical telepresence system of claim 6 , wherein the internal video stream includes video from a second medical videoscope, wherein the external video stream includes video from a second external camera, and wherein at least one of the external camera or the second external camera includes at least one of: a pan or a tilt or a zoom camera, and wherein an angle of a view of at least one of the external camera or the second external camera is capable of being changed by a remote viewer.
8 . The medical telepresence system of claim 7 , wherein the controller is configured to:
receive, from the remote device, a third display request selecting at least one of the internal video stream or the external video stream not currently locally displayed on the local monitor; and
in response to the third display request, update the GUI on the remote device in accordance with the third display request.
9 . The medical telepresence system of claim 7 , wherein at least one of the medical videoscope or the second medical videoscope is connected to a medical source, and wherein the medical source includes at least one of a medical scope or an ultrasound imager.
10 . The medical telepresence system of claim 1 , wherein the first imaging device, the second imaging device, and the local monitor are located in an operating room of a medical facility.
11 . The medical telepresence system of claim 10 further comprising:
a virtual presence camera coupled to the controller, wherein the virtual presence camera is configured to generate another video stream that provides a view of the operating room.
12 . The medical telepresence system of claim 11 , wherein the local monitor includes a privacy feature that disables at least one of the local video stream, the video stream from the first imaging device, the video stream from the second imaging device, or the video stream that provides a view of the operating room.
13 . The medical telepresence system of claim 11 , wherein the controller is configured to:
switch between the local video stream, the video stream from the first imaging device, the video stream from the second imaging device, and the video stream that provides a view of the operating room.
14 . The medical telepresence system of claim 1 , wherein the controller is coupled to a plurality of monitors, and wherein a user interface included on the local monitor is configured to receive an input selecting one or more monitors of the plurality of monitors for remote viewing.
15 . A computer implemented method for medical collaboration with a remote viewer, the method comprising:
receiving a display request, the display request including a request to display at least one of a video stream from a first imaging device, or a video stream from a second imaging device;
responsive to the display request, selecting and locally displaying on a local monitor, a local video stream, the local video stream including a video stream from the first imaging device or the second imaging device;
receiving a second display request, the second display request including a request to display at least one of the local video stream, the video stream from the first imaging device, or the video stream from the second imaging device on a remote device;
providing, in response to the second display request, a graphical user interface (GUI) for remote display at the remote device;
transmitting at least one of: the locally displayed video stream, the video stream from the first imaging device, or the video stream from the second imaging device to the GUI at the remote device; and
changing the GUI at the remote device to adjust which of at least one of the locally displayed video stream, the video stream from the first imaging device, or the video stream from the second imaging device is displayed on the remote device based on a medical procedural status of a human or animal subject patient undergoing a medical procedure, wherein the medical procedure status is automatically determined based on at least one of patient or procedure information received via one or more medical environment network messages, and wherein a controller automatically determines available content based on the information from the one or more medical environment network messages.
16 . The method of claim 15 , comprising:
changing at least one of the locally displayed video stream, the video stream from the first imaging device, or the video stream from the second imaging device on the remote device based on an additional status, wherein the additional status includes at least one of:
a state of a human or animal subject, a state of the first imaging device, a state of the second imaging device, or a state of a medical procedure.
17 . A non-transitory machine-readable medium with instructions stored thereon that, when executed by a processor of a computing device, cause the computing device to:
receive a display request, the display request including a request to display at least one of a video stream from a first imaging device, or a video stream from a second imaging device;
responsive to the display request, select and locally display on a local monitor, a local video stream, the local video stream including a video stream from the first imaging device or the second imaging device;
receive a second display request, the second display request including a request to display at least one of the local video stream, the video stream from the first imaging device, or the video stream from the second imaging device on a remote device;
provide, in response to the second display request, a graphical user interface (GUI) for remote display at the remote device;
transmit at least one of: the locally displayed video stream, the video stream from the first imaging device, or the video stream from the second imaging device to the GUI at the remote device; and
change the GUI at the remote device to adjust which of at least one of the locally displayed video stream, the video stream from the first imaging device, or the video stream from the second imaging device is displayed on the remote device based on a medical procedural status of a human or animal subject patient undergoing a medical procedure, wherein the medical procedure status is automatically determined based on at least one of patient or procedure information received via one or more medical environment network messages, and wherein a controller automatically determines available content based on the information from the one or more medical environment network messages.
18 . The non-transitory machine-readable medium of claim 17 , wherein:
the first imaging device includes a medical videoscope configured to provide an internal video stream of an internal view from within a human or animal subject during a medical procedure;
the second imaging device includes an external camera configured to provide an external video stream of an external view outside of the human or animal subject during the medical procedure;
the internal video stream includes video from a second medical videoscope;
the external video stream includes video from a second external camera;
at least one of the external camera or the second external camera includes at least one of: a pan or a tilt or a zoom camera; and
an angle of a view of at least one of the external camera or the second external camera is capable of being changed by a remote viewer.
19 . The non-transitory machine-readable medium of claim 18 , wherein the instructions cause the processor to:
receive, from the remote device, a third display request selecting at least one of the internal video stream or the external video stream not currently locally displayed on the local monitor; and
in response to the third display request, update the GUI on the remote device in accordance with the third display request.