Graphical user interfaces including touchpad driving interfaces for telemedicine devices
The present disclosure describes various aspects of remote presence interfaces (RPIs) for use on portable electronic devices (PEDs) to interface with remote telepresence devices. An RPI may allow a user to interact with a telepresence device, view a live video feed, provide navigational instructions, and/or otherwise interact with the telepresence device. The RPI may allow a user to manually, semi-autonomously, or autonomously control the movement of the telepresence device. One or more panels associated with a video feed, patient data, calendars, date, time, telemetry data, PED data, telepresence device data, healthcare facility information, healthcare practitioner information, menu tabs, settings controls, and/or other features may be utilized via the RPI.
1. A non-transitory computer-readable storage medium storing instructions that, when executed by a processor, are configured to cause the processor to perform operations comprising:
communicatively connecting an electronic device to a remote presence device;
selectively displaying a live video feed from a camera of the remote presence device in a video panel on an electronic display of the electronic device;
receiving a navigation input that forms at least part of an intended navigation path of the remote presence device, wherein receiving a navigation input comprises:
overlaying a vector graphically represented as a line or arrow on the live video feed, wherein the vector has beginning point and an end point, the beginning point representing a current location of the remote telepresence device within the live video feed;
allowing an operator to move the end point of the vector with respect to the live video feed while the remote telepresence device is in motion, wherein a horizontal component of the vector is used to determine a magnitude and direction of a rotational velocity and/or an angular displacement of the remote telepresence device, and wherein a vertical component of the vector is used to determine a magnitude of a forward velocity and/or a forward displacement of the remote telepresence device;
displaying at least a portion of the intended navigation path of the remote presence device overlaid on the live video feed, wherein the displayed intended navigation path includes the vector;
transforming the navigation input into navigation instructions that are interpretable by the remote presence device;
transmitting the navigation instructions associated with the navigation input to the remote presence device;
updating the live video feed as the remote presence device moves in accordance with the navigation instructions.
2. The non-transitory computer-readable storage medium of claim 1 , wherein the operations further comprise:
selectively displaying a toolbar comprising at least one selectable setting function associated with at least one of the electronic device and the remote presence device.
3. The non-transitory computer-readable storage medium of claim 1 , wherein the operations further comprise:
selectively displaying a plurality of destination locations within a healthcare facility;
receiving a selection of one of the plurality of destination locations within the healthcare facility as the navigation input; and
transmitting the navigation instructions associated with the selected destination location to the remote presence device.
4. The non-transitory computer-readable storage medium of claim 1 , wherein the operations further comprise:
selectively displaying a map of a healthcare facility associated with the remote presence device, and
wherein the navigation input is provided with respect to the map.
5. The non-transitory computer-readable storage medium of claim 1 , wherein the operations further comprise:
receiving a selection of an avatar to visually represent the operator of the electronic device; and
transmitting the selected avatar to the remote presence device.
6. The non-transitory computer-readable storage medium of claim 1 , wherein the operations further comprise:
selectively overlaying a plurality of directional icons on the live video feed within the video panel, and
wherein receiving a navigation input comprises at least one of:
receiving a selection of a left directional icon to move the remote presence device to the left relative to the live video feed; and
receiving a selection of a right directional icon to move the remote presence device to the right relative to the live video feed;
receiving a selection of a reverse directional icon to move the remote presence device in reverse relative to the live video feed; and
receiving a selection of a forward directional icon to move the remote presence device forward relative to the live video feed.
7. The non-transitory computer-readable storage medium of claim 6 , wherein the navigation instructions associated with a selection of the reverse directional icon are configured to orient the live video feed from the remote presence device in the direction of movement, independent of a direction the remote presence device is facing.
8. The non-transitory computer-readable storage medium of claim 1 , wherein the operations further comprise:
selectively displaying a selection of navigational modes, including at least one of:
a cursor pointer mode configured to allow an operator to provide a navigation input relative to the live video feed via an on-screen cursor;
a head mode configured to allow an operator to provide a navigation input for controlling only the movement of a head portion of the remote presence device;
a laser pointer mode configured to allow an operator to provide a navigation input relative to the live video feed by controlling the location of a simulated on-screen illumination point;
a map drive mode configured to allow an operator to provide a navigation input relative to a displayed map;
a click drive mode configured to allow an operator to provide a navigation input relative to the live video feed by selecting a location within the live video feed; and
a drag-drive mode configured to allow an operator to provide a navigation input relative to the live video feed by defining a navigational path within the live video feed; and
receiving a selection of a navigational mode.
9. The non-transitory computer-readable storage medium of claim 1 , wherein the operations further comprise:
selectively displaying a plurality of patient identifiers, wherein each patient identifier is associated with a location within a healthcare facility;
receiving a selection of one of the plurality of patient identifiers; and
transmitting navigation instructions based on the location within the healthcare facility associated with the selected patient identifier.
10. The non-transitory computer-readable storage medium of claim 1 , wherein the operations further comprise:
displaying a request for a selection of at least one of a plurality of remote presence devices;
receiving a selection of one of the plurality of remote presence devices;
displaying a request for a selection of at least one of plurality of patients, each of the plurality of patients associated with a location within a healthcare facility;
receiving a selection of one of the plurality of patients; and
communicatively connecting the electronic device to the selected remote presence device, and
wherein receiving the navigation input comprises receiving the location within the healthcare facility associated with the selected patient.
11. The non-transitory computer-readable storage medium of claim 1 , wherein the operations further comprise:
selectively displaying an avatar representation of the remote telepresence device in an avatar panel on the electronic display of the electronic device.
12. The non-transitory computer-readable storage medium of claim 1 , wherein the intended navigation path is overlaid as an arrow on the live video feed.
13. A non-transitory computer-readable storage medium storing instructions that, when executed by a processor, are configured to cause the processor to perform operations comprising:
communicatively connecting an electronic device to a remote presence device;
selectively displaying a live video feed from a camera of the remote presence device in a video panel on an electronic display of the electronic device;
selectively displaying a list of destinations within a healthcare facility;
receiving a navigation input with respect to the displayed list of destinations;
displaying at least a portion of an intended navigation path of the remote presence device overlaid on the live video feed, wherein the displayed intended navigation path includes a vector graphically represented as a line or arrow indicating a direction and a velocity of the navigation input, wherein the vector has beginning point and an end point, the beginning point representing a current location of the remote telepresence device within the live video feed, wherein the direction and length of the vector is changeable by the operator while the remote telepresence device is in motion, wherein a horizontal component of the vector is used to determine a magnitude and direction of a rotational velocity and/or an angular displacement of the remote telepresence device, and wherein a vertical component of the vector is used to determine a magnitude of a forward velocity and/or a forward displacement of the remote telepresence device;
transforming the navigation input into navigation instructions that are interpretable by the remote presence device;
transmitting the navigation instructions associated with the navigation input to the remote presence device; and
updating the live video feed as the remote presence device moves in accordance with the navigation instructions.
14. A non-transitory computer-readable storage medium storing instructions that, when executed by a processor, are configured to cause the processor to perform operations comprising:
communicatively connecting an electronic device to a remote presence device;
displaying a live video feed from a camera of the remote telepresence device in a video panel on an electronic display of the electronic device;
displaying a first virtual joystick on the electronic display of the electronic device;
receiving at least one navigation input via the first virtual joystick with respect to the live video feed;
generating a navigation instruction for the remote presence device based on the at least one navigation input;
transmitting the navigation instructions associated with the intended navigation path; and
displaying at least a portion of an intended navigation path of the remote presence device overlaid on the live video feed, wherein the displayed intended navigation path includes a vector graphically represented as a line or arrow indicating a direction and a velocity of the navigation input, wherein the vector has beginning point and an end point, the beginning point representing a current location of the remote telepresence device within the live video feed, wherein the direction and length of the vector is changeable by the operator while the remote telepresence device is in motion responsive to input via the first virtual joystick, wherein a horizontal component of the vector is used to determine a magnitude and direction of a rotational velocity and/or an angular displacement of the remote telepresence device, and wherein a vertical component of the vector is used to determine a magnitude of a forward velocity and/or a forward displacement of the remote telepresence device;
transforming the navigation input into navigation instructions that are interpretable by the remote presence device;
transmitting the navigation instructions associated with the navigation input to the remote presence device; and
updating the live video feed as the remote presence device moves in accordance with the navigation instructions.
15. The non-transitory computer-readable storage medium of claim 14 , wherein the intended navigation path is overlaid as an arrow on the live video feed.
16. The non-transitory computer-readable storage medium of claim 14 , wherein the operations further comprise:
displaying a second virtual joystick on the electronic display of the electronic device;
receiving a head movement input via the second virtual joystick with respect to the live video feed; and
transmitting head movement input instructions associated with the head movement input to the remote telepresence device.
17. The non-transitory computer-readable storage medium of claim 14 , wherein the first virtual joystick is overlaid on the live video feed within the video panel.
18. A non-transitory computer-readable storage medium storing instructions that, when executed by a processor, are configured to cause the processor to perform operations comprising:
communicatively connecting an electronic device to a remote presence device;
selectively displaying a live video feed from a camera the remote telepresence device in a video panel on an electronic display of the electronic device;
selectively overlaying a plurality of directional icons on the live video feed;
receiving a navigation input by:
overlaying a vector graphically represented as a line or arrow on the live video feed, wherein the vector has beginning point and an end point, the beginning point representing a current location of the remote telepresence device within the live video feed;
allowing an operator to change a length and direction of the vector with respect to the live video feed while the remote telepresence device is in motion, wherein a horizontal component of the vector is used to determine a magnitude and direction of a rotational velocity and/or an angular displacement of the remote telepresence device, and wherein a vertical component of the vector is used to determine a magnitude of a forward velocity and/or a forward displacement of the remote telepresence device
displaying at least a portion of an intended navigation path of the remote presence device overlaid on the live video feed, wherein the intended navigation path includes the vector;
transmitting navigation instructions associated with the navigation input to the remote telepresence device; and
updating the live video feed as the remote presence device moves in accordance with the navigation instructions.
19. The non-transitory computer-readable storage medium of claim 18 , wherein the operations further comprise:
displaying a request for a selection of at least one of a plurality of remote presence devices;
receiving a selection of one of the plurality of remote presence devices; and
communicatively connecting the electronic device to the at least one selected remote presence device.
20. The non-transitory computer-readable storage medium of claim 18 , wherein the operations further comprise:
selectively displaying patient information simultaneously with the live video feed.
21. The non-transitory computer-readable storage medium of claim 1 , wherein the length of the vector corresponds to the intended acceleration of the remote presence device.
22. The non-transitory computer-readable storage medium of claim 1 , wherein at least one of the direction and length of the vector are changed on response to a mouse dragging operation by the user on the live video feed.
23. The non-transitory computer-readable storage medium of claim 1 , wherein at least one of the direction and length of the vector are changed in response to a touch-drag operation by the user on the live video feed.
24. The non-transitory computer-readable storage medium of claim 23 , wherein the touch-drag operation is received in response to the user touching two fingers on the live video feed and dragging the fingers a desired distance and direction.
25. The non-transitory computer-readable storage medium of claim 1 , wherein at least one of the direction and length of the vector are changed in response to the user drawing the vector on the live video feed.
26. The non-transitory computer-readable storage medium of claim 1 , wherein the vector comprises a curved vector.