Displaying estimated image data in a user interface
View Patent ↗Methods and systems for robot functions and user interfaces are described. A server may receive a set of robot parameters, and may predict new parameters based on a robot command. In this manner, a user may receive parameters corresponding to the predicted values and mitigate network and processing latency. In other examples, a robot may provide a forward looking image and a robot speed. When a command to move forward is issued, the server may provide a predicted image and predicted speed. The server may be able to calculate a predicted image and a predicted speed (or other parameter) more quickly than the robot could provide the same information. The predicted information may be displayed on a user interface with a corresponding indication that the values are predicted. The robot may provide the server and the user interface with the actual data when it is available.
1. A method comprising:
receiving image data from a robotic device;
receiving a robot command;
generating estimated image data representing predicted image data corresponding to a future location of the robotic device, based on the received image data and the robot command;
transmitting the estimated image data for display in a user interface;
receiving revised image data from a robotic device; and
transmitting the revised image data for display in the user interface.
2. The method of claim 1 , wherein:
transmitting the estimated image data for display in a user interface comprises transmitting the data to a control device; and
transmitting the revised image data for display in the user interface comprises transmitting the data to the control device.
3. The method of claim 1 , wherein the estimated image data is calculated to simulate a view of the robotic device from the future location.
4. The method of claim 1 , wherein the image data comprises video data.
5. The method of claim 1 , wherein the image data comprises a still image.
6. The method of claim 1 , wherein the image data comprises image data from multiple cameras.
7. The method of claim 6 , wherein the multiple cameras are configured to provide multiple views from a location of the robotic device.
8. An article of manufacture including a non-transitory computer-readable medium, having stored thereon program instructions that, responsive to being executed by a computing device, cause the computing device to perform operations comprising:
receiving image data from a robotic device;
receiving a robot command;
generating estimated image data representing predicted image data corresponding to a future location of the robotic device, based on the received image data and the robot command;
transmitting the estimated image data for display in a user interface;
receiving revised image data from a robotic device; and
transmitting the revised image data for display in the user interface.
9. The article of manufacture of claim 8 , wherein:
transmitting the estimated image data for display in a user interface comprises transmitting the data to a control device; and
transmitting the revised image data for display in the user interface comprises transmitting the data to the control device.
10. The article of manufacture of claim 8 , wherein the estimated image data is calculated to simulate a view of the robotic device from the future location.
11. The article of manufacture of claim 8 , wherein the image data comprises video data.
12. The article of manufacture of claim 8 , wherein the image data comprises a still image.
13. The article of manufacture of claim 8 , wherein the image data comprises image data from multiple cameras.
14. The article of manufacture of claim 13 , wherein the multiple cameras are configured to provide multiple views from a location of the robotic device.
15. A server comprising:
a network interface configured to:
receive image data from a robotic device;
receive a robot command;
transmit an estimated image data for display in a user interface;
receive revised image data from a robotic device; and
transmit the revised image data for display in the user interface; and
a processor configured to generate the estimated image data representing predicted image data corresponding to a future location of the robotic device, based on the received image data and the robot command.
16. The server of claim 15 , wherein:
transmitting the estimated image data for display in a user interface comprises the communication means transmitting the data to a control device; and
transmitting the revised image data for display in the user interface comprises the communication means transmitting the data to the control device.
17. The server of claim 15 , wherein the estimated image data is calculated to simulate a view of the robotic device from the future location.
18. The server of claim 15 , wherein the image data comprises video data.
19. The server of claim 15 , wherein the image data comprises a still image.
20. The server of claim 15 , wherein the image data comprises image data from multiple cameras, wherein the multiple cameras are configured to provide multiple views from a location of the robotic device.