Method and system for controlling local display and remote virtual desktop from a mobile device
A computer-implemented method for transmitting and controlling images of a remotely executed application, the method including connecting a mobile computing device to a remote server; connecting a desktop computing device to the remote server and to the mobile computing device; starting an application on the remote server, wherein the application generates graphical objects controllable by commands from the mobile computing device; encoding each graphical object into a video stream; transferring the video stream to the mobile computing device and to the desktop computing device; generating the commands on mobile computing device; sending the commands to the remote server; detecting if the video stream contains results of execution of the commands; displaying the graphical objects on the local computing device; and generating an image of a substitute graphic object image if the video stream does not contain the results.
1. A method comprising:
receiving, by a processing device of a client device, a video stream from a remote server, wherein the video stream comprises a graphical object generated by an application running on the remote server and controllable by a command issued by a mobile device communicatively coupled with the client device, the command to be executed by the remote server;
detecting whether the video stream comprises a result of an execution of the command with respect to the graphical object by the remote server;
responsive to the video stream not comprising the result, generating, by the processing device of the client device, a substitute graphical object to replace the graphical object in the video stream; and
causing display of the substitute graphical object on the client device.
2. The method of claim 1 , wherein the command comprises at least one of positioning an application window, sizing the application window, or switching to a different application window.
3. The method of claim 1 , further comprising:
receiving the command from the mobile device; and
forwarding the command to the remote server.
4. The method of claim 1 , further comprising:
receiving the command in an operating system-independent format; and
translating the command into a format corresponding to an operating system running on the client device.
5. The method of claim 1 , wherein the video data stream further comprises data, embedded by a codec, indicating that the command has been executed on the remote server.
6. The method of claim 5 , further comprising:
reading the data embedded by the codec in the video stream to detect whether the video stream comprises the result of the execution of the command by the remote server.
7. The method of claim 1 , further comprising:
responsive to the video stream comprising the result, causing display of the graphical object on the client device.
8. A client device comprising:
a memory; and
a processing device coupled to the memory, the processing device configured to:
receive a video stream from a remote server, wherein the video stream comprises a graphical object generated by an application running on the remote server and controllable by a command issued by a mobile device communicatively coupled with the client device, the command to be executed by the remote server;
detect whether the video stream comprises a result of an execution of the command with respect to the graphical object by the remote server;
responsive to the video stream not comprising the result, generating a substitute graphical object to replace the graphical object in the video stream; and
cause display of the substitute graphical object on the client device.
9. The client device of claim 8 , wherein the command comprises at least one of selecting an application, changing a display brightness, or setting a display resolution.
10. The client device of claim 8 , wherein the processing device is further configured to:
receive the command from the mobile device; and
forward the command to the remote server.
11. The client device of claim 8 , wherein the processing device is further configured to:
receive the command in an operating system-independent format; and
translate the command into a format corresponding to an operating system running on the client device.
12. The client device of claim 8 , wherein the video data stream further comprises data, embedded by a codec, indicating that the command has been executed on the remote server.
13. The client device of claim 12 , wherein the processing device is further configured to:
read the data embedded by the codec in the video stream to detect whether the video stream comprises the result of the execution of the command by the remote server.
14. The client device of claim 8 , wherein the processing device is further configured to:
responsive to the video stream comprising the result, cause display of the graphical object on the client device.
15. A non-transitory computer-readable storage medium storing instructions, which when executed by a processing device of a client device, cause the processing device to perform operations comprising:
receiving, by the processing device, a video stream from a remote server, wherein the video stream comprises a graphical object generated by an application running on the remote server and controllable by a command issued by a mobile device communicatively coupled with the client device, the command to be executed by the remote server;
detecting whether the video stream comprises a result of an execution of the command with respect to the graphical object by the remote server;
responsive to the video stream not comprising the result, generating, by the processing device, a substitute graphical object to replace the graphical object in the video stream; and
causing display of the substitute graphical object on the client device.
16. The non-transitory computer-readable storage medium of claim 15 , wherein the operations further comprise:
receiving the command from the mobile device; and
forwarding the command to the remote server.
17. The non-transitory computer-readable storage medium of claim 15 , wherein the operations further comprise:
receiving the command in an operating system-independent format; and
translating the command into a format corresponding to an operating system running on the client device.
18. The non-transitory computer-readable storage medium of claim 15 , wherein the video data stream further comprises data, embedded by a codec, indicating that the command has been executed on the remote server.
19. The non-transitory computer-readable storage medium of claim 18 , further comprising:
reading the data embedded by the codec in the video stream to detect whether the video stream comprises the result of the execution of the command by the remote server.
20. The non-transitory computer-readable storage medium of claim 15 , wherein the operations further comprise:
responsive to the video stream comprising the result, causing display of the graphical object on the client device.