Publication of applications using server-side virtual screen change capture
Provided are computer-implemented methods and systems for optimization of publication of an application to a web browser. An example method for optimization of publication of an application to a web browser may include capturing, by a server-side agent, a video frame of a virtual screen associated with the application. The method may further include comparing, by the server-side agent, the video frame to a previous video frame of the virtual screen to detect a change in the video frame. The method may continue with generating, by the server-side agent, an image of the change based on the detection. The method may further include sending, by the server-side agent, the image of the change to a client device. The virtual screen may be re-rendered on the client device based on the image of the change and the previous video frame.
1. A method for optimization of publication of an application to a web browser, the method comprising:
continuously monitoring, by a server-side agent, a virtual screen associated with the application, the virtual screen displaying video data comprising a plurality of video frames;
capturing, by the server-side agent, a video frame of the plurality of the video frames for the virtual screen associated with the application;
comparing, by the server-side agent, the video frame of the plurality of the video frames to a previous video frame of the plurality of the video frames of the virtual screen to detect a change in the video frame;
based on the detection, generating, by the server-side agent, an image of the change; and
sending, by the server-side agent, the image of the change to a client device, wherein the virtual screen is re-rendered on the client device based on the image of the change and the previous video frame, the virtual screen being re-rendered by merging the previous virtual screen and the image of the change by a script running in a web browser of the client device, wherein the server-side agent captures all of the plurality of video frames of the video data;
wherein the virtual screen is re-rendered inside a web portal associated with a workspace, the workspace including a plurality of applications.
2. The method of claim 1 , further comprising:
receiving, from the client device, a user action with respect to the virtual screen; and
in response to the user action, executing, on the application, a command corresponding to the user action, wherein the change in the video frame is caused by the execution of the command.
3. The method of claim 2 , wherein the user action includes one of a keyboard event, a mouse event, and a touchscreen event.
4. The method of claim 1 , wherein the merging the previous virtual screen and the image of the change is performed using double buffering of video frames.
5. The method of claim 1 , wherein the application is executed on an application server.
6. The method of claim 5 , wherein the image is sent via a channel of communication established between the client device and the application server.
7. The method of claim 6 , wherein the channel of communication includes a Hypertext Transfer Protocol (HTTP) session.
8. The method of claim 1 , wherein the virtual screen is re-rendered using Hypertext Markup Language (HTML) and a script running in the web browser.
9. The method of claim 1 , wherein the image is in one of the following formats: PNG and JPG.
10. The method of claim 9 , wherein the JPG format is used for compression of the image.
11. The method of claim 1 , wherein the plurality of applications associated with the web portal are executed on an application server.
12. A system for optimization of publication of an application to a web browser, the system comprising:
an application server configured to run the application; and
a server-side agent configured to:
continuously monitor a virtual screen associated with the application, the virtual screen displaying video data comprising a plurality of video frames;
capture a video frame of the plurality of the video frames for the virtual screen associated with the application;
compare the video frame of the plurality of the video frames to a previous video frame of the plurality of the video frames of the virtual screen to detect a change in the video frame;
based on the detection, generate an image of the change; and
send the image of the change to a client device, wherein the virtual screen is re-rendered on the client device based on the image of the change and the previous video frame, the virtual screen being re-rendered by merging the previous virtual screen and the image of the change by a script running in a web browser of the client device, wherein the server-side agent captures all of the plurality of video frames of the video data;
wherein the virtual screen is re-rendered inside a web portal associated with a workspace, the workspace including a plurality of applications.
13. The system of claim 12 , wherein the application server is configured to:
receive, from the client device, a user action with respect to the virtual screen; and
in response to the user action, execute, on the application, a command corresponding to the user action, wherein the change in the video frame is caused by the execution of the command.
14. The system of claim 13 , wherein the user action includes one of a keyboard event, a mouse event, and a touchscreen event.
15. The system of claim 12 , wherein merging the previous virtual screen and the image of the change is performed using double buffering of video frames.
16. The system of claim 12 , wherein the application is executed on the application server.
17. A system for optimization of publication of an application to a web browser, the system comprising:
a server-side agent configured to:
continuously monitor a virtual screen associated with the application, the virtual screen displaying video data comprising a plurality of video frames;
capture a video frame of the plurality of the video frames for the virtual screen associated with the application;
compare the video frame of the plurality of the video frames to a previous video frame of the plurality of the video frames of the virtual screen to detect a change in the video frame;
based on the detection, generate an image of the change; and
send the image of the change to a client device, wherein the virtual screen is re-rendered on the client device based on the image of the change and the previous video frame, the virtual screen being re-rendered by merging the previous virtual screen and the image by a script running in the web browser of the client device using double buffering of video frames, wherein the server-side agent captures all of the plurality of video frames of the video data;
wherein the virtual screen is re-rendered inside a web portal associated with a workspace, the workspace including a plurality of applications; and
an application server configured to:
run the application;
receive, from the client device, a user action with regard to the virtual screen, the user action including one of a keyboard event and a mouse event; and
in response to the user action, execute, on the application, a command corresponding to the user action, wherein the change in the video frame is caused by the execution of the command.