Computer system providing hierarchical display remoting optimized with user and system hints and related methods
A computing device may include a memory and a processor cooperating with the memory to host virtual computing sessions to be remotely displayed at a client device via a frame buffer, with the client device being configured to render the virtual computing sessions via a graphical user interface (GUI). The computing device may further detect regions of interactive graphics within a virtual computing session based upon a virtual session input and without analyzing the frame buffer, assign a higher priority to the regions of interactive graphics than other content within the frame buffer, and send the contents of the frame buffer to the client device for rendering in the GUI based upon the assigned priority.
1. A computing device comprising:
a memory and a processor cooperating with the memory to
host virtual computing sessions to be remotely displayed at a client device via a frame buffer, the client device configured to render the virtual computing sessions via a graphical user interface (GUI),
classify graphics data, based upon a virtual session input, to be stored within the frame buffer as interactive graphics data defining regions of interactive graphics or other graphics data;
assign a first priority to the interactive graphics data and a second priority to the other graphics data, the first priority being higher than the second priority, and
send the graphics data from the frame buffer to the client computing device for rendering in the GUI so that the interactive graphics data defining regions of interactive graphics and having the first priority is rendered before the other graphics data having the second priority.
2. The computing device of claim 1 further configured to capture the virtual session input.
3. The computing device of claim 1 wherein the virtual session input comprises a window pattern event.
4. The computing device of claim 1 wherein the virtual session input comprises a scroll pattern event.
5. The computing device of claim 1 wherein the virtual session input comprises a text pattern input data.
6. The computing device of claim 5 wherein the processor is further configured to asynchronously send the text pattern input data to the client device for rendering prior to rendering of corresponding graphics data from the frame buffer.
7. The computing device of claim 5 wherein the text pattern input data comprises text data and associated text metadata; and wherein the text metadata comprises at least one of font type, font size, foreground color, background color, italic, bold, underline, and line spacing.
8. The computing device of claim 5 wherein the text pattern input data corresponds to a text pattern within a scroll container.
9. The computing device of claim 1 wherein the processor is configured to send the interactive graphics data within the frame buffer having the first priority with a different level of forward error correction (FEC) than the other graphics data within the frame buffer having the second priority.
10. The computing device of claim 1 wherein the processor is configured to send the interactive graphics data within the frame buffer having the first priority via a different virtual channel than the other graphics data within the frame buffer having the second priority.
11. The computing device of claim 10 wherein the processor is configured to send the interactive graphics data having the first priority from the frame buffer to the client computing device via a first channel, and send the other graphics data having the second priority from the frame buffer to the client computing device via a second channel.
12. The computing device of claim 1 wherein the processor classifies the graphics data without analyzing data within the frame buffer.
13. A method comprising:
hosting virtual computing sessions at a computing device to be remotely displayed at a client device via a frame buffer, the client device being configured to render the virtual computing sessions via a graphical user interface (GUI);
classify graphics data, based upon a virtual session input, to be stored within the frame buffer as interactive graphics data defining regions of interactive graphics or other graphics data;
assigning a first priority to the interactive graphics data and a second priority to the other graphics data at the computing device, the first priority being higher than the second priority; and
sending the graphics data from the frame buffer to the client device for rendering in the GUI so that the interactive graphics data defining regions of interactive graphics and having the first priority is rendered before the other graphics data having the second priority.
14. The method of claim 13 wherein the virtual session input comprises a window pattern event.
15. The method of claim 13 wherein the virtual session input comprises a scroll pattern event.
16. The method of claim 13 wherein the virtual session input comprises a text pattern input data.
17. A computing system comprising:
a server configured to host virtual computing sessions and remotely display the virtual computing sessions via a frame buffer; and
a client device configured to remotely access virtual computing sessions from the server via a graphical user interface (GUI);
wherein the server is further configured to
classify graphics data, based upon a virtual session input, to be stored within the frame buffer as interactive graphics data defining regions of interactive graphics or other graphics data;
assign a first priority to the regions of interactive graphics data and a second priority to the other graphics data, and
send the graphics data from the frame buffer to the client device for rendering in the GUI so that the interactive graphics data defining regions of interactive graphics and having the first priority is rendered before the other graphics data having the second priority.
18. The computing system of claim 17 wherein the server is further configured to capture the virtual session input.
19. The computing system of claim 17 wherein the wherein the virtual session input comprises a window pattern event.
20. The computing system of claim 17 wherein the wherein the virtual session input comprises a scroll pattern event.
21. The computing system of claim 17 wherein the wherein the virtual session input comprises a text pattern input data.