Recording GUI data
View Patent ↗A system for recording the interaction of a computer program via graphical user interface (GUI) is disclosed in which one or more operating system event queues are monitored and GUI interaction data logged.
1. An apparatus for recording graphical user interface (GUI) data for a computer program, the apparatus comprising one or more processors arranged to:
monitor an operating system event queue associated with a GUI for a program;
identify a first message on the operating system event queue defining a window of the GUI for the program;
log data representing the window in a log associated with the program, wherein the log is used to display a recorded GUI activity as a simulation of the program, and wherein the logging of the data is triggered in accordance with a predetermined logging period associated with time, message data content, or message data quantity;
identify one or more further messages on the operating system event queue defining one or more updates to the window;
identify a net change to the window defined in the further messages; and
log data representing the identified net change to the window in the log.
2. The apparatus according to claim 1 wherein the data representing the window comprises a serialization of the window.
3. The apparatus according to claim 1 wherein the data representing the net change to the window comprises a serialization of one or more changes to the window.
4. The apparatus according to claim 1 wherein the data representing the window and the data representing the net change to the window are derived from their respective identified messages on the operating system event queue.
5. The apparatus according to claim 1 wherein one or more messages on the operating system event queue define user input to the window of the GUI for the program.
6. The apparatus according to claim 1 wherein one or more predetermined sets of data are omitted from the log.
7. The apparatus according to claim 1 wherein the logged data comprises XML.
8. The apparatus according to claim 1 further operable to:
identify a log file for a selected application program; and
display the recorded GUI activity from the log file entries as a simulation of the selected application program GUI.
9. A method for recording graphical user interface (GUI) data for a computer program, the method comprising the steps of:
monitoring an operating system event queue associated with a GUI for a program;
identifying a first message on the operating system event queue defining a window of the GUI for the program;
logging data representing the window in a log associated with the program, wherein the log is used to display a recorded GUI activity as a simulation of the program, and wherein the logging of the data is triggered in accordance with a predetermined logging period associated with time, message data content, or message data quantity;
identifying one or more further messages on the operating system event queue defining one or more updates to the window;
identifying a net change to the window defined in the further messages; and
logging data representing the identified net change to the window in the log.
10. The method according to claim 9 wherein the data representing the window comprises a serialization of the window.
11. The method according to claim 9 wherein the data representing the net change to the window comprises a serialization of one or more changes to the window.
12. The method according to claim 9 wherein the data representing the window and the data representing the net change to the window are derived from their respective identified messages on the operating system event queue.
13. The method according to claim 9 wherein one or more messages on the operating system event queue define user input to the window of the GUI for the program.
14. The method according to claim 9 wherein one or more predetermined sets of data are omitted from the log.
15. The method according claim 9 wherein the logged data comprises XML.
16. The method according to claim 9 further comprising the steps of:
identifying a log file for a selected application program; and
displaying the recorded GUI activity from the log file entries as a simulation of the selected application program GUI.
17. A computer program product for recording GUI data for a computer program, the computer program product comprising a computer-readable storage medium having computer-readable program code embodied therewith, the computer-readable program code configured to:
monitor an operating system event queue associated with a GUI for a program;
identify a first message on the operating system event queue defining a window of the GUI for the program;
log data representing the window in a log associated with the program, wherein the log is used to display a recorded GUI activity as a simulation of the program, and wherein the logging of the data is triggered in accordance with a predetermined logging period associated with time, message data content, or message data quantity;
identify one or more further messages on the operating system event queue defining one or more updates to the window;
identify a net change to the window defined in the further messages; and
log data representing the identified net change to the window in the log.
18. The computer program product according to claim 17 wherein the data representing the window comprises a serialization of the window.
19. The computer program product according to claim 17 wherein the data representing the net change to the window comprises a serialization of one or more changes to the window.
20. The computer program product according to claim 17 wherein the data representing the window and the data representing the net change to the window are derived from their respective identified messages on the operating system event queue.
21. The computer program product according to claim 17 wherein one or more messages on the operating system event queue define user input to the window of the GUI for the program.