Method and system for automatically captioning actions in a recorded electronic demonstration

1. A method comprising:

while recording, via a recording application executed by a processor, a demonstration of an application executed concurrently with the recording application:

detecting an interaction with an interface element of the application;

capturing, by the recording application in response to said detecting the interaction, (i) an image of the interface element as displayed on a display device and (ii) a plurality of object properties associated with the interface element, wherein capturing the plurality of object properties comprises storing values of the plurality of object properties that are generated by the interaction with the interface element during execution of the application;

creating, by the recording application, a demonstration presentation comprising the captured image and a caption describing the interaction, the caption created by:

selecting, by the recording application, a caption template from among a plurality of predefined caption templates based on one or more of the stored values for one or more of the object properties captured by the recording application; and

inserting, by the recording application, a value of a name of the interface element into the caption template, the name being one of the object properties; and

outputting the demonstration presentation on an output device.

2. The method of claim 1 , wherein the object properties comprise at least one of a name of the interface element, a role of the interface element, a position of the interface element, a name of a parent of the interface element, a role of the parent of the interface element, or a position of the parent of the interface element.

3. The method of claim 1 , wherein capturing the object properties comprises querying an operating system in which the application is being executed in order to obtain the values of the object properties.

4. The method of claim 1 , wherein said capturing the object properties further comprises capturing, during the recording, an additional property associated with the interface element that describes a role of the interface element within the application, wherein the caption template is selected based on a value for the additional property associated with the interface element.

5. The method of claim 1 , wherein the caption template is also selected based on a value for one of the object properties that describes the detected interaction with the interface element.

6. The method of claim 1 , wherein said capturing the object properties further comprises capturing, during the recording, a position of the interaction, wherein the caption template is selected based on a value for the position of the interaction.

7. The method of claim 1 , wherein outputting the demonstration presentation comprises:

displaying the captured image; and

displaying the caption or playing an audio representation of the caption.

8. A computer program product comprising a non-transitory computer-readable storage medium with program code stored thereon, the program code comprising:

program code for performing, while a recording application records a demonstration of an application executed concurrently with the recording application, operations comprising:

detecting an interaction with an interface element of the application;

capturing, by the recording application in response to said detecting the interaction, (i) an image of the interface element as displayed on a display device and (ii) a plurality of object properties associated with the interface element, wherein capturing the plurality of object properties comprises storing values of the plurality of object properties that are generated by the interaction with the interface element during execution of the application;

program code for creating, by the recording application, a demonstration presentation comprising the captured image and a caption describing the interaction, the caption created by:

selecting, by the recording application, a caption template from among a plurality of predefined caption templates based on one or more of the stored values for one or more of the object properties captured by the recording application; and

inserting, by the recording application, a value of a name of the interface element into the caption template, the name being one of the object properties; and

program code for outputting the demonstration presentation on an output device.

9. The computer program product of claim 8 , wherein the object properties comprise at least one of a name of the interface element, a role of the interface element, a position of the interface element, a name of a parent of the interface element, a role of the parent of the interface element, or a position of the parent of the interface element.

10. The computer program product of claim 8 , wherein the program code for capturing the object properties comprises program code for querying an operating system in which the application is being executed in order to obtain the values of the object properties.

11. The computer program product of claim 8 , wherein the program code for capturing the object properties further comprises capturing, during the recording, an additional property associated with the interface element that describes a role of the interface element within the application, wherein the program code for selecting the caption template further comprises program code for selecting the caption template based on a value for the additional property associated with the interface element.

12. The computer program product of claim 8 , wherein the program code for selecting the caption template further comprises program code for selecting the caption template based on a value for one of the object properties that describes the detected interaction with the interface element.

13. The computer program product of claim 8 , wherein the program code for capturing the object properties further comprises capturing, during the recording, a position of the interaction, wherein the program code for selecting the caption template further comprises program code for selecting the caption template based on a value for the position of the interaction.