Virtual device interactive recording
View Patent ↗The present invention provides a mechanism for recording interactions with a Mobile Device to create a map of the structure of the menu system, Mobile Applications, and Mobile Service available on the device. A Recording/Control Environment is integrated with a physical Mobile Device, controls the Mobile Device, and records the resulting data from the Device. The Recording/Control Environment then saves the data as a map of the system structure. Once this graph has been created with a state representing every page available on the device, and with links representing every way of navigating between the individual states of the device, the graph can be used to re-create the experience of interacting with the device. A user may then virtually interact with a representative device through a Run-Time Environment, which uses the map structure to replay the interactions of the mobile device.
1. A method for providing recordings of interactions with a physical mobile device for subsequent simulation in a virtual environment, comprising:
detecting a stimulation of a control input to the physical mobile device through an interface;
generating a recording of an occurrence of a response produced, in response to said stimulation, by the physical mobile device;
creating a new state in a graph of states of the physical mobile device based on the response;
storing the generated recording of the occurrence of the response; and
processing the stored recording into a playback recording of the occurrence of said response for the virtual environment.
2. The method of claim 1 , further comprising determining a path not yet navigated and choosing the control input to select the path.
3. The method of claim 1 , further comprising splitting the generated recording into an existing state and a preamble sequence between states.
4. The method of claim 3 , further comprising creating a canonical sample by filtering dynamic information from the existing state.
5. The method of claim 4 , further comprising comparing the canonical sample to all previous canonical samples to determine if the canonical sample has been previously stored.
6. The method of claim 1 , further comprising running an application, wherein the application navigates recordings of previous responses based on a user choice.
7. The method of claim 6 , wherein the application displays an initial state based on a set of desired features to emphasize to a user.
8. The method of claim 6 , wherein the application displays a virtual representation of the mobile device and permits a user to navigate through a virtual interface to simulate a physical interaction with the mobile device.
9. A method for simulating interactions with a physical mobile device through a virtual environment, comprising:
displaying a virtual device interactive interface representing the physical mobile device;
accepting a user choice through the virtual device interactive interface;
traversing a graph of states of the physical mobile deviceto a current state based on the user choice, the current stte previously created in the graph based on a response previously produced by the physical mobile device in response to an actual stimulation of the physical mobile device; and
playing a playback recording asociated with the current state in the virtual environment, the played playback recording replaying an occurrence of the response previously produced by the physical mobile device in response to the actual stimulation of the physical mobile device.
10. The method of claim 9 , wherein the virtual device interactive interface represents a physical mobile device, which simulates actual interactions with the physical mobile device.
11. The method of claim 9 , wherein an initial virtual device interactive interface is chosen based on a set of interactions to emphasize to a user.
12. The method of claim 9 , wherein the playing simulates a physical response of the mobile device.
13. The method of claim 9 , further comprising waiting for an additional user choice and playing an associated animation in response to the additional user choice.
14. An apparatus for providing recordings of interactions with a physical mobile device for subsequent simulation in a virtual environment, comprising:
an interface configured for connecting to the physical mobile device;
one or more processors programmed for:
selecting a control input to the physical mobile device through the interface,
generating a recording of an occurrence of a response produced, in response to said stimulation, by the physical mobile device,
creating a new state in a graph of states of the physical mobile device based on the response,
storing the generated recording of the occurrence of the response and
processing the stored recording into a playback recording of the occurrence of said response for the virtual environment.
15. The apparatus of claim 14 , said one or more processors further programmed for determining a path not yet navigated and choosing the control input to select the path.
16. The apparatus of claim 14 , said one or more processors further programmed for splitting the generated recording into an existing state and a preamble sequence between states.
17. The apparatus of claim 16 , said one or more processors further programmed for creating a canonical sample by filtering dynamic information from the existing state.
18. An apparatus for simulating interactions with a physical mobile device through a virtual environment, comprising:
one or more processors programmed for
displaying a virtual device interactive interface representing the physical mobile device,
accepting a user choice through a user input,
traversing a graph of states of the physical mobile device to a current state based on the user choice, the current state previously created in the graph based on a response previously produced by the physical mobile device in response to an actual stimulation of the physical mobile device, and
playing a playback recording associated with the current state in the virtual environment to simulate an actual response of the physical mobile device based on the user choice, the played playback recording replaying an occurrence of the response previously produced by the physical mobile device in response to the actual stimulation of the physical mobile device.
19. The apparatus of claim 18 , wherein an initial virtual device interactive interface is chosen based on a set of interactions to emphasize to a user.
20. The apparatus of claim 18 , wherein the one or more processors is further programmed for waiting for an additional user choice and playing an associated animation in response to the additional user choice.
21. A non-transitory computer-readable medium comprising program code for providing recordings of interactions with a physical mobile device for subsequent simulation in a virtual environment, the program code for causing performance of a method comprising:
detecting a stimulation of a control input to the physical mobile device through an interface,
generating a recording of an occurrence of a response produced, in response to said stimulation, by the physical mobile device,
creating a new state in a graph of states of the physical mobile device based on the response,
storing the generated recording of the occurrence of the response; and
processing the stored recording into a playback recording of the occurrence of said response for the virtual environment.
22. The non-transitory computer-readable medium of claim 21 , the program code further for causing performance of the method comprising determining a path not yet navigated and choosing the control input to select the path.
23. The non-transitory computer-readable medium of claim 21 , the program code further for causing performance of the method comprising splitting the generated recording into an existing state and a preamble sequence between states.
24. The non-transitory computer-readable medium of claim 23 , the program code further for causing performance of the method comprising creating a canonical sample by filtering dynamic information from the existing state.
25. A non-transitory computer-readable medium comprising program code for simulating interactions with a physical mobile device through a virtual environment, the program code for causing performance of a method comprising:
displaying a virtual device interactive interface representing the physical mobile device;
accepting a user choice based on the virtual device interactive interface;
traversing a graph of states of the physical mobile device to a current state based on the user choice, the current state previously created in the graph based on a response previously produced by the physical mobile device in response to an actual stimulation of the physical mobile device; and
playing a playback recording associated with the current state in the virtual environment, the played playback recording replaying an occurrence of a response previously produced by the physical mobile device in response to an actual stimulation of the physical mobile device.
26. The non-transitory computer-readable medium of claim 25 , the program code further for causing performance of the method comprising choosing an initial virtual device interactive interface based on a set of interactions to emphasize to a user.
27. The non-transitory computer-readable medium of claim 25 , the program code further for causing performance of the method comprising simulating a physical response of the mobile device.
28. The non-transitory computer-readable medium of claim 25 , the program code further for causing performance of the method comprising waiting for an additional user choice and playing an associated animation in response to the additional user choice.