System and method for objectively measuring user experience of touch screen based devices
In certain embodiments, latency measurement related to touch screen response may be facilitated. In some embodiments, a robotic member may be moved to perform a physical contact with a touch screen of a device. Frame change rates of the touch screen may be monitored. A response end time of a response depicted on the touch screen may be determined based on the monitored frame change rates of the touch screen, where the touch-screen-depicted response is a response to. A latency of the touch screen response to the first contact may be determined based on a contact time of the physical contact and the response end time.
1. A method of measuring latency related to touch screen response, the method comprising:
monitoring, by one or more processors, frame change rates of a touch screen of a device;
determining, by one or more processors, based on the monitored frame change rates of the touch screen, a response end time of a response depicted on the touch screen, the touch-screen-depicted response being a response to a physical contact with the touch screen; and
determining, by one or more processors, a latency of the touch screen response to the physical contact based on a contact time of the physical contact and the response end time.
2. The method of claim 1 , further comprising:
causing, by one or more processors, a robotic member to move to perform the physical contact with the touch screen.
3. The method of claim 1 , further comprising:
generating, by a camera, a video of an interaction with the touch screen of the device, wherein the interaction comprises (i) the physical contact with the touch screen and (ii) the touch-screen-depicted response of the touch screen to the physical contact; and
determining the contact time of the physical contact based on the interaction video,
wherein monitoring the frame change rates comprises monitoring the frame change rates of the touch screen based on the interaction video.
4. The method of claim 3 , wherein the camera has a recording rate of at least a 60 frames-per-second.
5. The method of claim 3 , wherein the interaction comprises a plurality of contacts between a member and the touch screen, the plurality of contacts comprises the physical contact of a first type of contact and a second physical contact of a second type of contact different from the first type of contact, and at least one of the plurality of contacts comprises:
an initial contact between the member and the touch screen; and
a completion of the initial contact between the member and the touch screen.
6. The method of claim 5 , wherein at least one of the first or second types of contact comprises a touch, a swipe, or a button press.
7. The method of claim 5 , further comprising:
determining, by one or more processors, a first average latency of response of the touch screen to the first type of contact; and
determining, by one or more processors, a second average latency of response of the touch screen to the second type of contact.
8. The method of claim 1 , wherein the touch-screen-depicted response to the physical contact comprises:
an initial response of the touch screen comprising a first change of frame of the touch screen that occurs at a beginning of the touch-screen-depicted response; and
a completion of the touch-screen-depicted response comprising at least a plurality of frame changes.
9. The method of claim 1 , wherein determining the response end time comprises determining, based on the monitored frame change rates, the response end time to be a time at which no frame change subsequently occurs for at least a predetermined amount of time.
10. The method of claim 1 , further comprising:
determining, by one or more processors, a change in a number of pixels of the touch screen;
obtaining, by one or more processors, one or more characteristics of the touch screen being tested;
determining, by one or more processors, whether the change in the number of pixels is sufficient to determine that the touch screen has responded to the physical contact based on the one or more characteristics of the touch screen; and
determining, by one or more processors, the response end time based on the monitored frame change rates of the touch screen and the determination of whether the change in the number of pixels is sufficient.
11. The method of claim 1 , further comprising:
obtaining, by one or more processors, information specifying latencies of responses of the touch screen to contacts, the touch screen responses comprising the touch-screen-depicted response and the contacts comprising the physical contact;
determining, by one or more processors, respective amounts of time between contact times at which at least some of the contacts occurred and end times of the touch screen responses to other ones of the contacts, wherein the other ones of the contacts immediately preceded respective ones of the at least some contacts; and
determining, by one or more processors, latency patterns of the touch screen based on the respective amounts of time and the latencies of the touch screen responses to the at least some contacts.
12. A system comprising:
a computer system comprising one or more processors programmed with computer program instructions that, when executed by the one or more processors, cause the computer system to:
monitor frame change rates of a touch screen of a device;
determine, based on the monitored frame change rates of the touch screen, a response end time of a response depicted on the touch screen, the touch-screen-depicted response being a response to a physical contact with the touch screen; and
determine a latency of the touch screen response to the physical contact based on a contact time of the physical contact and the response end time.
13. The system of claim 12 , wherein the computer system is caused to:
cause a robotic member to move to perform the physical contact with the touch screen.
14. The system of claim 12 , wherein the computer system is caused to:
cause a camera to record a video of an interaction with the touch screen of the device, wherein the interaction comprises (i) the physical contact with the touch screen and (ii) the touch-screen-depicted response of the touch screen to the physical contact; and
determining the contact time of the physical contact based on the interaction video,
wherein monitoring the frame change rates comprises monitoring the frame change rates of the touch screen based on the interaction video.
15. The system of claim 14 , wherein the camera has a recording rate of at least a 60 frames-per-second.
16. The system of claim 12 , wherein determining the response end time comprises determining, based on the monitored frame change rates, the response end time to be a time at which no frame change subsequently occurs for at least a predetermined amount of time.
17. The system of claim 12 , wherein the computer system is caused to:
determine a change in a number of pixels of the touch screen;
obtain one or more characteristics of the touch screen being tested;
determine whether the change in the number of pixels is sufficient to determine that the touch screen has responded to the physical contact based on the one or more characteristics of the touch screen; and
determine the response end time based on the monitored frame change rates of the touch screen and the determination of whether the change in the number of pixels is sufficient.
18. One or more non-transitory computer-readable storage media comprising instructions that, when executed by one or more processors, perform operations comprising:
monitoring frame change rates of a touch screen of a device;
determining, based on the monitored frame change rates of the touch screen, a response end time of a response depicted on the touch screen, the touch-screen-depicted response being a response to a physical contact with the touch screen; and
determining a latency of the touch screen response to the physical contact based on a contact time of the physical contact and the response end time.
19. The one or more non-transitory computer-readable storage media of claim 18 , the operations further comprising:
causing a robotic member to move to perform the physical contact with the touch screen.
20. The one or more non-transitory computer-readable storage media of claim 18 , the operations further comprising:
causing a camera to record a video of an interaction with the touch screen of the device, wherein the interaction comprises (i) the physical contact with the touch screen and (ii) the touch-screen-depicted response of the touch screen to the physical contact; and
determining the contact time of the physical contact based on the interaction video,
wherein monitoring the frame change rates comprises monitoring the frame change rates of the touch screen based on the interaction video.