IP Library Granted Patent US 10,719,428
Granted Patent B2
US 10,719,428 · App. 15/214,645 · Granted Jul 21, 2020

Automation framework for testing user interface applications

Inventor: Vikas Taneja (Redmond, WA)
Assignee: salesforce.com, inc.
G06F11/3688G06F11/3664G06F11/3692
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,719,428
App. No.
15/214,645
Filed
Jul 20, 2016
Granted
Jul 21, 2020
Kind
B2
Art Unit
2113
USPC
714/38.1
Abstract

A user interface automation framework is described. A system records multiple user interface screenshots during a session of a user interacting with a user interface application executing on a host computer. The system records metadata associated with the host computer during the session. The system executes a test of the user interface application based on the multiple user interface screenshots and the metadata.

Claims (23)

1. A system for a user interface automation framework, the system comprising:

one or more processors; and

a non-transitory computer readable medium storing a plurality of instructions, which when executed, cause the one or more processors to:

record a plurality of user interface screenshots during a session of a user interacting with a user interface application executing on a host computer, the session occurring independently of any testing of the user interface application;

record, during the session, metadata associated with the host computer and any error messages indicating that the user interface application malfunctioned during the session, the metadata including at least one of a memory utilization, a central processing unit utilization, an input/output throughput, a network bandwidth utilization or a process execution; and

execute a test of the user interface application, the test including simulating the user interface application during a time period that includes the time when the malfunction occurred by recreating a computing environment associated with the host computer based on the recorded metadata and recorded user interface screenshots and comparing the metadata associated with a first of the plurality of user interface screenshots against metadata associated with a second of the plurality of user interface screenshot.

2. The system of claim 1 , wherein the plurality of user interface screenshots comprise at least one of displayed element location data, selectable element data, tab data, text data, textbox data, and checkbox data.

3. The system of claim 1 , wherein the user interacts with the user interface application via a web browser.

4. The system of claim 1 , wherein the plurality of instructions, when executed, further cause the one or more processors to execute a test based on a plurality of user interface screenshots recorded during a subset of the session and metadata recorded during the subset of the session.

5. A computer program product comprising computer-readable program code to be executed by one or more processors when retrieved from a non-transitory computer-readable medium, the program code including instructions to:

record a plurality of user interface screenshots during a session of a user interacting with a user interface application executing on a host computer, the session occurring independently of any testing of the user interface application;

record, during the session, metadata associated with the host computer and any error messages indicating that the user interface application malfunctioned during the session, the metadata including at least one of a memory utilization, a central processing unit utilization, an input/output throughput, a network bandwidth utilization or a process execution; and

execute a test of the user interface application, the test including simulating the user interface application during a time period that includes the time when the malfunction occurred by recreating a computing environment associated with the host computer based on the recorded metadata and the recorded user interface screenshots and comparing the metadata associated with a first of the plurality of user interface screenshots against metadata associated with a second of the plurality of user interface screenshot.

6. The computer program product of claim 5 , wherein the plurality of user interface screenshots comprise at least one of displayed element location data, selectable element data, tab data, text data, textbox data, and checkbox data.

7. The computer program product of claim 5 , wherein the user interacts with the user interface application via a web browser.

8. The computer program product of claim 5 , wherein the program code includes further instructions to execute a test based on a plurality of user interface screenshots recorded during a subset of the session and metadata recorded during the subset of the session.

9. A method for a user interface automation framework, the method comprising:

recording a plurality of user interface screenshots during a session of a user interacting with a user interface application executing on a host computer, the session occurring independently of any testing of the user interface application;

recording, during the session, metadata associated with the host computer and any error messages indicating that the user interface application malfunctioned during the session, the metadata including at least one of a memory utilization, a central processing unit utilization, an input/output throughput, a network bandwidth utilization or a process execution; and

executing a test of the user interface application, the test including simulating the user interface application during a time period that includes the time when the malfunction occurred by recreating a computing environment associated with the host computer based on the recorded metadata and the recorded user interface screenshots and comparing the metadata associated with a first of the plurality of user interface screenshots against metadata associated with a second of the plurality of user interface screenshot.

10. The method of claim 9 , wherein the plurality of user interface screenshots comprise at least one of displayed element location data, selectable element data, tab data, text data, textbox data, and checkbox data.

11. The method of claim 9 , wherein the user interacts with the user interface application via a web browser.

12. The method of claim 9 , wherein executing the test comprises executing a test based on a plurality of user interface screenshots recorded during a subset of the session and metadata recorded during the subset of the session.

Assignments (2)
CHANGE OF NAME Recorded Oct 30, 2023
From: SALESFORCE.COM, INC.
To: SALESFORCE, INC.
Reel/Frame 065394/0169 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 20, 2016
From: TANEJA, VIKAS
To: SALESFORCE.COM, INC.
Reel/Frame 039197/0141 →
Continuity (1)
Related Publication 20180024915A1 · Jan 25, 2018