IP Library Granted Patent US 9,804,955
Granted Patent B2
US 9,804,955 · App. 14/811,479 · Granted Oct 31, 2017

Method and apparatus for creating reference images for an automated test of software with a graphical user interface

Inventor: Jonathan Gillaspie (Boulder, CO)
Assignee: TestPlant Europe Limited
G06F11/368G06F11/3664G06K9/4604G06K9/4652G06K9/52G06K9/6215G06T7/13G06T7/60G06T7/90
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,804,955
App. No.
14/811,479
Granted
Oct 31, 2017
Kind
B2
Abstract

A method for updating a test description for an automated computer test. The automated test is configured to cause a test computer system to communicate with a system under test comprising one or more computer programs being executed upon a computer device. The test description is configured to be executed by a test program to cause the test computer system to perform an automated computer test by comparing a received image from a GUI of the system under test with one or more reference images to identify an expected image. The method includes receiving a user input representative of the selection of a desired reference image from a GUI of a system under test. The method also includes obtaining the desired reference image by identifying one or more correlations between two or more pixels of the GUI of the system under test to determine a group of pixels corresponding to the desired reference image, determining the image boundaries of the desired reference image based the determined group of pixels and/or any identified correlations, capturing the desired reference image delimited by the determined image boundaries, and updating the test description with the captured reference image and utilizing the updated test description in an automated computer test.

Claims (39)

1. A method for updating a test description for an automated computer test, the automated test being configured, when executed, to cause a test computer system to communicate with a system under test comprising one or more computer programs being executed upon a computer device, wherein the test description is configured to be executed by a test program to cause the test computer system to perform an automated computer test by comparing a received image from a GUI of the system under test with one or more reference images to identify an expected image, wherein the method comprises:

a) receiving a user input representative of the selection of at least one pixel of a desired reference image from a GUI of a system under test; and

b) automatically obtaining the desired reference image by:

c) identifying one or more correlations between the at least one selected pixel and one or more adjacent pixels of the GUI of the system under test to determine a group of pixels corresponding to the desired reference image;

d) determining the image boundaries of the desired reference image based the determined group of pixels and/or any identified correlations;

e) capturing the desired reference image delimited by the determined image boundaries; and

f) updating the test description with the captured reference image.

2. A method according to claim 1 , wherein the correlations comprise one or more of: color correlations; positional correlations; temporal correlations; or empirical correlations.

3. A method according to claim 2 , wherein the color correlations comprise correlations between the color registers of two or more pixels.

4. A method according to claim 3 , wherein two or more pixels are determined to be correlated if the difference between the values of the color registers for the pixels falls within a predetermined range.

5. A method according to claim 4 , wherein two or more pixels are determined to be correlated if the values of the color registers for those pixels are the same.

6. A method according to claim 2 , wherein the positional correlations comprise geometric correlations and/or pattern-based correlations between two or more pixels.

7. A method according to claim 6 , wherein geometric correlations may comprise one or more of: pixels forming a straight line, pixels forming a rectangle or square; or pixels forming a circle.

8. A method according to claim 2 , wherein the temporal correlations comprise two or more pixels changing within a pre-defined time period of each other.

9. A method according to claim 8 , wherein the temporal correlations comprise two or more pixels changing substantially simultaneously.

10. A method according to claim 1 , wherein, prior to step c), the method comprises:

generating a model of the GUI of the system under test to identify one or more correlations between pixels of the GUI of the system under test.

11. A method according to claim 10 , wherein the model comprises a direct copy of the GUI of the system under test.

12. A method according to claim 10 , wherein the model comprises a transformation of the GUI of the system under test.

13. A method according to claim 12 , wherein the transformation may comprise one or more of: a dimensional scaling of the GUI of the system under test; a color transform; a mathematical transform; or a reduced form of the GUI of the system under test.

14. A method according to claim 13 , wherein a reduced form of the GUI of the system under test may comprise one or more of: the removal of text or removal of borders.

15. A method according to claim 10 , wherein the step of modelling is carried out on the test computer system.

16. A method according to claim 10 , wherein the step of modelling comprises dynamically modelling the pixels of the GUI of the system under test.

17. A method according to claim 1 , further comprising:

g) utilising the updated test description in an automated computer test.

18. A non-transitory computer readable medium comprising instructions configured when executed to perform a method for updating a test description for an automated computer test, the automated test being configured, when executed, to cause a test computer system to communicate with a system under test comprising one or more computer programs being executed upon a computer device, wherein the test description is configured to be executed by a test program to cause the test computer system to perform an automated computer test by comparing a received image from a GUI of the system under test with one or more reference images to identify an expected image, wherein the method comprises:

a) receiving a user input representative of the selection of at least one pixel of a desired reference image from a GUI of a system under test; and

b) automatically obtaining the desired reference image by:

c) identifying one or more correlations between the at least one selected pixel and one or more adjacent pixels of the GUI of the system under test to determine a group of pixels corresponding to the desired reference image;

d) determining the image boundaries of the desired reference image based the determined group of pixels and/or any identified correlations;

e) capturing the desired reference image delimited by the determined image boundaries; and

f) updating the test description with the captured reference image.

19. A computer system comprising: a processing device, a storage device and a non-transitory computer readable medium comprising instructions configured to perform, when executed, a method for updating a test description for an automated computer test, the automated test being configured, when executed, to cause a test computer system to communicate with a system under test comprising one or more computer programs being executed upon a computer device, wherein the test description is configured to be executed by a test program to cause the test computer system to perform an automated computer test by comparing a received image from a GUI of the system under test with one or more reference images to identify an expected image, wherein the method comprises:

a) receiving a user input representative of the selection of at least one pixel of a desired reference image from a GUI of a system under test; and

b) automatically obtaining the desired reference image by:

c) identifying one or more correlations between the at least one selected pixel and one or more adjacent pixels of the GUI of the system under test to determine a group of pixels corresponding to the desired reference image;

d) determining the image boundaries of the desired reference image based the determined group of pixels and/or any identified correlations;

e) capturing the desired reference image delimited by the determined image boundaries; and

f) updating the test description with the captured reference image.

Assignments (6)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 2, 2021
From: KEYSIGHT TECHNOLOGIES UK LIMITED
To: EGGPLANT LIMITED
Reel/Frame 055108/0484 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 7, 2021
From: EGGPLANT LIMITED
To: KEYSIGHT TECHNOLOGIES UK LIMITED
Reel/Frame 054847/0455 →
RELEASE OF SECURITY INTEREST Recorded Dec 18, 2020
From: SILICON VALLEY BANK
To: EGGPLANT LIMITED (F/K/A TESTPLANT EUROPE LIMITED)
Reel/Frame 054688/0627 →
CHANGE OF NAME Recorded Aug 7, 2020
From: TESTPLANT EUROPE LIMITED
To: EGGPLANT LIMITED
Reel/Frame 053435/0274 →
SECURITY INTEREST Recorded Jun 28, 2018
From: TESTPLANT EUROPE LIMITED
To: SILICON VALLEY BANK
Reel/Frame 046231/0968 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 25, 2017
From: GILLASPIE, JONATHAN
To: TESTPLANT EUROPE LIMITED
Reel/Frame 043677/0464 →
Continuity (1)
Related Publication 20170031799A1 · Feb 2, 2017