Method and system for webpage regression testing
A regression testing system comprises an automatic test tool configured to capture a first web screen shot and a second web screen shot of a webpage, where the webpage has undergone an update or edit. The regression testing system also comprises a visual comparator configured to identify similar areas in the first web screen shot and the second web screen shot. The visual comparator receives, and compares characteristics of, the web screen shots. Furthermore, the regression testing system generates a report with marked different characteristics between the first and second web screen shots. The regression testing system identifies similar areas in the first and second web screen shots shot even if the similar areas are at different locations within the web screen shots. The comparison performed by the visual comparator includes performing a pixel comparison combined with a marking algorithm to group differences in smaller, related but separate areas.
1. A method comprising:
comparing, by a computer-based system for webpage regression testing, characteristics of a first web screen shot of a webpage and a second web screen shot of the webpage, wherein a webpage update is implemented between the first web screen shot and the second web screen shot, and wherein the comparing includes comparing pixels in the first web screen shot to pixels in the second web screen shot by iteratively shifting regions of the first web screen shot to determine a corresponding region of the second web screen shot; and
providing, by the computer-based system and based on the comparing, a report including a modified screen shot visually indicating one or more discrepancies between the first web screen shot and the second web screen shot, wherein the report further indicates changes to the webpage that would increase matching of the first web screen shot to the second web screen shot.
2. The method of claim 1 , further comprising capturing, by the computer-based system, the first web screen shot and the second web screen shot.
3. The method of claim 1 , further comprising receiving, by the computer-based system, the first web screen shot and the second web screen shot.
4. The method of claim 1 , further comprising marking, by the computer-based system, different characteristics between the first web screen shot and the second web screen shot, wherein the marking produces the modified screen shot.
5. The method of claim 1 , wherein the one or more characteristics include one or more of the following characteristics: color, size, font, style, location, and value.
6. The method of claim 1 , wherein the report regarding changing the webpage includes a suggested color change for a portion of text on the webpage.
7. The method of claim 1 , further comprising configuring parameters to optimize performance of the computer-based system.
8. The method of claim 1 , wherein the comparing includes:
comparing a first rectangular area of the first web screen shot to a second rectangular area of the second web screen shot; and
determining a percentage difference, wherein the percentage difference indicates a ratio of a number of pixels in discrepancy to a total number of pixels in one of the first rectangular area or the second rectangular area.
9. The method of claim 8 , further comprising:
determining the rectangular size of the first rectangular area and the second rectangular area, wherein the determining the rectangular size comprises:
performing a pixel comparison of the first rectangular area to the second rectangular area; and
forming a rectangle around a grouping of pixel discrepancies.
10. The method of claim 1 , wherein the comparing further includes:
iteratively shifting the first rectangular area; and
marking the differences in the second web screen shot for rectangular areas for which a match is not found.
11. The method of claim 1 , wherein the computer-based system comprises a visual comparator which is a Java application programming interface (API).
12. The method of claim 1 , wherein the different characteristics are at least one of color, element positioning, and content.
13. The method of claim 5 , wherein the report is generated in Hyper Text Markup Language (HTML).
14. A non-transitory computer program product having computer-executable instructions stored thereon that, if executed by a computer-based system for webpage regression testing, cause the computer-based system to perform operations comprising:
comparing, by the computer-based system, characteristics of a first web screen shot of a webpage and a second web screen shot of the webpage, wherein a webpage update is implemented between the first web screen shot and the second web screen shot, and wherein the comparing includes comparing pixels in the first web screen shot to pixels in the second web screen shot by iteratively shifting regions of the first web screen shot to determine a corresponding region of the second web screen shot; and
providing, by the computer-based system and based on the comparing, a report including a modified screen shot visually indicating one or more discrepancies between the first web screen shot and the second web screen shot, wherein the report further indicates changes to the webpage that would increase matching of the first web screen shot to the second web screen shot, and wherein the report further includes suggestions regarding changing one or more characteristics of an element of the webpage in order to increase matching of the first web screen shot and the second web screen shot.
15. The product of claim 14 , wherein the comparing includes:
comparing a first rectangular area of the first web screen shot to a second rectangular area of the second web screen shot; and
determining a percentage difference, wherein the percentage difference indicates a ratio of a number of pixels in discrepancy to a total number of pixels in one of the first rectangular area or the second rectangular area.
16. The product of claim 15 , further comprising:
determining the rectangular size of the first rectangular area and the second rectangular area, wherein the determining the rectangular size comprises:
performing a pixel comparison of the first rectangular area to the second rectangular area; and
forming a rectangle around a grouping of pixel discrepancies.
17. The product of claim 14 , wherein the comparing the first web screen shot and the second web screen shot comprises comparing visual changes occurring after the webpage update.
18. A non-transitory computer-readable medium having stored thereon instructions executable by a computer system to cause the computer system to perform operations comprising:
comparing characteristics of a first web screen shot of a webpage and a second web screen shot of the webpage, wherein the comparing includes iteratively shifting a region of the first web screen shot to determine a corresponding region of the second web screen shot, wherein a webpage update is implemented between the first web screen shot and the second web screen shot, and wherein the comparing includes comparing pixels in the first web screen shot to pixels in the second web screen shot; and
providing a report based on the comparing including a modified screen shot visually indicating one or more discrepancies between the first web screen shot and the second web screen shot, wherein the report further indicates changes to the webpage that would increase matching of the first web screen shot to the second web screen shot.