Classifying input fields and groups of input fields of a webpage
A method, a system and a machine-readable data carrier, which are intended to classify input fields and groups of input fields of a webpage, are described. The method for classifying input fields and groups of input fields of a webpage may include a browser extension that contains program elements Content Script and Background Script and a program recognition module. The method may form a hierarchy of HTML-documents of a webpage. A multicomponent system for classifying input fields and groups of input fields of a webpage may include a processor device and a storage, and a set of instructions that, when executed by the processor, control the processor to form a hierarchy with grouped fields and a report file for HTML-documents of the webpage. The instructions may also identify elements of the HTML-documents on the webpage.
1. A computer-implemented method comprising:
identifying content of a webpage, the webpage comprising input fields and groups of input fields, the webpage comprising one or more HTML-encoded documents, the identifying comprising:
generating, for each HTML-encoded document of the one or more HTML-encoded documents, a document identifier of the HTML-encoded document;
for each HTML-encoded document having one or more in-line frames, generating, for each in-line frame of the one or more in-line frames, a frame identifier and a parent identifier, wherein the parent identifier identifies the HTML-encoded document having the respective in-line frame;
determining, for each HTML-encoded document, whether one or more invisible elements exist;
determining, for each HTML-encoded document, whether one or more visible elements exist;
grouping the visible elements to create a report file, the report file comprising a hierarchical structure associated with the one or more visible elements or the one or more invisible elements or a combination of the one or more visible elements and the one or more invisible elements, wherein the hierarchical structure comprises, for each in-line frame, an in-line frame hierarchical structure; and
outputting the report file;
determining, based on the report file, a single tree data structure comprising a single tree of elements for each HTML-encoded document of the webpage; and
outputting the single tree data structure.
2. The computer-implemented method of claim 1 , further comprising:
determining, on the webpage, one or more clickable elements,
wherein the determining the single tree data structure is further based on the determination of the one or more clickable elements.
3. The computer-implemented method of claim 2 , wherein the determining clickable elements comprises:
determining whether the clickable elements comprise one or more of:
large texts on the webpage;
form submission buttons;
a label for each input field;
whether buttons, for each input field, are elements of a single group or classes; or
whether elements of the input field are elements of a single group or classes.
4. The computer-implemented method of claim 1 , wherein the determining visible elements in each HTML-encoded document comprises:
determining visible elements within any child HTML-encoded document.
5. The computer-implemented method of claim 1 ,
wherein each execution of the identifying content of the webpage is separated by each execution's HTML-encoded document, and
wherein access across each execution of the identifying content of the webpage is forbidden.
6. The computer-implemented method of claim 1 , further comprising:
sending, into each in-line frame, a message with a unique identifier of the in-line frame.
7. The computer-implemented method of claim 1 , further comprising:
generating document identifiers for each HTML-encoded document within each in-line frame, a second document identifier; and
generating, for each in-line frame and based on the parent identifier of the in-line frame and based on the second document identifier, a second single tree data structure for the in-line frame,
wherein the grouping to create the report file further comprises grouping, based on the parent identifier and a corresponding document identifier, the second single tree data structure as the in-line frame hierarchical structure.
8. The computer-implemented method of claim 7 , further comprises:
sending, to each execution of the generating the second single tree data structure, the parent identifier.
9. The computer-implemented method of claim 1 , further comprising:
identifying a hierarchical relationship between the HTML-encoded documents by a pair of identifiers comprising a first identifier of the HTML-encoded document and a second identifier of the parent's in-line frame.
10. The computer-implemented method of claim 1 ,
wherein the invisible elements of the HTML-encoded documents are excluded from further analysis.
11. The computer-implemented method of claim 1 , further comprising:
storing the hierarchical relationship and association between visible elements of the webpage in the report file.
12. The computer-implemented method of claim 1 ,
wherein the single tree of elements comprises coordinates of each element of the webpage.
13. An apparatus comprising:
one or more processors; and
memory storing instructions that, when executed by the one or more processors, cause the apparatus to:
identify content of a webpage, the webpage comprising input fields and groups of input fields, the webpage comprising one or more HTML-encoded documents, the instructions to identify comprising instructions to:
generate, for each HTML-encoded document of the one or more HTML-encoded documents, a document identifier of the HTML-encoded document;
for each HTML-encoded document having one or more in-line frames, generate, for each in-line frame of the one or more in-line frames, a frame identifier and a parent identifier, wherein the parent identifier identifies the HTML-encoded document having the respective in-line frame;
determine, for each HTML-encoded document, whether one or more invisible elements exist;
determine, for each HTML-encoded document, whether one or more visible elements exist;
group the visible elements to create a report file, the report file comprising a hierarchical structure associated with the one or more visible elements or the one or more invisible elements or a combination of the one or more visible elements and the one or more invisible elements, wherein the hierarchical structure comprises, for each in-line frame, an in-line frame hierarchical structure; and
output the report file;
determine, based on the report file, a single tree data structure comprising a single tree of elements for each HTML-encoded document of the webpage; and
output the single tree data structure.
14. The apparatus of claim 13 , the instructions further causing the one or more processors to:
determine, on the webpage, one or more clickable elements,
wherein the determination of the single tree data structure is further based on the determination of the one or more clickable elements.
15. The apparatus of claim 14 , wherein the instructions to determine the clickable elements further cause the one or more processors to:
determine whether the clickable elements comprise one or more of:
large texts on the webpage;
form submission buttons;
a label for each input field;
whether buttons, for each input field, are elements of a single group or classes; or
whether elements of the input field are elements of a single group or classes.
16. The apparatus of claim 13 , wherein the instructions to determine the visible elements in each HTML-encoded document further cause the one or more processors to:
determine visible elements within any child HTML-encoded document.
17. The apparatus of claim 13 ,
wherein each execution of the identifying content of the webpage is separated by each execution's HTML-encoded document, and
wherein access across each execution of the identifying content of the webpage is forbidden.
18. The apparatus of claim 13 , wherein the instructions further cause the one or more processors to:
send, into each in-line frame, a message with a unique identifier of the in-line frame.
19. The apparatus of claim 13 , wherein the instructions further cause the one or more processors to:
generate document identifiers for each HTML-encoded document within each in-line frame, a second document identifier; and
generating, for each in-line frame and based on the parent identifier of the in-line frame and based on the second document identifier, a second single tree data structure for the in-line frame,
wherein the instructions to group to create the report file further comprises instructions to group, based on the parent identifier and a corresponding document identifier, the second single tree data structure as the in-line frame hierarchical structure.
20. The apparatus of claim 19 , wherein the instructions further cause the one or more processors to:
send, to each execution of the generation of the second single tree data structure, the parent identifier.