System for superimposed communication by object oriented resource manipulation on a data network
An adaptive web resource interaction system based on analogue referencing includes a computer implemented method, a computer system, and a non-transitory computer readable medium to provide an autonomous infrastructure that enables an automatically controlled interaction environment on web resources for both human and machine users, where the system dynamically adapts itself to contextual and/or structural alterations of each interacted web resource according to each rendering of a client individually. Thus, within the scope of any data network including the Internet, the system provides an infrastructure that ensures the consistency (stability) and persistency (sustainability) of interactions, where human and machine users may interact with web resources by associating/integrating—and/or reaching to—virtually any kind of user input including user generated software applications—stored and executed by the system—that dynamically process/manipulate web objects, and interact with each other through those user inputs that act as network links.
1. A method comprising:
analyzing a web page rendered for a user to identify visual elements in the web page;
generating, for each of the identified visual elements, uniform visual element identifiers (UVEIs), each of the UVEIs uniquely identifying a corresponding one of the identified visual elements;
associating, with each of the UVEIs, at least one of: information regarding the web page, distinctive information of the corresponding one of the visual elements, distinctive properties of the corresponding one of the visual elements, or relative position information of the corresponding one of the visual elements in the web page;
identifying, for each of the visual elements, cluster information to interrelate the visual elements within the web page, the cluster information identifying clusters of interrelated visual elements based on respective relative position of the visual elements, respective functional relationships of the visual elements with other visual elements, or both;
associating with at least one of the visual elements or a cluster of interrelated visual elements an application that dynamically processes and/or manipulates at least one of the visual elements or the cluster of interrelated visual elements;
re-analyzing the web page in response to the web page being subsequently rendered as a re-rendered web page to re-identify each of the visual elements in the re-rendered web page;
generating, for each of the visual elements identified in the re-rendered web page, new uniform visual identifiers (nUVEIs), each of the nUVEIs uniquely identifying a corresponding one of the visual elements identified in the re-rendered web page;
associating, with each of the nUVEIs, at least one of: information regarding the re-rendered web page, distinctive information of the corresponding one of the visual elements identified in the re-rendered web page, distinctive properties of the corresponding one of the visual elements identified in the re-rendered web page, or relative position information of the corresponding one of the visual elements in the re-rendered web page;
comparing the nUVEIs with the UVEIs and associating the nUVEIs with the UVEIs based on a predefined threshold of similarity; and
adapting respective execution procedures of the application for the nUVEIs in accordance with association and comparison of the nUVEIs and the UVEIs.
2. The method of claim 1 , wherein identifying, for each of the visual elements, cluster information comprises an initial step of classifying each of the visual elements into one of a plurality of predetermined classes.
3. The method of claim 2 , wherein identifying, for each of the visual elements, cluster information comprises identifying, for each of the clusters of interrelated visual elements, at least one function of a respective cluster within the web page, and generating, for each respective cluster, uniform cluster function identifiers (UCFIs), each of the UCFIs including the at least one function of the respective cluster.
4. The method of claim 3 , wherein identifying, for each of the visual elements, cluster information comprises identifying the visual elements and clusters of interrelated visual elements available for user interaction based on a set of predefined interaction rules, the classification of the visual elements, and the uniform cluster function identifiers (UCFIs).
5. The method of claim 1 , wherein associating with at least one of the visual elements or the cluster of interrelated visual elements the application comprises receiving a user selection of the at least one of the visual elements or the cluster of interrelated visual elements;
receiving user commands to generate the application that dynamically processes and/or manipulates the selected at least one of the visual elements or the cluster of interrelated visual elements; and
setting adaptation rules for the application according to the selected at least one of the visual elements or the cluster of interrelated visual elements.
6. The method of claim 1 , further comprising receiving an input representative of a user interaction with at least one of the visual elements or the cluster of interrelated visual elements; and
storing the user interaction with the at least one of the visual elements as user input in association with the one of the UVEIs, or storing the user interaction with the cluster of interrelated visual elements as user input in association with a corresponding set of the UVEIs that belong to the cluster of interrelated visual elements.
7. The method of claim 6 , wherein identifying, for each of the visual elements, cluster information comprises identifying, for each of the clusters of interrelated visual elements, at least one function of a respective cluster within the web page, and generating, for each respective cluster, uniform cluster function identifiers (UCFIs); and
recording a corresponding UCFI of the respective cluster and/or recording for each of the UVEIs that belong to the respective cluster corresponding cluster information.
8. The method of claim 7 , wherein identifying, for each of the visual elements, cluster information comprises classifying each of the visual elements into one or more of a plurality of predetermined classes, and wherein recording the corresponding UCFI comprises recording, for each of the UVEIs that belong to the respective cluster, corresponding cluster information and a predetermined class of each of the visual elements in the respective cluster.
9. The method of claim 1 , wherein the UVEIs are stored in a database as recorded UVEIs (rUVEIs) and comparing the nUVEIs with UVEIs comprises comparing the nUVEIs with the rUVEIs stored in the database.
10. The method of claim 1 , wherein re-identifying, for each of the visual elements identified in the re-rendered web page, new cluster information comprises:
re-identifying, for each of a plurality of new clusters, a function within the re-rendered web page; and
generating, for each of the new clusters, new uniform cluster function identifiers (nUCFIs), each of the nUCFIs including the function of a respective new cluster of interrelated visual elements.
11. The method of claim 10 , wherein re-identifying, for each of the visual elements identified in the re-rendered web page, new cluster information further comprises an initial step of re-classifying each of the visual elements identified in the re-rendered web page into one or more of a plurality of predetermined classes.
12. The method of claim 10 , further comprising comparing the nUCFIs with UCFIs stored in a database as recorded UCFIs (rUCFIs) and associating the nUCFIs with the rUCFIs based on a predefined threshold of similarity to re-establishing a previously established association between a user input and a visual element or a cluster of interrelated visual elements.
13. The method of claim 1 , wherein comparing the nUVEIs with UVEIs comprises:
constructing, based on the UVEIs, an initial state representation of the at least one of the visual elements or the cluster of interrelated visual elements associated with the application;
constructing based on the nUVEIs a recent state representation of the at least one of the visual elements or the cluster of interrelated visual elements associated with the application; and
comparing the initial state representation with the recent state representation to identify contextual and structural differences.
14. The method of claim 13 , wherein adapting respective execution procedures of the application comprises adapting the respective execution procedures of the application to the recent state representation of the at least one of the visual elements or the cluster of interrelated visual elements associated with the application in accordance with the identified contextual and structural differences.
15. The method of claim 14 , wherein adapting respective execution procedures of the application to the recent state representation comprises identifying a procedure to adapt the respective execution procedures to the recent state representation of the at least one of the visual elements or the cluster of interrelated visual elements associated with the application according to the identified contextual and structural differences, a predefined set of adaptation rules defined for the application, and the at least one of the visual elements or the cluster of interrelated visual elements associated with the application.
16. A system comprising:
a server computer configured to:
analyze a web page rendered for a user to identify visual elements in the web page;
generate, for each of the identified visual elements, uniform visual element identifiers (UVEIs), each of the UVEIs uniquely identifying a corresponding one of the identified visual elements;
associate, with each of the UVEIs, at least one of: information regarding the web page, distinctive information of the corresponding one of the visual elements, distinctive properties of the corresponding one of the visual elements, or relative position information of the corresponding one of the visual elements in the web page;
identify, for each of the visual elements, cluster information to interrelate the visual elements within the web page, the cluster information identifying clusters of interrelated visual elements based on respective relative position of the visual elements, respective functional relationships of the visual elements with other visual elements, or both;
associate with at least one of the visual elements or a cluster of interrelated visual elements an application that dynamically processes and/or manipulates at least one of the visual elements or the cluster of interrelated visual elements;
re-analyze the web page in response to the web page being subsequently rendered as a re-rendered web page to re-identify each of the visual elements in the re-rendered web page;
generate, for each of the visual elements identified in the re-rendered web page, new uniform visual identifiers (nUVEIs), each of the nUVEIs uniquely identifying a corresponding one of the visual elements identified in the re-rendered web page;
associate, with each of the nUVEIs, at least one of: information regarding the re-rendered web page, distinctive information of the corresponding one of the visual elements identified in the re-rendered web page, distinctive properties of the corresponding one of the visual elements identified in the re-rendered web page, or relative position information of the corresponding one of the visual elements in the re-rendered web page;
compare the nUVEIs with the UVEIs and associate the nUVEIs with the UVEIs based on a predefined threshold of similarity; and
adapt respective execution procedures of the application for the nUVEIs in accordance with association and comparison of the nUVEIs and the UVEIs.
17. The system of claim 16 , wherein the server computer is further configured to classify each of the visual elements into one of a plurality of predetermined classes in order to identify, for each of the visual elements, respective cluster information.
18. The system of claim 17 , wherein the server computer is further configured to identify, for each of the clusters of interrelated visual elements, at least one function of a respective cluster within the web page, and generate, for each respective cluster, uniform cluster function identifiers (UCFIs), each of the UCFIs including the at least one function of the respective cluster.
19. The system of claim 18 , wherein the server computer is further configured to identify the visual elements and clusters of interrelated visual elements in the web page available for user interaction based on a set of predefined interaction rules, classification of the visual elements, and the uniform cluster function identifiers (UCFIs).
20. The system of claim 16 , wherein the server computer is further configured to:
receive a user selection of the at least one of the visual elements or the cluster of interrelated visual elements;
receive user commands to generate the application that dynamically processes and/or manipulates the selected at least one of the visual elements or the cluster of interrelated visual elements; and
set adaptation rules for the application according to the selected at least one of the visual elements or the cluster of interrelated visual elements.
21. The system of claim 16 , wherein the server computer is further configured to:
receive an input representative of a user interaction with the at least one of the visual elements or the cluster of interrelated visual elements; and
store, in a database, the user interaction with the at least one of the visual elements as user input in association with the one of the UVEIs, or store, in the database, the user interaction with the cluster of interrelated visual elements as user input in association with a corresponding set of the UVEIs that belong to the cluster of interrelated visual elements.
22. The system of claim 21 , wherein the server computer is further configured to: identify, for each of the clusters of interrelated visual elements, at least one function of a respective cluster within the web page, and generate, for each respective cluster, uniform cluster function identifiers (UCFIs); and
record a corresponding UCFI of the respective cluster and/or recording for each of the UVEIs that belong to the respective cluster corresponding cluster information.
23. The system of claim 22 , wherein the server computer is further configured to: classify each of the visual elements into one or more of a plurality of predetermined classes, and wherein recordation of the corresponding UCFI comprises the server computer being further configured to: record, for each of the UVEIs that belong to the respective cluster, corresponding cluster information and a predetermined class of each of the visual elements in the respective cluster.
24. The system of claim 16 , further comprising a database, and wherein the server computer is further configured to store the UVEIs in the database as recorded UVEIs (rUVEIs) and compare the nUVEIs with the rUVEIs stored in the database.
25. The system of claim 16 , wherein the server computer is further configured to:
re-identify, for each of a plurality of new clusters, a function within the re-rendered web page; and
generate, for each of the new clusters, new uniform cluster function identifiers (nUCFIs), each of the nUCFIs including the function of a respective new cluster of interrelated visual elements.
26. The system of claim 25 , wherein the server computer is further configured to: re-classify each of the visual elements identified in the re-rendered web page into one of a plurality of predetermined classes prior to identification, by the server computer, of new cluster information.
27. The system of claim 25 , wherein the server computer is further configured to: compare the nUCFIs with UCFIs stored in a database as recorded UCFIs (rUCFIs) and associate the nUCFIs with the rUCFIs based on a predefined threshold of similarity to re-establish a previously established association between a user input and a visual element or a cluster of interrelated visual elements.
28. The system of claim 16 , wherein the server computer is further configured to:
construct, based on the UVEIs, an initial state representation of the at least one of the visual elements or the cluster of interrelated visual elements associated with the application;
construct based on the nUVEIs a recent state representation of the at least one of the visual elements or the cluster of interrelated visual elements associated with the application; and
compare the initial state representation with the recent state representation to identify contextual and structural differences.
29. The system of claim 28 , wherein the server computer is further configured to: adapt the respective execution procedures of the application to the recent state representation of the at least one of the visual elements or the cluster of interrelated visual elements associated with the application in accordance with the identified contextual and structural differences.
30. The system of claim 29 , wherein the server computer is further configured to: identify a procedure to adapt the respective execution procedures to the recent state representation of the at least one of the visual elements or the cluster of interrelated visual elements associated with the application according to identified contextual and structural differences, a predefined set of adaptation rules defined for the application, and the at least one of the visual elements or the cluster of interrelated visual elements associated with the application.
31. A non-transitory computer readable medium storing instructions executable by a processor, the computer readable medium comprising:
instructions executable with the processor to analyze a web page rendered for a user to identify visual elements in the web page;
instructions executable with the processor to generate, for each of the identified visual elements, uniform visual element identifiers (UVEIs), each of the UVEIs uniquely identifying a corresponding one of the identified visual elements;
instructions executable with the processor to associate, with each of the UVEIs, at least one of: information regarding the web page, distinctive information of the corresponding one of the visual elements, distinctive properties of the corresponding one of the visual elements, or relative position information of the corresponding one of the visual elements in the web page;
instructions executable with the processor to identify, for each of the visual elements, cluster information to interrelate the visual elements within the web page, the cluster information identifying clusters of interrelated visual elements based on respective relative position of the visual elements, respective functional relationships of the visual elements with other visual elements, or both;
instructions executable with the processor to associate with at least one of the visual elements or a cluster of interrelated visual elements an application that dynamically processes and/or manipulates at least one of the visual elements or the cluster of interrelated visual elements;
instructions executable with the processor to re-analyze the web page in response to the web page being subsequently rendered as a re-rendered web page to re-identify each of the visual elements in the re-rendered web page;
instructions executable with the processor to generate, for each of the visual elements identified in the re-rendered web page, new uniform visual identifiers (nUVEIs), each of the nUVEIs uniquely identifying a corresponding one of the visual elements identified in the re-rendered web page;
instructions executable with the processor to associate, with each of the nUVEIs, at least one of: information regarding the re-rendered web page, distinctive information of the corresponding one of the visual elements identified in the re-rendered web page, distinctive properties of the corresponding one of the visual elements identified in the re-rendered web page, or relative position information of the corresponding one of the visual elements in the re-rendered web page;
instructions executable with the processor to compare the nUVEIs with the UVEIs and associate the nUVEIs with the UVEIs based on a predefined threshold of similarity; and
instructions executable with the processor to adapt respective execution procedures of the application for the nUVEIs in accordance with association and comparison of the nUVEIs and the UVEIs.