Tamper-proof interaction data
Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for validating interactions with false rendered elements. In one aspect, a method includes receiving a rendering notification and a declaration of a rendered element defined in an active window on a client device, detecting interaction with the rendered element at the client device, determining whether the interaction occurred at a declared location of the rendered element within the active window, and processing the interaction including: in response to determining that the interaction occurred: capturing a screenshot of the active window on the client device; verifying a visual appearance of the rendered element in the screenshot with a declared appearance of the rendered element, and generating an interaction attestation, thereby validating the interaction. In response to determining that the interaction did not occur, refraining from generating the interaction attestation.
1. A method performed by a data processing apparatus, the method comprising:
detecting a first interaction with a rendered element that was rendered at a first client device;
determining that the first interaction occurred at a declared location of the rendered element at the first client device; and
in response to determining that the first interaction occurred at the declared location of the rendered element:
capturing a screenshot of a first active interface of the first client device;
verifying a visual appearance of the rendered element in the screenshot with a declared appearance of the rendered element; and
generating an interaction attestation for the first interaction with the rendered element, thereby validating the first interaction;
detecting a second interaction with the rendered element that was rendered at a second client device;
determining that the second interaction with the rendered element did not occur at the declared location of the rendered element;
in response to determining that the second interaction did not occur at the declared location of the rendered element, refraining from generating the interaction attestation for the second interaction with the rendered element.
2. The method of claim 1 , further comprising receiving a verified appearance of the rendered element.
3. The method of claim 2 , wherein the verified appearance includes a unique stable identifier (ID) and/or stable uniform resource identifier (URI) and a verified shape.
4. The method of claim 1 , wherein verifying a visual appearance of the rendered element in the screenshot with a declared appearance of the rendered element comprises utilizing an image matching algorithm.
5. The method of claim 1 , wherein detecting the first interaction comprises receiving a selection signal specifying an XY coordinate of a user click within an active window.
6. The method of claim 1 , further comprising aggregating interaction attestations for a plurality of interactions with a plurality of instantiations of the rendered element.
7. The method of claim 1 , wherein generating the interaction attestation comprises generating one or more of i) a stable identifier (ID) and/or uniform resource identifier (URI) of the declared appearance, ii) a timestamp of the first interaction, iii) a device integrity token, iv) a digital signature by the first client device, v) XY coordinates of the first interaction, and/or vi) a client device public key.
8. The method of claim 7 , wherein the stable ID and/or URI of the declared appearance includes a user intent of the first interaction.
9. The method of claim 8 , wherein the user intent corresponds to an action conveyed by the visual appearance of the rendered element.
10. The method of claim 8 , further comprising:
in response to the interaction attestation including a user intent, modifying a report of the interaction based on the user intent.
11. The method of claim 8 , further comprising:
in response to determining that the first interaction is different than the user intent, determining that the rendered element is a false rendered element and triggering a false interaction response.
12. The method of claim 11 , further comprising:
in response to triggering the false interaction response, intercepting a pathway of the first client device to a landing page of the false rendered element.
13. The method of claim 1 , further comprising:
in response to determining that the second interaction did not occur at the declared location of the rendered element, triggering a false interaction response.
14. A non-transitory computer storage medium encoded with a computer program, the computer program comprising instructions that when executed by a data processing apparatus cause the data processing apparatus to perform operations comprising:
detecting a first interaction with a rendered element that was rendered at a first client device;
determining that the first interaction occurred at a declared location of the rendered element at the first client device; and
in response to determining that the first interaction occurred at the declared location of the rendered element:
capturing a screenshot of a first active interface of the first client device;
verifying a visual appearance of the rendered element in the screenshot with a declared appearance of the rendered element; and
generating an interaction attestation for the first interaction with the rendered element, thereby validating the first interaction;
detecting a second interaction with the rendered element that was rendered at a second client device;
determining that the second interaction with the rendered element did not occur at the declared location of the rendered element;
in response to determining that the second interaction did not occur at the declared location of the rendered element, refraining from generating the interaction attestation for the second interaction with the rendered element.
15. The non-transitory computer storage medium of claim 14 , wherein the instructions cause the data processing apparatus to perform operations further comprising receiving a verified appearance of the rendered element.
16. The non-transitory computer storage medium of claim 15 , wherein the verified appearance includes a unique stable identifier (ID) and/or stable uniform resource identifier (URI) and a verified shape.
17. The non-transitory computer storage medium of claim 14 , wherein verifying a visual appearance of the rendered element in the screenshot with a declared appearance of the rendered element comprises utilizing an image matching algorithm.
18. The non-transitory computer storage medium of claim 14 , wherein detecting the first interaction comprises receiving a selection signal specifying an XY coordinate of a user click within an active window.
19. The non-transitory computer storage medium of claim 14 , wherein the instructions cause the data processing apparatus to perform operations further comprising aggregating interaction attestations for a plurality of interactions with a plurality of instantiations of the rendered element.
20. The non-transitory computer storage medium of claim 14 , wherein generating the interaction attestation comprises generating one or more of i) a stable identifier (ID) and/or uniform resource identifier (URI) of the declared appearance, ii) a timestamp of the first interaction, iii) a device integrity token, iv) a digital signature by the first client device, v) XY coordinates of the first interaction, and/or vi) a client device public key.