Methods and apparatus to prevent illicit proxy communications from affecting a monitoring result
Methods, apparatus, systems and articles of manufacture to prevent illicit proxy communications from affecting a monitoring result are disclosed. An example method includes accessing a log of communications of a proxy server, the log of communications including a plurality of records, each of the plurality of records corresponding to a requesting device that transmitted a communication to the proxy server, identifying a first internet protocol (IP) address subnet in the log of communications, the first IP address subnet associated with a block of IP addresses, filtering the plurality of records for a first set of records associated with communications originating from the first IP address subnet, and in response to determining the first set of records does not include a record associated with a heartbeat communication, adding the first IP address subnet to a blacklist of the proxy server.
1. An apparatus, comprising:
at least one memory instructions; and
at least one processor to execute the instructions to:
access a log of communications of a proxy server associated with a central facility of an audience measurement entity, the log of communications including a plurality of records, each of the plurality of records corresponding to a requesting device that transmitted a communication to the proxy server;
identify a first internet protocol (IP) address subnet in the log of communications, the first IP address subnet associated with a block of IP addresses;
filter the plurality of records for a first set of records associated with communications originating from the first IP address subnet;
compare first user agent fields in the first set of records to second user agent fields indicative of a first record originating from a mobile device, the first record originating from the mobile device associated with a heartbeat communication; and
add the first IP address subnet to a blocklist of the proxy server in response to determining none of the first user agent fields match the second user agent fields, the first set of records not including a second record associated with the heartbeat communication indicative of the first set of records originating from a non-mobile device.
2. The apparatus of claim 1 , wherein the at least one processor executes the instructions to:
identify a second IP address subnet in the log of communications;
filter the plurality of records for a second set of records associated with communications originating from the second IP address subnet; and
add the second IP address subnet to a blacklist of the proxy server in response to determining the second set of records does not include the second record associated with the heartbeat communication.
3. The apparatus of claim 1 , wherein the at least one processor executes the instructions to:
determine a quantity of unique user agents in the first set of records; and
identify the first IP address subnet as originating valid traffic in response to determining the quantity of unique user agents satisfies a threshold.
4. The apparatus of claim 1 , wherein the at least one processor executes the instructions to:
compare the first user agent fields to the second user agent fields indicative of the first record originating from the mobile device; or
compare first uniform resource locator fields to second uniform resource locator fields indicative of the first record originating from the mobile device.
5. The apparatus of claim 1 , wherein the at least one processor executes the instructions to identify the first IP address subnet as originating valid traffic in response to determining the first set of records includes the second record associated with the heartbeat communication.
6. A non-transitory machine-readable storage medium comprising instructions which, when executed, cause a central facility of an audience measurement entity to at least:
access a log of communications of a proxy server associated with a central facility of an audience measurement entity, the log of communications including a plurality of records, each of the plurality of records corresponding to a requesting device that transmitted a communication to the proxy server;
identify a first internet protocol (IP) address subnet in the log of communications, the first IP address subnet associated with a block of IP addresses;
filter the plurality of records for a first set of records associated with communications originating from the first IP address subnet;
compare first user agent fields in the first set of records to second user agent fields indicative of a first record originating from a mobile device, the first record originating from the mobile device associated with a heartbeat communication; and
in response to determining none of the first user agent fields match the second user agent fields, add the first IP address subnet to a blocklist of the proxy server, the first set of records not a second record associated with the heartbeat communication indicative of the first set of records originating from a non-mobile device.
7. The non-transitory machine-readable storage medium of claim 6 , further including:
identify a second IP address subnet in the log of communications;
filter the plurality of records for a second set of records associated with communications originating from the second IP address subnet; and
in response to determining the second set of records does not include the second record associated with the heartbeat communication, add the second IP address subnet to a blacklist of the proxy server.
8. The non-transitory machine-readable storage medium of claim 6 , further including:
determine a quantity of unique user agents in the first set of records; and
in response to determining the quantity of unique user agents satisfies a threshold, identify the first IP address subnet as originating valid traffic.
9. The non-transitory machine-readable storage medium of claim 6 , wherein the instructions, when executed, further cause the central facility to determine the first set of records does not include the second record associated with the heartbeat communication by at least:
comparing the first user agent fields to the second user agent fields indicative of the first record originating from the mobile device; or
comparing uniform resource locator fields to second uniform resource locator fields indicative of the first record originating from the mobile device.
10. The non-transitory machine-readable storage medium of claim 6 , wherein the instructions, when executed, further cause the central facility to at least, in response to determining the first set of records includes the second record associated with the heartbeat communication, identify the first IP address subnet as originating valid traffic.
11. The non-transitory machine-readable storage medium of claim 6 , wherein the instructions, when executed, further cause the central facility to at least,
exclude a third set of records associated with illicit communications from the log of communications to form a log of legitimate communications; and
process the log of legitimate communications to credit usage of mobile computing devices associated with the third set of records.
12. A method, including:
accessing a log of communications of a proxy server associated with a central facility of an audience measurement entity, the log of communications including a plurality of records, each of the plurality of records corresponding to a requesting device that transmitted a communication to the proxy server;
identifying a first internet protocol (IP) address subnet in the log of communications, the first IP address subnet associated with a block of IP addresses;
filtering the plurality of records for a first set of records associated with communications originating from the first IP address subnet;
comparing first user agent fields in the first set of records to second user agent fields indicative of a first record originating from a mobile device, the first record originating from the mobile device associated with a heartbeat communication; and
in response to determining none of the first user agent fields match the second user agent fields, adding the first IP address subnet to a blocklist of the proxy server, the first set of records not including a second record associated with the heartbeat communication indicative of the first set of records originating from a non-mobile device.
13. The method of claim 12 , further including:
identifying a second IP address subnet in the log of communications;
filtering the plurality of records for a second set of records associated with communications originating from the second IP address subnet; and
in response to determining the second set of records does not include the second record associated with the heartbeat communication, adding the second IP address subnet to a blacklist of the proxy server.
14. The method of claim 12 , further including:
determining a quantity of unique user agents in the first set of records; and
in response to determining the quantity of unique user agents satisfies a threshold, identifying the first IP address subnet as originating valid traffic.
15. The method of claim 12 , wherein the determining the first set of records does not include the second record associated with the heartbeat communication includes at least one of:
comparing the first user agent fields to the second user agent fields indicative of the first record originating from the mobile device; or
comparing first uniform resource locator fields to second uniform resource locator fields indicative of the first record originating from the mobile device.
16. The method of claim 12 , further including in response to determining the first set of records includes the second record associated with the heartbeat communication, identifying the first IP address subnet as originating valid traffic.
17. The method of claim 12 , further including:
excluding a third set of records associated with illicit communications from the log of communications to form a log of legitimate communications; and
processing the log of legitimate communications to credit usage of mobile computing devices associated with the third set of records.