Multi-stage network scanning

1. A method for scanning a network, the method comprising:

receiving a list of a plurality of target devices, wherein the list includes at least a first device and a second device;

scanning the first device to determine if a particular port and protocol combination appears to be open on the first device;

storing target devices with the open port and protocol combinations in the queueing service; and

upon determining that the particular port and protocol combination appears to be open on the first device, interrogating the first device before or during scanning of the second device to gather data regarding a service running on the first device;

wherein the interrogated device is an HTTP server, and the method further comprises organizing data from the interrogation into objects representing HTTP responses.

2. The method of claim 1 wherein the interrogation comprises connecting to the first device using transmission control protocol (TCP) or user datagram protocol (UDP).

3. The method of claim 1 further comprising receiving metadata specifying port and protocol combinations for scanning.

4. The method of claim 1 wherein the list of the plurality of target devices includes devices that specifically have not opted out from being scanned.

5. The method of claim 1 further comprising processing an opt-out request from a target.

6. The method of claim 1 wherein the list of the plurality of target devices includes at least one of an IP address and a host name for each of the plurality of target devices.

7. The method of claim 1 wherein interrogating the first device comprises interrogating the first device from a plurality of interrogation locations.

8. The method of claim 1 wherein scanning the first device involves scanning the first device from a plurality of locations.

9. A system for scanning a network, the system comprising:

an interface for at least receiving a list of a plurality of target devices, wherein the list includes at least a first device and a second device;

a scanning module configured to scan the first device to determine if a particular port and protocol combination appears to be open on the first device;

a queueing service to store target devices with the open port and protocol combinations; and

a first collection device configured to, upon the scanning module determining that the particular port and protocol combination appears to be open on the first device, interrogate the first device before or during scanning of the second device to gather data regarding a service running on the first device;

wherein the interrogated device is an HTTP server, and the system further includes a processing module configured to organize data from the interrogation into objects representing HTTP responses.

10. The system of claim 9 wherein the interrogation involves connecting to the first device using transmission control protocol (TCP) or user datagram protocol (UDP).

11. The system of claim 9 wherein the scanning module is further configured to receive metadata specifying port and protocol combinations for scanning.

12. The system of claim 9 wherein the list of the plurality of target devices includes devices that specifically have not opted out from being scanned.

13. The system of claim 9 wherein the interface is further configured to process an opt-out request from a target.

14. The system of claim 9 wherein the list of the plurality of target devices includes at least one of an IP address and a host name for each of the plurality of target devices.

15. The system of claim 9 further comprising a second collection device configured to interrogate the first device from a different location than the first collection device to observe trends from differing collection points.

16. The system of claim 9 wherein the first device is scanned from a plurality of locations.