Methods, systems, and computer readable media for measuring detection accuracy of a security device using benign traffic

1. A method for measuring detection accuracy of a security device using benign traffic, the method comprising:

at an Internet protocol (IP) traffic simulator having a first communications interface and a second communications interface:

sending, by the first communications interface, a plurality of benign data packets to a security device, wherein the plurality of benign data packets is engineered to include content associated with one or more malicious data packets;

receiving, by the second communications interface, one or more of the plurality of benign data packets via the security device; and

determining, using statistics associated with the plurality of benign data packets, a detection accuracy metric associated with the security device, wherein determining the detection accuracy metric includes dividing a number of benign data packets returned to the IP traffic simulator via the security device by a number of benign data packets sent by the IP traffic simulator to the security device; and

identifying, using distinct characteristics associated with the plurality of benign data packets, wherein the distinct characteristics includes at least one characteristic that affects detection accuracy, a portion of a first packet of the plurality of benign data packets that causes the security device to block the first packet.

2. The method of claim 1 wherein the security device is an intrusion prevention system or a data leakage prevention system.

3. The method of claim 1 wherein the benign data packets contain non-confidential information and the one or more malicious data packets contain confidential information.

4. The method of claim 1 wherein the one or more malicious data packets include data for triggering a vulnerability in a target system.

5. The method of claim 1 wherein the statistics associated with the plurality of benign data packets includes one or more packet counters for determining a number of benign data packets sent to the security device, received via the security device, or blocked by the security device.

6. The method of claim 1 wherein the detection accuracy metric comprises an integer, a percentage, a probability, a code, a color, a value, or a range of values.

7. The method of claim 1 wherein the plurality of benign data packets is provided by a security analysis entity.

8. The method of claim 1 wherein each of the plurality of benign data packets is engineered to have distinct characteristics.

9. The method of claim 1 wherein the first communications interface is associated with a first IP address and the second communications interface is associated with a second IP address.

10. A system for measuring detection accuracy of a security device using benign traffic, the system comprising:

an Internet protocol (IP) traffic simulator, the IP traffic simulator comprising:

a first physical communications interface configured to send a plurality of benign data packets to a security device, wherein the plurality of benign data packets is engineered to include content associated with one or more malicious data packets;

a second physical communications interface configured to receive one or more of the plurality of benign data packets via the security device; and

a detection accuracy module (DAM) configured to determine, using statistics associated with the plurality of benign data packets, a detection accuracy metric associated with the security device, wherein determining the detection accuracy metric includes dividing a number of benign data packets returned to the IP traffic simulator via the security device by a number of benign data packets sent by the IP traffic simulator to the security device and to identify, using distinct characteristics associated with the plurality of benign data packets, wherein the distinct characteristics includes at least one characteristic that affects detection accuracy, a portion of a first packet of the plurality of benign data packets that causes the security device to block the first packet.

11. The system of claim 10 wherein the security device is an intrusion prevention system or a data leakage prevention system.

12. The system of claim 10 wherein the benign data packets contain non-confidential information and the one or more malicious data packets contain confidential information.

13. The system of claim 10 wherein the one or more malicious data packets include data for triggering a vulnerability in a target system.

14. The system of claim 10 wherein the statistics associated with the plurality of benign data packets includes one or more packet counters for determining a number of benign data packets sent to the security device, received via the security device, or blocked by the security device.

15. The system of claim 10 wherein the detection accuracy metric comprises an integer, a percentage, a probability, a code, a color, a value, or a range of values.

16. The system of claim 10 wherein the plurality of benign data packets is provided by a security analysis entity.

17. The system of claim 10 wherein the plurality of benign data packets is stored in a database.

18. The system of claim 10 wherein each of the plurality of benign data packets is engineered to have distinct characteristics.

19. The system of claim 10 wherein the first communications interface is associated with a first IP address and the second communications interface is associated with a second IP address.

20. A non-transitory computer readable medium comprising computer executable instructions embodied in the non-transitory computer readable medium that when executed by a processor of a computer control the computer to perform steps comprising:

at an Internet protocol (IP) traffic simulator having a first communications interface and a second communications interface:

sending, by the first communications interface, a plurality of benign data packets to a security device, wherein the plurality of benign data packets is engineered to include content associated with one or more malicious data packets;

receiving, by the second communications interface, one or more of the plurality of benign data packets via the security device; and

determining, using statistics associated with the plurality of benign data packets, a detection accuracy metric associated with the security device, wherein determining the detection accuracy metric includes dividing a number of benign data packets returned to the IP traffic simulator via the security device by a number of benign data packets sent by the IP traffic simulator to the security device; and

identifying, using distinct characteristics associated with the plurality of benign data packets, wherein the distinct characteristics includes at least one characteristic that affects detection accuracy, a portion of a first packet of the plurality of benign data packets that causes the security device to block the first packet.