Evaluating an effectiveness of a monitoring system

1. A method for evaluating an effectiveness of a monitoring system, comprising:

receiving, via at least one computing device, visual media at a monitoring system monitored by a set of users; generating, via at least one computing device, a plurality of benchmark test cases for a same detected event captured within a same video sequence of the visual media, each of the plurality of benchmark test case comprising a different simulated visual alert generated in response to the detected event and displayed within the same video sequence of the visual media to indicate to the set of users an occurrence of the detected event;

evaluating, via at least one computing device, a monitoring performance of the set of users in response to each of the plurality of benchmark test; and

predicting, via at least one computing device, an effectiveness of the monitoring system based on the performance of the set of users in response to each of the plurality of benchmark test cases;

the different simulated visual alert comprising a visual tag sized according to the relative distance between the same detected event and a camera receiving the visual media, wherein the visual tag increases in size as the distance decreases between the same detected event and the camera receiving the visual media.

2. The method according to claim 1 , the evaluating further comprising:

dynamically creating, via at least one computing device, the simulated alert within the visual media at run-time.

3. The method according to claim 2 , the evaluating comprising evaluating, via at least one computing device, an ability of the set of users to respond to the plurality of benchmark test cases.

4. The method according to claim 2 , wherein the at least one characteristic of the simulated alert comprises at least one of the following: spatial characteristics, auditory characteristics, temporal characteristics, or haptic characteristics.

5. A system for evaluating an effectiveness of a monitoring system comprising:

at least one processing unit;

memory operably associated with the at least one processing unit; and

a performance evaluation tool storable in memory and executable by the at least one processing unit to cause the system to:

receive visual media at a monitoring system monitored by a set of users;

generate a plurality of benchmark test cases for a same detected event captured within a same video sequence of the visual media, each of the plurality of benchmark test case comprising a different simulated visual alert generated in response to the detected event and displayed within the same video sequence of the visual media to indicate to the set of users an occurrence of the detected event; and

predict an effectiveness of the monitoring system based on the performance of the set of users in response to each of the plurality of benchmark test cases;

the different simulated visual alert comprising a visual tag sized according to the relative distance between the same detected event and a camera receiving the visual media, wherein the visual tag increases in size as the distance decreases between the same detected event and the camera receiving the visual media.

6. The performance evaluation tool according to claim 5 , further executed to cause the system to:

dynamically create the simulated alert within the visual media at run-time.

7. The performance evaluation tool according to claim 6 , further executed to cause the system to evaluate an ability of the set of users to respond to the plurality of benchmark test cases.

8. The performance evaluation tool according to claim 6 , the at least one characteristic of the simulated alert comprising at least one of the following: spatial characteristics, auditory characteristics, temporal characteristics, or haptic characteristics.

9. A non-transitory computer-readable medium storing computer instructions, which when executed, enables a computer system to evaluate an effectiveness of a monitoring system, the computer instructions comprising:

receiving visual media at a monitoring system monitored by a set of users;

generating a plurality of benchmark test cases for a same detected event captured within a same video sequence of the visual media, each of the plurality of benchmark test case comprising a different simulated visual alert generated in response to the detected event and displayed within the same video sequence of the visual media to indicate to the set of users an occurrence of the detected event;

evaluating a monitoring performance of the set of users in response to each of the plurality of benchmark test cases; and

predicting an effectiveness of the monitoring system based on the performance of the set of users in response to each of the plurality of benchmark test cases;

the different simulated visual alert comprising a visual tag sized according to the relative distance between the same detected event and a camera receiving the visual media, wherein the visual tag increases in size as the distance decreases between the same detected event and the camera receiving the visual media.

10. The non-transitory computer-readable medium according to claim 9 , the computer instructions for evaluating further comprising:

dynamically creating the simulated alert within the visual media at run-time.

11. The non-transitory computer-readable medium according to claim 10 , the computer instructions for evaluating further comprising evaluating an ability of the set of users to respond to the plurality of benchmark test cases.

12. The non-transitory computer-readable medium according to claim 10 , wherein the at least one characteristic of the simulated alert comprises at least one of the following: spatial characteristics, auditory characteristics, temporal characteristics, or haptic characteristics.

13. A method for deploying a performance evaluation tool for use in a computer system that evaluates an effectiveness of a monitoring system, the method comprising the computer implemented steps to:

receive visual media at a monitoring system monitored by a set of users;

generate a plurality of benchmark test cases for a same detected event captured within a same video sequence of the visual media, each of the plurality of benchmark test case comprising a different simulated visual alert generated in response to the detected event and displayed within the same video sequence of the visual media to indicate to the set of users an occurrence of the detected event;

evaluate a monitoring performance of the set of users in response to each of the plurality of benchmark test cases; and

predict an effectiveness of the monitoring system based on the performance of the set of users in response to each of the plurality of benchmark test cases;

the different simulated visual alert comprising a visual tag sized according to the relative distance between the same detected event and a camera receiving the visual media, wherein the visual tag increases in size as the distance decreases between the same detected event and the camera receiving the visual media.

14. The method according to claim 13 , the computer-implemented step to evaluate further comprising:

dynamically creating the simulated alert within the visual media at run-time.

15. The method according to claim 14 , the computer-implemented step to evaluate further comprising evaluating an ability of the set of users to respond to the plurality of benchmark test cases.

16. The method according to claim 14 , wherein the at least one characteristic of the simulated alert comprises at least one of the following: spatial characteristics, auditory characteristics, temporal characteristics, or haptic characteristics.

17. The method according to claim 1 , wherein the different simulated alert has a color selected based on a set of background colors within a region of interest.