Method and system for detecting the occurrence of an interaction event via trajectory-based analysis

1. A computer-implemented method for automatically detecting an occurrence of an interaction event of two or more people concurrently present in a surveilled area using a video camera directed towards the surveilled area, the method comprising:

a) acquiring a video stream from the video camera, the video stream including a temporal sequence of video frames including the surveilled area within a FOV (field-of-view) associated with the video camera;

b) detecting and tracking two or more people within a common temporal sequence of video frames included in the video stream, and generating a trajectory of each person tracked within the first common temporal sequence of video frames;

c) processing the trajectories of the tracked people to extract one or more trajectory interaction features (TIFs) associated with the trajectories of the two or more people tracked within the first common temporal sequence of video frames; and

d) applying predefined heuristics to the extracted TIFs to detect an interaction event associated with the predefined heuristics has occurred between at least two people of the two or more people tracked within the first common temporal sequence of video frames,

wherein the TIFs include one or more of a position, a velocity and a relative distance associated with the two or more people within the first common temporal sequence of video frames, and the predefined heuristics applied in step d) include the calculation of an evidence vector state, the evidence vector state calculated as a function of a velocity threshold and a proximity threshold associated with the two or more people tracked within the first common temporal sequence of video frames.

2. The computer-implemented method for automatically detecting the interaction event of two or more people according to claim 1 ,

wherein steps b)-d) are repeated for a second common temporal sequence of video frames, distinct from the first common temporal sequence of video frames, to determine if the interaction event has occurred between at least two people of the two or more people tracked within the second common temporal sequence of video frames.

3. The computer-implemented method for automatically detecting the interaction of two or more people according to claim 2 , further comprising:

e) collecting evidence of the detected interaction events in step d), the evidence including one or more of the number of occurrences of the detected interaction event, the number of occurrences of the detected interaction event associated with each of the two or more people detected within the first and second common temporal sequence of video frames, a time duration and start/end time associated with each detected interaction event, a calculated probability of the occurrence of the interaction event, and an indication of static or dynamic movement associated with each of the two or more people detected within the first and second common temporal sequence of video frames.

4. The computer-implemented method for automatically detecting the interaction event of two or more people according to claim 3 , further comprising:

f) communicating an alert to an operatively associated central system, the alert indicating one or more of the number of occurrences of the detected interaction event, the number of occurrences of the detected interaction event associated with each of the two or more people detected within the first and second common temporal sequence of video frames, a time duration and start/end time associated with each detected interaction event, a calculated probability of the occurrence of the interaction event, and an indication of static or dynamic movement associated with each of the two or more people detected within the first and second common temporal sequence of video frames.

5. The computer implemented method for automatically detecting the interaction event of two or more people according to claim 1 , wherein the interaction event is an illegal drug deal between two or more people.

6. The computer implemented method for automatically detecting the interaction event of two or more people according to claim 5 , wherein steps b)-d) are repeated for a second common temporal sequence of video frames, distinct from the first common temporal sequence of video frames, to determine if the interaction event has occurred between at least two people of the two or more people tracked within the second common temporal sequence of video frames.

7. The computer-implemented method for automatically detecting the interaction event of two or more people according to claim 6 , further comprising:

e) collecting evidence of the detected interaction events in step d), the evidence including one or more of the number of occurrences of the detected interaction event, the number of occurrences of the detected interaction event associated with each of the two or more people detected within the first and second common temporal sequence of video frames, a time duration and start/end time associated with each detected interaction event, a calculated probability of the occurrence of the interaction event, and an indication of static or dynamic movement associated with each of the two or more people detected within the first and second common temporal sequence of video frames.

8. The computer-implemented method for automatically detecting the interaction event of two or more people according to claim 7 , further comprising:

f) communicating an alert to an operatively associated central system, the alert indicating one or more of the number of occurrences of the detected interaction event, the number of occurrences of the detected interaction event associated with each of the two or more people detected within the first and second common temporal sequence of video frames, a time duration and start/end time associated with each detected interaction event, a calculated probability of the occurrence of the interaction event, and an indication of static or dynamic movement associated with each of the two or more people detected within the first and second common temporal sequence of video frames.

9. A video system for automatically detecting an occurrence of an interaction event of two or more people concurrently present in a surveilled area comprising:

a video camera with an associated FOV (field-of-view) directed towards the surveilled area; and

a video processing system operatively connected to the video camera, the video processing system configured to:

a) acquire a video stream from the video camera, the video stream including a temporal sequence of video frames including the surveilled area within the FOV associated with the video camera;

b) detect and track two or more people within a first common temporal sequence of video frames included in the video stream, and generate a trajectory of each person tracked within the first common temporal sequence of video frames;

c) process the trajectories of the tracked people to extract one or more trajectory interaction features (TIFs) associated with the trajectories of the two or more people tracked within the first common temporal sequence of video frames; and

d) apply predefined heuristics to the extracted TIFs to detect an interaction event has occurred between at least two people of the two or more people tracked within the first common temporal sequence of video frames,

wherein the TIFs include one or more of a position, a velocity and a relative distance associated with the two or more people within the first common temporal sequence of video frames, and the predefined heuristics applied in step d) include the calculation of an evidence vector state, the evidence vector state calculated as a function of a velocity threshold and a proximity threshold associated with the two or more people tracked within the first common temporal sequence of video frames.

10. The video system for automatically detecting the occurrence of an interaction event according to claim 9 , wherein steps b)-d) are repeated for a second common temporal sequence of video frames, distinct from the first common temporal sequence of video frames, to determine if the interaction event has occurred between at least two people of the two or more people tracked within the second common temporal sequence of video frames.

11. The video system for automatically detecting the occurrence of an interaction event according to claim 10 , further comprising the video processing system configured to:

e) collect evidence of the detected interaction events in step d), the evidence including one or more of the number of occurrences of the detected interaction event, the number of occurrences of the detected interaction event associated with each of the two or more people detected within the first and second common temporal sequence of video frames, a time duration and start/end time associated with each detected interaction event, a calculated probability of the occurrence of the interaction event, and an indication of static or dynamic movement associated with each of the two or more people detected within the first and second common temporal sequence of video frames.

12. The video system for automatically detecting the occurrence of an interaction event according to claim 11 , further comprising the video processing system configured to:

f) communicate an alert to an operatively associated central system, the alert indicating one or more of the number of occurrences of the detected interaction event, the number of occurrences of the detected interaction event associated with each of the two or more people detected within the first and second common temporal sequence of video frames, a time duration and start/end time associated with each detected interaction event, a calculated probability of the occurrence of the interaction event, and an indication of static or dynamic movement associated with each of the two or more people detected within the first and second common temporal sequence of video frames.

13. The video system for automatically detecting the occurrence of an interaction event according to claim 9 , wherein the interaction event is an illegal drug deal between two or more people.

14. The video system for automatically detecting the occurrence of an interaction event according to claim 13 , wherein steps b)-d) are repeated for a second common temporal sequence of video frames, distinct from the first common temporal sequence of video frames, to determine if the interaction event has occurred between at least two people of the two or more people tracked within the second common temporal sequence of video frames.

15. The video system for automatically detecting the occurrence of an interaction event according to claim 14 , further comprising the video processing system configured to:

e) collect evidence of the detected interaction events in step d), the evidence including one or more of the number of occurrences of the detected interaction event, the number of occurrences of the detected interaction event associated with each of the two or more people detected within the first and second common temporal sequence of video frames, a time duration and start/end time associated with each detected interaction event, a calculated probability of the occurrence of the interaction event, and an indication of static or dynamic movement associated with each of the two or more people detected within the first and second common temporal sequence of video frames.

16. The video system for automatically detecting the occurrence of an interaction event according to claim 15 , further comprising the video system configured to:

f) communicate an alert to an operatively associated central system, the alert indicating one or more of the number of occurrences of the detected interaction event, the number of occurrences of the detected interaction event associated with each of the two or more people detected within the first and second common temporal sequence of video frames, a time duration and start/end time associated with each detected interaction event, a calculated probability of the occurrence of the interaction event, and an indication of static or dynamic movement associated with each of the two or more people detected within the first and second common temporal sequence of video frames.

17. A video system for automatically detecting an occurrence of an interaction event of two or more objects concurrently present in a surveilled area, the interaction event associated with an illegal drug deal between the two or more objects, comprising:

a video camera with an associated FOV (field-of-view) directed towards the surveilled area; and

a video processing system operatively connected to the video camera, the video processing system configured to:

a) acquire a video stream from the video camera, the video stream including a temporal sequence of video frames including all or part of the surveilled area within all or part of the FOV associated with the video camera;

b) detect and track two or more objects within a first common temporal sequence of video frames included in the video stream, and generate a trajectory of each object tracked within the first common temporal sequence of video frames;

c) process the trajectories of the tracked objects to extract one or more trajectory interaction features (TIFs) associated with the trajectories of the two or more objects tracked within the first common temporal sequence of video frames, the TIFs including one or more of a position, a velocity and a relative distance associated with the two or more objects within the first common temporal sequence of video frames; and

d) apply predefined heuristics to the extracted TIFs to detect an interaction event has occurred between at least two objects of the two or more objects tracked within the first common temporal sequence of video frames, the predefined heuristics including a velocity threshold and a proximity threshold associated with the two or more objects tracked within the first common temporal sequence of video frames, and calculate an evidence vector state, the evidence vector state calculated as a function of the velocity they show and the proximity threshold associated with the two or more objects tracked within the first common temporal sequence of video frames,

wherein steps b)-d) are repeated for a second common temporal sequence of video frames, distinct from the first common temporal sequence of video frames, to determine if the interaction event has occurred between at least two objects of the two or more objects tracked within the second common temporal sequence of video frames.

18. The video system for automatically detecting the occurrence of an interaction event according to claim 17 , further comprising the video system configured to:

e) collect evidence of the detected events in step d), the evidence including one or more of the number of the number of occurrences of the detected interaction event, the number of occurrences of the detected interaction event associated with each of the two or more objects detected within the first and second common temporal sequence of video frames, a time duration and start/end time associated with each detected interaction event, a calculated probability of the occurrence of the interaction event, and an indication of static or dynamic movement associated with each of the two or more objects detected within the first and second common temporal sequence of video frames.

19. The video system for automatically detecting the occurrence of an interaction event according to claim 18 , further comprising:

a central processing system operatively associated with the video processing system,

the video processing system is configured to:

f) communicate an alert to the central processing system, the alert indicating one or more of the number of occurrences of the detected interaction event, the number of occurrences of the detected interaction event associated with each of the two or more objects detected within the first and second temporal sequence of video frames, a time duration and start/end time associated with each detected interaction event, a calculated probability of the occurrence of the interaction event, and an indication of static or dynamic movement associated with each of the two or more objects detected within the first and second common temporal sequence of video frames.