Video monitoring method, video monitoring apparatus and video monitoring system

1. A video monitoring method, comprising:

obtaining video data collected by a video collecting module;

determining an object as a monitored target based on pre-set scene information and the video data;

extracting characteristic information of the object; and

determining predictive information of the object based on the characteristic information, wherein the video data comprises video data including the depth information,

wherein the pre-set scene information comprises background depth information of a background region of a monitored scene, and

wherein determining an object as a monitored target based on preset scene information and the video data comprises:

obtaining a depth information difference between current depth information of each pixel point of the video data and corresponding background depth information, and determining a region comprising a pixel point whose depth information difference is greater than a first predetermined threshold as a foreground candidate region; and

performing median filtering on video data of the foreground candidate region to obtain video data of a foreground region to be monitored.

2. The video monitoring method according to claim 1 , further comprising:

configuring the video collecting module and determining coordinate parameters of the video collecting module,

wherein determining coordinate parameters of the video collecting module comprises:

selecting multiple reference points on a predetermined reference plane;

determining a transformation relationship of a camera coordinate system of the video collecting module and a world coordinate system based on coordinate information of the multiple reference points; and

determining the coordinate parameters of the video collecting module based on the transformation relationship.

3. The video monitoring method according to claim 2 , wherein determining an object as a monitored target further comprises:

removing a noise region where the number of pixel points included is less than a second predetermined threshold from the foreground region to be monitored, to obtain a plurality of first foreground sub-regions;

determining a space between each of the plurality of first foreground sub-regions in a first predetermined direction; and

connecting respective first foreground sub-regions whose space is smaller than a third predetermined threshold in the first predetermined direction, to obtain a plurality of second foreground sub-regions as a plurality of objects.

4. The video monitoring method according to claim 3 , wherein extracting characteristic information of the object comprises:

determining a second direction of the object in the monitored scene based on the video data of the object;

determining a first end point and a second end point of the object in the second direction; and

determining a length between the first end point and the second end point based on the transformation relationship.

5. The video monitoring method according to claim 4 , wherein extracting characteristic information of the object further comprises:

selecting a predetermined point in the object, and tracking motion of the predetermined point based on the video data; and

determining a motion speed of the predetermined point in the second direction as a motion speed of the object.

6. The video monitoring method according to claim 5 , wherein extracting characteristic information of the object further comprises:

selecting multiple predetermined points in the object, and determining an average value of motion speeds of the multiples predetermined points in the second direction as a motion speed of the object; and

determining the motion speeds of the object at a plurality of predetermined time intervals continuously to obtain a probability distribution of the motion speeds of the object.

7. The video monitoring method according to claim 6 , wherein determining predictive information of the object based on the characteristic information comprises:

based on a length and the motion speed of each of the plurality of objects, determining an average waiting time required for moving from the second end point to the first end point as predictive information of each of the plurality of objects.

8. The video monitoring method according to claim 7 , wherein determining predictive information of the object based on the characteristic information further comprises:

based on the probability distribution of the motion speeds, subtracting a triple standard deviation of the motion speed by the average value of the motion speed as a slowest motion speed; and

based on the length and the slowest motion speed of each of the plurality of objects, determining a longest waiting time required for moving from the second end point to the first end point as the predictive information of each of the plurality of objects.

9. A video monitoring system, comprising:

a video collecting module configured to collect video data; and

a video monitoring module configured to perform monitoring based on the video data, and comprising:

an object determining unit configured to determine an object as a monitored target based on pre-set scene information and the video data;

a characteristic information extracting unit configured to extract characteristic information of the object; and

a predictive information determining unit configured to determine predictive information of the object based on the characteristic information,

wherein the video data comprises video data including the depth information,

wherein the pre-set scene information comprises background depth information of a background region of a monitored scene, and

wherein the object determining unit obtains a depth information difference between current depth information of each pixel point of the video data and corresponding background depth information, determines a region comprising a pixel point whose depth information difference is greater than a first predetermined threshold as a foreground candidate region, and performs median filtering on video data of the foreground candidate region to obtain video data of a foreground region to be monitored.

10. The video monitoring system according to claim 9 , wherein the video monitoring module configures the video collecting module and determines coordinate parameters of the video collecting module,

wherein determining coordinate parameters of the video collecting module by the video monitoring module comprises:

selecting multiple reference points on a predetermined reference plane;

determining a transformation relationship of a camera coordinate system of the video collecting module and a world coordinate system based on coordinate information of the multiple reference points; and

determining the coordinate parameters of the video collecting module based on the transformation relationship.

11. The video monitoring system according to claim 10 , wherein the object determining unit removes a noise region where the number of pixel points included is less than a second predetermined threshold from the foreground region to be monitored, to obtain a plurality of first foreground sub-regions;

determines a space between each of the plurality of first foreground sub-regions in a first predetermined direction; and

connects, in the first predetermined direction, respective first foreground sub-regions whose space is smaller than a third predetermined threshold, to obtain a plurality of second foreground sub-regions as a plurality of objects.

12. The video monitoring system according to claim 11 , wherein the characteristic information extracting unit determines a second direction of the object in the monitored scene based on the video data of the object;

determines a first end point and a second end point of the object in the second direction; and

determines a length between the first end point and the second end point based on the transformation relationship.

13. The video monitoring system according to claim 12 , wherein the characteristic information extracting unit selects a predetermined point in the object, and tracks motion of the predetermined point based on the video data; and

determines a motion speed of the predetermined point in the second direction as a motion speed of the object.

14. The video monitoring system according to claim 13 , wherein the characteristic information extracting unit selects multiple predetermined points in the object, and determines an average value of motion speeds of the multiple predetermined points in the second direction as a motion speed of the object; and

determines the motion speeds of the object at a plurality of predetermined time intervals continuously to obtain a probability distribution of the motion speeds of the object.

15. The video monitoring system according to claim 14 , wherein the predictive information determining unit determines an average waiting time required for moving from the second end point to the first end point as predictive information of each of the plurality of objects based on a length and the motion speed of each of the plurality of objects.

16. The video monitoring system according to claim 15 , wherein the predictive information determining unit subtracts a triple standard deviation of the motion speed by the average value of the motion speed as a slowest motion speed based on the probability distribution of the motion speeds; and

determines a longest waiting time required for moving from the second end point to the first end point as the predictive information of each of the plurality of objects based on the length and the slowest motion speed of each of the plurality of objects.

17. A video monitoring apparatus, comprising:

a processor;

a memory; and

computer program instructions stored in the memory, when executed by the processor, performing steps of:

obtaining video data collected by a video collecting module;

determining an object as a monitored target based on pre-set scene information and the video data;

extracting characteristic information of the object; and

determining predictive information of the object based on the characteristic information, wherein the video data comprises video data including depth information,

wherein the pre-set scene information comprises background depth information of a background region of a monitored scene, and

wherein the step of determining an object as a monitored target based on pre-set scene information and the video data performed by the computer program instructions when executed by the processor comprises:

obtaining a depth information difference between current depth information of each pixel point of the video data and a corresponding background depth information, and determining a region comprising a pixel point whose depth information difference is greater than a first predetermined threshold as a foreground candidate region; and

performing median filtering on video data of the foreground candidate region to obtain video data of a foreground region to be monitored.

18. The video monitoring apparatus according to claim 17 , wherein the computer program instructions, when executed by the processor, perform the step of configuring the video collecting module and determining coordinate parameters of the video collecting module, wherein determining coordinate parameters of the video collecting module comprises:

selecting multiple reference points on a predetermined reference plane;

determining a transformation relationship of a camera coordinate system of the video collecting module and a world coordinate system based on coordinate information of the multiple reference points; and

determining the coordinate parameters of the video collecting module based on the transformation relationship.

19. The video monitoring apparatus according to claim 18 , wherein determining an object as a monitored target performed by the computer program instructions when executed by the processor further comprises:

removing a noise region where the number of pixel points included is less than a second predetermined threshold from the foreground region to be monitored to obtain a plurality of first foreground sub-regions;

determining a space between each of the plurality of first foreground sub-regions in a first predetermined direction; and

connecting respective first foreground sub-regions whose space is smaller than a third predetermined threshold in the first predetermined direction to obtain a plurality of second foreground sub-regions as a plurality of objects.

20. The video monitoring apparatus according to claim 19 , wherein extracting characteristic information of the object performed by the computer program instructions when executed by the processor comprises:

determining a second direction of the object in the monitored scene based on the video data of the object;

determining a first end point and a second end point of the object in the second direction; and

determining a length between the first end point and the second end point based on the transformation relationship.

21. The video monitoring apparatus according to claim 20 , wherein extracting characteristic information of the object performed by the computer program instructions when executed by the processor further comprises:

selecting a predetermined point in the object, and tracking motion of the predetermined point based on the video data; and

determining a motion speed of the predetermined point in the second direction as a motion speed of the object.

22. The video monitoring apparatus according to claim 21 , wherein extracting characteristic information of the object performed by the computer program instructions when executed by the processor further comprises:

selecting multiple predetermined points in the object, and determining an average value of motion speeds of the multiple predetermined points in the second direction as a motion speed of the object; and

determining the motion speeds of the object at a plurality of predetermined time intervals continuously to obtain a probability distribution of the motion speeds of the object.

23. The video monitoring apparatus according to claim 22 , wherein determining predictive information of the object based on the characteristic information performed by the computer program instructions when executed by the processor comprises:

based on a length and the motion speed of each of the plurality of objects, determining an average waiting time required for moving from the second end point to the first end point as predictive information of each of the plurality of objects.

24. The video monitoring apparatus according to claim 23 , wherein determining predictive information of the object based on the characteristic information performed by the computer program instructions when executed by the processor further comprises:

based on the probability distribution of the motion speeds, subtracting a triple standard deviation of the motion speed by the average value of the motion speed as a slowest motion speed; and

based on the length and the slowest motion speed of each of the plurality of objects, determining a longest waiting time required for moving from the second end point to the first end point as the predictive information of each of the plurality of objects.