Method and device for acquiring information, and system for detecting attention degree
The present disclosure provides an information acquiring method and apparatus, and an attention degree detecting system. The information acquiring method includes: acquiring a video frame captured by a video capturing equipment detecting whether a pedestrian exists in the video frame by using a first deep-learning model; processing the video frame by using a second deep-learning model to generate a pedestrian bounding box of the pedestrian under a condition that the pedestrian exists in the video frame, and assigning a corresponding pedestrian identifier to the pedestrian bounding box; identifying an image in the pedestrian bounding box by using a third deep-learning model to identify feature information of the pedestrian; and writing a pedestrian historical data into a database, wherein the pedestrian historical data comprises a timestamp and an identifier of the video frame, coordinate information of the pedestrian bounding box, the pedestrian identifier and the feature information of the pedestrian.
1 . An attention degree detecting system, comprising:
a video capturing equipment configured to acquire video information of a predetermined area;
an information acquiring apparatus comprising:
a first memory configured to store instructions;
a first processor coupled to the first memory, wherein based on the instructions stored in the first memory, the first processor is configured to:
acquire a video frame captured by the video capturing equipment;
detect whether a pedestrian exists in the video frame by using a first deep-learning model;
process the video frame by using a second deep-learning model to generate a pedestrian bounding box of the pedestrian under a condition that the pedestrian exists in the video frame, and assign a corresponding pedestrian identifier to the pedestrian bounding box;
identify an image in the pedestrian bounding box by using a third deep-learning model to identify feature information of the pedestrian, wherein the feature information of the pedestrian comprises behavior feature information of the pedestrian, and the behavior feature information of the pedestrian comprises at least one of taking, putting back or holding; and
write a pedestrian historical data into a database, wherein the pedestrian historical data comprises a timestamp of the video frame, an identifier of the video frame, coordinate information of the pedestrian bounding box, the pedestrian identifier and the feature information of the pedestrian; and
an attention degree detecting apparatus comprising:
a second memory configured to store instructions;
a second processor coupled to the second memory, wherein based on the instructions stored in the second memory, the second processor is configured to:
receive a query request for querying an attention degree of a predetermined area;
extract a plurality of pedestrian historical data associated with the predetermined area from a predetermined database;
extract a plurality of pedestrian historical data to be detected from the plurality of pedestrian historical data, wherein timestamps in the plurality of pedestrian historical data to be detected are within a predetermined time range;
count the number of pieces of feature information of the pedestrians in the pedestrian historical data to be detected; and
determine the attention degree of the predetermined area within the predetermined time range according to the result of counting.
2 . The attention degree detecting system according to claim 1 , wherein the first processor is further configured to:
group all pedestrian historical data in the database according to the pedestrian identifier to obtain a plurality of first groups after writing the pedestrian historical data into the database; and
perform a first deduplication processing on all pedestrian history data in each first group to retain only one piece of pedestrian historical data among a plurality of pieces of pedestrian historical data which have same feature information and have intervals between the timestamps of video frames smaller than a time threshold.
3 . The attention degree detecting system according to claim 2 , wherein the first processor is further configured to:
group all pedestrian historical data in the database according to a generation time of the video frames to obtain a plurality of second groups after writing the pedestrian historical data into the database; and
perform a second deduplication processing on all pedestrian history data in each second group to retain only one piece of pedestrian historical data among a plurality of pieces of pedestrian historical data in which a distance between center positions of the pedestrian bounding boxes is smaller than a distance threshold.
4 . The attention degree detecting system according to claim 1 , wherein the first processor is further configured to perform the following in order to assign the corresponding pedestrian identifier to the pedestrian bounding box:
identify pedestrian feature information in the pedestrian bounding box by using a second deep-learning model;
retrieve whether the pedestrian feature information is comprised in a pedestrian feature library; and
write the pedestrian feature information into the pedestrian feature library under a condition that the pedestrian feature information is not comprised in the pedestrian feature library, and assigning a new pedestrian identifier to the pedestrian bounding box.
5 . The attention degree detecting system according to claim 4 , wherein the first processor is further configured to perform the following in order to assigning the corresponding pedestrian identifier to the pedestrian bounding box:
assign a pedestrian identifier associated with the pedestrian feature information in the pedestrian feature library to the pedestrian bounding box under a condition that the pedestrian feature information is comprised in the pedestrian feature library.
6 . The attention degree detecting system according to claim 1 , further comprising wherein the first processor is further configured to:
discard the video frame under a condition that there is no pedestrian in the video frame.
7 . The attention degree detecting system according to claim 1 , wherein
the behavior feature information of the pedestrian further comprises at least one of walking or staying.
8 . The attention degree detecting system according to claim 1 , wherein
the feature information of the pedestrian comprises attribute feature information of the pedestrian.
9 . The attention degree detecting system according to claim 8 , wherein
the attribute feature information of the pedestrian comprises at least one of a gender of the pedestrian, an age of the pedestrian, a clothing of the pedestrian and an appearance features of the pedestrian.