Surveillance image retrieval apparatus and surveillance system
Disclosed is a surveillance image retrieval apparatus capable of generating an image representing a search result that a surveillant can visually confirm, even if a face image used is not suitable for the visual identification of a person. The surveillance image retrieval apparatus includes a surveillance image acquirer, which acquires surveillance images; a feature amount generator, which extracts a face image from the surveillance images and generates the feature amount of the extracted face image; an image feature amount memory for storing a face image, a surveillance image, and other metadata associated with an acquired feature amount; a face image designator, which selects an appropriate face image in accordance with a user's input, and designates the selected face image as a query image for a person search; a similar image searcher for searching the series of surveillance images stored in the image feature amount memory for a face image similar to the designated face image; a presentation image selector, which examines surveillance images that are close to the search result in imaging time, and selects presentation surveillance images that include face images of the same person; and a screen data generator for outputting the presentation surveillance images selected.
1. A surveillance image retrieval apparatus comprising:
a surveillance image acquirer that acquires a series of surveillance images picked up by an imager;
a feature amount generator that extracts one or more face images from the series of surveillance images acquired by the surveillance image acquirer and generates a feature amount of each of the extracted face images included in the series of surveillance images;
an image feature amount memory that stores the extracted face images and other metadata associated with the generated feature amount of each of the face images;
a face image designator that selects an appropriate face image from the face images stored in the image feature amount memory in accordance with a user input, and designates the selected face image as a query image for a person search within the series of surveillance images;
a similar image searcher that searches the face images stored in the image feature amount memory for a face image similar to the designated face image;
a presentation image selector that examines surveillance images that are close in imaging time to the similar image retrieved as a search result and selects presentation surveillance images that contain face images of the same person as a person depicted by the similar image; and
a screen data generator that outputs the presentation surveillance images selected by the presentation image selector,
wherein the presentation image selector includes:
a face image selector that calculates similarity between a face image representing the search result and a face image in a surveillance image preceding a surveillance image containing the face image representing the search result, and, when the calculated similarity is not greater than a threshold value, concludes that the face image in the surveillance image preceding the surveillance image containing the face image representing the search result depicts the same person as the face image representing the search result, and selects the face image in the surveillance image preceding the surveillance image containing the face image representing the search result;
a movement direction calculator that calculates the direction of movement of the region of the face image selected by the face image selector in a surveillance image; and
a determiner that selects as an optimum image a surveillance image containing a largest-size face image whose movement direction calculated by the movement direction calculator is deviated from the downward direction in the surveillance image by a value not greater than a threshold value.
2. The surveillance image retrieval apparatus according to claim 1 , wherein the presentation image selector includes:
a face image selector that calculates similarity between a face image representing the search result and a face image in a surveillance image succeeding a surveillance image containing the face image representing the search result, and, when the calculated similarity is not greater than a threshold value, concludes that the face image in the surveillance image succeeding the surveillance image containing the face image representing the search result depicts the same person as the face image representing the search result, and selects the face image in the surveillance image succeeding the surveillance image containing the face image representing the search result;
a movement direction calculator that calculates the direction of movement of the region of the face image selected by the face image selector in a surveillance image; and
a determiner that selects as an optimum image a surveillance image containing a largest-size face image whose movement direction calculated by the movement direction calculator is deviated from the downward direction in the surveillance image by a value not greater than a threshold value.
3. The surveillance image retrieval apparatus according to claim 1 , wherein the screen data generator generates a screen that simultaneously presents a search result surveillance image retrieved by the similar image searcher and an optimum image selected by the presentation image selector.