Investigation assistance system and investigation assistance method

1. An investigation assistance system comprising:

a processor;

a user terminal; and

an integrated server that is communicably connected to a plurality of analysis servers, wherein the plurality of analysis servers each include a machine learning model;

wherein the user terminal is configured to:

obtain a snapshot of a scene where an incident occurs including images of an object that includes at least one person at the scene;

display an analysis server selection screen showing a list of the plurality of analysis servers corresponding to a plurality of different object feature elements related to an incident,

select a first analysis server that includes a first machine learning model from the analysis server selection screen,

transmit, to the integrated server, a search request via the plurality of analysis servers that each include the machine learning model for the object that includes the at least one person at the scene satisfying a search condition including an object feature element of the object being searched by the selected first analysis server based on an input of the search condition,

upon receiving from the integrated server a search result that includes a blacklist registration request for the at least one person, selecting the at least one person for blacklisting, and

transmitting the selected at least one person for blacklisting to the integrated server; and

wherein the integrated server is configured to;

transmit an object search instruction to the first analysis server based on the search request,

receive the search result from the first analysis server indicating that the object feature element of the object that includes the at least one person at the scene as part of the blacklist registration request of the at least one person at the scene,

transmit the search result from the analysis server that includes the blacklist registration request of the at least one person to the user terminal, and

upon receiving from the user terminal the selected at least one person for blacklisting, transmit a request to the analysis server that the selected at least one person for blacklisting be registered on the blacklist.

2. The investigation assistance system according to claim 1 ,

wherein the user terminal selects a second analysis server from the analysis server selection screen after the first analysis server is selected, and transmits, to the integrated server, a search request for an object satisfying a search condition including an object feature element of an object to be searched by the selected first analysis server and second analysis server selection screen based on an input of the search condition, and

wherein the integrated server transmits an object search instruction to each of the first analysis server and the second analysis server based on the search request, receives a search result from each of the first analysis server and the second analysis server, and transmits the search result to the user terminal.

3. The investigation assistance system according to claim 1 ,

wherein the integrated server is communicably connected to n (n is an integer equal to or larger than 2) analysis servers, and periodically monitors a communication status with each of the n analysis servers,

wherein when a search condition including k (k is an integer from 1 to n) different object feature elements is received from the user terminal, the integrated server determines k analysis servers provided corresponding to the k object feature elements included in the search condition among the n analysis servers, and transmits an object search request to each of the k analysis servers,

wherein when it is detected that a communication disconnection with a specific analysis server among the k analysis servers occurs, the integrated server transmits, to the user terminal, search results received from the (k−1) analysis servers and a communication disconnection notification indicating that a communication disconnection with the specific analysis server occurs, and

wherein the user terminal displays a search result screen including the search results received from the (k−1) analysis servers and the communication disconnection notification.

4. The investigation assistance system according to claim 3 ,

wherein the user terminal displays the search result screen including a communication disconnection icon indicating that a communication disconnection with the specific analysis server occurs.

5. The investigation assistance system according to claim 3 ,

wherein when it is detected that the communication with the specific analysis server is restored, the integrated server transmits a restoration notification indicating that the communication with the specific analysis server is restored to the user terminal, and

wherein the user terminal displays the search result screen including the restoration notification transmitted from the integrated server.

6. The investigation assistance system according to claim 5 ,

wherein the user terminal does not display a communication disconnection icon on the search result screen according to the reception of the restoration notification, the communication disconnection icon indicating that a communication disconnection with the specific analysis server occurs before the user terminal receives the restoration notification from the integrated server.

7. The investigation assistance system according to claim 1 ,

wherein the integrated server is communicably connected to at least a first analysis server and a second analysis server,

wherein when a search condition including a first object feature element related to an incident and a second object feature element related to the incident is received from the user terminal, the integrated server transmits a search request for an object satisfying the first object feature element to the first analysis server and a search request for an object satisfying the second object feature element to the second analysis server,

wherein the integrated server receives a first search result including the object satisfying the first object feature element from the first analysis server and a second search result including the object satisfying the second object feature element from the second analysis server,

wherein the integrated server transmits a third search result obtained by excluding the second search result from the first search result to the user terminal, and

wherein the user terminal displays a search result screen including the third search result transmitted from the integrated server.

8. The investigation assistance system according to claim 7 ,

wherein the first search result includes identification information and imaging time information of a camera that images the object satisfying the first object feature element,

wherein the second search result includes identification information and imaging time information of a camera that images the object satisfying the second object feature element, and

wherein the integrated server extracts the third search result based on the second search result in which the identification information and the imaging time information of the camera included in each of the first search result and the second search result are the same.

9. The investigation assistance system according to claim 7 ,

wherein the user terminal transmits, to the integrated server, an exclusion search condition in which some object feature elements constituting the first object feature element or the second object feature element are designated as search exclusion targets, and

wherein the integrated server transmits a search request for an object satisfying the exclusion search condition to the first analysis server or the second analysis server, receives a search result from the first analysis server or the second analysis server, and transmits the search result to the user terminal.

10. An investigation assistance method executed by an investigation assistance system including a processor, a user terminal, and an integrated server that is communicably connected to a plurality of analysis servers, the investigation assistance method comprising:

obtaining, by the user terminal, a snapshot of a scene where an incident occurs including images of an object that includes at least one person at the scene;

displaying, by the user terminal, an analysis server selection screen showing a list of the plurality of analysis servers corresponding to a plurality of different object feature elements related to an incident, wherein the plurality of analysis servers each include a machine learning model;

selecting, by the user terminal, a first analysis server that includes a first machine learning model from the analysis server selection screen;

transmitting, by the user terminal to the integrated server, a search request via the plurality of analysis servers that each include the machine learning model for the object that includes the at least one person at the scene satisfying a search condition including an object feature element of the object being searched by the selected first analysis server based on an input of the search condition;

transmitting, by the integrated server, an object search instruction to the first analysis server based on the search request;

receiving, by the integrated server, a search result from the first analysis server indicating the object feature element of the object that includes the at least one person at the scene as part of a blacklist registration request of the at least one person at the scene;

transmitting, by the integrated server to the user terminal, the search result that includes the blacklist registration request of the at least one person to the user terminal;

upon receiving the search result that includes a blacklist registration request for the at least one person, selecting at the user terminal the at least one person for blacklisting, and

transmitting, from the user terminal to the integrated server, the selected at least one person for blacklisting to the integrated server; and

upon receiving the selected at least one person for blacklisting, transmitting a request to the analysis server that the selected at least one person for blacklisting be registered on the blacklist.

11. The investigation assistance method according to claim 10 ,

wherein the integrated server is communicably connected to n (n is an integer equal to or larger than 2) analysis servers,

the investigation assistance method further comprising:

periodically monitoring, by the integrated server, a communication status with each of the n analysis servers;

receiving, by the integrated server, a search condition including k (k is an integer from 1 to n) different object feature elements from the user terminal, and subsequently determining k analysis servers provided corresponding to the k object feature elements included in the search condition among the n analysis servers;

transmitting, by the integrated server, an object search request to each of the k analysis servers;

when detecting that a communication disconnection with a specific analysis server among the k analysis servers occurs, transmitting, by the integrated server, to the user terminal, search results received from the (k−1) analysis servers and a communication disconnection notification indicating that a communication disconnection with the specific analysis server occurs; and

displaying, by the user terminal, a search result screen including the search results received from the (k−1) analysis servers and the communication disconnection notification.

12. The investigation assistance method according to claim 10 ,

wherein the integrated server is communicably connected to at least a first analysis server and a second analysis server,

the investigation assistance method further comprising:

receiving, by the integrated server, a search condition including a first object feature element related to an incident or the like and a second object feature element related to the incident or the like from the user terminal, and subsequently transmitting, by the integrated server, a search request for an object satisfying the first object feature element to the first analysis server and a search request for an object satisfying the second object feature element to the second analysis server,

receiving, by the integrated server, a first search result including the object satisfying the first object feature element from the first analysis server and a second search result including the object satisfying the second object feature element from the second analysis server,

transmitting, by the integrated server, a third search result obtained by excluding the second search result from the first search result to the user terminal, and

displaying, by the user terminal, a search result screen including the third search result transmitted from the integrated server.