IP Library Granted Patent US 12,175,760
Granted Patent B2
US 12,175,760 · App. 17/909,458 · Granted Dec 24, 2024

Image analysis system, image analysis method, and image analysis program

Inventors: Keigo Hasegawa (Tokyo, JP); Wataru Ito (Tokyo, JP); Kazunari Iwanaga (Tokyo, JP)
Assignee: HITACHI KOKUSAI ELECTRIC INC.
G06V20/52G06T7/0002G06T7/11G06T2207/20081G06V2201/07
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,175,760
App. No.
17/909,458
Granted
Dec 24, 2024
Kind
B2
Abstract

There is provided an image analysis system having an image analysis server which analyzes an input image of a monitoring area and detects a state of a specific monitored object. The image analysis server is configured to divide, in the input image of the monitoring area, a portion of an area in which the monitored object is expected to be present into a plurality of grids, generate a trained model trained by associating “1” with an image of a grid in which the monitored object is present and “0” with an image of a grid in which the monitored object is not present for each grid, calculate, for the input image, a confidence of a presence of the monitored object for each grid using the trained model, determine a presence or absence of the monitored object in the monitoring area based on confidences of the plurality of grids, and detect an abnormality when a confidence value in at least one of the grids is inconsistent with the determination result.

Claims (28)

1. An image analysis system having an image analysis server which analyzes an input image of a monitoring area and detects a state of a specific monitored object,

wherein the image analysis server is configured to

divide, in the input image of the monitoring area, a portion of an area in which the monitored object is expected to be present into a plurality of grids,

generate a trained model trained by associating “1” with an image of a grid in which the monitored object is present and “0” with an image of a grid in which the monitored object is not present for each grid,

calculate, for the input image, a confidence of a presence of the monitored object for each grid using the trained model,

determine a presence or absence of the monitored object in the monitoring area based on a comparison result between confidences of the plurality of grids and a threshold value, and

detect an abnormality when a confidence value in at least one of the grids is inconsistent with the determination result.

2. The image analysis system of claim 1 , wherein the image analysis server is configured to obtain information indicating the presence or absence of the monitored object in the monitoring area from an outside, and detect the abnormality when the confidence value in at least one of the grids is inconsistent with the information indicating the presence or absence of the monitored object.

3. The image analysis system of claim 2 , wherein the image analysis server is configured to accumulate a set of a grid unit image and information on the presence or absence of the monitored object corresponding to the grid unit image as training data, perform training using the training data to build a new model, and update the trained model with the new model.

4. The image analysis system of claim 3 , wherein the image analysis server is configured to exclude an image in which an abnormality is detected and information on the presence or absence of the monitored object corresponding to the image in which the abnormality is detected from the training data.

5. The image analysis system of claim 1 , wherein the image analysis server is configured to obtain information indicating the presence or absence of the monitored object in the monitoring area from an outside, and detect an abnormality when the information indicating the presence or absence of the monitored object obtained from the outside is different from the determination result.

6. The image analysis system of claim 5 , wherein the image analysis server is configured to accumulate a set of a grid unit image and information on the presence or absence of the monitored object corresponding to the grid unit image as training data, perform training using the training data to build a new model, and update the trained model with the new model.

7. The image analysis system of claim 6 , wherein the image analysis server is configured to exclude an image in which an abnormality is detected and information on the presence or absence of the monitored object corresponding to the image in which the abnormality is detected from the training data.

8. The image analysis system of claim 1 , wherein the image analysis server is configured to accumulate a set of a grid unit image and information on the presence or absence of the monitored object corresponding to the grid unit image as training data, perform training using the training data to build a new model, and update the trained model with the new model.

9. The image analysis system of claim 8 , wherein the image analysis server is configured to exclude an image in which an abnormality is detected and information on the presence or absence of the monitored object corresponding to the image in which the abnormality is detected from the training data.

10. An image analysis method for detecting a state of a specific monitored object by analyzing an input image of a monitoring area, comprising:

dividing, in the input image of the monitoring area, a portion of an area in which the monitored object is expected to be present into a plurality of grids,

generating a trained model trained by associating “1” with an image of a grid in which the monitored object is present and “0” with an image of a grid in which the monitored object is not present for each grid,

calculating, for the input image, a confidence of a presence of the monitored object for each grid using the trained model,

determining a presence or absence of the monitored object in the monitoring area based on a comparison result between confidences of the plurality of grids and a threshold value, and

detecting an abnormality when a confidence value in at least one of the grids is inconsistent with the determination result.

11. An image analysis program which operates on an image analysis server which is configured to analyze an input image of a monitoring area and detect a state of a specific monitored object,

wherein the image analysis program causes the image analysis server to perform dividing, in the input image of the monitoring area, a portion of an area in which the monitored object is expected to be present into a plurality of grids,

generating a trained model trained by associating “1” with an image of a grid in which the monitored object is present and “0” with an image of a grid in which the monitored object is not present for each grid,

calculating, for the input image, a confidence of a presence of the monitored object for each grid using the trained model,

obtaining information indicating a presence or absence of the monitored object in the monitoring area from an outside, and

detecting an abnormality when a confidence value in at least one of the grids is inconsistent with the information indicating the presence or absence of the monitored object,

wherein the presence or absence of the monitored object in the monitoring area is determined based on a comparison result between confidences of the plurality of grids and a threshold value.

Assignments (2)
CHANGE OF NAME Recorded Mar 31, 2025
From: HITACHI KOKUSAI ELECTRIC INC.
To: KOKUSAI DENKI ELECTRIC INC.
Reel/Frame 070681/0471 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 6, 2022
From: HASEGAWA, KEIGO; ITO, WATARU; IWANAGA, KAZUNARI
To: HITACHI KOKUSAI ELECTRIC INC.
Reel/Frame 060993/0821 →
Priority Claims (1)
JP 2020-057507 · Mar 27, 2020 · national
Continuity (1)
Related Publication 20230125890A1 · Apr 27, 2023