Fixed state inspection apparatus, fixed state inspection system, fixed state inspection method, and a non-transitory computer readable medium

1. A fixed state inspection apparatus comprising:

at least one memory configured to store instructions; and

at least one processor configured to execute the instructions to:

acquire frame image group information being information including a plurality of frame images acquired by continuously capturing images of a freight train along a traveling direction, at least one of the frame images including a fixing mechanism that is provided for fixing a container and a flatcar in the freight train and can switch between a fixed state and a released state between the container and the flatcar;

detect the fixing mechanism in an unfixed state different from the fixed state in the freight train by processing at least one image obtained from the frame image group information; and

generate and output detection position information being information allowing determination of a position of the detected fixing mechanism in the freight train, based on a detection frame image being a frame image including the detected fixing mechanism.

2. The fixed state inspection apparatus according to claim 1 , wherein

the detection position information relating to a position of the detected fixing mechanism in the freight train is outputted, based on the detection frame image being a frame image including the detected fixing mechanism and another frame image.

3. The fixed state inspection apparatus according to claim 2 , wherein the at least one processor configured further to execute the instructions to

generate overall image information indicating an overall image including an image of a side part of the freight train over an entire length along the traveling direction, by compositing a plurality of frame images included in the frame image group information.

4. The fixed state inspection apparatus according to claim 3 , wherein

outputting the detection position information includes:

determining an area occupied by the detection frame image in the overall image, based on the detection frame image and the overall image;

determining a car number of a car relating to the determined area, by analyzing the overall image, and

outputting information indicating the car number as the detection position information.

5. The fixed state inspection apparatus according to claim 4 , wherein

the area occupied by the detection frame image in the overall image is determined by checking the detection frame image against the overall image.

6. The fixed state inspection apparatus according to claim 4 , wherein

determining the area occupied by the detection frame image in the overall image includes:

generating frame area information indicating an area occupied by each of the plurality of frame images in the overall image; and

determining the area occupied by the detection frame image in the overall image, based on the frame area information.

7. The fixed state inspection apparatus according to claim 3 , wherein

outputting the detection position information includes:

generating frame area information indicating an area occupied by each of the plurality of frame images in the overall image;

determining a car number of each car in the overall image by analyzing the overall image;

generating frame-car information indicating a car number of a car indicated in each of the plurality of frame images, based on the determined car number and the frame area information; and

determining a car number of a car relating to the detection frame image, based on the frame-car information, and

outputting information indicating the car number as the detection position information.

8. The fixed state inspection apparatus according to claim 3 , wherein

the fixing mechanism in the unfixed state is detected, based on an overall image acquired from the frame image group information.

9. The fixed state inspection apparatus according to claim 3 , wherein

the fixing mechanism in the unfixed state is detected, based on an overall image acquired from the frame image group information, and

the detection position information is information indicating a car number of a car including the detected fixing mechanism, obtained by analyzing the overall image.

10. The fixed state inspection apparatus according to claim 3 , wherein

outputting the detection position information includes:

determining a car number of a car relating to the detection frame image, by successively analyzing the plurality of frame images, and

outputting information indicating the car number as the detection position information.

11. The fixed state inspection apparatus according to claim 10 , wherein

outputting the detection position information includes:

generating frame-car information indicating a car number of a car indicated in each of the plurality of frame images, by successively analyzing the plurality of frame images;

determining a car number of a car relating to the detection frame image, based on the frame-car information, and

outputting information indicating the car number as the detection position information.

12. The fixed state inspection apparatus according to claim 1 , wherein

the fixing mechanism in the unfixed state in the freight train is detected by inputting the frame image group information to a learned learning model undergoing machine learning for detecting a fixing mechanism in the unfixed state.

13. The fixed state inspection apparatus according to claim 12 , wherein

the fixing mechanism in the unfixed state in the freight train is detected by inputting the frame image group information and an image capture environment to a learned learning model undergoing machine learning for detecting a fixing mechanism in the unfixed state in a plurality of the image capture environments.

14. The fixed state inspection apparatus according to claim 13 , wherein

the image capture environment is set based on a time period for image capture or weather at image capture.

15. The fixed state inspection apparatus according to claim 1 , wherein

the fixing mechanism in the unfixed state in the freight train is detected by checking the frame image group information against reference information indicating the fixing mechanism in the fixed state.

16. The fixed state inspection apparatus according to claim 1 , wherein

outputting the detection position information includes:

determining a position of the detected fixing mechanism in the freight train, based on an image capture condition at image capture of the detection frame image, and

outputting the detection position information allowing determination of the determined position.

17. A fixed state inspection system comprising:

the fixed state inspection apparatus according to claim 1 ; and

image capture apparatus for capturing an image of the freight train, wherein

the frame image group information is acquired from the image capture apparatus.

18. The fixed state inspection system according to claim 17 , wherein

the image capture apparatus is provided in such a way as to move relatively to the freight train on one or both sides of the freight train along the traveling direction.

19. A fixed state inspection method comprising:

acquiring frame image group information being information including a plurality of frame images acquired by continuously capturing images of a freight train along a traveling direction, at least one of the frame images including a fixing mechanism that is provided for fixing a container and a flatcar in the freight train and can switch between a fixed state and a released state between the container and the flatcar;

detecting the fixing mechanism in an unfixed state different from the fixed state in the freight train, by processing at least one image obtained from the frame image group information; and

outputting detection position information relating to a position of the detected fixing mechanism in the freight train, based on a detection frame image being a frame image including the detected fixing mechanism.

20. A non-transitory computer readable medium having recorded thereon a program for causing a computer to execute:

acquiring frame image group information being information including a plurality of frame images acquired by continuously capturing images of a freight train along a traveling direction, at least one of the frame images including a fixing mechanism that is provided for fixing a container and a flatcar in the freight train and can switch between a fixed state and a released state between the container and the flatcar;

detecting the fixing mechanism in an unfixed state different from the fixed state in the freight train, by processing at least one image obtained from the frame image group information; and

outputting detection position information relating to a position of the detected fixing mechanism in the freight train, based on a detection frame image being a frame image including the detected fixing mechanism.