Image processing method, computer program, and image processing apparatus

1 . An image processing method comprising, by an image processing apparatus:

detecting candidates of a scene change point in a moving image;

detecting candidate frames that are candidates of a main frame of a scene from among frames forming the moving image;

determining the main frame from among the candidate frames;

determining, based on a time-series order of the candidates of the scene change point and the main frame,

when the main frame does not exist between two candidates of the scene change point that are consecutive in time series, the scene change point with one of the two candidates of the scene change point excluded, and

when a candidate of the scene change point exists between two main frames that are consecutive in time series and are similar to each other, the scene change point with the candidate of the scene change point excluded,

to determine the scene change point from among the candidates of the scene change point;

generating a summary moving image based on the determined scene change point; and

storing the summary moving image.

2 . The image processing method according to claim 1 , further comprising:

calculating statistical values of the frames; and

detecting the candidates of the scene change point based on a difference between the statistical values of two of the frames.

3 . The image processing method according to claim 1 , further comprising:

calculating hash values of the frames; and

detecting the candidates of the scene change point based on a difference between the hash values of two of the frames.

4 . The image processing method according to claim 1 , further comprising:

extracting an edge from each frame; and

detecting the candidate frames based on a change in the edge between two frames.

5 . The image processing method according to claim 1 , further comprising:

extracting a feature point from the candidate frames; and

determining the main frame from the plurality of candidate frames with a candidate frame excluded based on a result of comparison in the feature point between the candidate frames.

6 . The image processing method according to claim 1 , further comprising:

storing information on the scene change point and the main frame determined, in association with the moving image;

receiving selection of the scene change point or the main frame; and

playing the moving image based on the scene change point or the main frame selected.

7 . The image processing method according to claim 6 , further comprising:

storing information on the scene change point and the main frame determined, in association with character information on the moving image.

8 . The image processing method according to claim 7 , further comprising:

acquiring a moving image obtained by capturing work of installing or repairing an air-conditioning-related device;

determining the scene change point and the main frame for the acquired moving image; and

storing the information on the scene change point and the main frame determined, in association with character information on the air-conditioning-related device.

9 . The image processing method according to claim 1 , further comprising:

extracting partial moving images from the moving image based on the scene change point and the main frame determined; and

generating a summary moving image by combining the extracted partial moving images.

10 . The image processing method according to claim 1 , further comprising:

inputting the main frame determined to a learning model configured to classify a type of installation or repair for an input of a main frame of a moving image obtained by capturing work of installing or repairing an air-conditioning-related device;

acquiring a classification result output by the learning model; and

determining a title of the moving image or a scene included in the moving image based on the classification result acquired.

11 . A non-transitory computer-readable medium storing a computer program thereon, the computer program being configured to execute processing of:

detecting candidates of a scene change point in a moving image;

detecting candidate frames that are candidates of a main frame of a scene from among frames forming the moving image;

determining the main frame from among the candidate frames;

determining, based on a time-series order of the candidates of the scene change point and the main frame,

when the main frame does not exist between two candidates of the scene change point that are consecutive in time series, the scene change point with one of the two candidates of the scene change point excluded, and

when a candidate of the scene change point exists between two main frames that are consecutive in time series and are similar to each other, the scene change point with the candidate of the scene change point excluded,

to determine the scene change point from among the candidates of the scene change point;

generating a summary moving image based on the determined scene change point; and

storing the summary moving image.

12 . An image processing apparatus comprising:

a processor including

a scene-change-point candidate detection unit configured to detect candidates for a scene change point in a moving image;

a candidate-frame detection unit configured to detect candidate frames that are candidates of a main frame of a scene from among frames forming the moving image;

a main frame determination unit configured to determine the main frame from among the candidate frames;

a scene-change-point determination unit configured to determine, based on a time-series order of the candidates of the scene change point and the main frame,

when the main frame does not exist between two candidates of the scene change point that are consecutive in time series, the scene change point with one of the two candidates of the scene change point excluded, and

when a candidate of the scene change point exists between two main frames that are consecutive in time series and are similar to each other, the scene change point with the candidate of the scene change point excluded,

to determine the scene change point from among the candidates of the scene change point; and

a database processing unit configured to generate a summary moving image based on the determined scene change point, and to store the summary moving image.