Monitoring device of analyzer
A monitoring device includes an acquisition unit configured to acquire a captured image of a display panel of a control device configured to control an analyzer, an image storage unit configured to store the captured image, and a state determination unit configured to determine a state of the analyzer based on the captured image.
1 . A monitoring device of an analyzer executing a fatigue test comprising:
a processor configured to acquire a captured image of a display panel of a control device configured to control the analyzer executing the fatigue test, and
a memory that stores the captured image,
wherein
the processor is configured to perform image recognition processing on the captured image,
the display panel comprises a plurality of display devices, at least one of the display devices is a numerical display device, and a numerical value to be displayed by the numerical display device includes a number of cycles of the fatigue test, and
the processor is configured to:
acquire a plurality of the captured images captured at a predetermined time interval in the fatigue test,
generate a numerical data indicating a value of the number of cycles from the captured image,
update a determined value being a value of the number of cycles to be associated with the captured image, based on the numerical data of the number of cycles generated,
obtains a regression line, with respect to a time, of the numerical data of the number of cycles generated from each of at least three of the captured images captured before a target image being one of the plurality of captured images, and
in a case where an amount of difference from the regression line of a target value being a value of the numerical data of the number of cycles generated from the target image is equal to or smaller than a predetermined value, updates the determined value with the target value.
2 . The monitoring device of an analyzer according to claim 1 , wherein the plurality of display devices comprises a plurality of display lamps, and the processor determines a state of the analyzer that is indicated by a combination of lighting modes of the plurality of display lamps, based on a first captured image that is included in the captured image and corresponds to the plurality of display lamps.
3 . The monitoring device of an analyzer according to claim 2 , wherein the processor is configured to determine a first region in the first captured image, and a second region having a larger change in an image than the first region that is caused in a case where a lighting mode of the display lamp changes, and generate a determination image including an image of the second region, and
the processor is configured to acquire the determination image as the first captured image.
4 . The monitoring device of an analyzer according to claim 3 , wherein the processor generates the determination image by applying a mask image for masking the first region, to the first captured image.
5 . The monitoring device of an analyzer according to claim 2 or 3 , comprising a state recognition model obtained by learning, by machine learning, a relationship between the first captured image with various lighting modes of the plurality of display lamps and a state of the analyzer,
wherein the processor determines a state of the analyzer by inputting the first captured image to the state recognition model.
6 . The monitoring device of an analyzer according to claim 5 , wherein, when the processor determines a state of the analyzer using the state recognition model, the processor adds warning information corresponding to an accuracy of the determination, to a determination result of the state.
7 . The monitoring device of an analyzer according to claim 2 or 3 ,
wherein, at at least two corners of each of display device regions being regions in which the display devices are provided, markers to which barcodes indicating an identification code of the display device region are allocated are arranged on the display panel,
the processor acquires the identification code from captured images of the markers included in the captured image, and
the processor identifies image regions in the captured image that correspond to the respective display device regions, based on positions of the markers and the identification code.
8 . The monitoring device of an analyzer according to claim 7 ,
wherein, on the display panel, at least one of the display device regions is rectangular, and the markers are arranged at four corners of the at least one rectangular display device region, and
the processor corrects distortion of an image in the image region based on positions of the markers arranged at the four corners of the rectangular display device region.
9 . The monitoring device of an analyzer according to claim 7 ,
wherein the numerical display device displays a specific symbol and a numerical value,
the processor estimates a character size of the numerical value displayed on the numerical display device, based on a size of the symbol displayed on the numerical display device, and
the processor generates numerical data to be displayed on the numerical display device, by image recognition processing that uses the estimated character size.
10 . The monitoring device of an analyzer according to claim 1 ,
wherein, in a case where an amount of difference from the regression line of the target value is not equal to or smaller than a predetermined value, when all of the numerical data of the number of cycles generated from a predetermined number of the captured images captured before the target image are same values, the processor updates the determined value with the same value, and updates the regression line.
11 . The monitoring device of an analyzer according to claim 1 ,
wherein, in a case where an amount of difference from the regression line of the target value is not equal to or smaller than a predetermined value, when at least one of the numerical data of the number of cycles generated from a predetermined number of the captured images captured before the target image is a value different from other values, the processor does not update the determined value.
12 . The monitoring device of an analyzer according to claim 11 ,
wherein, when processor does not update the determined value, the update unit adds warning information to the number of cycles determined value.