Automatic screen state detection robot, method and computer-readable storage medium

1. An automatic screen state detection robot, comprising a memory having an automatic screen state detection program stored thereon and a processor, and the automatic screen state detection program being executed by the processor to implement the operations of:

controlling the robot to move into a preset area of each of service devices in a self-service branch respectively;

taking a service device corresponding to a preset area as the service device to be detected if the robot moves into the preset area, and sending a preset graphic code to the service device to be detected so as to determine whether a display screen of the service device to be detected has a circuit fault or not according to content of the preset graphic code displayed on the display screen; and

controlling the service device to display an image according to preset display parameters if the display screen has no circuit fault and analyzing the image displayed on the display screen to find whether the display screen has an abnormality of a preset type, comprising:

controlling the display screen to display a plurality of preset colors in a single-color display mode simultaneously, wherein different preset colors correspond to display areas of different sizes, a shape of the display area corresponding to each preset color corresponds to a shape of a maximum display area of the display screen, and a display area corresponding to one of the preset colors is the maximum display area of the display screen;

taking a mask code for a display graph on the display screen corresponding to a preset color when the preset color is displayed in the single-color display mode, so as to obtain a mask code image;

carrying out anti-interference treatment on a mask code image of a preset color corresponding to a display area that is smaller than the maximum display area to obtain an anti-interference image;

determining an actual maximum display area of the display screen according to theobtained anti-interference image, extracting an image of an actual display area for the mask code image of the preset color corresponding to the maximum display area according to the determined actual maximum display area, so as to obtain a maximum display image;

carrying out noise-filtering enhancement pretreatment on the maximum display image to obtain an enhanced image; and

analyzing the enhanced image to find whether the display screen to be detected has the abnormality of the preset type.

2. The automatic screen state detection robot according to claim 1 , wherein the processor is further configured for executing the automatic screen state detection program to implement, after the preset graphic code being sent to the service device to be detected so as to determine whether the service device to be detected has the circuit fault or not according to the content of the preset graphic code displayed on the display screen, the step of:

sending prompt message to a predetermined monitoring device to indicate that the display screen has the circuit fault to be dealt with if the service device to be detected has the circuit fault.

3. The automatic screen state detection robot according to claim 1 , wherein the operation of controlling the robot to move into a preset area of each of service devices in a self-service branch respectively comprises:

controlling the robot to move by following a preset mobile navigation path, and after the robot moves into the preset area of one service device and detection of the display screen to be detected is completed, controlling the robot to continue moving by following the mobile navigation path until detection of display screens of all the service devices is completed; or

controlling the robot to move randomly, and after the robot moves into the preset area of one service device and detection of the display screen to be detected is completed, labeling the service device to be detected as an obstacle and controlling the robot to circumvent; after the circumvention is completed, controlling the robot to continue moving randomly until all the service devices are labeled as the obstacles; and removing the obstacle labels of the service devices.

4. The automatic screen state detection robot according to claim 1 , wherein the operation of sending a preset graphic code to the service device to be detected so as to determine whether a display screen of the service device to be detected has a circuit fault or not according to content of the preset graphic code displayed on the display screen comprises:

controlling the robot to communicate wirelessly with the service device to be detected so as to send a display instruction for displaying the preset graphic code to the service device to be detected, wherein the preset graphic code comprises preset information;

controlling the robot to scan and analyze the content displayed on the display screen by the service device to be detected on the basis of the display instruction;

determining that the display screen to be detected has no circuit fault if the preset information is scanned and analyzed from the display screen to be detected; and

determining that the display screen to be detected has the circuit fault if the preset information is not scanned and analyzed from the display screen to be detected.

5. The automatic screen state detection robot according to claim 1 , wherein the step of carrying out anti-interference treatment on a mask code image of a preset color corresponding to a display area that is smaller than the maximum display area to obtain an anti-interference image comprises:

obtaining coordinates of a plurality of points on each of boundary lines of the mask code image of the preset color corresponding to the display area that is smaller than the maximum display area;

obtaining an extension line of each of the boundary lines of the mask code image through a least-square straight-line fitting algorithm on the basis of the coordinates of the plurality of points on each of the boundary lines;

obtaining intersection points of the four boundary lines according to the extension line of each of the boundary lines of the mask code image, and determining a position of a quadrilateral of the mask code image according to the intersection points of the four boundary lines and the four boundary lines; and

transforming the quadrilateral into a rectangle through inverse perspective transformation, and obtaining the anti-interference image according to a position of the mask code image rectangle.

6. An automatic screen state detection robot, comprising:

controlling the robot to move into a preset area of each of service devices in a self-service branch respectively;

taking a service device corresponding to a preset area as the service device to be detected if the robot moves into the preset area, and sending a preset graphic code to the service device to be detected so as to determine whether a display screen of the service device to be detected has a circuit fault or not according to content of the preset graphic code displayed on the display screen; and

controlling the service device to be detected to display an image according to preset display parameters if the display screen has no circuit fault and analyzing the image displayed on the display screen to find whether the display screen has an abnormality of a preset type, comprising:

controlling the display screen to display a plurality of preset colors in a single-color display mode simultaneously, wherein different preset colors correspond to display areas of different sizes, a shape of the display area corresponding to each preset color corresponds to a shape of a maximum display area of the display screen, and a display area corresponding to one of the preset colors is the maximum display area of the display screen;

taking a mask code for a display graph on the display screen corresponding to a preset color when the preset color is displayed in the single-color display mode, so as to obtain a mask code image;

carrying out anti-interference treatment on a mask code image of a preset color corresponding to a display area that is smaller than the maximum display area to obtain an anti-interference image;

determining an actual maximum display area of the display screen according to the obtained anti-interference image, extracting an image of an actual display area for the mask code image of the preset color corresponding to the maximum display area according to the determined actual maximum display area, so as to obtain a maximum display image;

carrying out noise-filtering enhancement pretreatment on the maximum display image to obtain an enhanced image; and

analyzing the enhanced image to find whether the display screen to be detected has the abnormality of the preset type.

7. The automatic screen state detection method according to claim 6 , further comprising, after the preset graphic code being sent to the service device to be detected so as to determine whether the service device to be detected has the circuit fault or not according to the content of the preset graphic code displayed on the display screen, the step of:

sending prompt message to a predetermined monitoring device to indicate that the display screen has the circuit fault to be dealt with if the service device to be detected has the circuit fault.

8. The automatic screen state detection method according to claim 6 , wherein the step of controlling the robot to move into a preset area of each of service devices in a self-service branch respectively comprises:

controlling the robot to move by following a preset mobile navigation path, and after the robot moves into the preset area of one service device and detection of the display screen to be detected is completed, controlling the robot to continue moving by following the mobile navigation path until detection of the display screens of all the service devices is completed; or

controlling the robot to move randomly, and after the robot moves into the preset area of one service device and detection of the display screen to be detected is completed, labeling the service device to be detected as an obstacle and controlling the robot to circumvent; after the circumvention is completed, controlling the robot to continue moving randomly until all the service devices are labeled as the obstacles; and removing the obstacle labels of the service devices.

9. The automatic screen state detection method according to claim 6 , wherein the step of sending a preset graphic code to the service device to be detected so as to determine whether a display screen of the service device to be detected has a circuit fault or not according to content of the preset graphic code displayed on the display screen comprises:

controlling the robot to communicate wirelessly with the service device to be detected so as to send a display instruction for displaying the preset graphic code to the service device to be detected, wherein the preset graphic code comprises preset information;

controlling the robot to scan and analyze the content displayed on the display screen by the service device to be detected on the basis of the display instruction;

determining that the display screen to be detected has no circuit fault if the preset information is scanned and analyzed from the display screen of the service device to be detected; and

determining that the display screen of the service device to be detected has the circuit fault if the preset information is not scanned and analyzed from the display screen to be detected.

10. The automatic screen state detection method according to claim 6 , wherein the step of carrying out anti-interference treatment on a mask code image of a preset color corresponding to a display area that is smaller than the maximum display area to obtain an anti-interference image comprises:

obtaining coordinates of a plurality of points on each of boundary lines of the mask code image of the preset color corresponding to the display area that is smaller than the maximum display area;

obtaining an extension line of each of the boundary lines of the mask code image through a least-square straight-line fitting algorithm on the basis of the coordinates of the plurality of points on each of the boundary lines;

obtaining intersection points of the four boundary lines according to the extension line of each of the boundary lines of the mask code image, and determining a position of a quadrilateral of the mask code image according to the intersection points of the four boundary lines and the four boundary lines; and

transforming the quadrilateral into a rectangle through inverse perspective transformation, and obtaining the anti-interference image according to a position of the mask code image rectangle.

11. A non-transitory computer-readable storage medium, wherein the computer-readable storage medium has an automatic screen state detection program stored thereon, and the automatic screen state detection program can be executed by one or more processors to implement the steps of:

controlling the robot to move into a preset area of each of service devices in a self-service branch respectively;

taking a service device corresponding to a preset area as the service device to be detected if the robot moves into the preset area, and sending a preset graphic code to the service device to be detected so as to determine whether a display screen of the service device to be detected has a circuit fault or not according to content of the preset graphic code displayed on the display screen; and

controlling the service device to be detected to display an image according to preset display parameters if the display screen has no circuit fault and analyzing the image displayed on the display screen to find whether the display screen has an abnormality of a preset type, comprising:

controlling the display screen to display a plurality of preset colors in a single-color display mode simultaneously, wherein different preset colors correspond to display areas of different sizes, a shape of the display area corresponding to each preset color corresponds to a shape of a maximum display area of the display screen, and a display area corresponding to one of the preset colors is the maximum display area of the display screen;

taking a mask code for a display graph on the display screen corresponding to a preset color when the preset color is displayed in the single-color display mode, so as to obtain a mask code image;

carrying out anti-interference treatment on a mask code image of a preset color corresponding to a display area that is smaller than the maximum display area to obtain an anti-interference image;

determining an actual maximum display area of the display screen according to the obtained anti-interference image, extracting an image of an actual display area for the mask code image of the preset color corresponding to the maximum display area according to the determined actual maximum display area, so as to obtain a maximum display image;

carrying out noise-filtering enhancement pretreatment on the maximum display image to obtain an enhanced image; and

analyzing the enhanced image to find whether the display screen to be detected has the abnormality of the preset type.

12. The non-transitory computer-readable storage medium according to claim 11 , wherein the automatic screen state detection program can be further executed by one or more processors to implement, after the preset graphic code being sent to the service device to be detected so as to determine whether the service device to be detected has the circuit fault or not according to the content of the preset graphic code displayed on the display screen, the step of:

sending prompt message to a predetermined monitoring device to indicate that the display screen has the circuit fault to be dealt with if the service device to be detected has the circuit fault.

13. The non-transitory computer-readable storage medium according to claim 11 , wherein the step of controlling the robot to move into a preset area of each of service devices in a self-service branch respectively comprises:

controlling the robot to move by following a preset mobile navigation path, and after the robot moves into the preset area of one service device and detection of the display screen to be detected is completed, controlling the robot to continue moving by following the mobile navigation path until detection of display screens of all the service devices is completed; or

controlling the robot to move randomly, and after the robot moves into the preset area of one service device and detection of the display screen to be detected is completed, labeling the service device to be detected as an obstacle and controlling the robot to circumvent; after the circumvention is completed, controlling the robot to continue moving randomly until all the service devices are labeled as the obstacles; and removing the obstacle labels of the service devices.

14. The non-transitory computer-readable storage medium according to claim 11 , wherein the step of sending a preset graphic code to the service device to be detected so as to determine whether a display screen of the service device to be detected has a circuit fault or not according to content of the preset graphic code displayed on the display screen comprises:

controlling the robot to communicate wirelessly with the service device to be detected so as to send a display instruction for displaying the preset graphic code to the service device to be detected, wherein the preset graphic code comprises preset information;

controlling the robot to scan and analyze the content displayed on the display screen by the service device to be detected on the basis of the display instruction;

determining that the display screen to be detected has no circuit fault if the preset information is scanned and analyzed from the display screen to be detected; and

determining that the display screen of the service device to be detected has the circuit fault if the preset information is not scanned and analyzed from the display screen to be detected.

15. The non-transitory computer-readable storage medium according to claim 9 , wherein the step of carrying out anti-interference treatment on a mask code image of a preset color corresponding to a display area that is smaller than the maximum display area to obtain an anti-interference image comprises:

obtaining coordinates of a plurality of points on each of boundary lines of the mask code image of the preset color corresponding to the display area that is smaller than the maximum display area;

obtaining an extension line of each of the boundary lines of the mask code image through a least-square straight-line fitting algorithm on the basis of the coordinates of the plurality of points on each of the boundary lines;

obtaining intersection points of the four boundary lines according to the extension line of each of the boundary lines of the mask code image, and determining a position of a quadrilateral of the mask code image according to the intersection points of the four boundary lines and the four boundary lines; and

transforming the quadrilateral into a rectangle through inverse perspective transformation, and obtaining the anti-interference image according to a position of the mask code image rectangle.