Inspection spot output apparatus, control method, and storage medium

1. An information processing apparatus comprising:

a memory storing instructions, and

a processor configured to execute the instructions to:

acquire a captured image containing an instrument to be inspected;

acquire inspection information indicating each inspection item of the instrument contained in the captured image;

display an indication representing an inspection spot corresponding to the inspection item indicated by the inspection information so that the indication is superimposed on the inspection spot on a display device or displays the indication in the inspection spot on the display device or near the instrument;

display an image of an input interface receiving, an input of an inspection result regarding the inspection item on the display device, when a captured image containing a marker is acquired after acquisition of the inspection information; and

determine whether a captured image, acquired after acquisition of the inspection information, contains the instrument, and display on the display device an image in which the indication representing the inspection spot is superimposed on the instrument only when it is determined that the captured image, acquired after acquisition of the inspection information does not contain the instrument,

wherein the image of an input interface is displayed at a position determined based on a position of the marker included in a captured image.

2. The information processing apparatus according to claim 1 , wherein the marker is attached to a body of a user of the information processing apparatus.

3. The information processing apparatus according to claim 2 , wherein the marker is a predetermined image displayed on a display device of a device attached to the user.

4. The information processing apparatus according to claim 1 ,

wherein the inspection information indicates rankings of a plurality of inspection items, and

wherein the processor is further configure to display an indication representing an inspection spot corresponding to the inspection item at a first rank on the display device and, after an inspection result of the inspection item at the first rank is input, display an indication representing an inspection spot corresponding to the inspection item at a second rank on the display device, the second rank being a next rank of the first rank.

5. The information processing apparatus according to claim 1 ,

wherein the inspection information indicates rankings of a plurality of inspection items,

wherein the processor is further configured to display on the display device the image in which the indication representing the inspection spot corresponding to the inspection item at a first rank is superimposed on the instrument, when a captured image which does not contain the instrument or a captured image which contains the marker or another marker is acquired after acquisition of the inspection information,

wherein the processor is further configured to display on the display device an image in which the indication representing an inspection spot corresponding to the inspection item at a second rank is superimposed on the instrument, when a captured image which does not contain the instrument or a captured image which contains the marker or another marker is acquired after an inspection result regarding the inspection item at the first rank is input, the second rank being a next rank of the first rank.

6. The information processing apparatus according to claim 1 , wherein the processor is further configured to display on the display device an indication representing a direction in which an inspection spot not contained in the captured image is located, when the inspection spot indicated by the acquired inspection information is not contained in the captured image.

7. The information processing apparatus according to claim 1 ,

wherein the display device is a display device of a transmissive head-mounted display, and

wherein the processor is further configured to display an indication representing the inspection spot at or near a position on the display device overlapping the inspection spot seen by eyes of a user through the display device.

8. The information processing apparatus according to claim 7 , wherein the processor is further configured to: calculate a position of the inspection spot on the display device seen by the eyes of the user through the display device based on an angle of view of a camera generating the captured image, a positional relation between the camera and the display device, and a position of the inspection spot contained in the captured image; and display an indication representing the inspection spot at or near the calculated position.

9. The information processing apparatus according to claim 1 , wherein the inspection spot indicated by the inspection item is a meter, a lever, or a switch.

10. An information processing apparatus comprising:

a memory storing instructions; and

a processor configured to execute the instructions to:

acquire a captured image containing an instrument to be inspected;

acquire inspection information indicating each inspection item of the instrument contained in the captured image;

display an indication representing an inspection spot corresponding to the inspection item indicated by the inspection information so that the indication is superimposed on the inspection spot on a display device or displays the indication in the inspection spot on the display device or near the instrument;

display an image of an input interface receiving an input of an inspection result regarding the inspection item on the display device, when a captured image containing a marker is acquired after acquisition of the inspection information;

determine whether an input of an inspection result received in regard to the inspection item indicates an abnormal state; and

acquire additional information from a storage device storing the additional information in response to the input of the inspection result indicating the abnormal state,

wherein the image of an input interface is displayed at a position determined based on a position of the marker included in a captured image.

11. A control method executed by a computer, the method comprising:

acquiring a captured image containing an instrument to be inspected;

acquiring inspection information indicating each inspection item of the instrument contained in the captured image,

displaying an indication representing an inspection spot corresponding to the inspection item indicated by the inspection information so that the indication is superimposed on the inspection spot on a display device or displays the indication in the inspection spot on the display device or near the instrument;

displaying an image of an input interface receiving an input of an inspection result regarding the inspection item on the display device, when a captured image containing a marker is acquired after acquisition of the inspection information, and

determining whether a captured image, acquired after acquisition of the inspection information, contains the instrument, and displaying on the display device an image in which the indication representing the inspection spot is superimposed on the instrument only when it is determined that the captured image, acquired after acquisition of the inspection information does not contain the instrument,

wherein the image of an input interface is displayed at a position determined based on a position of the marker included in a captured image.

12. Anon-transitory computer-readable storage medium storing a program causing a computer to execute each step of the control method according to claim 11 .

13. The information processing apparatus according to claim 10 ,

wherein the additional information includes: inspection information indicating an inspection item which is to be additionally inspected; or a manual indicating an action which the user is to execute.

14. A control method executed by a computer, the method comprising:

acquiring a captured image containing an instrument to be inspected;

acquiring inspection information indicating each inspection item of the instrument contained in the captured image;

displaying an indication representing an inspection spot corresponding to the inspection item indicated by the inspection information so that the indication is superimposed on the inspection spot on a display device or displays the indication in the inspection spot on the display device or near the instrument;

displaying an image of an input interface receiving an input of an inspection result regarding the inspection item on the display device, when a captured image containing a marker is acquired after acquisition of the inspection information;

determining whether an input of an inspection result received in regard to the inspection item indicates an abnormal state; and

acquiring additional information from a storage device storing the additional information in response to the input of the inspection result indicating the abnormal state,

wherein the image of an input interface is displayed at a position determined based on a position of the marker included in a captured image.

15. A non-transitory computer-readable storage medium storing a program causing a computer to execute each step of the control method according to claim 14 .