Autonomous work machine, control device, autonomous work machine control method, control device operation method, and storage medium
An autonomous work machine that works in a work area, the autonomous work machine comprising: a storage unit that stores past captured images including one or more markers arranged to define the work area; a specifying unit that specifies a past captured image stored in the storage unit and similar to a current captured image captured by an image capturing unit; and a control unit that controls the autonomous work machine based on the past captured image specified by the specifying unit.
1. An autonomous work machine that works in a work area, the autonomous work machine comprising:
at least one processor circuit with a memory;
a plurality of past captured images including one or more markers arranged to define the work area stored in the memory;
instructions that, when executed by the processor circuit, cause the at least one processor circuit to at least:
specify a past captured image of the past captured images stored in the memory and similar to a current captured image captured by an image capturing unit;
detect a marker in the current captured image and the specified past captured image; and
determine whether the marker is missing in the current captured image with respect to the specified past captured image based on a detection result from the current captured image and a detection result from the specified past captured image similar to the current captured image, and
when it is determined that the marker is missing, superimpose, on the current captured image and as a virtual marker, a corresponding marker in the specified past captured image,
wherein the instructions, when executed by the processor circuit, further cause the at least one processor circuit to at least:
stop, move backward, or turn the autonomous work machine when a distance from the autonomous work machine to a virtual line connecting a plurality of markers detected from the current captured image becomes equal to or less than a first threshold, and
stop, move backward, or turn the autonomous work machine when a distance from the autonomous work machine to a virtual line connecting a marker of the plurality of markers detected from the current captured image and the virtual marker is equal to or less than a second threshold larger than the first threshold.
2. The autonomous work machine according to claim 1 , wherein the instructions, when executed by the processor circuit, further cause the at least one processor circuit to at least, in a case where a plurality of markers have been detected from the specified past captured image, set a virtual line connecting the plurality of markers, wherein the autonomous work machine is controlled such that the autonomous work machine does not deviate to a region beyond the virtual line set.
3. The autonomous work machine according to claim 2 , wherein
a marker included in the specified past captured image and distance information from the autonomous work machine is stored in association with the marker, and
the virtual line is set based on distance information of each of the plurality of detected markers.
4. The autonomous work machine according to claim 2 , wherein
the past captured image and another past captured image having parallax with respect to the past captured image are stored in the memory in association with each other, and
the instructions, when executed by the processor circuit, further cause the at least one processor circuit to at least,
calculate, based on the past captured image and the other past captured image having parallax with respect to the past captured image, distance information from the autonomous work machine to each of the plurality of detected markers, and
set the virtual line based on the calculated distance information.
5. The autonomous work machine according to claim 2 , wherein
the past captured image and information of a position and orientation of the autonomous work machine at a time of capturing the past captured image are stored in the memory in association with each other, and
the instructions, when executed by the processor circuit, further cause the at least one processor circuit to at least,
acquire the information on the position and orientation of the autonomous work machine corresponding to the specified past captured image; and
acquire, based on the information on the position and orientation of the autonomous work machine and map information including an arrangement position of the marker, distance information to the detected marker from the specified past captured image, and
when a plurality of markers have been detected, the virtual line is set based on the distance information acquired for each of the plurality of markers.
6. The autonomous work machine according to claim 1 , wherein the instructions, when executed by the processor circuit, further cause the at least one processor circuit to at least control the autonomous work machine to stop, move backward, or turn in a case where a distance from the autonomous work machine to the virtual line becomes equal to or less than a threshold.
7. The autonomous work machine according to claim 1 , wherein the instructions, when executed by the processor circuit, further cause the at least one processor circuit to at least:
update information stored in the memory; update the specified past captured image based on a captured image including the one or more markers captured by the image capturing unit.
8. The autonomous work machine according to claim 7 , wherein the information of the specified past captured image is periodically updated.
9. The autonomous work machine according to claim 7 , wherein the information of the specified past captured image is updated for each season or each month.
10. The autonomous work machine according to claim 7 , wherein:
the instructions, when executed by the processor circuit, further cause the at least one processor circuit to at least: set a plurality of virtual line connecting markers,
set the virtual line based on distance information of each of a marker detected from the current captured image and the virtual marker superimposed and arranged on the current captured image, and
wherein the autonomous work machine is controlled so that the autonomous work machine does not deviate to a region beyond the set virtual line.
11. A control method for an autonomous work machine that works in a work area and includes a storage unit that stores past captured images including one or more markers arranged to define the work area, the control method comprising:
specifying a past captured image stored in the storage unit and similar to a current captured image captured by an image capturing unit;
detecting a marker in the current captured image and the specified past captured image;
determining whether the marker is missing in the current captured image with respect to the specified past captured image based on a detection result from the current captured image and a detection result from the specified past captured image similar to the current captured image,
when it is determined that the marker is missing, superimposing, on the current captured image and as a virtual marker, a corresponding marker in the specified past captured image,
stopping, moving backward, or turning the autonomous work machine when a distance from the autonomous work machine to a virtual line connecting a plurality of markers detected from the current captured image becomes equal to or less than a first threshold, and
stopping, moving backward, or turning the autonomous work machine when a distance from the autonomous work machine to a virtual line connecting a marker of the plurality of markers detected from the current captured image and the virtual marker is equal to or less than a second threshold larger than the first threshold.
12. A non-transitory computer readable storage medium storing a program for causing a computer to execute a control method for an autonomous work machine that works in a work area and includes a storage unit that stores past captured images including one or more markers arranged to define the work area, the control method comprising:
specifying a past captured image stored in the storage unit and similar to a current captured image captured by an image capturing unit;
detecting a marker in the current captured image and the specified past captured image;
determining whether the marker is missing in the current captured image with respect to the specified past captured image based on a detection result from the current captured image and a detection result from the specified past captured image similar to the current captured image,
when it is determined that the marker is missing, superimposing, on the current captured image and as a virtual marker, a corresponding marker in the specified past captured image,
stopping, moving backward, or turning the autonomous work machine when a distance from the autonomous work machine to a virtual line connecting a plurality of markers detected from the current captured image becomes equal to or less than a first threshold, and
stopping, moving backward, or turning the autonomous work machine when a distance from the autonomous work machine to a virtual line connecting a marker of the plurality of markers detected from the current captured image and the virtual marker is equal to or less than a second threshold larger than the first threshold.