Vehicle control apparatus, control method, and non-transitory computer readable medium
An object is to provide a vehicle control apparatus that can accurately control autonomous driving of a vehicle using images. A vehicle control apparatus ( 10 ) according to the present disclosure includes a camera image acquisition unit ( 11 ) configured to acquire an image from a camera included in a forklift; an image recognition unit ( 12 ) configured to recognize a pallet and an insertion opening provided in the pallet from the acquired image; and a movement control unit ( 13 ) configured to determine a direction in which the forklift is present with respect to the insertion opening according to a relative size of the insertion opening relative to a size of the pallet in the image and control movement of the forklift so as to move a fork of the forklift to a position where the fork of the forklift can be inserted into the insertion opening.
1 . A vehicle control apparatus comprising:
at least one memory storing instructions, and
at least one processor configured to execute the instructions to;
acquire an image from a camera included in a forklift;
recognize a pallet and an insertion opening provided in the pallet from the acquired image;
determine a direction in which the forklift is present with respect to the insertion opening according to a relative size of the insertion opening relative to a size of the pallet in the image and control movement of the forklift so as to move a fork of the forklift to a position where the fork of the forklift can be inserted into the insertion opening; and
estimate a distance from the forklift to the insertion opening using a camera capable of measuring the distance; wherein
the at least one processor is further configured to execute the instructions to control the movement of the forklift based on a value of D cos R, where D (D is a positive real number) is the distance from the forklift to the insertion opening and R is an angle between a direction in which the insertion opening is facing and the direction in which the forklift is present, in such a way that when the value of D cos R exceeds a threshold, the forklift is controlled to move along an extension line in the direction in which the insertion opening is facing in a shortest distance, whereas when the value of D cos R falls below the threshold, the forklift is controlled to move along the extension line in the direction in which the insertion opening is facing to a position away from the insertion opening by the distance D.
2 . The vehicle control apparatus according to claim 1 , wherein the at least one processor is further configured to execute the instructions to generate a first rectangle surrounding the pallet and a second rectangle surrounding the insertion opening using a learning model that has been trained on shapes of the pallet and the insertion opening.
3 . The vehicle control apparatus according to claim 2 , wherein the at least one processor is further configured to execute the instructions to determine the direction in which the forklift is present with respect to a position of the insertion opening based on a result of a comparison of a first length of a width of the first rectangle with a second length of a width of the second rectangle.
4 . The vehicle control apparatus according to claim 3 , wherein the at least one processor is further configured to execute the instructions to control the movement of the forklift to bring the first rectangle closer to a center of the image when a difference between the first length and the second length falls below a threshold.
5 . The vehicle control apparatus according to claim 3 , wherein when the difference between the first length and the second length exceeds the threshold, the at least one processor is further configured to execute the instructions to control the movement of the forklift so that the forklift is moved to a position where the difference between the first length and the second length falls below the threshold.
6 . The vehicle control apparatus according to claim 1 , wherein the at least one processor is further configured to execute the instructions to control a speed of the forklift according to the distance from the forklift to the insertion opening.
7 . The vehicle control apparatus according to claim 1 , wherein the at least one processor is further configured to execute the instructions to use a learning model trained on the shapes of the pallet and insertion opening to recognize the pallet and the insertion opening.
8 . The vehicle control apparatus according to claim 1 , wherein the at least one processor is further configured to execute the instructions to control a control lever to make the forklift move forward or backward and control the steering to make the forklift turn.
9 . The vehicle control apparatus according to claim 8 , further comprising a structure attachable to and detachable from the forklift and is a mechanism capable of operating the control lever and the steering.
10 . A vehicle control method executed by a vehicle control apparatus comprising:
acquiring an image from a camera included in a forklift;
estimating a distance from the forklift to an insertion opening using a camera capable of measuring the distance;
recognizing a pallet and the insertion opening provided in the pallet from the acquired image;
determining a direction in which the forklift is present with respect to the insertion opening according to a relative size of the insertion opening relative to a size of the pallet in the image; and
controlling movement of the forklift so as to move a fork of the forklift to a position where the fork of the forklift can be inserted into the insertion opening, wherein
the controlling the movement of the forklift comprises controlling the movement of the forklift based on a value of D cos R, where D (D is a positive real number) is the distance from the forklift to the insertion opening and R is an angle between a direction in which the insertion opening is facing and the direction in which the forklift is present, in such a way that when the value of D cos R exceeds a threshold, the forklift is controlled to move along an extension line in the direction in which the insertion opening is facing in a shortest distance, whereas when the value of D cos R falls below the threshold, the forklift is controlled to move along the extension line in the direction in which the insertion opening is facing to a position away from the insertion opening by the distance D.
11 . A non-transitory computer readable medium storing a program for causing a computer to execute:
acquiring an image from a camera included in a forklift;
estimating a distance from the forklift to an insertion opening using a camera capable of measuring the distance;
recognizing a pallet and the insertion opening provided in the pallet from the acquired image;
determining a direction in which the forklift is present with respect to the insertion opening according to a relative size of the insertion opening relative to a size of the pallet in the image; and
controlling movement of the forklift so as to move a fork of the forklift to a position where the fork of the forklift can be inserted into the insertion opening, wherein
the controlling the movement of the forklift comprises, controlling the movement of the forklift based on a value of D cos R, where D (D is a positive real number) is the distance from the forklift to the insertion opening and R is an angle between a direction in which the insertion opening is facing and the direction in which the forklift is present, in such a way that when the value of D cos R exceeds a threshold, the forklift is controlled to move along an extension line in the direction in which the insertion opening is facing in a shortest distance, whereas when the value of D cos R falls below the threshold, the forklift is controlled to move along the extension line in the direction in which the insertion opening is facing to a position away from the insertion opening by the distance D.