Agricultural machine and gesture recognition system for agricultural machine
An agricultural machine includes a controller configured or programmed to control an action of the agricultural machine, and at least one sensor to sense an environment around the agricultural machine. When the at least one sensor acquires motion information of a person performing a gesture, the controller is configured or programmed to cause the agricultural machine to perform an action determined based on a type of the gesture and an operational authority granted to the person.
1 . An agricultural machine capable of performing self-driving comprising:
a controller configured or programmed to control an action of the agricultural machine; and
at least one sensor to sense an environment around the agricultural machine; wherein
when the at least one sensor acquires motion information of a person performing a gesture, the controller is configured or programmed to cause the agricultural machine to perform an action determined based on a type of the gesture and an operational authority granted to the person;
the operational authority includes a plurality of levels with different actions or different groups of actions to be performed by the agricultural machine; and
the controller is configured or programmed to cause the agricultural machine to perform an action determined in accordance with the type of gesture and the level of operational authority.
2 . The agricultural machine of claim 1 , wherein, when the at least one sensor acquires the motion information, the controller is configured or programmed to:
cause the agricultural machine to perform an action included in a first group in accordance with the type of gesture when a first operational authority is granted to the person; and
cause the agricultural machine to perform an action included in a second group, which includes all actions included in the first group, in accordance with the type of gesture when a second operational authority, which is a higher level of authority than the first operational authority, is granted to the person.
3 . The agricultural machine of claim 2 , wherein
the first group and the second group each include at least one of an action of stopping the agricultural machine and an action of decelerating the agricultural machine; and
when the at least one sensor acquires motion information of a person performing a first type of gesture while the agricultural machine is traveling, the controller is configured or programmed to cause the agricultural machine to stop or decelerate, regardless of the level of operational authority granted to the person.
4 . The agricultural machine of claim 2 , wherein
the second group includes at least one of an action of starting travel of the agricultural machine and an action of stopping a prime mover of the agricultural machine; and
when the at least one sensor acquires motion information of a person performing a second type of gesture while the agricultural machine is stopped and the second operational authority is granted to the person, the controller is configured or programmed to start travel of the agricultural machine or stops the prime mover of the agricultural machine.
5 . The agricultural machine of claim 2 , further comprising:
an implement to perform an action under control of the controller; wherein
the second group includes an action to be performed by the implement; and
when the at least one sensor acquires the motion information and the second operational authority is granted to the person, the controller is configured or programmed to cause the implement to perform an action determined in accordance with the type of gesture.
6 . The agricultural machine of claim 2 , wherein
the second operational authority has a highest level of the plurality of levels;
the second group includes an action in which the agricultural machine moves out of a field; and
where the agricultural machine is in the field, when the at least one sensor acquires motion information of a person performing a third type of gesture and the second operational authority is granted to the person, the controller is configured or programmed to cause the agricultural machine to move out of the field.
7 . The agricultural machine of claim 2 , wherein
the second operational authority has a highest level of the plurality of levels;
the second group includes an action to be performed when the agricultural machine is outside the field; and
where the agricultural machine is outside the field, when the at least one sensor acquires the motion information and the second operational authority is granted to the person, the controller is configured or programmed to cause the agricultural machine to perform an action determined in accordance with the type of gesture.
8 . The agricultural machine of claim 2 , wherein when the at least one sensor acquires motion information of a first person performing a gesture and motion information of a second person performing a gesture of a different type from the gesture performed by the first person, the controller is configured or programmed to cause the agricultural machine to perform an action determined in accordance with the type of gesture performed by the second person if the first operational authority is granted to the first person and the second operational authority is granted to the second person.
9 . The agricultural machine of claim 2 , further comprising a receiver to receive a signal indicating that the second operational authority is granted to the person.
10 . The agricultural machine of claim 9 , wherein
the second group includes at least one of an action in which the agricultural machine starts traveling and an action of stopping a prime mover of the agricultural machine; and
where the agricultural machine is stopped, when the at least one sensor acquires motion information of a person performing a second type of gesture and the receiver receives the signal, the controller is configured or programmed to cause the agricultural machine to start traveling or stop the prime mover of the agricultural machine.
11 . The agricultural machine of claim 9 , further comprising:
an implement to perform an action under control of the controller; wherein
the second group includes an action to be performed by the implement; and
when the at least one sensor acquires the motion information and the receiver receives the signal, the controller is configured or programmed to cause the implement to perform an action determined in accordance with the type of gesture.
12 . The agricultural machine of claim 9 , wherein
the second operational authority has the highest level of the plurality of levels;
the second group includes an action in which the agricultural machine moves out of a field; and
where the agricultural machine is in the field, when the at least one sensor acquires motion information of a person performing a third type of gesture and when the receiver receives the signal, the controller is configured or programmed to cause the agricultural machine to move out of the field.
13 . The agricultural machine of claim 9 , wherein
the second operational authority has a highest level of the plurality of levels;
the second group includes an action to be performed when the agricultural machine is outside the field; and
where the agricultural machine is outside the field, when the at least one sensor acquires the motion information and the receiver receives the signal, the controller is configured or programmed to cause the agricultural machine to perform an action determined in accordance with the type of gesture.
14 . The agricultural machine of claim 9 , wherein a communication protocol between a transmitter carried by a person and the receiver conforms to a beacon standard or an RFID standard.
15 . The agricultural machine of claim 1 , further comprising:
a processor configured or programmed to process sensing data output from the at least one sensor;
the processor is configured or programmed to recognize a trajectory of the gesture based on the sensing data output from the at least one sensor when the motion information is acquired; and
the controller is configured or programmed to cause the agricultural machine to perform an action determined based on a result of comparison between a trajectory of the gesture and a specific pattern.
16 . The agricultural machine of claim 15 , wherein
the processor is configured or programmed to perform person recognition by analyzing the sensing data to acquire identification information associated with the person; and
the controller is configured or programmed to control an action of the agricultural machine in accordance with an operational authority determined based on the identification information.
17 . The agricultural machine of claim 1 , further comprising:
a receiver to receive a signal that is transmitted from a transmitter carried by a person and that includes identification information associated with the person; and
a storage to store a table that maps identification information associated with a person to an operational authority granted to the person; wherein
the controller is configured or programmed to cause the agricultural machine to perform an action determined based on the operational authority of the person determined by referring to the table, using the identification information acquired by the receiver.
18 . The agricultural machine of claim 1 , wherein the gesture performed by a person includes an action using an object worn by the person.
19 . A gesture recognition system for use in an agricultural machine capable of performing self-driving and including a controller configured or programmed to control an action of the agricultural machine, the gesture recognition system comprising:
at least one sensor to sense an environment around the agricultural machine;
a processor configured or programmed to process sensing data output from the at least one sensor; and
a terminal usable to set an operational authority for a person involved in agricultural work; wherein
the operational authority includes a plurality of levels with different actions or different groups of actions to be performed by the agricultural machine;
the processor is configured or programmed to recognize a type of gesture based on the sensing data output from the at least one sensor when motion information of the person performing the gesture is acquired; and
the gesture recognition system instructs the controller to cause the agricultural machine to perform an action determined based on the type of gesture and the level of operational authority granted to the person.