Automatically determining extrinsic parameters of modular edge computing devices
Implementations are disclosed for automatic commissioning, configuring, calibrating, and/or coordinating sensor-equipped modular edge computing devices that are mountable on agricultural vehicles. In various implementations, neighbor modular edge computing device(s) that are mounted on a vehicle nearest a given modular edge computing device may be detected based on sensor signal(s) generated by contactless sensor(s) of the given modular edge computing device. Based on the detected neighbor modular edge computing device(s), an ordinal position of the given modular edge computing device may be determined relative to a plurality of modular edge computing devices mounted on the agricultural vehicle. Based on the sensor signal(s), distance(s) to the neighbor modular edge computing device(s) may be determined. Extrinsic parameters of the given modular edge computing device may be determined based on the ordinal position of the given modular edge computing device and the distance(s).
1 . A method for automatically determining extrinsic parameters of a first edge computing device of a plurality of edge computing devices in an agricultural environment, the method comprising:
detecting, using signals by generated by one or more sensors of the first edge computing device, a second edge computing device of the plurality of edge computing devices near the first edge computing device;
determining, based on the detected second edge computing device, an ordinal position of the first edge computing device relative to the second edge computing device;
determining, based on visual signals generated by a visual sensor of the first edge computing device, a distance to the second edge computing device; and
determining the extrinsic parameters of the first edge computing device based on the ordinal position of the first edge computing device and the distance to the second edge computing device.
2 . The method of claim 1 , wherein detecting the second edge computing device further comprises:
receiving, from the second edge computing device, a wireless communication comprising position and distance information.
3 . The method of claim 2 , wherein determining the ordinal position of the first edge computing device is additionally based on the wirelessly received position and distance information.
4 . The method of claim 2 , wherein determining the distance to the second edge computing device based on visual signals generated by the visual sensor of the first edge computing device is additionally based on the wirelessly received position and distance information.
5 . The method of claim 1 , further comprising:
receiving, from a server computing system, an agricultural inference about the agricultural environment; and
wherein automatically determining the extrinsic parameters of the first edge computing device occurs on a local system in response to receiving the agricultural inference.
6 . The method of claim 1 , wherein determining the distance to the second edge computing device based on visual signals generated by the visual sensor of the first edge computing device comprises:
identifying at least one visual features detected in a first region of a first image captured by the visual sensor of the first edge computing device that is the same as one or more visual features detected in a second region of a second image captured by a visual sensor of the second edge computing device; and
determining the distance to the second edge computing device based on the at least one visual feature that is the same between the first image and the second image.
7 . The method of claim 1 , wherein determining the ordinal position of the first edge computing device comprises:
identifying a visual feature detected in a first image captured by the visual sensor of the first edge computing device representing the second edge computing device; and
determining the ordinal position of first edge computing device based on the identified visual feature.
8 . The method of claim 1 , wherein the first edge computing device is mounted to an agricultural robot operating in the agricultural environment.
9 . The method of claim 1 , wherein the second edge computing device is mounted to an agricultural vehicle operating in the agricultural environment.
10 . The method of claim 9 , wherein the second edge computing device is removably couplable from the agricultural vehicle.
11 . A non-transitory computer-readable storage medium storing computer program instructions for automatically determining extrinsic parameters of a first edge computing device of a plurality of edge computing devices in an agricultural environment, the computer program instructions, when executed by one or more processors, causing the one or more processors to:
detect, using signals by generated by one sensors of the first edge computing device, a second edge computing device of the plurality of edge computing devices near the first edge computing device;
determine, based on the detected second edge computing device, an ordinal position of the first edge computing device relative to the second edge computing device;
determine, based on visual signals generated by a visual sensor of the first edge computing device, a distance to the second edge computing device; and
determine the extrinsic parameters of the first edge computing device based on the ordinal position of the first edge computing device and the distance to the second edge computing device.
12 . The non-transitory computer-readable storage medium of claim 11 , wherein detecting the second edge computing device causes the one or more processors to:
receive, from the second edge computing device, a wireless communication comprising position and distance information.
13 . The non-transitory computer-readable storage medium of claim 12 , wherein determining the ordinal position of the first edge computing device is additionally based on the wirelessly received position and distance information.
14 . The non-transitory computer-readable storage medium of claim 12 , wherein determining the distance to the second edge computing device based on visual signals generated by the visual sensor of the first edge computing device is additionally based on the wirelessly received position and distance information.
15 . The non-transitory computer-readable storage medium of claim 11 , wherein executing the computer program instructions further cause the one or more processors to:
receive, from a server computing system, an agricultural inference about the agricultural environment; and
wherein automatically determining the extrinsic parameters of the first edge computing device occurs on a local system in response to receiving the agricultural inference.
16 . The non-transitory computer-readable storage medium of claim 11 , wherein determining the distance to the second edge computing device based on visual signals generated by the visual sensor of the first edge computing device causes the one or more processors to:
identify at least one visual features detected in a first region of a first image captured by the visual sensor of the first edge computing device that is the same as one or more visual features detected in a second region of a second image captured by a visual sensor of the second edge computing device; and
determine the distance to the second edge computing device based on the at least one visual feature that is the same between the first image and the second image.
17 . The non-transitory computer-readable storage medium of claim 11 , wherein determining the ordinal position of the first edge computing device causes the one or more processors to:
identify a visual feature detected in a first image captured by the visual sensor of the first edge computing device representing the second edge computing device; and
determine the ordinal position of the first edge computing device based on the identified visual feature.
18 . The non-transitory computer-readable storage medium of claim 11 , wherein the first edge computing device is mounted to an agricultural robot operating in the agricultural environment.
19 . The non-transitory computer-readable storage medium of claim 11 , wherein the second edge computing device is mounted to an agricultural vehicle operating in the agricultural environment.
20 . An agriculture robot comprising:
one or more sensors configured to generate signals representing position and location information in an agricultural environment;
a visual sensor configured to capture images of the agricultural environment;
a first edge computing device of a plurality of edge computing devices in the agricultural environment;
one or more processors; and
a non-transitory computer-readable storing medium storing computer program instructions for automatically determining extrinsic parameters of the first edge computing device of a plurality of edge computing devices, the computer program instructions, when executed by the one or more processors, causing the one or more processors to:
detect, using signals by generated by the one sensors, a second edge computing device near the first edge computing device;
determine, based on the detected second edge computing device, an ordinal position of the first edge computing device relative to the second edge computing device;
determine, based on visual signals generated by a visual sensor of the first edge computing device, a distance to the second edge computing device; and
determine the extrinsic parameters of the first edge computing device based on the ordinal position of the first edge computing device and the distance to the second edge computing device.