IP Library Granted Patent US 11,750,791
Granted Patent B2
US 11,750,791 · App. 17/505,058 · Granted Sep 5, 2023

Automatically determining extrinsic parameters of modular edge computing devices

Inventors: Elliott Grant (Woodside, CA); Sergey Yaroshenko (Newark, CA); Gabriella Levine (San Francisco, CA)
Assignee: Mineral Earth Sciences LLC
H04N13/239A01B63/02A01B76/00A01B79/005G06T7/73G06T7/85H04N13/246H04N13/296G06T2207/30188G06T2207/30204
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,750,791
App. No.
17/505,058
Granted
Sep 5, 2023
Kind
B2
Abstract

Implementations are disclosed for automatic commissioning, configuring, calibrating, and/or coordinating sensor-equipped modular edge computing devices that are mountable on agricultural vehicles. In various implementations, neighbor modular edge computing device(s) that are mounted on a vehicle nearest a given modular edge computing device may be detected based on sensor signal(s) generated by contactless sensor(s) of the given modular edge computing device. Based on the detected neighbor modular edge computing device(s), an ordinal position of the given modular edge computing device may be determined relative to a plurality of modular edge computing devices mounted on the agricultural vehicle. Based on the sensor signal(s), distance(s) to the neighbor modular edge computing device(s) may be determined. Extrinsic parameters of the given modular edge computing device may be determined based on the ordinal position of the given modular edge computing device and the distance(s).

Claims (38)

1. A method for automatically determining extrinsic parameters of a given modular edge computing device of a plurality of modular edge computing devices mounted on a vehicle, the method implemented using one or more processors and comprising:

detecting, based on one or more sensor signals generated by one or more contactless sensors of the given modular edge computing device, one or more neighbor modular edge computing devices of the plurality of modular edge computing devices that are mounted on the vehicle nearest the given modular edge computing device;

based the detected one or more neighbor modular edge computing devices, determining an ordinal position of the given modular edge computing device relative to the plurality of modular edge computing devices;

determining, based on one or more time-of-flight sensor signals of the sensor signals, one or more distances to the one or more neighbor modular edge computing devices; and

determining the extrinsic parameters of the given modular edge computing device based on the ordinal position of the given modular edge computing device and the one or more distances.

2. The method of claim 1 , wherein one or more of the contactless sensors comprises a vision sensor.

3. The method of claim 2 , wherein the sensor signal generated by the vision sensor is indicative of a fiducial marker on a surface of one or more of the neighbor modular edge computing devices.

4. The method of claim 1 , wherein determining the extrinsic parameters includes detecting an absolute orientation of the given modular edge computing device based on one or more of the sensor signals or one or more other sensor signals.

5. The method of claim 1 , wherein determining the extrinsic parameters includes determining a relative orientation of the given modular edge computing device based on an observed orientation of one or more of the neighbor modular edge computing devices.

6. The method of claim 1 , further comprising:

generating one or more instructions to alter an orientation or position of the given modular edge computing device based on one or more of the extrinsic parameters; and

causing output to be provided at one or more output devices, wherein the output conveys the one or more instructions.

7. The method of claim 1 , wherein one or more of the contactless sensors comprises a laser.

8. The method of claim 1 , wherein the vehicle comprises a tractor, and the plurality of modular edge computing devices are mounted along a boom affixed to the tractor.

9. The method of claim 1 , wherein the vehicle comprises a center pivot, and the plurality of modular edge computing devices are mounted along the center pivot.

10. A modular edge computing device comprising:

one or more contactless sensors; and

circuitry to:

identify, from a plurality of modular edge computing devices arranged along an axis on an agricultural vehicle, and based on one or more sensor signals generated by one or more of the contactless sensors, one or more neighbor modular edge computing devices that are mounted nearest the modular edge computing device on the agricultural vehicle;

based the detected one or more neighbor modular edge computing devices, determine an ordinal position of the modular edge computing device relative to the plurality of modular edge computing devices;

determine, based on one or more time-of-flight sensor signals of the sensor signals, one or more distances to the one or more neighbor modular edge computing devices; and

determine one or more extrinsic parameters of the modular edge computing device based on the ordinal position and the one or more distances.

11. The modular edge computing device of claim 10 , further comprising instructions to:

determine a relative orientation of the modular edge computing device based on an observed orientation of one or more of the neighbor modular edge computing devices; and

set one or more intrinsic parameters of one or more of the contactless sensors based on the ordinal position of the modular edge computing device and the relative orientation.

12. The modular edge computing device of claim 10 , wherein one or more of the contactless sensors comprises a vision sensor, and the sensor signal generated by the vision sensor is indicative of a fiducial marker on a surface of one or more of the neighbor modular edge computing devices.

13. The modular edge computing device of claim 10 , wherein the circuitry is further configured to:

generate one or more instructions to alter an orientation or position of the given modular edge computing device based on one or more of the extrinsic parameters; and

cause output to be provided at one or more output devices, wherein the output conveys the one or more instructions.

14. A non-transitory computer-readable medium for automatically determining extrinsic parameters of a given modular edge computing device of a plurality of modular edge computing devices mounted on a vehicle, the medium comprising instructions that, in response to execution of the instructions by a processor of the given modular edge computing device, cause the processor to:

detect, based on one or more sensor signals generated by one or more contactless sensors of the given modular edge computing device, one or more neighbor modular edge computing devices of the plurality of modular edge computing devices that are mounted on the vehicle nearest the given modular edge computing device;

based the detected one or more neighbor modular edge computing devices, determine an ordinal position of the given modular edge computing device relative to the plurality of modular edge computing devices;

determine, based on one or more time-of-flight sensor signals of the sensor signals, one or more distances to the one or more neighbor modular edge computing devices; and

determine the extrinsic parameters of the given modular edge computing device based on the ordinal position of the given modular edge computing device and the one or more distances.

15. The non-transitory computer-readable medium of claim 14 , wherein one or more of the contactless sensors comprises a vision sensor.

16. The non-transitory computer-readable medium of claim 15 , wherein the sensor signal generated by the vision sensor is indicative of a fiducial marker on a surface of one or more of the neighbor modular edge computing devices.

17. The non-transitory computer-readable medium of claim 14 , further comprising instructions to detect an absolute orientation of the given modular edge computing device based on one or more of the sensor signals or one or more other sensor signals.

18. The non-transitory computer-readable medium of claim 1 , further comprising instructions to determine a relative orientation of the given modular edge computing device based on an observed orientation of one or more of the neighbor modular edge computing devices.

Assignments (3)
MERGER Recorded Jun 26, 2024
From: MINERAL EARTH SCIENCES LLC
To: DEERE & CO.
Reel/Frame 067848/0074 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 24, 2023
From: X DEVELOPMENT LLC
To: MINERAL EARTH SCIENCES LLC
Reel/Frame 062850/0575 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 4, 2022
From: GRANT, ELLIOTT; YAROSHENKO, SERGEY; LEVINE, GABRIELLA
To: X DEVELOPMENT LLC
Reel/Frame 058539/0392 →
Continuity (1)
Related Publication 20230120944A1 · Apr 20, 2023