Optical system for tracking the heading and position of an implement compared to the pulling tractor and other uses
Methods, apparatus, and systems for sensing or tracking relative position between objects or locations. A digital camera or imager captures one or more fiducials in its field of view. By calibration and processing, the imaged fiducials can be identified and distinguished from other objects and background in camera space, and position of imaged fiducials in camera space relative to a reference can be translated to position of the actual fiducials in physical space. In one example, the fiducials are IR LEDs.
1. A method of tracking position of a second object relative to a first object, wherein the first object is a motor vehicle and the second object is towed by the vehicle, moving relative the vehicle, or fixed in position relative the vehicle, the method comprising:
a. designating at least one fiducial on the second object, the fiducial comprising at least one of:
i. a light source on the second object;
ii. an inherent feature of the second object;
b. mounting an optical imaging sensor on the first object, the optical imaging sensor:
i. having a field-of-view to capture the fiducial(s) in relevant relationships of the second object to the first object; and
ii. capable of identifying imaged fiducial(s) acquired in the field-of-view;
c. estimating position of the second object in physical space without acquired geospatial data of position of the second object by combining analysis of the acquired fiducial(s) in camera space with offset of the second object from a reference or calibration differentiated by analysis of the imaged fiducials in camera space relative to:
i. a single plane including one of horizontal and vertical;
ii. two planes including horizontal and vertical; or
iii. three planes including horizontal, vertical, and depth;
d. using estimated position of the second object immediately during movement of the first object or logged for retrieval and use later.
2. The method of claim 1 wherein the optical imaging sensor comprises a digital camera adapted to produce a camera-space coordinate system correlated to a 2-D plane or 3-D coordinates in physical space.
3. The method of claim 1 wherein the light source is an LED.
4. The method of claim 3 wherein the light source is an IR LED.
5. The method of claim 1 wherein the light source is a plurality of light sources comprising:
a. a pair of light sources spaced apart in a plane;
b. three or more light sources in a pre-designed geometric relationship to one another in a single plane or multiple planes; or
c. three or more light sources with at least one light source in a different plane than the others.
6. The method of claim 1 wherein the fiducial is an inherent point, feature, or pattern on the second object which can be detected, identified, and distinguished in camera space.
7. The method of claim 1 wherein the fiducial(s) are detected, identified, and distinguished by machine-learning, training, image recognition, or references based on shape or a grid.
8. The method of claim 3 wherein each LED light source comprises one or more of a pre-selected intensity, duty cycle, and emission band when operating.
9. The method of claim 1 wherein the first object is a tractor and the second object is a towed implement, and the use of the estimation second object position is used during movement of the tractor and towed implement or logged for retrieval and use during another pass with a different implement at a later time.
10. A method of monitoring whether a tow-behind implement attached to a tractor at a hitch point is aligned with the tractor comprising:
a. mounting a set of spaced-apart light sources on the implement behind the hitch point without any electrical communication between the light sources and the tractor;
b. mounting a digital camera on the tractor, the camera having a field-of-view (FOV) that includes at least a substantial range of positions of the implement during use;
c. calibrating the FOV of view of the camera relative a calibration position correlated to physical space; and
d. during use, tracking the position of images of the light sources captured in the camera FOV relative to the calibration position;
e. correlating offset of the light sources from calibration position to direction and magnitude of offset of the implement from the tractor without acquired geospatial data of position of the light sources on the second object;
f. using the correlation immediately during movement of the tractor or logging the correlation for retrieval and use later.
11. The method of claim 10 wherein the light sources each comprise an LED with a power source on a mounting interface to mount to the implement.
12. The method of claim 10 wherein the calibrating comprises training, image recognition, or references based on shape or a grid.
13. The method of claim 10 further comprising using the tracking of the position of the images of the light sources to steer the tractor.
14. A system of monitoring or tracking position of a second object relative to a moving first object comprising:
a. at least one fiducial on the second object without any electrical communication between the fiducial(s) and the first object, each of the fiducial(s) comprising at least one of:
i. a light source on the second object; and
ii. an inherent feature of the second object;
b. an optical imaging sensor mounted on the first object, the optical imaging sensor:
i. having a field of view to capture the fiducial(s) in relevant relationships of the second object to the first object;
ii. capable of identifying imaged fiducial(s) acquired in the field-of-view;
c. a processor or display adapted for estimating position of the second object in physical space by analysis of the acquired fiducial(s) in camera space relative to a calibration position correlated to physical space without acquired geospatial data of position of the light sources on the second object; and
d. producing an output of estimated position of the second object relative the first object based on the correlation.
15. The system of claim 14 wherein the optical imaging sensor comprises a digital camera adapted to produce a camera-space coordinate system correlated to a 2-D plane or 3-D coordinates in physical space.
16. The system of claim 14 wherein the fiducials comprise IR LEDs, each at one or more of a pre-selected intensity, duty cycle, and emission band when operating.
17. The system of claim 14 wherein the fiducials comprise inherent features of the second object that can be trained for camera space recognition by image recognition software.
18. The system of claim 14 wherein the fiducials comprise a plurality or cloud of fiducials.
19. The system of claim 14 wherein the first object is a motive source and the second object is a towed implement.
20. The system of claim 14 wherein the first object is independent of the second object.
21. The system of claim 14 including a processor to store the estimated position for use with a follow along pass of the first object through the physical space after a first pass.
22. The system of claim 14 wherein the processor further comprises software for at least one of:
a. filtering irrelevant content from the acquired image of the second object; and
b. compensating for drift of the first object relative to a pre-determined path through the physical space.
23. The system of claim 14 wherein the calibration position is generated by training, image recognition, or references based on shape or a grid.