Wearable object locator and imaging system
View Patent ↗An object locator system for locating an object of interest in a scene. The locator system includes: a) a body mounted pedestrian localization unit worn by an operator; b) a hand-held rangefinder configured to be grasped by the operator; c) a pose sensor for estimating relative position and orientation of the hand-held rangefinder relative to the localization device; and d) a computer control system coupled to the pedestrian localization unit, the rangefinder, and the pose sensor, the computer control system being programmed to compute a relative location of the object with respect to the body worn localization unit using range data from the rangefinder and relative pose from the pose sensor, and transform the relative location to a global location using data from the pedestrian localization unit.
1. An object locator system for locating an object of interest in a scene, comprising:
a) a hand-held rangefinder configured to be grasped by the operator
b) a body mountable pedestrian localization unit configured to be worn by an operator spaced from said hand-held rangefinder;
c) a pose sensor for estimating relative position and orientation of said hand-held rangefinder relative to said localization device; and
d) a computer control system coupled to said pedestrian localization unit, said rangefinder, and said pose sensor, said computer control system being programmed to
compute a relative location of the object with respect to said body worn localization unit using range data from said rangefinder and relative pose from said pose sensor, and
transform the relative location to a global location using data from said pedestrian localization unit.
2. The system according to claim 1 wherein the body worn pedestrian localization unit includes a foot mounted sensor.
3. The system according to claim 1 wherein the body worn pedestrian localization unit includes a torso mounted sensor.
4. The system according to claim 2 wherein the foot mounted sensor is an inertial sensor.
5. The system according to claim 3 wherein the torso mounted sensor is an inertial sensor.
6. The system according to claim 1 wherein said sensor for estimating relative pose includes
a camera, and
a feature on the operator's body, and wherein said camera has a known spatial relationship with said rangefinder, said camera being configured to observe said feature on the operator's body with a known spatial relationship between said feature and said pedestrian localization unit.
7. The system according to claim 1 wherein said sensor for estimating relative pose is a 3D camera.
8. The system according to claim 6 wherein said feature is a visual target.
9. The system according to claim 6 wherein said feature is a visual target which is a designated part of clothing worn by the operator.
10. The system according to claim 1 wherein said sensor for estimating relative pose includes
a feature on said rangefinder, and
a camera configured for observing said feature on said rangefinder, said camera having a known spatial orientation to said pedestrian localization device.
11. The system according to claim 10 wherein said camera is mounted on a body part of the operator such that it has a field of view in which the feature is located.
12. The system according to claim 10 wherein the camera is a 3D camera providing one of range images and point-clouds.
13. The system according to claim 10 wherein said camera is a 2D camera that captures 2D images.
14. The system according to claim 10 wherein said feature is a visual target with a known spatial relationship to the rangefinder.
15. The system according to claim 1 wherein said hand-held rangefinder is coupled with an imaging camera.
16. The system according to claim 15 wherein said imaging camera is a 3D camera providing one of range images and point-clouds.
17. The system according to claim 15 wherein said imaging camera is a 2D camera that captures 2D images.
18. The system according to claim 15 wherein said imaging camera is configured to operate in any one or combination of visible, infra-red or UV spectrum.
19. The system according to claim 1 further comprising a light source mounted on said hand-held unit, said light source configured to emit light of selected frequencies for illuminating the scene being recorded.
20. The system according to claim 1 wherein said hand-held rangefinder is a laser rangefinder.
21. The system according to claim 6 wherein said computer control system is programmed to
analyse images from said pose sensor and compute a relative position and orientation (pose) of said feature,
compute a relative pose of the pedestrian localization unit computed using a known spatial relationship between said feature and said pedestrian localization unit, and
computing a location of the object of interest in a local coordinate system of said pedestrian localization unit using a measured distance between the hand-held rangefinder and said object of interest, the relative pose of the pedestrian localization unit from a known starting point and a known spatial relationship between the hand-held rangefinder and said pose sensor.
22. The system according to claim 1 further comprising a GNSS and optionally a compass coupled with said processor, and wherein said processor is programmed to transform the global location of the specified object of interest to an absolute location using said GNSS and compass.
23. The system according to claim 22 wherein said processor is programmed to transform all locations of objects of interest to an absolute coordinate system and visualisation in a Geographic Information System.
24. The system according to claim 23 wherein the processor is programmed to provide a location and heading relative to an initial location where the system is started or reset, and wherein the processor is programmed to assign this initial location and heading to a point on a global map of the environment manually or automatically using another global localisation system.
25. A method of locating an object of interest in a scene, comprising:
a) attaching a body worn pedestrian localization unit to a part of an operator's body;
b) aiming a hand-held rangefinder at an object of interest and obtaining distance data of the object of interest from the hand-held rangefinder, the body worn pedestrian localization unit being mounted to the operator's body space from the hand-held rangefinder;
c) estimating a relative position and orientation of said hand-held rangefinder relative to said localization device using a pose sensor; and
d) computing a relative location of the object of interest with respect to said body worn localization unit using the distance data and the estimated relative pose from said pose sensor, and transforming the relative location to a global location using data from said pedestrian localization unit.
26. The method according to claim 25 wherein the body worn pedestrian localization unit includes a foot mounted sensor.
27. The method according to claim 25 wherein the body worn pedestrian localization unit includes a torso mounted sensor.
28. The method according to claim 26 wherein the foot mounted sensor is an inertial sensor.
29. The system according to claim 27 wherein the torso mounted sensor is an inertial sensor.
30. The method according to claim 25 wherein said feature is mounted on the operator's body, and wherein the sensor for estimating relative pose is a camera coupled with said rangefinder observing said feature mounted on the operator's body with a known spatial relationship between said feature and said pedestrian localization unit.
31. The method according to claim 25 wherein said feature is mounted on said rangefinder, and wherein said sensor for estimating relative pose is a camera observing said feature on said rangefinder, said camera having a known spatial orientation to said pedestrian localization device.
32. The method according to claim 25 including capturing images of the object of interest using an imaging camera coupled with the hand-held rangefinder.
33. The method according to claim 32 wherein said imaging camera is configured to operate in any one or combination of visible, infra-red or UV spectrum.
34. The method according to claim 25 further comprising illuminating the scene being recorded with light of selected wavelengths.
35. The method according to claim 25 further comprising coupling a GNSS and optionally a compass coupled with said operator and the computer control system, and wherein the computer control system is programmed to transform the global location of the object interest to an absolute location using said GNSS and compass.
36. The method according to claim 35 wherein said computer control system is programmed to transform all locations of objects of interest to an absolute coordinate system and visualisation in a Geographic Information System.
37. The method according to claim 36 wherein the processor is programmed to provide a location and heading relative to an initial location where the system is started or reset, and wherein the processor is programmed to assign this initial location and heading to a point on a global map of the environment manually or automatically using another global localisation system.