Point-and-click control of unmanned, autonomous vehicle using omni-directional visors
View Patent ↗The proposed method outlines a new control mechanism well-suited for small, unmanned aerial vehicles traversing in a GPS-denied areas. It has the strong advantage of simplifying the interface, so that even an untrained operator can handle the difficult, dynamic problems encountered in closed quarters. The proposed system seamlessly integrates point-and-click control with way-point navigation, in an intuitive interface. An additional advantage of the proposed system is that it adds minimal hardware to the payload of the UAV, and can possibly, strongly diminish the bandwidth and delay effects of the communication channel.
1. A control system device comprising: a teleoperated vehicle;
an omnidirectional camera or wide field of view mounted on a vehicle;
a 3D display worn by an operator to visualize video or a sequence of images collected by the vehicle;
a communication mechanism between the vehicle and the operator
a display overlay that indicates to the operator a desired goal location of the vehicle; and
a virtual reality glove allowing the operator to select a distance along a trajectory displayed in a pair of 3D display stereo goggles worn by the operator.
2. The control system device of claim 1 , further comprising:
a control system on the teleoperated vehicle that computes a control command given a motion that occurred during a communications delay.
3. The control system device of claim 1 , further comprising:
a mechanism for inertial measurement of a head-mounted display worn by the operator; and translating/rotating the image displayed within the head-mounted display.
4. The control system device of claim 3 , wherein
the image, to the operator, would look as if there was a pan-tilt unit installed in the vehicle.
5. The control system device of claim 3 , wherein
the image show to the operator would look as if the vehicle has moved to a future location.
6. The control system device of claim 1 , further comprising:
a mechanism for inertial measurement of the vehicle; and
translating/rotating the images displayed to the operator.
7. The control system device of claim 1 , further comprising:
an indicator that displays distance to a possible collision.
8. The control system device of claim 7 , wherein
a control system displays how long it would take for the vehicle to arrive to a location assigned by the operator.
9. The control system device of claim 1 , further comprising:
an input device allowing the operator to select a distance along the trajectory displayed in the stereo goggles.
10. The control system device of claim 1 , wherein
obstacles are sensed by ladar, structure-from-motion, or stereo sensors.
11. The control system device of claim 10 , wherein
obstacles sensed by the ladar, structure-from-motion, or stereo sensor, are displayed in an operator's head-mounted display; and
obstacles senses are overlaid over a video stream.
12. The control system device of claim 1 , wherein
multiple operators can view an imagery and select different goal points.