A vehicular gesture control system includes sensors such as IoT (internet of things) sensors that can share data with other vehicles and that can communicate with the cloud to provide intelligent handling of the vehicle.
1. A method for controlling a vehicle, the method comprising:
generating a multi-dimensional model of a vehicle operating in a 3D environment;
determining a hand control gesture as captured by a plurality of cameras or sensors in the vehicle, wherein a sequence of finger, palm or hand movements represents a vehicle control request based on at least the multi-dimensional model, and wherein the proximity of the finger, palm or hand configuration over a vehicle component selects the vehicle component for control;
moving a finger, palm, or hand in a predetermined sequence to actuate the vehicle component;
determining vehicle control options based on the model, a current state of the vehicle and the environment of the vehicle; and
controlling the vehicle to operate based on the model and the 3D environment, and the sequence of finger, palm, or hand movement in response.
2. The method of claim 1 , further comprising detecting a hand movement as mouse movement or mouse clicks to control the vehicle.
3. The method of claim 1 , further comprising controlling a car window position using an arm gesture and finger gesture and exiting by forming a fist.
4. The method of claim 1 , further comprising controlling a seat position using an arm gesture and a figure gesture, comprising moving the seat as specified by an arm angular movement.
5. The method of claim 1 , further comprising unlocking a hood or a trunk using an arm gesture and a figure gesture, wherein to open the trunk a driver makes a right angular movement and an opposite movement for unlocking the hood.
6. The method of claim 1 , further comprising controlling temperature of a driver and front passenger seats using an arm gesture and a finger gesture, wherein the number of fingers affect a seat temperature.
7. The method of claim 1 , further comprising performing a left arm gesture based navigation control for a car.
8. The method of claim 1 , further comprising activating a positioning system and selecting start and destination using gestures.
9. The method of claim 1 , further comprising controlling a mirror position with gesture based control.
10. The method of claim 1 , further comprising controlling music using hand gesture.
11. The method of claim 1 , further comprising controlling vehicle temperature with a hand gesture.
12. The method of claim 1 , further comprising controlling sound volume using a gesture.
13. The method of claim 1 , further comprising controlling sun roof opening and closure using a gesture.
14. The method of claim 1 , further comprising controlling wind shield wipers with a gesture.
15. The method of claim 1 , further comprising controlling operation of a rear view mirror.
16. The method of claim 1 , further comprising gesturing on a steering wheel to make calls, receive and respond to texts, launch apps, get turn-by-turn directions, find the nearest other local businesses, play music, or search the Internet while driving.
17. The method of claim 1 , further comprising controlling an air conditioning system.
18. The method of claim 1 , further comprising recognizing a combination of gestures to create a custom gesture control.
19. The method of claim 1 , further comprising ultrasonic sensors to detect gestures.
20. The method of claim 1 , further comprising rendering a display or sound or tactile feedback for a detected gesture.