System for man-machine interaction in vehicles
A system for man-machine interaction for a vehicle is disclosed. The proposed system includes an interactive reflected display on a windscreen of the vehicle; an eye tracking module including an eye gaze tracker for tracking eye gaze direction of a user, and a training unit to train the tracking module using a neural network to predict a real-time set of coordinates for eye gaze direction of the user based on a created reference data set of coordinates of the display; a finger tracking module to detect presence of a finger of the user and track movement of the finger; a cursor module configured to, on the basis of a received input, move a cursor on the display to an area of interest on the display; and a wireless switch module operatively coupled to the display for selecting a target in the area of interest on the display.
1. A system for man-machine interaction, the system comprising:
an interactive display, wherein the interactive display is reflection from a screen of a display device on an inclined and/or a curved surface, wherein the inclined and/or the curved surface is a windscreen of a vehicle, and wherein the display device is selected from a group consisting of a tablet computer, a personal digital assistance, and a mobile smart phone; and
an eye gaze tracking module, the eye gaze tracking module comprising:
an eye gaze tracker for tracking eye gaze direction of a user,
wherein a training unit is to train the eye gaze tracking module using a neural network to predict a real-time set of coordinates for the eye gaze direction of the user based on a created reference data set of coordinates of the display.
2. The system as claimed in claim 1 , wherein the system further comprises a finger tracking module to detect presence of a finger of the user and track movement of the finger, a cursor module configured to, on the basis of a received input, move a cursor on the display to an area of interest on the display, and a wireless switch module operatively coupled to the interactive display, wherein the wireless switch module is configured for selecting a target in the area of interest on the display based on position of the cursor on the display.
3. The system as claimed in claim 2 , wherein the input of the cursor module is any of the eye gaze direction of the user from the eye gaze tracking module and the presence of the finger from the finger tracking module.
4. The system as claimed in claim 2 , wherein a precedence is given to a signal from the finger tracking module over a signal from the eye gaze tracking module, and the position of the cursor on the display is corrected based on detected movement of the finger by moving the cursor in direction of the detected movement of the finger, and wherein when the finger tracking module does not locate the finger of the user within its field, the system resumes to move the cursor based on the detected eye gaze direction of the user.
5. The system as claimed in claim 2 , wherein the system further comprises a processor operatively coupled to the eye gaze tracking module, the finger tracking module, the interactive display, the cursor module, and the wireless switch module.
6. The system as claimed in claim 1 , wherein the reference data set of coordinates of the display is created based on a set of coordinates for the display determined by the eye gaze tracking module for a corresponding eye gaze direction for each of a plurality of test users.
7. The system as claimed in claim 1 , wherein the system further comprises a median filter configured to take median of pixels of continuously recorded eye gaze positions on the display by the eye gaze tracking module.
8. The system as claimed in claim 1 , wherein the system further comprises a target prediction unit that highlights a clickable object nearest to a cursor position on the display to the area of interest on the display.
9. The system as claimed in claim 8 , wherein the highlighting of the clickable object is based on hotspots associated with each clickable object.
10. The system as claimed in claim 9 , wherein the hotspots associated with different clickable objects are selected based on minimizing value of cost function:
∑
∀
d
ij
1
d
ij
2
,
where d ij is distance between new hotspots on clickable objects i and j.
11. The system as claimed in claim 9 , wherein a new hotspot is selected even if increasing value of the cost function, based on the following condition:
e
(
oldCostFn
-
newCostFn
)
T
>
a
random
number
between
0
and
1.
where T runs from 5000 to 1 and reduced by 1 in each iteration.