Method and apparatus for an eye tracking wearable computer
An embodiment of an Eye Tracking Wearable Computer apparatus includes a first portable unit for data gathering and communicating feedback and a second portable unit for processing the at least gathered data from the first unit. The first portable unit includes an eyeglass frame, at least one first optical unit disposed on the eyeglass frame for capturing at least one scene image corresponding to a field of view of a user, at least one second optical unit disposed on the eyeglass frame for capturing at least one eye image corresponding to at least a portion of at least one eye of the user, at least one microphone to allow the user to communicate via voice, at least one speaker to allow the user to receive feedback via voice, at least one visible light source to allow the user to receive feedback via light signals, at least one motion sensor to monitor the head movements of the user, and at least one first processor to at least receive data from the data gathering units in the first portable unit and at least manage the communication with the second portable unit. The second portable unit is in communication with the first portable unit and includes at least one second processor configured for receiving the at least data from the first processor and decoding a pre-defined command from the user and executing at least one command in response to the received command. At least one of the processors will determine a direction within the field of view to which the at least one eye is directed based upon the at least a history of one eye image, and generates a command or a subset of the at least one scene image based on the determined direction. At least one of the processors will provide a feedback to the user to acknowledge the user command received. In one embodiment, the Wearable Computer will function as a driver assistant and in another embodiment as a cameraman.
1. An apparatus of a wearable computer comprising:
a first portable unit including:
an eyeglass frame to be worn by a user;
at least one first scene camera disposed on the eyeglass frame, for capturing at least one scene image corresponding to a field of view of the user;
at least one accelerometer disposed on the eyeglass frame for tracking at least the head movement of the user and generating at least one signal corresponding to at least a duration of head movement of the user
at least one digital compass disposed on the eyeglass frame for tracking at least the direction of the user's head and generating at least one output corresponding to at least a direction of the user's head;
at least one microphone disposed on the eyeglass frame for capturing at least a duration of the voice of the user;
at least one speaker disposed on the eyeglass frame for providing at least a feedback to the user via voice; and
at least one first processor disposed on the eyeglass frame:
communicating with the at least one first scene camera, the at least one accelerometer, the at least one digital compass, the at least one microphone, and the at least one speaker,
receiving the at least one first scene image from the at least one first scene camera, the at least one signal from the at least one accelerometer, the at least one signal from the at least one microphone, and the at least one output from the at least one digital compass, and
transmitting a subset of the at least one first scene image from the at least one first scene camera, the at least one signal from the at least one accelerometer, the at least one signal from the at least one microphone, and the at least one output from the at least one digital compass;
a second portable unit including:
at least one second processor, communicating at least with the at least one first processor disposed on the first portable unit, and configured for:
receiving from the at least one first processor:
the subset of the at least one first scene image from the at least one first scene camera, the at least one signal from the at least one accelerometer, the at least one signal from the at least one microphone, and the at least one output from the at least one digital compass,
determining a head direction of the user from the at least one output from the at least one digital compass,
maintaining at least one history of the user's head movement based on at least a portion of the received signal from the at least one accelerometer,
utilizing at least signal processing to recognize as least one word in the at least one signal from the at least one microphone,
providing a feedback to the user via the at least one speaker based on the at least one recognized word in the at least one signal from the at least one microphone,
utilizing image processing to recognize as least one object in the subset of the at least one first scene image, and
taking at least one action based on the at least one recognized object in the subset of the at least one first scene image.
2. The apparatus of the wearable computer of claim 1 , further including at least one first eye tracking camera disposed on the eyeglass frame, directed towards one eye of the user, for capturing at least a plurality of eye images corresponding to at least a portion of one eye of the user and transmitting the plurality of eye images to the at least one first processor.
3. The apparatus of the wearable computer of claim 2 , wherein the at least one first processor determining a gaze direction of the user based on at least one eye image captured by the at least one first eye tracking camera and utilizing the determined gaze direction to select a subset of the at least one first scene image.
4. The apparatus of the wearable computer of claim 3 , wherein the at least one first processor configuring the at least one first scene camera based on the determined gaze direction.
5. The apparatus of the wearable computer of claim 1 , further including at least one second scene camera disposed on the eyeglass frame, for capturing at least one second scene image corresponding to at least a subset of the scene outside the field of view of the user and transmitting the at least one second scene image to the at least one first processor.
6. The apparatus of the wearable computer of claim 1 , further including at least one GPS sensor disposed on the second portable unit for tracking the physical location of the user and generating at least one signal corresponding to at least one physical location of the user and transmitting the at least one signal corresponding to the at least one physical location of the user to the at least one second processor.
7. The apparatus of the wearable computer of claim 6 , wherein the at least one second processor receiving the at least one GPS signal and maintaining at least one history of the user's location based on at least a portion of the received signal from the at least one GPS sensor.
8. The apparatus of the wearable computer of claim 1 , wherein the at least one action is providing an audio feedback to the user via the at least one speaker.
9. The apparatus of the wearable computer of claim 1 , wherein the at least one action is to instruct the user to take at least one action.
10. The apparatus of the wearable computer of claim 5 , wherein the at least one action is requesting the at least one second scene image from the at least one second scene camera via the at least one processor.
11. The apparatus of the wearable computer of claim 1 , wherein the second portable unit further including at least one wireless transceiver, in communication with the at least one second processor, for data communication with at least another wireless device.
12. The apparatus of the wearable computer of claim 11 , wherein the at least one action is contacting a remote person via the at least one wireless transceiver.
13. The apparatus of the wearable computer of claim 11 , wherein the at least one wireless transceiver is a WIFI transceiver.
14. The apparatus of the wearable computer of claim 11 , wherein the at least one wireless transceiver is a cellular transceiver.
15. The apparatus of the wearable computer of claim 12 , wherein the remote person provides a feedback to the user via the at least one speaker.
16. The apparatus of the wearable computer of claim 12 , wherein the at least one second processor further configured for providing at least one head direction of the user to the remote person.
17. The apparatus of the wearable computer of claim 7 , wherein the at least one second processor configured for providing at least one physical location of the user to the remote person.
18. The apparatus of the wearable computer of claim 1 , wherein the second portable unit further including at least one Bluetooth transceiver being in communication with the at least one second processor, for data communication with another Bluetooth transceiver.
19. The apparatus of the wearable computer of claim 1 , wherein the first portable unit further including at least one Bluetooth transceiver being in communication with the at least one first processor, for data communication with another Bluetooth transceiver.
20. The apparatus of the wearable computer of claim 1 , wherein the at least one first portable unit further including a heart beat sensor to measure the heart beat of the user, wherein the heart beat sensor is in communication with the at least one first processor.