MOBILE GAZE INPUT SYSTEM FOR PERVASIVE INTERACTION
A mobile gaze-tracking system is provided. The user operates the system by looking at the gaze tracking unit and at pre-defined regions at the fringe of the tracking unit. The gaze tracking unit may be placed on a smartwatch, a wristband, or woven into a sleeve of a garment. The unit provides feedback to the user in response to the received command input. The unit provides feedback to the user on how to position the mobile unit in front of his eyes. The gaze tracking unit interacts with one or more controlled devices via wireless or wired communications. Example devices include a lock, a thermostat, a light or a TV. The connection between the gaze tracking unit may be temporary or longer-lasting. The gaze tracking unit may detect features of the eye that provide information about the identity of the user.
1 . A method comprising:
detecting, by a mobile device, a device to be controlled;
connecting the mobile device to the device to be controlled over a wireless connection;
detecting, by the mobile device, a gaze input; and
transmitting the gaze input to the device to be controlled.
2 . The method of claim 1 , wherein:
the gaze input is one of a plurality of gaze inputs;
the device to be controlled is a door; and
the method further comprises:
receiving, by the device to be controlled, the plurality of gaze inputs;
comparing, by the device to be controlled, the plurality of gaze inputs
to a predetermined series of gaze inputs; and
based on the plurality of gaze inputs matching the predetermined series of gaze inputs, unlocking the door.
3 . The method of claim 1 , wherein the device to be controlled is a thermostat; and
the method further comprises:
receiving, by the thermostat, the gaze input; and
in response to receiving the gaze input, changing a temperature of the thermostat.
4 . The method of claim 1 , further comprising:
receiving, by the mobile device, data from the device to be controlled; and
presenting, on a display of the mobile device, the received data.
5 . The method of claim 1 , wherein the gaze input is in a direction and includes a degree in the direction.
6 The method of claim 1 , wherein the mobile device is a wearable device.
7 . The method of claim 6 , wherein:
the wearable device is worn on a wrist of a user; and
the gaze input corresponds to a control region selected from the group consisting of a back of a hand, a forearm, above an arm, and below the arm.
8 . The method of claim 1 , further comprising:
prior to the connecting of the mobile device to the device to be controlled over the wireless connection, detecting, by the mobile device, an initial gaze input; and wherein
the connecting of the mobile device to the device to be controlled is in response to the detection of the initial gaze input.
9 . The method of claim 1 , wherein the gaze input is selected from the group consisting of: a look-away input, a dwell-time activation input, a gesture activation input, and a pursuit activation input.
10 . The method of claim 1 , further comprising:
connecting the mobile device to a second device including a display; and
causing presentation on the display of information regarding the device to be controlled.
11 . The method of claim 1 , further comprising:
providing, on the mobile device, visual feedback to the receiving of the gaze input.
12 . The method of claim 11 , wherein the visual feedback comprises a directional indicator based on the gaze input.
13 . The method of claim 11 , wherein the visual feedback comprises a distance indicator based on the gaze input.
14 . The method of claim 1 , further comprising:
providing, on the mobile device vibration feedback to the receiving of the gaze input.
15 . The method of claim 1 , further comprising:
providing, on the mobile device, audio feedback to the receiving of the gaze input.
16 . A system comprising:
a memory storing instructions;
a display; and
one or more processors configured by the instructions to perform operations comprising:
connecting to a device to be controlled;
receiving data from the device to be controlled;
displaying the received data on the display;
detecting a direction of a user's gaze;
causing an adjustment of the displayed data based on the detected direction; and
transmitting the adjustment to the device to be controlled.
17 . The system of claim 16 , wherein:
the direction of the user's gaze is one of a sequence of gaze directions;
the device to be controlled is a door; and
the method further comprises:
receiving, by the device to be controlled, the sequence of gaze directions;
comparing, by the device to be controlled, the sequence of gaze directions to a predetermined sequence of gaze directions; and
based on the sequence of gaze directions matching the predetermined sequence of gaze directions, unlocking the door.
18 . The system of claim 16 , wherein:
the device to be controlled is a thermostat; and
the operations further comprise:
receiving, by the thermostat, the adjustment; and
in response to receiving the adjustment changing a temperature of the thermostat.
19 . The system of claim 16 , wherein the operations further comprise:
receiving data from the device to be controlled; and
presenting, on the display, the received data.
20 . A machine-readable storage medium storing instructions which, when executed by one or more processors, cause the one or more processors to perform operations comprising:
determining that a user's eyes cannot be detected by an eye-tracking sensor;
determining a direction of motion of the eye-tracking sensor suitable for allowing the user's eyes to be detected by the eye-tracking sensor; and
displaying an indicator of the direction of motion.