CONTENT NAVIGATION AND SELECTION IN AN EYES-FREE MODE
Techniques are disclosed for facilitating the use of an electronic device having a user interface that is sensitive to a user's gestures. An “eyes-free” mode is provided in which the user can control the device without looking at the device display. Once the eyes-free mode is engaged, the user can control the device by performing gestures that are detected by the device, wherein a gesture is interpreted by the device without regard to a specific location where the gesture is made. The eyes-free mode can be used, for example, to look up a dictionary definition of a word in an e-book or to navigate through and select options from a hierarchical menu of settings on a tablet. The eyes-free mode advantageously allows a user to interact with the user interface in situations where the user has little or no ability to establish concentrated visual contact with the device display.
1 . A device comprising:
a touch sensitive surface for detecting gestures made by a user; and
a user interface including a manual mode in which the user interface is configured to respond to a content selection gesture by selecting a segment of displayed digital content, wherein the content selection gesture is responded to without regard to a particular location on the touch sensitive surface where said gesture is detected.
2 . The device of claim 1 , wherein the content selection gesture comprises a horizontal fling gesture.
3 . The device of claim 1 , wherein the selected segment of the displayed digital content is chosen from the group consisting of a selected word, a selected sentence and a selected paragraph.
4 . The device of claim 1 , further comprising a speaker, wherein the user interface is further configured to respond to the content selection gesture by aurally presenting the selected segment of the displayed digital content using the speaker.
5 . The device of claim 1 , further comprising a text-to-speech module, wherein the user interface is further configured to respond to the content selection gesture by generating an audio signal corresponding to the selected segment of the displayed digital content using the text-to-speech module.
6 . The device of claim 1 , wherein:
the user interface further includes an options overlay in which a plurality of command options are displayed on a display;
the user interface further includes a control overlay corresponding to a selected one of the plurality of command options displayed in the options overlay; and
the selected one of the plurality of command options is applied to the selected segment of the displayed digital content.
7 . The device of claim 1 , wherein:
the user interface further includes an options overlay in which a plurality of command options are displayed on a display;
the user interface further includes a control overlay corresponding to a selected one of the plurality of command options displayed in the options overlay;
detection of a forward transition gesture causes the user interface to transition (a) from the manual mode to the options overlay when the manual mode is active, and (b) from the options overlay to the control overlay when the options overlay is active; and
the forward transition gesture is responded to without regard to a particular location on the touch sensitive surface where said gesture is detected.
8 . The device of claim 1 , wherein:
the selected segment of the displayed digital content is a selected word; and
the user interface further includes (a) an options overlay in which a word definition function is displayed on a display, and (b) a control overlay in which a definition of the selected word is displayed on the display.
9 . The device of claim 1 , further comprising a speaker, wherein:
the selected segment of the displayed digital content is a selected word; and
the user interface further includes (a) an options overlay in which a word spelling function is displayed on a display, and (b) a control overlay in which the selected word is spelled aloud using the speaker.
10 . The device of claim 1 , wherein:
the device is selected from the group consisting of an e-reader, a tablet computer and a smartphone; and
the touch sensitive surface is a touch sensitive display.
11 . The device of claim 1 , further comprising:
a speaker; and
a text-to-speech module, wherein:
the user interface further includes a reading mode in which the text-to-speech module converts the displayed digital content into an audio signal that is aurally presented using the speaker,
detection of a transition command gesture causes the user interface to toggle back-and-forth between the reading and manual modes, and
the transition command gesture is responded to without regard to a particular location on the touch sensitive display where said gesture is detected.
12 . A mobile electronic device comprising:
a touch sensitive display for displaying digital content and detecting gestures made by a user;
a speaker;
a text-to-speech module; and
a user interface including (a) a reading mode in which the text-to-speech module converts the displayed digital content into an audio signal that is aurally presented using the speaker, and (b) a manual mode in which the playing of the audio signal generated by the text-to-speech module is paused, wherein:
detection of a transition command gesture causes the user interface to toggle back-and-forth between the reading and manual modes,
the user interface is configured to respond to a content selection gesture that is detected by the touch sensitive display while the user interface is in the manual mode by selecting a segment of the displayed digital content, and
the transition command gesture and the content selection gesture are responded to without regard to a particular location on the touch sensitive display where such gestures are detected.
13 . The mobile electronic device of claim 12 , wherein the content selection gesture is a multi-finger horizontal fling that results in selection of a selected word from the displayed digital content.
14 . The mobile electronic device of claim 12 , wherein the user interface is configured to not respond to the content selection gesture when the user interface is in the reading mode.
15 . The mobile electronic device of claim 12 , wherein the user interface is configured to only respond to the transition command gesture when in the reading mode.
16 . The mobile electronic device of claim 12 , wherein detection of the transition command gesture causes the user interface to play a mode transition announcement using the speaker.
17 . The mobile electronic device of claim 12 , wherein the user interface is configured to further respond to the content selection gesture by causing the selected segment of digital content to be aurally presented using the speaker.
18 . A non-transitory computer readable medium encoded with instructions that, when executed by at least one processor, cause a content selection process to be carried out, the process comprising:
displaying digital content on a display;
detecting a content selection gesture made on a touch sensitive surface;
responding to the content selection gesture by selecting a segment of displayed digital content, wherein the content selection gesture is responded to without regard to a particular location on the touch sensitive surface where said gesture is detected.
19 . The non-transitory computer readable medium of claim 18 , wherein the content selection process further comprises responding to the content selection gesture by highlighting the selected segment of the displayed digital content.
20 . The non-transitory computer readable medium of claim 18 , wherein the content selection process further comprises responding to the content selection gesture by aurally presenting the selected segment of the displayed digital content using a text-to-speech module and a speaker.