Selecting multimodal elements

1. An apparatus comprising:

a processor; and

a memory that stores code executable by the processor, the code comprising:

code that receives a coarse-grained indication to locate a coarse-grained portion of an editable electronic document;

code that receives an audio signal, the audio signal comprising:

a fine-grained indication to locate a fine-grained portion of the coarse-grained portion,

a user command to be performed on content of the electronic document in the fine-grained portion, and

a sound pitch of a plurality of sound pitches;

code that, in response to receiving the audio signal, examines a predetermined quantity of previous coarse-grained indications to determine whether the previous coarse-grained indications include the fine-grained portion; and

code that:

ignores the user command in response to determining that the user command does not match the fine-grained portion indicated in one of the previous coarse-grained indications of the predetermined quantity of previous coarse-grained indications, and

executes the user command on the fine-grained portion in response to determining that the user command matches the fine-grained portion indicated in one of the previous coarse-grained indications of the predetermined quantity of previous coarse-grained indications,

wherein:

the electronic document comprises one of a plain text document and a word processing document,

the coarse-grained portion is a sub-portion of the electronic document,

the fine-grained portion is a sub-portion of the coarse-grained portion,

each of the plurality of sound pitches is mapped to a respective user command,

the sound pitch in the audio signal is a particular sound pitch mapped to the user command, and

the user command is a particular user command that rearranges data in the content of the electronic document, and

one of the coarse-grained portion and the fine-grained portion comprises a set of paragraphs.

2. The apparatus of claim 1 , wherein the code further comprises code that parses the electronic document into a plurality of portions, the fine-grained portion selected from the plurality of portions.

3. The apparatus of claim 2 , wherein the code that parses further parses the electronic document into a hierarchal structure of elements, the fine-grained portion comprising one of the elements.

4. The apparatus of claim 1 , wherein the code further comprises code that determines the fine-grained portion based on the coarse-grained indication and the audio signal.

5. The apparatus of claim 1 , wherein the coarse-grained indication is selected from the group consisting of a touch indication, a gaze indication, and an audio indication.

6. The apparatus of claim 1 , wherein a portion of the executable code is implemented as code selected from the group consisting of a library and an application programming interface, the fine-grained portion selected from the group consisting of the whole electronic document, a page, a paragraph, a sentence, a word, a character, a table, a cell, a chart, an image, a link, and an embedded object.

7. A method comprising:

receiving a coarse-grained indication to locate a coarse-grained portion of an editable electronic document;

receiving an audio signal, the audio signal comprising:

a fine-grained indication to locate a fine-grained portion of the coarse-grained portion,

a user command to be performed on content of the electronic document in the fine-grained portion, and

a sound pitch of a plurality of sound pitches;

in response to receiving the audio signal, examining a predetermined quantity of previous coarse-grained indications to determine whether the previous coarse-grained indications include the located fine-grained portion;

ignoring the user command in response to determining that the user command does not match the located fine-grained portion indicated in one of the previous coarse-grained indications of the predetermined quantity of previous coarse-grained indications; and

executing the user command on the fine-grained portion in response to determining that the user command matches the located fine-grained portion indicated in one of the previous coarse-grained indications of the predetermined quantity of previous coarse-grained indications,

wherein:

the electronic document comprises one of a plain text document and a word processing document,

the coarse-grained portion is a sub-portion of the electronic document,

the fine-grained portion is a sub-portion of the coarse-grained portion,

each of the plurality of sound pitches is mapped to a respective user command,

the sound pitch in the audio signal is a particular sound pitch mapped to the user command, and

the user command is a particular user command that rearranges data in the content of the electronic document, and

one of the coarse-grained portion and the fine-grained portion comprises a set of paragraphs.

8. The method of claim 7 , further comprising parsing the electronic document in a plurality of portions, the fine-grained portion selected from the plurality of portions.

9. The method of claim 7 , further comprising parsing the electronic document into a hierarchal structure of elements, the fine-grained portion comprising one of the elements.

10. The method of claim 7 , further comprising determining the fine-grained portion based on the coarse-grained indication and the audio signal.

11. The method of claim 7 , further comprising determining the user command represented by the audio signal using voice recognition.

12. The method of claim 7 , wherein the coarse-grained indication is selected from the group consisting of a touch indication, a gaze indication, and an audio indication.

13. A program product comprising a computer-readable hardware storage device that stores code executable by a processor, the executable code comprising code to perform:

receiving a coarse-grained indication to locate a coarse-grained portion of an editable electronic document;

receiving an audio signal, the audio signal comprising:

comprising a fine-grained indication to locate a fine-grained portion of the coarse-grained portion,

a user command to be performed on content of the electronic document in the fine-grained portion, and

a sound pitch of a plurality of sound pitches;

in response to receiving the audio signal, examining a predetermined quantity of previous coarse-grained indications to determine whether the previous coarse-grained indications include the located fine-grained portion;

ignoring the user command in response to determining that the user command does not match the located fine-grained portion indicated in one of the previous coarse-grained indications of the predetermined quantity of previous coarse-grained indications; and

executing the user command on the fine-grained portion in response to determining that the user command matches the located fine-grained portion indicated in one of the previous coarse-grained indications of the predetermined quantity of previous coarse-grained indications,

wherein:

the electronic document comprises one of a plain text document and a word processing document,

the coarse-grained portion is a sub-portion of the electronic document,

the fine-grained portion is a sub-portion of the coarse-grained portion,

each of the plurality of sound pitches is mapped to a respective user command,

the sound pitch in the audio signal is a particular sound pitch mapped to the user command, and

the user command is a particular user command that rearranges data in the content of the electronic document, and

one of the coarse-grained portion and the fine-grained portion comprises a set of paragraphs.

14. The program product of claim 13 , the code further parses the electronic document into a plurality of portions, the fine-grained portion selected from the plurality of portions.

15. The program product of claim 13 , the code further parses the electronic document into a hierarchal structure of elements, the fine-grained portion comprising one of the elements.

16. The program product of claim 13 , the code further determines the fine-grained portion based on the coarse-grained indication and the audio signal.

17. The program product of claim 13 , the code further determines the user command represented by the audio signal using voice recognition.

18. The program product of claim 13 , wherein the coarse-grained indication is selected from the group consisting of a touch indication, a gaze indication, and an audio indication.

19. The program product of claim 13 , wherein a portion of the executable code is implemented as code selected from the group consisting of a library and an application programming interface, the fine-grained portion selected from the group consisting of the whole electronic document, a page, a paragraph, a sentence, a word, a character, a table, a cell, a chart, an image, a link, and an embedded object.