System and method for simultaneous touch and voice control
For a mobile computing device, enhanced functionality may be provided by associating actions with combined speech and touch gestures. A touch gesture is received into the device and simultaneously or near-simultaneously speech is received into the device. The touch gesture and speech are processed to determine a result and the device performs an action based on the result. In particular embodiments, commands for a mapping application may be based on spoken search terms and geographic areas marked by touch gestures.
1. A method, comprising:
receiving speech via a wireless communications device;
receiving a touch gesture via the wireless communications device;
processing the speech and the touch gesture to determine a result of the combination of the speech and the touch gesture, wherein an order of receipt of said speech and said touch gesture is generated;
performing an action with the wireless communications device that is based on the result and the order of receipt, wherein the action is performed on a document and wherein an area of the document is identified by a combination of the touch gesture and the speech, wherein said action performed on said document is searching, and wherein said action performed is based on previous comments, previous ratings and similar searches of others users, and wherein said action performed is a new search request in a similar geographic area and within a similar time window of a similar search of other users;
reporting results to opted in wireless communication devices, wherein reporting the results includes displaying icons on the document indicating the other users who have performed the similar search in their respective current locations and icons indicating locations of the search results;
receiving an additional input to select the other users identified by the similar search; and
highlighting the search result that s in the best proximity to the user and the selected users.
2. The method of claim 1 wherein the touch gesture indicates a geographic area on a mapping application.
3. The method of claim 2 wherein the speech comprises one or more search terms.
4. The method of claim 3 wherein the action comprises executing a search of locations matching the search terms within the geographic area.
5. The method of claim 1 further comprising:
receiving a second speech input via a wireless communications device;
receiving a second touch gesture via the wireless communications device, wherein the touch gesture indicates an area of the document on which an action is to be performed and the speech indicates the action to be performed on the document area.
6. The method of claim 5 wherein the second speech input comprises a formatting command and wherein the touch gesture comprises the area of the document to be formatted.
7. The method of claim 5 wherein the second speech input comprises an emailing command and wherein the touch gesture comprises the area of the document to be emailed.
8. The method of claim 5 wherein the second speech input comprises a search command and wherein the touch gesture comprises the area of the document to be searched.
9. The method of claim 1 wherein the speech comprises an area of a document to search from and the touch gesture comprises a direction in which to search.
10. A wireless computing device configured to:
receive speech via the wireless computing device;
receive a touch gesture via the wireless computing device;
process the speech and the touch gesture to determine a result of the combination of the speech and the touch gesture, wherein an order of receipt of said speech and said touch gesture is generated;
perform an action with the wireless communications device that is based on the result and the order of receipt, wherein the action is performed on a document and wherein an area of the document is identified by a combination of the touch gesture and the speech, wherein said action performed on said document is searching, and wherein said action performed is based on previous comments, previous ratings and similar searches of other users, and wherein said action performed is a new search request in a similar geographic area and within a similar time window of a similar search of other users;
report results to opted in wireless communication devices, wherein reporting the results includes displaying icons on the document indicating the other users who have performed the similar search in their respective current locations and icons indicating locations of the search results;
receive an additional input to select the other users identified by the similar search; and
highlight the search result that is in the best proximity to the user and the selected users.
11. The wireless computing device of claim 10 wherein the touch gesture indicates a geographic area on a map application.
12. The wireless computing device of claim 11 wherein the speech comprises one or more search terms.
13. The wireless computing device of claim 12 wherein the action executes a search of locations that match the search terms within the geographic area.
14. The wireless computing device of claim 10
receiving a second speech input via a wireless communications device;
receiving a second touch gesture via the wireless communications device, wherein the touch gesture indicates the area of the document on which an action is to be performed and the speech indicates the action to be performed on the document area.
15. The wireless computing device of claim 14 wherein the second speech input comprises a format command and wherein the touch gesture comprises the area of the document to be formatted.
16. The wireless computing device of claim 14 wherein the second speech input comprises an email command and wherein the touch gesture comprises the area of the document to be emailed.
17. The wireless computing device of claim 14 wherein the second speech input comprises a search command and wherein the touch gesture comprises the area of the document to be searched.
18. The wireless computing device of claim 10 wherein the speech comprises an area of a document to search from and the touch gesture comprises a direction in which to search the document.
19. A non-transitory computer readable medium comprising executable instructions for: receiving speech via a wireless communications device;
receiving a touch gesture via the wireless communications device;
processing the speech and the touch gesture to determine a result of the combination of the speech and the touch gesture, wherein an order of receipt of said speech and said touch gesture is generated; and
performing an action with the wireless communications device that is based on the result and the order of receipt, wherein the action is performed on a document and wherein an area of the document is identified by a combination of the touch gesture and the speech, wherein said action performed on said document is searching, and wherein said action performed is based on previous comments, previous ratings and similar searches of others users, and wherein said action performed is a new search request in a similar geographic area and within a similar time window of a of the similar searches of others users; and in a similar time window of the similar search and
reporting results to opted in wireless communication devices, wherein reporting the results includes displaying icons on the document indicating the other users who have performed the similar search in their respective current locations and icons indicating locations of the search results;
receiving an additional input to select the other users identified by the similar search; and
highlighting the search result that is in the best proximity to the user and the selected users.
20. The non-transitory computer readable medium of claim 19 wherein the touch gesture indicates a geographic area on a mapping application, wherein the speech comprises one or more search terms and wherein the action comprises executing a search of locations matching the search terms within the geographic area.