Multimodal natural language query system and architecture for processing voice and proximity-based queries

1. A natural language query system processing voice and proximity-based queries, comprising:

a device, comprising:

a speech input module receiving a voice-based query in natural language form from a user; and

a location/proximity module receiving location/proximity information from a location/proximity device;

a speech conversion module converting the voice-based query in natural language form to text in natural language form;

a natural language processing module converting the text in natural language form to text in searchable form using lexicons and grammar rules to parse sentences and determine underlying meanings of the voice-base query, wherein the underlying meanings are further determined responsive to the location/proximity information from the location/proximity module;

a semantic engine module converting the text in searchable form to a formal database query; and

a database-look-up module using the formal database query to obtain a result related to the voice-based query in natural language form from a database, wherein the location/proximity module is configured to provide a context and environment to the database-look-up module narrowing and streamlining the formal database query associated with the voice-based query, and wherein the narrowing and streamlining is responsive to the location/proximity information.

2. The natural language query system of claim 1 , wherein the device comprises a device selected from the group consisting of a Web-enabled portable personal computer, a Web-enabled laptop computer, a Web-enabled personal digital assistant, and a Web-enabled phone.

3. The natural language query system of claim 1 , wherein the speech input module comprises a speech plug-in and a microphone.

4. The natural language query system of claim 1 , wherein the location/proximity module comprises a location/proximity module selected from the group consisting of a radio frequency identification reader and a global positioning system.

5. The natural language query system of claim 1 , wherein the location/proximity device comprises a location/proximity device selected from the group consisting of a radio frequency identification tag and a satellite.

6. The natural language query system of claim 1 , wherein the speech conversion module resides in a speech server located remotely from the device.

7. The natural language query system of claim 1 , wherein the natural language processing module resides in a server located remotely from the device.

8. The natural language query system of claim 1 , wherein the semantic engine module resides in a database server located remotely from the device.

9. The natural language query system of claim 1 , wherein the database look-up module resides in a database server located remotely from the device.

10. The natural language query system of claim 1 , further comprising a speech output module for delivering the result related to the voice-based query in natural language form to the user.

11. A natural language query architecture stores on a computer readable storage media processing voice and proximity-based queries, comprising:

a Web-enabled device, comprising:

a speech plug-in receiving a voice-based query in natural language form from a user; and

a location/proximity plug-in receiving location/proximity information from a location/proximity device;

a speech conversion algorithm converting the voice-based query in natural language form to text in natural language form;

a natural language processing algorithm converting the text in natural language form to text in searchable form using lexicons and grammar rules to parse sentences and determine underlying meanings of the voice-base query, wherein the underlying meanings are further determined responsive to the location/proximity information from the location/proximity plug-in;

a semantic engine algorithm converting the text in searchable form to a formal database query; and

a database-look-up algorithm using the formal database query to obtain a result related to the voice-based query in natural language form from a database, wherein the location/proximity plug-in is configured to provide a context and environment to the database-look-up algorithm narrowing and streamlining the formal database query associated with the voice-based query, and wherein the narrowing and streamlining is responsive to the location/proximity information.

12. The natural language query architecture of claim 11 , wherein the Web-enabled device comprises a Web-enabled device selected from the group consisting of a Web-enabled portable personal computer, a Web-enabled laptop computer, a Web-enabled personal digital assistant, and a Web-enabled phone.

13. The natural language query architecture of claim 11 , wherein the speech input plug-in comprises a speech input plug-in and a microphone.

14. The natural language query architecture of claim 11 , wherein the location/proximity plug-in comprises a location/proximity plug-in selected from the group consisting of a radio frequency identification reader and a global positioning system.

15. The natural language query architecture of claim 11 , wherein the location/proximity device comprises a location/proximity device selected from the group consisting of a radio frequency identification tag and a satellite.

16. The natural language query architecture of claim 11 , wherein the speech conversion algorithm resides in a speech server located remotely from the Web-enabled device.

17. The natural language query architecture of claim 11 , wherein the natural language processing algorithm resides in a server located remotely from the Web-enabled device.

18. The natural language query architecture of claim 11 , wherein the semantic engine algorithm resides in a database server located remotely from the Web-enabled device.

19. The natural language query architecture of claim 11 , wherein the database-look-up algorithm resides in a database server located remotely from the Web-enabled device.

20. The natural language query architecture of claim 11 , further comprising a speech output plug-in delivering the result related to the voice-based query in natural language form to the user.

21. A natural language query method processing voice and proximity-based queries, comprising:

providing a device, comprising:

a speech input module receiving a voice-based query in natural language form from a user; and

a location/proximity module receiving location/proximity information from a location/proximity device;

converting the voice-based query in natural language form to text in natural language form using a speech conversion module;

converting the text in natural language form to text in searchable form using a natural language processing module configured to use lexicons and grammar rules to parse sentences and determine underlying meanings of the voice-based query, wherein the underlying meanings are further determined responsive to the location/proximity information from the location/proximity module;

converting the text in searchable form to a formal database query using a semantic engine module;

narrowing the formal database query responsive to the location/proximity information from the location/proximity module, wherein the location/proximity module is configured to provide a context and environment narrowing and streamlining the formal database query associated with the voice-based query; and

obtaining a result related to the voice-based query in natural language form from a database using the formal database query and a database-look-up module.

22. The natural language query method of claim 21 , wherein the device comprises a device selected from the group consisting of a Web-enabled portable personal computer, a Web-enabled laptop computer, a Web-enabled personal digital assistant, and a Web-enabled phone.

23. The natural language query method of claim 21 , wherein the speech input module comprises a speech plug-in and a microphone.

24. The natural language query method of claim 21 , wherein the location/proximity module comprises a location/proximity module selected from the group consisting of a radio frequency identification reader and a global positioning system.

25. The natural language query method of claim 21 , wherein the location/proximity device comprises a location/proximity device selected from the group consisting of a radio frequency identification tag and a satellite.

26. The natural language query method of claim 21 , wherein the speech conversion module resides in a speech server located remotely from the device.

27. The natural language query method of claim 21 , wherein the natural language processing module resides in a server located remotely from the device.

28. The natural language query method of claim 21 , wherein the semantic engine module resides in a database server located remotely from the device.

29. The natural language query method of claim 21 , wherein the database-look-up module resides in a database server located remotely from the device.

30. The natural language query method of claim 21 , further comprising delivering the result related to the voice-based query in natural language form to the user using a speech output module.