System and method for controlling an application using natural language communication
A system and method are disclosed for setting up a communication link between a device or application and a system with a controller. The controller can collect and send information to the application. A user interfaces with the controller to access the functionality of the application through providing commands to the controller. The system allows the user to interface with multiple applications.
1. A method comprising:
searching for a central controller;
establishing communication with the central controller;
sending an app-specific function declaration to the central controller;
receiving a query from the central controller that includes a new grammar; and
updating a grammar library associated with the app with the new grammar.
2. The method of claim 1 further comprising transferring a grammar to the central controller.
3. The method of claim 1 further comprising transferring an identity of the app to the central controller.
4. The method of claim 1 further comprising:
sending a device identity to the central controller;
sending a grammar rule, from a device or a web resource pointed to by the device identity, to the central controller;
sending audio from a speecrophone to the central controller;
invoking automatic speech recognition (ASR) and natural language understanding (NLU) services on the audio;
associating the audio with the device identity and the grammar rule; and
invoking a function from the function declaration.
5. The method of claim 4 further comprising:
sending a command from the central controller to the device; and
receiving status information from the device.
6. The method of claim 4 further comprising adding the device identity to a list of known device identities.
7. The method of claim 4 further comprising adding the grammar rule to a database of known grammar rules.
8. The method of claim 1 further comprising:
sending a location of an application to the central controller;
sending a device identity to the central controller;
sending a grammar rule for the device identity to the central controller;
sending audio to the central controller;
invoking automatic speech recognition (ASR) and natural language understanding (NLU) services on the audio;
associating the audio with the device identity and the grammar rule; and
invoking a function from the function declaration.
9. A system comprising:
a controller; and
an application in communication with the controller, wherein the application sends an app-specific function declaration to the controller and receives a query from the central controller that includes a new grammar and updated a grammar library, which is associated with the application, with the new grammar.
10. The system of claim 9 further comprising an input means in communication with the controller for receiving commands from a user.
11. The system of claim 9 , wherein the application includes an identity.
12. The system of claim 11 , wherein the controller receives the identity and the function declaration from the application.
13. The system of claim 11 , wherein the controller receives a grammar from at least one of the application and a web resource pointed to by the identity and the controller receives speech audio from a speecrophone.
14. The system of claim 13 , wherein the controller processes the speech audio using at least one of automatic speech recognition (ASR) and natural language understanding (NLU) services and associates the speech audio with the identity and the grammar to invoke a function from the function declaration.
15. The system of claim 9 further comprising a speecrophone in communication with the controller, the speecrophone being for sending speech input from a user to the controller and for receiving information from the controller and verbally communicating it to a user.