MOBILE DIALOGUE SYSTEM AND MOBILE CONTENT DELIVERY SOLUTIONS

1 . A mobile phone which transmits and receives data in operable connection with a server system having a plurality of autonomous modules that communicate via a central facilitator hub module, the server system including:

a GUI server that handles a visual modality of graphics and text output to, and input from a mobile phone;

a dialog server for receiving a query from a multimodal server, wherein the multimodal server interfaces with each of a voice server and the GUI server in processing multimodal inputs and outputs, respectively;

a database server for performing a search in a database in response to user input and returning the result to the dialog server; and

a download manager server for updating and managing content on the mobile phone;

wherein the mobile phone includes a multimodal client comprising;

a voice client for handling the voice modality, receiving and forwarding voice commands from the mobile phone and outputting synthesized voice from the multimodal server,

a GUI client for handling the visual modality, collecting and transferring input from the mobile phone to the multimodal server; and

a connection manager for providing an interface between the voice client, the GUI client and with the multimodal server over a network.

2 . The mobile phone according to claim 1 , wherein said mobile phone is configured with multiple processors, including a programmable digital signal processor (DSP) and a reduced instruction set computing processor (RISP).

3 . The mobile phone of claim 1 wherein said cell phone includes a multimedia digital signal processor configured for receiving and processing compressed audio and/or visual data files.

4 . The mobile phone according to claim 2 wherein the digital signal processor is configured to receive and process an optimized digital media file sent by synchronized orthogonal frequency-division multiplex modulation.

5 . A mobile dialogue and mobile content delivery system using Real-Time Streaming Protocol (RTSP) and Real-Time Protocol (RTP), the system comprising a server part and a client part, the server part comprising;

a multimodal server comprising a voice server for handling voice modality and a GUI server for handling visual modality including graphics and text output to the user and the input received from the user respectively;

a download manager server for updating and managing a content list and updating new services and information at a handset over the air;

a dialog server for receiving a user query from the multimodal server;

a database server for performing a lookup in a database in response to the user query, and returning the result back to the dialog server;

the client part comprising:

a voice client for handling the voice modality, receiving and forwarding voice commands from the user and outputting synthesized voice from the multimodal server;

a GUI client for handling the visual modality, collecting and transferring other available input from the user to the multimodal server; and

a connection manager for providing an interface between the voice client, the GUI client and via the network consequently with the multimodal serve.

6 . The system according to claim 5 , wherein the client part is a cellular phone.

7 . The system according to claim 6 wherein the cellular phone has multiple processors wherein at least one processor featuring a digital signal processor is primarily dedicated to processing the compressed audio and/or visual data and handles modulating and demodulating the bit stream, coding/decoding and compression/decompression processes.

8 . A method performed by the system according to claim 5 , the method comprising:

registering by the GUI server where a user has pointed based on user inputs;

performing with the voice server DTMF or voice recognition and extracting essential meaning of a voice of the user based on user inputs;

employing a timer mechanism to collect user inputs within a specified time window, wherein when the time window expires the multimodal server has received a maximum of simultaneous user inputs;

passing the user inputs to the dialog server; the dialog server creating a response to the user inputs by querying the database server;

performing a lookup in a database on the database server and return results back to the dialog server;

processing the results on the dialog server to create a presentable response to the user; the multimodal server splitting the presentable response into different modalities of graphics and speech, which being sent out via the GUI server and the voice server respectively;

the multimodal server transferring the voice response to the client part and the client presenting the visual modality of the result to the user.

9 . A synchronization method for a multimodal dialogue system, the method comprising:

receiving an input from a plurality of input modalities;

synchronizing the input preprocessing extraction and recognition;

synchronizing the input modalities based on the dialogue history;

synchronizing the input modalities based on the dialogue context;

synchronizing the input modalities based on the temporal order of events associated with the input;

synchronizing an output modalities; and

output modality synthesizing synchronization.

10 . The synchronization method of claim 9 wherein the multimodal dialogue system is available over a cellular network.

11 . The synchronization method of claim 10 wherein the cellular network supports the simultaneous transmission of real time voice and data.

12 . The synchronization method of claim 9 wherein the input is provided through a device by voice, keyboard, graphics or video.