IP Library Granted Patent US 8,788,675
Granted Patent B2
US 8,788,675 · App. 11/232,586 · Granted Jul 22, 2014

Multi-modal communication using a session specific proxy server

Inventor: Senaka Balasuriya (Westmont, IL)
Assignee: Motorola Mobility LLC
G06F17/30899H04L65/1046
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,788,675
App. No.
11/232,586
Granted
Jul 22, 2014
Kind
B2
Abstract

A method and apparatus for multi-modal communication includes a controller ( 236 ) operably coupled to at least one multi-modal session proxy server ( 226 ). On a per multi-modal session basis, the controller ( 236 ) provides the multi-modal session proxy server ( 226 ) with a multi-modal proxy identifier ( 138 ). The multi-modal proxy identifier ( 138 ) is then provided to at least one browser with a per session multi-modal proxy evaluator ( 220 ) having a browser proxy identifier ( 140 ) wherein the browser proxy identifier ( 140 ) is evaluated in view of the multi-modal proxy identifier ( 138 ). The multi-modal session proxy server ( 226 ) then receives an information request ( 231 ) from the browser with per session multi-modal proxy evaluator ( 220 ) wherein the requested information is fetched from a content server ( 240 ). When the requested information is retrieved, a multi-modal synchronization coordinator ( 122 ) notifies the other browser with per session multi-modal proxy evaluator ( 232 ), via a multi-modal synchronization interface ( 234 ).

Claims (42)

1. A system for multi-modal communication comprising:

a terminal that includes at least:

at least one graphical browser with a graphical browser per session multi-modal proxy evaluator that dynamically evaluates, on a per session basis, a stored graphical browser proxy identifier with a received per-session multi-modal proxy identifier from a network element as selected by the network element; and

at least one graphical browser multi-modal synchronization interface operably coupled to the at least one graphical browser.

2. The system of claim 1 wherein the terminal further comprises:

an audio subsystem comprising a microphone for receiving an audio input and a speaker for providing an audio output;

a terminal voice transfer interface operably coupled to the audio subsystem; and

a terminal session control for initiating a wireless terminal session.

3. The system of claim 2 further comprising:

a network element including:

at least one voice browser with a voice browser per session multi-modal proxy evaluator, wherein the at least one voice browser dynamically evaluates, on a per session basis a voice browser proxy identifier; and

at least one voice browser multi-modal synchronization interface operably coupled to the at least one voice browser.

4. The system of claim 3 wherein the network element includes:

a network session control for receiving initialization commands from the terminal session control;

a network voice transfer interface for transmitting and receiving encoded audio information from the terminal voice transfer interface; and

a speech engine operably coupled to the network voice transfer interface, wherein when a voice command is provided from the terminal voice transfer interface, the speech engine decodes the voice command for the voice browser.

5. The system of claim 3 wherein the network element includes a multi-modal synchronization coordinator coupled to the multi-modal voice browser multi-modal synchronization interface and to the graphical browser multi-modal synchronization interface; and

a plurality of multi-modal session proxy servers operatively coupled to the multi-modal synchronization coordinator and to the graphical browser and voice browser.

6. The system of claim 4 wherein the network element further includes:

a controller; and

at least one multi-modal session proxy server having a proxy address operably coupled to the at least one voice browser and the at least one graphical browser, wherein the controller determines, on a per session basis, from among a plurality of multi-modal proxy servers, a multi-modal proxy identifier representing the proxy address of the multi-modal session proxy server and the multi-modal proxy identifier is provided to the at least one voice browser and the at least one graphical browser.

7. The system of claim 6 further comprising:

a multi-modal synchronization coordinator;

at least one information request provided by at least one of the at least one graphical browser and the at least one voice browser to the multi-modal session proxy server whereby the multi-modal session proxy server fetches requested information; and

wherein if the requested information is provided to the at least one voice browser, the at least one graphical browser is updated via the at least one graphical browser multi-modal synchronization interface through the multi-modal synchronization coordinator and if the requested information is provided to the at least one graphical browser, the at least one voice browser is updated via the at least one voice browser multi-modal synchronization interface through the multi-modal synchronization coordinator.

8. The system of claim 6 further comprising:

at least one content server operably coupled to the multi-modal session proxy server of the network element whereupon when an information request is provided to the multi-modal session proxy server, the multi-modal session proxy server retrieves the requested information from the at least one content server.

9. The system of claim 6 wherein the controller of the network element further comprises:

a load balancer operably coupled to the controller wherein the load balancer provides an indication of the available bandwidth of the at least one multi-modal proxy server to the controller such that the controller can determine, on a per session basis, the multi-modal session proxy identifier.

10. A method for multi-modal communication comprising:

receiving, by a terminal, a multi-modal proxy identifier corresponding to a per-session determined multi-modal session proxy server from a plurality of different multi-modal proxy servers, on a per session basis, for a graphical browser;

evaluating, by the terminal, on a per session basis, a current graphical browser proxy identifier in response to receiving the multi-modal proxy identifier;

receiving the multi-modal proxy identifier, on a per session basis, for a voice browser;

evaluating, on a per session basis, a current voice browser proxy identifier in response to receiving the multi-modal proxy identifier;

sending an information request from at least one of the graphical browser or voice browser via a multi-modal session proxy server identified by the multi-modal proxy identifier.

11. The method of claim 10 further comprising:

prior to receiving a multi-modal proxy identifier, initiating a multi-modal session between a terminal and a multi-modal network element and determining the multi-modal session proxy server from the plurality of different multi-modal session proxy servers, on a per session basis.

12. The method of claim 11 wherein the graphical browser is disposed on the terminal and the voice browser is disposed on the network element.

13. The method of claim 11 wherein determining the multi-modal session proxy server on a per-session basis comprises selecting the multi-modal proxy server from the plurality of multi-modal proxy servers, based on a bandwidth comparison.

14. The method of claim 12 , prior to sending an information request, further comprising:

storing an updated graphical browser proxy identifier in a graphical browser memory location; and

storing an updated voice browser proxy identifier in a voice browser memory location.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 13, 2015
From: BALASURIYA, SENAKA
To: MOTOROLA, INC.
Reel/Frame 035167/0449 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 13, 2015
From: MOTOROLA MOBILITY LLC
To: GOOGLE TECHNOLOGY HOLDINGS LLC
Reel/Frame 035204/0050 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 21, 2012
From: MOTOROLA MOBILITY, INC.
To: MOTOROLA MOBILITY LLC
Reel/Frame 028829/0856 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 13, 2010
From: MOTOROLA, INC
To: MOTOROLA MOBILITY, INC
Reel/Frame 025673/0558 →
Continuity (2)
Division 10034794 · Dec 28, 2001
Related Publication 20060020704A1 · Jan 26, 2006