IP Library Granted Patent US 9,819,744
Granted Patent B1
US 9,819,744 · App. 14/312,629 · Granted Nov 14, 2017

Multi-modal communication

Inventor: Senaka Balasuriya (Westmont, IL)
Assignee: GOOGLE TECHNOLOGY HOLDINGS LLC
H04L67/141H04L65/105H04L65/1046
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,819,744
App. No.
14/312,629
Granted
Nov 14, 2017
Kind
B1
Abstract

A method and apparatus for multi-modal communication includes a controller ( 236 ) operably coupled to at least one multi-modal session proxy server ( 226 ). On a per multi-modal session basis, the controller ( 236 ) provides the multi-modal session proxy server ( 226 ) with a multi-modal proxy identifier ( 138 ). The multi-modal proxy identifier ( 138 ) is then provided to at least one browser with a per session multi-modal proxy evaluator ( 220 ) having a browser proxy identifier ( 140 ) wherein the browser proxy identifier ( 140 ) is evaluated in view of the multi-modal proxy identifier ( 138 ). The multi-modal session proxy server ( 226 ) then receives an information request ( 231 ) from the browser with per session multi-modal proxy evaluator ( 220 ) wherein the requested information is fetched from a content server ( 240 ). When the requested information is retrieved, a multi-modal synchronization coordinator ( 122 ) notifies the other browser with per session multi-modal proxy evaluator ( 232 ), via a multi-modal synchronization interface ( 234 ).

Claims (45)

1. An apparatus comprising:

at least one controller configured to:

select one of a plurality of multi-modal session proxy servers for a session, wherein each of the plurality of multi-modal session proxy servers has a proxy address; and

determine one of a plurality of multi-modal proxy identifiers that represents the proxy address of the selected one of the plurality of multi-modal session proxy servers.

2. The apparatus of claim 1 , wherein the at least one controller is configured to:

provide the one of the plurality of multi-modal proxy identifiers to a terminal device for comparison against at least one stored proxy identifier for the session, wherein the terminal device is operably coupled to the controller and the selected one of the plurality of multi-modal session proxy servers.

3. The apparatus of claim 2 , wherein the terminal device provides a voice browser that utilizes a voice browser proxy identifier and a graphical browser that utilizes a graphical browser proxy identifier and the at least one controller is configured to:

provide the one of the plurality of multi-modal proxy identifiers to the voice browser or the terminal device for comparison against the voice browser proxy identifier and the graphical browser proxy identifier for the session.

4. The apparatus of claim 1 , wherein the at least one controller is operably coupled to at least one load balancer, wherein the at least one controller is configured to:

receive information from the load balancer; and

select the one of the plurality of multi-modal session proxy servers for the session based at least in part on the received information.

5. The apparatus of claim 4 , wherein the information comprises at least one of available bandwidth for at least some of the plurality of multi-modal proxy servers or a location of at least some of the plurality of multi-modal proxy servers.

6. A method for multi-modal communication comprising:

receiving a multi-modal proxy identifier for a session based on a selection from a plurality of multi-modal proxy servers;

evaluating at least one stored proxy identifier with respect to the received multi-modal proxy identifier;

sending an information request for the session using a first mode via a multi-modal session proxy server identified by the multi-modal proxy identifier; and

receiving a reply to the request in a second mode via the multi-modal session proxy server.

7. The method of claim 6 , wherein evaluating, on the per session basis, the at least one stored proxy identifier with respect to the received multi-modal proxy identifier further comprises:

comparing the at least one stored proxy identifier to the received multi-modal proxy identifier; and

updating the at least one stored proxy identifier with the received multi-modal proxy identifier when the at least one stored proxy identifier differs from the received multi-modal proxy identifier.

8. The method of claim 6 , wherein the at least one stored proxy identifier comprises a voice browser proxy identifier and a graphical browser proxy identifier.

9. The method of claim 8 , further comprising:

synchronizing the voice browser proxy identifier and the graphical browser proxy identifier based at least in part on the received multi-modal proxy identifier.

10. The method of claim 6 , wherein the reply comprises information fetched from a content server.

11. The method of claim 6 , wherein the selection from the plurality of multi-modal proxy servers is based at least in part on information received from a load balancer.

12. The method of claim 11 , wherein the information comprises at least one of available bandwidth for at least some of the plurality of multi-modal proxy servers or a location of at least some of the plurality of multi-modal proxy servers.

13. The method of claim 6 , further comprising:

receiving the multi-modal proxy identifier for one of a voice browser session or a graphical browser session based on the selection from the plurality of multi-modal proxy servers; and

utilizing the multi-modal proxy identifier for the other of the voice browser session or the graphical browser session.

14. A non-transitory machine readable medium embodying instructions that, when executed by a machine, cause the machine to perform a method comprising:

receiving a multi-modal proxy identifier for a session based on a selection from a plurality of multi-modal proxy servers;

evaluating at least one stored proxy identifier with respect to the received multi-modal proxy identifier;

sending an information request for the session via a multi-modal session proxy server identified by the multi-modal proxy identifier; and

receiving a reply to the request via the multi-modal session proxy server.

15. The machine readable medium of claim 14 , wherein evaluating the at least one stored proxy identifier with respect to the received multi-modal proxy identifier further comprises:

comparing the at least one stored proxy identifier to the received multi-modal proxy identifier; and

updating the at least one stored proxy identifier with the received multi-modal proxy identifier when the at least one stored proxy identifier differs from the received multi-modal proxy identifier.

16. The machine readable medium of claim 14 , wherein the at least one stored proxy identifier comprises a voice browser proxy identifier and a graphical browser proxy identifier.

17. The machine readable medium of claim 16 , wherein the method further comprises:

synchronizing the voice browser proxy identifier and the graphical browser proxy identifier based at least in part on the received multi-modal proxy identifier.

18. The machine readable medium of claim 14 , wherein the reply comprises information fetched from a content server.

19. The machine readable medium of claim 14 , wherein the selection from the plurality of multi-modal proxy servers is based at least in part on information received from a load balancer.

20. The machine readable medium of claim 14 , wherein the method further comprises:

receiving the multi-modal proxy identifier for one of a voice browser session or a graphical browser session based on the selection from the plurality of multi-modal proxy servers; and

utilizing the multi-modal proxy identifier for the other of the voice browser session or the graphical browser session.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 30, 2017
From: MOTOROLA, INC.
To: MOTOROLA MOBILITY, INC.
Reel/Frame 041803/0281 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 30, 2017
From: MOTOROLA MOBILITY LLC
To: GOOGLE TECHNOLOGY HOLDINGS LLC
Reel/Frame 041803/0289 →
CHANGE OF NAME Recorded Mar 30, 2017
From: MOTOROLA MOBILITY, INC.
To: MOTOROLA MOBILITY LLC
Reel/Frame 042117/0583 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 13, 2015
From: BALASURIYA, SENAKA
To: MOTOROLA, INC.
Reel/Frame 035167/0449 →
Continuity (1)
Continuation 10034794 · Dec 28, 2001