IP Library Granted Patent US 9,570,075
Granted Patent B1
US 9,570,075 · App. 15/263,427 · Granted Feb 14, 2017

Techniques for integrating voice control into an active telephony call

Inventors: Jared Kashimba (Micanopy, FL); Sai Rathnam (Raleigh, NC); Matthews Abraham (Cary, NC); Andrew Gulino (Chapel Hill, NC); Charles Marcel Kinard (Cary, NC); Aaron Medford (Smithfield, NC); Justin Milam (Burgaw, NC); Travis Morton (Raleigh, NC); Jon Schniepp (Raleigh, NC); Brandon Smith (Cary, NC); Shawn Starler (Fuquay-Varina, NC); Greg Stephens (Cary, NC); Sam Thomas (Holly Springs, NC); Matthew Wood (Durham, NC)
Assignee: Republic Wireless, Inc.
G10L15/22G10L15/1822H04L61/6068H04W4/14G10L2015/223H04W84/042H04W84/12
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,570,075
App. No.
15/263,427
Granted
Feb 14, 2017
Kind
B1
Abstract

Examples are disclosed for responding to voice commands within an existing telephony call between two or more end user communication devices mediated by an IP based communications server. The server is mediating a telephony call among the two or more end user communication devices where each end user communication device has its own communication link to the server. The server may detect a trigger event from one of the end user communication devices. Upon detecting the trigger event, the server may receive voice input over the communication link from the end user communication device that generated the trigger event. The received voice input may be parsed into one or more voice commands. The server may then cause the one or more voice commands to be executed. In other embodiments, much of the intelligence and processing may be carried out on the end user communication device directly.

Claims (82)

1. An IP based communications server for responding to voice commands within an existing telephony call between two or more end user communication devices mediated by the IP based communications server, comprising:

a memory unit for storing code;

at least one processor for executing the stored code to:

mediate a telephony call among the two or more end user communication devices, each end user communication device with its own communication link to the IP based communications server;

detect a user initiated trigger event within the existing telephony call from one of the end user communication devices;

upon detecting the user initiated trigger event: (i) causing the end user communication device that generated the trigger event to enter a temporary mute mode with respect to the existing telephony call; and (ii) receive voice input over the communication link from the end user communication device that generated the user initiated trigger event;

parse the received voice input into one or more voice commands; and

cause the one or more voice commands to be executed.

2. The communications server of claim 1 , further comprising:

cause a first acknowledgment to be presented to the end user communication device that generated the user initiated trigger event so as to inform an end user that voice input entered into the end user communication device that generated the user initiated trigger event will be processed as command input while in temporary mute mode.

3. The communications server of claim 2 , the first acknowledgment comprising an audible tone.

4. The communications server of claim 2 , the first acknowledgment comprising a haptic feedback or a vibration.

5. The communications server of claim 2 , further comprising:

determine if any end user voice input has been received since the end user communication device that generated the user initiated trigger event was placed into temporary mute mode;

if no end user voice input has been received since the end user communication device that generated the user initiated trigger event was placed into temporary mute mode within a pre-determined time-out period, exiting temporary mute mode and resuming normal communications for the existing telephony call; and

cause a second acknowledgment to be delivered to the end user communication device that generated the user initiated trigger event so as to inform an end user that the end user communication device that generated the user initiated trigger event has exited temporary mute mode.

6. The communications server of claim 2 , further comprising:

determine if any end user voice input has been received since the end user communication device that generated the user initiated trigger event was placed into temporary mute mode;

if end user voice input has been received since the end user communication device that generated the user initiated trigger event was placed into temporary mute mode, exiting temporary mute mode and resuming normal communications for the existing telephony call following a pre-determined time-out period after the end of the voice input; and

cause a second acknowledgment to be delivered to the end user communication device that generated the user initiated trigger event so as to inform an end user that the end user communication device that generated the user initiated trigger event has exited temporary mute mode.

7. The communications server of claim 1 , the user initiated trigger event comprising a non-verbal acoustic signature comprising sounds made when tapping the external housing of the end user communication device.

8. The communications server of claim 7 , the non-verbal acoustic signature comprising a time constrained pattern of the tap sounds.

9. The communications server of claim 1 , the communication link between the end user communication device that generated the user initiated trigger event and the IP based communications server comprising an Internet Protocol (IP) connection over an 802.11 WiFi access point.

10. The communications server of claim 1 , the communication link between the end user communication device that generated the user initiated trigger event and the IP based communications server comprising an Internet Protocol (IP) connection over a cellular network.

11. The communications server of claim 1 , the communication link between the end user communication device that generated the user initiated trigger event and the IP based communications server comprising a circuit switched connection over a cellular network.

12. The communications server of claim 11 , the circuit switched connection over a cellular network comprising at least one of a Global System for Mobile Communications (GSM) network or a Code Division Multiple Access (CDMA) network.

13. The communications server of claim 1 , the communication link between the end user communication device that generated the user initiated trigger event and the IP based communications server comprising a circuit switched connection over a Public Switched Telephone Network (PSTN).

14. The communications server of claim 1 , wherein the one or more voice commands are comprised of instructions to:

compose a short message service (SMS) message, the SMS message including at least one recipient identifier and SMS content; and

send the SMS message on behalf of an end user that generated the user initiated trigger event to the at least one recipient identifier.

15. The communications server of claim 1 , wherein the one or more voice commands are comprised of instructions to:

compose a calendar entry comprised of one or more of an event name, a date, any participants, and a time; and

enter the calendar entry into a calendar application on behalf of an end user that generated the user initiated trigger event.

16. The communications server of claim 1 , wherein the one or more voice commands are comprised of instructions to:

record a portion of the existing telephony call for a specified period of time; and

perform at least one of storing or delivering the recorded portion of the existing telephony call to at least one of the end user communication device that generated the user initiated trigger event, another end user communication device, the communications server, or an external server or resource accessible to the end user.

17. The communications server of claim 1 , wherein the one or more voice commands are further comprised of instructions to:

transcribe a portion of the existing telephony call; and

perform at least one of storing or delivering the transcription of the portion of the existing telephony call to at least one of the end user communication device that generated the user initiated trigger event, another end user communication device, the communications server, or an external server or resource accessible to the end user.

18. The communications server of claim 1 , wherein the one or more voice commands are comprised of instructions to:

map an address, location, or landmark using a mapping application on the end user communication device that generated the user initiated trigger event.

19. The communications server of claim 1 , wherein the one or more voice commands are comprised of instructions to:

mute or un-mute the end user communication device that generated the user initiated trigger event with respect to the ongoing telephony call.

20. The communications server of claim 1 , wherein the one or more voice commands are comprised of instructions to:

create an additional call leg to another end user communication device; and

join the additional call leg with the existing telephony call.

21. The communications server of claim 1 , wherein the one or more voice commands are comprised of instructions to:

create an additional call leg to another end user communication device;

join the additional call leg with the existing telephony call; and

terminate the end user communication device that generated the user initiated trigger event from the existing telephony call.

22. The communications server of claim 1 wherein the one or more voice commands are comprised of instructions to:

compose an email message, the email message including at least one recipient email address; and

send the email message on behalf of an end user that generated the user initiated trigger event to the at least one recipient email address.

23. The communications server of claim 1 , wherein the one or more voice commands are comprised of instructions to:

compose one of a short message service (SMS) or multimedia messaging service (MMS) location message, the location message including at least one recipient identifier and one of a location link or map indicative of the current physical location of the end user communication device that generated the user initiated trigger event; and

send the location message on behalf of an end user that generated the user initiated trigger event.

24. The communications server of claim 1 , wherein the one or more voice commands are comprised of instructions to:

perform a financial transaction comprising:

identifying a source for withdrawal of funds;

identifying a destination for deposit of funds;

determining an amount to transfer;

authenticating the transaction; and

causing the transfer of funds to occur.

25. The communications server of claim 1 , wherein the one or more voice commands are comprised of instructions to:

engage a translation feature that:

captures audio from at least one end user communication device in a first language;

translates the captured audio to a second language;

plays the translated audio to another end user communication device.

26. The communications server of claim 1 , wherein the one or more voice commands are comprised of instructions to:

enter speakerphone mode on the end user communication device that generated the user initiated trigger event.

27. The communications server of claim 1 , wherein the one or more voice commands are comprised of instructions to:

remotely engage one or more end point devices connected to a network;

cause one or more of the end point devices connected to the network to perform a function, the function including at least one of:

unlocking a door;

opening a garage door;

arming or disarming an alarm system;

switching a light; and

controlling a thermostat.

28. The communications server of claim 1 , wherein the one or more voice commands are comprised of instructions to:

add a new contact to a contact database on behalf of an end user that generated the user initiated trigger event.

29. The communications server of claim 1 , wherein the one or more voice commands are comprised of instructions to:

apply an overlay to audio coming from the end user communication device that generated the user initiated trigger event to modify the natural sound of one of a user's voice or a background.

Assignments (5)
CHANGE OF NAME Recorded May 27, 2021
From: REPUBLIC WIRELESS, INC.
To: RELAY, INC.
Reel/Frame 056753/0703 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENT NO. 9,014,138 SHOULD BE PATENT NO. 9,014,038 PREVIOUSLY RECORDED ON REEL 041030 FRAME 0123. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Aug 17, 2020
From: BANDWIDTH.COM, INC.
To: REPUBLIC WIRELESS, INC.
Reel/Frame 053583/0771 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 19, 2016
From: BANDWIDTH.COM, INC.
To: REPUBLIC WIRELESS, INC.
Reel/Frame 041030/0123 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 6, 2016
From: BANDWIDTH.COM, INC.
To: REPUBLIC WIRELESS, INC.
Reel/Frame 040821/0231 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 13, 2016
From: KASHIMBA, JARED; RATHNAM, SAI; ABRAHAM, MATHEWS; GULINO, DREW; KINARD, MARCEL; MEDFORD, AARON; MILAM, JUSTIN; MORTON, TRAVIS; SCHNIEPP, JON; SMITH, BRANDON; STARLER, SHAWN; STEPHENS, GREG; THOMAS, SAM; WOOD, MATTHEW
To: BANDWIDTH.COM, INC.
Reel/Frame 039710/0221 →
Continuity (1)
Continuation 15260704 · Sep 9, 2016