IP Library Granted Patent US 11,330,100
Granted Patent B2
US 11,330,100 · App. 15/884,294 · Granted May 10, 2022

Server based intelligent personal assistant services

Inventors: Thaddeus White (Los Altos, CA); Karl Osterlund (San Jose, CA); Tobin E. Farrand (Pacific Grove, CA); Arvind Vasudev (Sunnyvale, CA); Douglas Hart (San Jose, CA); David A. Bryan (Cedar Park, TX); William M. Gillon (San Mateo, CA)
Assignee: Ooma, Inc.
H04M3/42102G06F3/167G10L15/26H04L12/281H04L12/282H04L12/283H04M3/527G08C2201/31H04L2012/2841
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,330,100
App. No.
15/884,294
Granted
May 10, 2022
Kind
B2
Abstract

Systems and methods for augmenting an appliance device with an intelligent personal assistant. Exemplary methods include: receiving, by the appliance device, an identifier for a called party; initiating a voice call using the received identifier; monitoring audio of the voice call; determining the monitored audio includes a predetermined wake word; beginning communications with the intelligent personal assistant, the communications including at least a portion of the monitored audio, the portion of the monitored audio comprising a request for the intelligent personal assistant; receiving a result from the intelligent personal assistant, the result being responsive to the request; receiving indicia that the voice call is over from at least one of the called party and a calling party; and terminating the voice call using the indicia.

Claims (57)

1. A computing service for providing a server based intelligent personal assistant service comprising:

a VoIP service configured to:

receive a VoIP audio stream based on a call between a first party and a second party;

detect a predetermined wake word from the VoIP audio stream during the call;

access a server based intelligent personal assistant service over the Internet using a query while the call is ongoing, the query including a portion of the VoIP audio stream;

receive a result over the Internet from the server based intelligent personal assistant service, the result being responsive to the query; and

provide the result to at least one of the first or second party using a connection that provides one- or two-way communications, the connection being established by the server based intelligent personal assistant service; and

the computing service, comprising:

at least compute and storage capabilities to service at least one party, wherein the compute and storage capabilities are configured to provide the server based intelligent personal assistant service to the first and second party, the server based intelligent personal assistant service being configured to:

receive the query over the Internet from the VoIP service, the query including a portion of the VoIP audio stream;

establish the connection with at least one of the first or the second party, the connection being separate from the call maintained between the first party and the second party;

determine a request for the server based intelligent personal assistant service from the query; and

generate and provide a result by the server based intelligent personal assistant service, the result being responsive to the request.

2. The service according to claim 1 , wherein the VoIP service is configured to determine when the VoIP audio stream received an indicia that the call is over from the at least one of the first or second party.

3. The service according to claim 1 , wherein the VoIP service is integrated in a premises network.

4. The service according to claim 3 , wherein the VoIP service is integrated into a premises router.

5. The service according to claim 1 , wherein the query comprises a request for real-time information including at least one of traffic, currency exchange rate, score of a sporting event, and news.

6. The service according to claim 1 , wherein the query causes the server based intelligent personal assistant service to search at least one of a calendar of the first party, a calendar of the second party, an email account of the first party, an email account of the second party, Wikipedia articles, IMDb, television schedule, movie show times, theater show times, and restaurant hours.

7. The service of claim 1 , wherein the predetermined wake word is at least one predetermined word for activating the server based intelligent personal assistant service.

8. The service of claim 1 , wherein the server is a cloud-based server.

9. A method for providing a server based intelligent personal assistant services comprising:

receiving by a VoIP service a VoIP audio stream based on a call between a first party and a second party;

detecting by the VoIP service a predetermined wake word from the VoIP audio stream during the call;

accessing from the VoIP service a server based intelligent personal assistant service over the Internet using a query while the call is ongoing, the query including a portion of the VoIP audio stream;

receiving by the server based intelligent personal assistant service the query;

establishing by the server based intelligent personal assistant service a connection that is separate from the call, the connection providing one- or two-way communications with at least one of the first or second party;

determining a request for the server based intelligent personal assistant service from the query;

generating a result by the server based intelligent personal assistant service, the result being responsive to the request; and

providing the result to the at least one of the first or second party using the connection established by the server based intelligent personal assistant service.

10. The method of claim 9 , wherein the VoIP service is configured to determine when the VoIP audio stream received an indicia that the call is over from at least one of the first or second party.

11. The method of claim 9 , wherein the VoIP service is integrated in a premises network.

12. The method of claim 11 , wherein the VoIP service is integrated into a premises router.

13. The method of claim 9 , wherein the query comprises a request for real-time information including at least one of traffic, currency exchange rate, score of a sporting event, and news.

14. The method of claim 9 , wherein the query causes the server based intelligent personal assistant service to search at least one of a calendar of the first party, a calendar of the second party, an email account of the first resource party, an email account of the second party, Wikipedia articles, IMDb, television schedule, movie show times, theater show times, and restaurant hours.

15. The method of claim 9 , wherein the predetermined wake word is at least one predetermined word for activating the server based intelligent personal assistant service.

16. The method of claim 9 , wherein the server is a cloud-based server.

17. A system comprising:

a VoIP network device; and

a server based intelligent personal assistant device, the VoIP network device configured to:

receive a VoIP audio stream based on a call between a first party and a second party;

detect a predetermined wake word from the VoIP audio stream during the call;

access a server based intelligent personal assistant service over the Internet using a query while the call is ongoing, the query including a portion of the VoIP audio stream;

receive a result over the Internet from the server based intelligent personal assistant service, the result being responsive to the query; and

provide the result to at least one of the first or second party using a connection that allows one- or two-way communications established by the server based intelligent personal assistant service with the at least one of the first party or the second party; and

the server based intelligent personal assistant device, comprising:

at least compute and storage capabilities to service at least one party, wherein the compute and storage capabilities are configured to provide the server based intelligent personal assistant service to the first and second party, the server based intelligent personal assistant service being configured to:

receive the query over the Internet from a VoIP service, the query including a portion of the VoIP audio stream;

establish the connection allowing the one- or two-way communications with the at least one of the first or second party;

determine a request for the server based intelligent personal assistant service from the query;

generate a result by the server based intelligent personal assistant service, the result being responsive to the request; and

provide the result to the at least one of the first or second party using the connection.

18. The system of claim 17 , wherein the VoIP service is configured to determine when the VoIP audio stream received an indicia that the call is over from the at least one of the first or second party.

19. The system of claim 17 , wherein the VoIP service is integrated in a premises network.

20. The system of claim 19 , wherein the VoIP service is integrated into a premises router.

21. The system of claim 17 wherein the query comprises a request for real-time information including at least one of traffic, currency exchange rate, score of a sporting event, and news.

22. The system of claim 17 , wherein the query causes the server based intelligent personal assistant service to search at least one of a calendar of the first party, a calendar of the second party, an email account of the first party, an email account of the second party, Wikipedia articles, IMDb, television schedule, movie show times, theater show times, and restaurant hours.

23. The system of claim 17 , wherein the server is a cloud-based server.

Assignments (3)
RELEASE OF SECURITY INTEREST Recorded Jun 9, 2023
From: KEYBANK NATIONAL ASSOCIATION, AS ADMINISTRATIVE AGENT
To: OOMA, INC.
Reel/Frame 063910/0866 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Jan 11, 2021
From: OOMA, INC.
To: KEYBANK NATIONAL ASSOCIATION
Reel/Frame 054959/0756 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 17, 2018
From: WHITE, THADDEUS; OSTERLUND, KARL; FARRAND, TOBIN E.; VASUDEV, ARVIND; HART, DOUGLAS; BRYAN, DAVID A.; GILLON, WILLIAM M.
To: OOMA, INC.
Reel/Frame 045839/0560 →
Continuity (2)
Continuation In Part 14327163 · Jul 9, 2014
Related Publication 20180152557A1 · May 31, 2018
Cited By (3)
US 12,190,702 US 12,250,339 US 12,634,789