IP Library Granted Patent US 12,283,277
Granted Patent B2
US 12,283,277 · App. 18/462,949 · Granted Apr 22, 2025

Audio firewall

Inventors: Philip Alan Bunker (Vista, CA); Mayank Saxena (Pleasanton, CA)
Assignee: Nice North America LLC
G10L15/26G10L13/00G10L15/22G10L15/30G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,283,277
App. No.
18/462,949
Granted
Apr 22, 2025
Kind
B2
Abstract

An audio firewall system has a microphone that generates audio data. A speech-to-text engine converts the audio data to text data. The text data is parsed for a service wake word and corresponding content data. The service wake word identifies one of a local security system and a remote assistant server. A text-to-speech engine converts the service wake word and the corresponding content data to converted audio data. The converted audio data is provided to the remote assistant server. The content data is provided to the local security system. The audio firewall system receives a response from the remote assistant server or the local security system and outputs an audio signal corresponding to the response.

Claims (49)

1. A method comprising:

accessing, at an audio firewall system, first audio data including at least a request and a wake word generated with a microphone of the audio firewall system;

determining whether the first audio data is directed at a local security system or a server by determining whether the first audio data identifies a local device that is locally connected to the local security system; and

in response to determining that the first audio data is directed at the server, and not at the local security system, converting a text of the first audio data including the request and the wake word to second audio data, and providing the second audio data to the server.

2. The method of claim 1 , wherein the request includes a command directed at the local device.

3. The method of claim 2 , further comprising:

determining whether the first audio data is directed at the server based on the wake word.

4. The method of claim 3 , wherein the wake word is associated with the server.

5. The method of claim 1 , further comprising:

converting the first audio data to text data;

parsing the text data for the wake word and the request; and

in response to determining that the first audio data is directed at the local security system, providing the request in the text data to the local security system.

6. The method of claim 1 , further comprising:

receiving a response from the server in response to providing the second audio data to the server; and

outputting an audio signal corresponding to the response with a speaker of the audio firewall system.

7. The method of claim 1 , further comprising:

in response to determining that the first audio data is directed at the local security system and not the server, providing the first audio data to the local security system;

receiving a response from the local security system in response to providing the first audio data to the local security system; and

outputting an audio signal corresponding to the response with a speaker at the audio firewall system.

8. The method of claim 1 , further comprising:

adjusting at least one of a pitch or a speed of the first audio data to generate the second audio data.

9. The method of claim 1 , wherein the audio firewall system is configured to communicate with a plurality of remote servers, each remote server having a corresponding wake word.

10. An audio firewall system comprising:

one or more processors; and

a memory storing instructions that, when executed by the one or more processors, configure the audio firewall system to perform operations comprising:

accessing, at an audio firewall system, first audio data including at least a request and a wake word generated with a microphone of the audio firewall system;

determining whether the first audio data is directed at a local security system or a server by determining whether the first audio data identifies a local device that is locally connected to the local security system; and

in response to determining that the first audio data is directed at the server and not at the local security system, converting a text of the first audio data including the request and the wake word to second audio data, and providing the second audio data to the server.

11. The audio firewall system of claim 10 , wherein the request includes a command directed at the local device.

12. The audio firewall system of claim 11 , wherein the operations further comprise:

determining whether the first audio data is directed at the server based on the wake word.

13. The audio firewall system of claim 12 , wherein the wake word is associated with the server.

14. The audio firewall system of claim 10 , wherein the operations further comprise:

converting the first audio data to text data;

parsing the text data for the wake word and the request; and

in response to determining that the first audio data is directed at the local security system, providing the request in the text data to the local security system.

15. The audio firewall system of claim 10 , wherein the operations further comprise:

receiving a response from the server in response to providing the second audio data to the server; and

outputting an audio signal corresponding to the response with a speaker of the audio firewall system.

16. The audio firewall system of claim 10 , wherein the operations further comprise:

in response to determining that the first audio data is directed at the local security system and not the server, providing the first audio data to the local security system;

receiving a response from the local security system in response to providing the first audio data to the local security system; and

outputting an audio signal corresponding to the response with a speaker at the audio firewall system.

17. The audio firewall system of claim 10 , wherein the operations further comprise:

adjusting at least one of a pitch or a speed of the first audio data to generate the second audio data.

18. A non-transitory machine-storage medium storing instructions that, when executed by one or more processors of a machine, cause the one or more processors to perform operations comprising:

accessing, at an audio firewall system, first audio data including at least a request and a wake word generated with a microphone of the audio firewall system;

determining whether the first audio data is directed at a local security system or a server by determining whether the first audio data identifies a local device that is locally connected to the local security system; and

in response to determining that the first audio data is directed at the server and not at the local security system, converting a text of the first audio data including the request and the wake word to second audio data, and providing the second audio data to the server.

Assignments (3)
CHANGE OF NAME Recorded Jan 9, 2024
From: NORTEK SECURITY & CONTROL LLC
To: NICE NORTH AMERICA LLC
Reel/Frame 066242/0513 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 15, 2023
From: BUNKER, PHILIP ALAN; SAXENA, MAYANK
To: NORTEK SECURITY & CONTROL LLC
Reel/Frame 064921/0191 →
CHANGE OF NAME Recorded Sep 15, 2023
From: NORTEK SECURITY & CONTROL LLC
To: NICE NORTH AMERICA LLC
Reel/Frame 064921/0340 →