IP Library › Granted Patent US 12,250,536
Granted Patent B2
US 12,250,536 · App. 18/382,575 · Granted Mar 11, 2025

Information security/privacy via a decoupled security accessory to an always listening device

Inventor: Xiao Ming Mai (Cranbury, NJ)
Assignee: Thomas Stachura
H04W12/02G06F21/6245H04M1/72409H04M1/72448H04M1/72463G06F3/041H04M1/72412
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,250,536
App. No.
18/382,575
Granted
Mar 11, 2025
Kind
B2
Abstract

An always-listening-capable computing device is disclosed, comprising: a first electronic sensor configured to receive user input, a second electronic sensor configured to receive a signal indicating that a user depressed a physical button, a gate-keeping module implemented by a processor, wherein data from the first electronic sensor passes through the gate-keeping module while a gatekeeping function is disabled, no data from the first electronic sensor passes through the communications module while the gatekeeping function is enabled, all data input to the gate-keeping module is received via an exclusive input lead from the first electronic sensor, and all data output from the gate-keeping module is transmitted via an exclusive output lead to a component other than the first electronic sensor. The device receives the signal indicating that the user has depressed the physical button; and enables or disables a functionality of a second computing device.

Claims (45)

1. A listening device comprising:

a sensor configured to detect user input;

a primary processor; and

a gate-keeping pre-processor, disposed between the sensor and the primary processor, configured to:

block communications between the sensor and the primary processor when a gate-keeping function is enabled;

based on a determination that a first portion of user input, received via an exclusive input lead from the sensor, comprises a command, disable the gate-keeping function; and

allow communications between the sensor and the primary processor when the gate-keeping function is disabled, wherein the primary processor is configured to receive and process a second portion of the user input when the gate-keeping function is disabled.

2. The listening device of claim 1 , further comprising:

a communications module configured to transmit the second portion of the user input to a remote server after the second portion of the user input has been processed by the primary processor.

3. The listening device of claim 2 , further comprising:

an output configured to cause a response, received from the remote server, to be conveyed to a user of the listening device.

4. The listening device of claim 1 , wherein processing the second portion of the user input comprises encrypting the second portion of the user input prior to relaying the second portion of the user input to a communications module.

5. The listening device of claim 1 , wherein the gate-keeping pre-processor is configured to:

re-enable the gate-keeping function after a predetermined amount of time has elapsed.

6. The listening device of claim 1 , wherein the gate-keeping pre-processor is configured to:

re-enable the gate-keeping function based on a determination that a second user input comprises a second command.

7. The listening device of claim 6 , wherein the command and the second command are the same command.

8. The listening device of claim 1 , wherein the gate-keeping pre-processor comprises a pre-processing function of the primary processor.

9. The listening device of claim 1 , wherein the gate-keeping pre-processor comprises a localized pre-processor that is incapable of receiving external electrical signals.

10. The listening device of claim 1 , further comprising:

one or more indicators configured to provide an indication of whether the gate-keeping function is enabled or disabled.

11. The listening device of claim 10 , wherein the one or more indicators comprises light emitting diodes (LEDs).

12. A gate-keeping pre-processor comprising:

an exclusive input lead from a sensor of a listening device; and

an exclusive output lead to a primary processor of the listening device, wherein the gate-keeping pre-processor is configured to:

block communications between the sensor and the primary processor when a gate-keeping function is enabled;

based on a determination that a first portion of user input, received via an exclusive input lead from the sensor, comprises a command, disable the gate-keeping function; and

allow communications between the sensor and the primary processor when the gate-keeping function is disabled, wherein the primary processor is configured to receive and process a second portion of the user input when the gate-keeping function is disabled.

13. The gate-keeping pre-processor of claim 12 , wherein the gate-keeping pre-processor is further configured to:

re-enable the gate-keeping function after a predetermined amount of time has elapsed.

14. The gate-keeping pre-processor of claim 12 , wherein the gate-keeping pre-processor is further configured to:

re-enable the gate-keeping function based on a determination that a second user input comprises a second command.

15. The gate-keeping pre-processor of claim 14 , wherein the command and the second command are the same command.

16. The gate-keeping pre-processor of claim 12 , wherein the gate-keeping pre-processor comprises a pre-processing function of the primary processor.

17. The gate-keeping pre-processor of claim 12 , wherein the gate-keeping pre-processor comprises a localized pre-processor that is incapable of receiving external electrical signals.

18. A method comprising:

blocking, by a gate-keeping pre-processor disposed between a sensor of a listening device and a primary processor of the listening device, signals associated with environmental audio when a gate-keeping function is enabled;

disabling, based on a determination that the environmental audio comprises a command, the gate-keeping function; and

allowing a portion of the environmental audio after the command to be received by the primary processor when the gate-keeping function is disabled.

19. The method of claim 18 , wherein the determination that the environmental audio comprises a command comprises:

analyzing, using at least one of Natural Language Processing or artificial intelligence, the environmental audio to determine whether the environmental audio comprises the command.

20. The method of claim 18 , further comprising:

re-enabling the gate-keeping function based on at least one of: a predetermined amount of time has elapsed or a second environmental audio comprising a second command.

21. The method of claim 18 , further comprising:

recording the environmental audio, wherein the portion of the environmental audio comprises recorded environmental audio.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 23, 2023
From: MAI, XIAO MING
To: STACHURA, THOMAS
Reel/Frame 065305/0857 →
Continuity (13)
Continuation 17750537 · May 23, 2022
Continuation 17083596 · Oct 29, 2020
Continuation 16267364 · Feb 4, 2019
Continuation In Part 16198588 · Nov 21, 2018
Continuation In Part 16198573 · Nov 21, 2018
Continuation In Part 16198594 · Nov 21, 2018
Continuation In Part 16198600 · Nov 21, 2018
Continuation In Part 16010725 · Jun 18, 2018
Continuation In Part 16010725 · Jun 18, 2018
Continuation In Part 16010725 · Jun 18, 2018
Continuation In Part 16010725 · Jun 18, 2018
Continuation In Part 15812679 · Nov 14, 2017
Related Publication 20240048970A1 · Feb 8, 2024
References Cited (173)
US 4153370A · Corey, III · 1979 [cited by applicant]
US 5248919A · Hanna et al. · 1993 [cited by applicant]
US 5448646A · Lucey et al. · 1995 [cited by applicant]
US 6005548A · Latypov et al. · 1999 [cited by applicant]
US 6252544B1 · Hoffberg · 2001 [cited by applicant]
US 6804396B2 · Higaki et al. · 2004 [cited by applicant]
US 7010332B1 · Irvin et al. · 2006 [cited by applicant]
US 7106843B1 · Gainsboro et al. · 2006 [cited by applicant]
US 7340077B2 · Gokturk et al. · 2008 [cited by applicant]
US 7365282B2 · Altonen et al. · 2008 [cited by applicant]
US 7424623B2 · Du et al. · 2008 [cited by applicant]
US 7444000B2 · Rhoads · 2008 [cited by applicant]
US 7760905B2 · Rhoads et al. · 2010 [cited by applicant]
US 7840031B2 · Albertson et al. · 2010 [cited by applicant]
US 8090961B2 · Yoffe et al. · 2012 [cited by applicant]
US 8522309B2 · Yoffe et al. · 2013 [cited by applicant]
US 8638989B2 · Holz · 2014 [cited by applicant]
US 8723789B1 · Rafii · 2014 [cited by applicant]
US 8745541B2 · Wilson et al. · 2014 [cited by applicant]
US 9024842B1 · Prada Gomez et al. · 2015 [cited by applicant]
US 9177557B2 · Talwar et al. · 2015 [cited by applicant]
US 9258394B2 · Sobti et al. · 2016 [cited by applicant]
US 9357320B2 · Gelter · 2016 [cited by applicant]
US 9472206B2 · Ady · 2016 [cited by applicant]
US 9679696B2 · Bhutani et al. · 2017 [cited by applicant]
US 9697828B1 · Prasad et al. · 2017 [cited by applicant]
US 9747884B2 · Lehmann · 2017 [cited by applicant]
US 9851735B2 · Bard et al. · 2017 [cited by applicant]
US 10002259B1 · Mai · 2018 [cited by applicant]
US 10152969B2 · Reilly et al. · 2018 [cited by applicant]
US 10332517B1 · Wang · 2019 [cited by applicant]
US 10354648B2 · Christopher · 2019 [cited by applicant]
US 10354658B2 · Wilberding · 2019 [cited by applicant]
US 10616411B1 · Chang et al. · 2020 [cited by applicant]
US 10616746B2 · Fong et al. · 2020 [cited by applicant]
US 10874011B1 · Orysh et al. · 2020 [cited by applicant]
US 11107480B2 · Boyer · 2021 [cited by applicant]
US 11184711B2 · Stachura · 2021 [cited by applicant]
US 20040193413A1 · Wilson et al. · 2004 [cited by applicant]
US 20040264149A1 · Carswell · 2004 [cited by applicant]
US 20050039040A1 · Ransom et al. · 2005 [cited by applicant]
US 20070123283A1 · Bennetts et al. · 2007 [cited by applicant]
US 20080168290A1 · Jobs et al. · 2008 [cited by applicant]
US 20080317265A1 · Bouza, II et al. · 2008 [cited by applicant]
US 20090103169A1 · Kokeguchi · 2009 [cited by applicant]
US 20100066676A1 · Kramer et al. · 2010 [cited by applicant]
US 20100125816A1 · Bezos · 2010 [cited by applicant]
US 20100306713A1 · Geisner et al. · 2010 [cited by applicant]
US 20110032184A1 · Roche et al. · 2011 [cited by applicant]
US 20110091047A1 · Konchitsky et al. · 2011 [cited by applicant]
US 20110173204A1 · Murillo et al. · 2011 [cited by applicant]
US 20110173574A1 · Clavin et al. · 2011 [cited by applicant]
US 20110179482A1 · Yoffe et al. · 2011 [cited by applicant]
US 20110185309A1 · Challinor et al. · 2011 [cited by applicant]
US 20110291926A1 · Gokturk et al. · 2011 [cited by applicant]
US 20110301934A1 · Tardif · 2011 [cited by applicant]
US 20120053931A1 · Holzrichter · 2012 [cited by applicant]
US 20120133484A1 · Griffin · 2012 [cited by applicant]
US 20120237049A1 · Brown et al. · 2012 [cited by applicant]
US 20130038458A1 · Toivola et al. · 2013 [cited by applicant]
US 20130074002A1 · Markovic et al. · 2013 [cited by applicant]
US 20130093445A1 · Newman · 2013 [cited by applicant]
US 20130159939A1 · Krishnamurthi · 2013 [cited by applicant]
US 20130174205A1 · Jacobsen et al. · 2013 [cited by applicant]
US 20130231930A1 · Sanso · 2013 [cited by applicant]
US 20130259254A1 · Xiang et al. · 2013 [cited by applicant]
US 20130278501A1 · Bulzacki · 2013 [cited by applicant]
US 20130344917A1 · Sobti et al. · 2013 [cited by applicant]
US 20140123208A1 · Plagemann et al. · 2014 [cited by applicant]
US 20140222436A1 · Binder et al. · 2014 [cited by applicant]
US 20140244273A1 · Laroche et al. · 2014 [cited by applicant]
US 20140278435A1 · Ganong et al. · 2014 [cited by applicant]
US 20140372126A1 · Ady · 2014 [cited by applicant]
US 20150074524A1 · Nicholson et al. · 2015 [cited by applicant]
US 20150206529A1 · Kwon et al. · 2015 [cited by applicant]
US 20150221307A1 · Shah · 2015 [cited by examiner]
US 20150279366A1 · Krestnikov et al. · 2015 [cited by applicant]
US 20160056629A1 · Baker et al. · 2016 [cited by applicant]
US 20160098983A1 · Lehmann · 2016 [cited by applicant]
US 20160148615A1 · Lee et al. · 2016 [cited by applicant]
US 20160156378A1 · Linari · 2016 [cited by applicant]
US 20160195856A1 · Spero · 2016 [cited by applicant]
US 20160224036A1 · Baker et al. · 2016 [cited by applicant]
US 20160253149A1 · Yer et al. · 2016 [cited by applicant]
US 20160336022A1 · Florencio et al. · 2016 [cited by applicant]
US 20160366746A1 · van de Ven et al. · 2016 [cited by applicant]
US 20160381053A1 · Taboso Ballesteros et al. · 2016 [cited by applicant]
US 20170004293A1 · Mantri et al. · 2017 [cited by applicant]
US 20170007917A1 · Back et al. · 2017 [cited by applicant]
US 20170011600A1 · Joung et al. · 2017 [cited by applicant]
US 20170054760A1 · Barton et al. · 2017 [cited by applicant]
US 20170064246A1 · Kline et al. · 2017 [cited by applicant]
US 20170148444A1 · Bocklet et al. · 2017 [cited by applicant]
US 20170171941A1 · Steiner · 2017 [cited by applicant]
US 20170180984A1 · Thomas et al. · 2017 [cited by applicant]
US 20170238401A1 · Sadwick et al. · 2017 [cited by applicant]
US 20170270627A1 · Hodge · 2017 [cited by applicant]
US 20170280223A1 · Cavarra et al. · 2017 [cited by applicant]
US 20170359467A1 · Norris et al. · 2017 [cited by applicant]
US 20180124256A1 · Kawamura et al. · 2018 [cited by applicant]
US 20180152783A1 · Barmoav et al. · 2018 [cited by applicant]
US 20180158365A1 · Roche · 2018 [cited by applicant]
US 20180167547A1 · Casey et al. · 2018 [cited by applicant]
US 20180300055A1 · Bynum · 2018 [cited by applicant]
US 20180321905A1 · Fountaine · 2018 [cited by applicant]
US 20180324518A1 · Dusan et al. · 2018 [cited by applicant]
US 20180329512A1 · Liao et al. · 2018 [cited by applicant]
US 20180352315A1 · Gelling et al. · 2018 [cited by applicant]
US 20190043466A1 · Masterson et al. · 2019 [cited by applicant]
US 20190043471A1 · Maziewski et al. · 2019 [cited by applicant]
US 20190043494A1 · Czyryba et al. · 2019 [cited by applicant]
US 20190051299A1 · Ossowski et al. · 2019 [cited by applicant]
US 20190074002A1 · Christopher · 2019 [cited by examiner]
US 20190074014A1 · Wilberding · 2019 [cited by applicant]
US 20190147173A1 · Mai · 2019 [cited by applicant]
US 20190147847A1 · Mai · 2019 [cited by applicant]
US 20190147848A1 · Mai · 2019 [cited by applicant]
US 20190147874A1 · Mai · 2019 [cited by applicant]
US 20190147905A1 · Mai · 2019 [cited by applicant]
US 20190174306A1 · Mai · 2019 [cited by applicant]
US 20190287529A1 · Christopher et al. · 2019 [cited by applicant]
US 20190342339A1 · Nanda et al. · 2019 [cited by applicant]
US 20190347449A1 · Kowasic · 2019 [cited by applicant]
US 20200005799A1 · Boyer · 2020 [cited by applicant]
US 20200045527A1 · Fong et al. · 2020 [cited by applicant]
US 20200089464A1 · Curtis · 2020 [cited by applicant]
US 20200196141A1 · Baker et al. · 2020 [cited by applicant]
US 20200258518A1 · Stachura · 2020 [cited by applicant]
US 20200258528A1 · Stachura · 2020 [cited by applicant]
US 20200260184A1 · Stachura · 2020 [cited by applicant]
US 20200260185A1 · Stachura · 2020 [cited by applicant]
US 20200260186A1 · Stachura · 2020 [cited by applicant]
US 20200329330A1 · Mitchell et al. · 2020 [cited by applicant]
US 20210118438A1 · Clarke et al. · 2021 [cited by applicant]
US 20220113936A1 · Baker et al. · 2022 [cited by applicant]
US 20220139377A1 · Lee et al. · 2022 [cited by applicant]
CN 101604447B · 2011 [cited by applicant]
CN 208172539U · 2018 [cited by applicant]
CN 108989954A · 2018 [cited by applicant]
JP H08241098A · 1996 [cited by applicant]
JP H11175095A · 1999 [cited by applicant]
JP 201772857A · 2017 [cited by applicant]
Bjorn Karmann. “Project Alias.” Instructables. https://www.instructables.com/id/Project-Alias/. <http://www.instructables.com/id/Project-Alias/> Retrieved Feb. 7, 2020. 2 pages. [cited by applicant]
“Alexa Privacy.” Amazon.com. https://www.amazon.com/b/ref=dp_zr_faq?node=19149155011#microphone_controls. Retrieved Feb. 7, 2020. 2 pages. [cited by applicant]
Bjorn Karmann. Project Alias 2.0 GitHub. https://github.com/bjoernkarmann/project_alias Retrieved Feb. 7, 2020. 5 pages. [cited by applicant]
Shannon Liao. “This Project hacks Amazon Echo and Google Home to protect your privacy.” The Verge. Jan. 15, 2019. 2 pages. https://www.theverge.com/circuitbreaker/2019/1/15/18182214/amazon-echo-google-home-privacy-prote… [cited by applicant]
Gra.In. https://www.gra.in/ Retrieved. Feb. 7, 2020. 7 pages. [cited by applicant]
Ashley Carman. “John McAfee's ‘hack-proof’ phone is doomed to fail.” The Verge. Apr. 28, 2017. 2 pages. https://www.theverge.com/circuitbreaker/2017/4/28/15459314/john-mcafee-privacy-phone-announce/ 2 pages. [cited by applicant]
Project Alias, by Bjorn Karmann (Bjornkarmannbjoernkarmann.dk), 3 pages. [cited by applicant]
Microphone Controls “Echo smart speakers have a microphone off button”, 2 pages. [cited by applicant]
Project Alias 2.0, Bjorn Karmann, 5 pages. [cited by applicant]
ShareAll sharing Options for: This project hacks Amazon Echo and Google Home to protect your privacy, 2 pages. [cited by applicant]
Long Lived Antiques with Modern Function, 7 pages. [cited by applicant]
John McAfee's Hack-Proof phone is dommed to fail, 2 pages. [cited by applicant]
Apr. 24, 2020, International Search Report of PCT/CA2020/050171. [cited by applicant]
Feb. 1, 2017, Wagoner, Ara “How to mute Google Home's Microphones (and why you need to)” https://www.androidcentral.com/how-mute-google-home-microphone-and-why-you-need. [cited by applicant]
Jan. 4, 2021, U.S. Non-Final Office Action of U.S. Appl. No. 16/785,202. [cited by applicant]
Feb. 1, 2021, U.S. Final Office Action of U.S. Appl. No. 16/785,176. [cited by applicant]
Jul. 7, 2021, IN, Search Report of Indian Application No. 202027024959. [cited by applicant]
Aug. 25, 2021, U.S., Non-Final Office Action of U.S. Appl. No. 16/785,176. [cited by applicant]
Sep. 8, 2021—(EP) Extended European Search Report—App. No. 18879317.8. [cited by applicant]
Nov. 5, 2019, Tung, Liam; Alexa, Siri, Google Assistant smart speakers—they're all open to remote laser attacks. [cited by applicant]
Jan. 15, 2019, The Smart? Speaker Blocker: An Open-Source Privacy Filter for Connected Home Speakers, Chris Champion, llesanmi Olade, Constantinos Papangelis, Haining Liang and Charles Fleming, Xi' an Jiaotong—Liverpool… [cited by applicant]
John McAfee's Hack-Proof phone is doomed to fail, 2 pages. [cited by applicant]
Mar. 3, 2022, IN, First Examination Report in Indian Application No. 202127035688. [cited by applicant]
Apr. 22, 2022, U.S., Non-Final OA, U.S. Appl. No. 17/530,549. [cited by applicant]
Jul. 1, 2022, Non-Final Office Action of related case, U.S. Appl. No. 16/785,856. [cited by applicant]
Jan. 13, 2022—(JP) First Office Action—App No. JP2020-545224. [cited by applicant]
Jun. 9, 2022—(JP) Decision of Refusa—App No. JP2020-545224. [cited by applicant]
Jul. 6, 2022, Non-Final Office Action in related U.S. Appl. No. 16/785,930. [cited by applicant]
Sep. 29, 2022—European Search Report of Application No. 20751890.3-1210/3921830 PCT/CA2020050171. [cited by applicant]
Dec. 19, 2023, Office Action of CN Application No. 202080019490.3. [cited by applicant]
Sep. 6, 2024—(CA) Examination Report—App 3,083,745. [cited by applicant]