IP Library › Granted Patent US 12,260,870
Granted Patent B2
US 12,260,870 · App. 17/378,634 · Granted Mar 25, 2025

Interrupt for noise-cancelling audio devices

Inventors: Baptiste P. Paquier (Saratoga, CA); Aram M. Lindahl (Menlo Park, CA); Adam E. Kriegel (Mountain View, CA); Kisun You (Campbell, CA); Sarang S. Ranade (San Jose, CA)
Assignee: Apple Inc.
G10L21/0208G06N20/00G10L15/08G10L17/02G10L2015/088
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,260,870
App. No.
17/378,634
Granted
Mar 25, 2025
Kind
B2
Abstract

Implementations of the subject technology provide systems and methods for determining whether to interrupt a user of an audio device that is operating in a noise-cancelling mode of operation. For example, the user may desire to be interrupted by one or more pre-designated contacts that are identified at an associated electronic device as interrupt-authorized contacts, or by a person who speaks a designated keyword to the user.

Claims (52)

1. A device of a first user, the device comprising:

secure memory storing a plurality of contacts including contacts designated at the device as interrupt-authorized contacts for a peripheral device; and

one or more processors configured to:

provide audio content to the peripheral device, the audio content to be played without noise canceling content by the peripheral device in a first mode of operation of the peripheral device or to be played combined with the noise cancelling content by the peripheral device in a second mode of operation of the peripheral device;

receive, from the peripheral device, information associated with a voice input received by the peripheral device from a person other than the first user during operation of the peripheral device in the second mode of operation, wherein the information associated with the voice input comprises a voice profile and an indication from a first acoustic model stored in secure memory at the peripheral device that the person is a potential interrupt-authorized contact;

determine, with a second acoustic model at the device at least in part based on the voice profile and the indication received from the peripheral device, whether the person is one of the interrupt-authorized contacts;

in response to determining that the peripheral device is operating in the second mode of operation:

automatically transmit an instruction to the peripheral device to switch from the second mode of operation to the first mode of operation to allow the voice input to pass through if it is determined that the person is one of the interrupt-authorized contacts; and

transmit an instruction to the peripheral device to continue operation in the second mode of operation if it is determined that the person is not one of the interrupt-authorized contact.

2. The device of claim 1 , wherein the interrupt-authorized contacts are not authorized users of the device or the peripheral device, and wherein determining that the person is one of the interrupt-authorized contacts does not provide access, by the person, to any content at or from the device or the peripheral device.

3. The device of claim 1 , wherein the one or more voice profiles have been received at the device from a second device of the person or from a remote server.

4. The device of claim 1 , wherein the first acoustic model and the second acoustic model have each been trained at the device.

5. The device of claim 4 , wherein the second acoustic model has been trained, at the device, using the one or more voice profiles.

6. The device of claim 5 , wherein the first acoustic model has been trained, at the device, using a training voice input that includes at least portion of a name of the first user.

7. The device of claim 1 , wherein the one or more processors are configured to determine whether the voice profile extracted from the voice input corresponds to one or more voice profiles associated the interrupt-authorized contacts, in part, based on recency information for the plurality of contacts stored at the device, frequency information for the plurality of contacts stored at the device, or a communication between the device and a second device of the person.

8. A peripheral device of a first user, the peripheral device comprising:

a speaker;

a microphone; and

processing circuitry configured to:

operate the speaker to play audio content received from a first device of the first user without noise canceling content in a first mode of operation;

operate the speaker to play the audio content combined with the noise cancelling content generated using the microphone in a second mode of operation; and

while operating the speaker in the second mode of operation:

receive a voice input, with the microphone, from a person other than the first user;

determine, at least in part using a first acoustic model stored in secure memory at the peripheral device, whether the person has been designated, at the first device, as an interrupt-authorized contact by:

determining, using the first acoustic model, that the person is a potential interrupt-authorized contact;

providing information associated with the voice input to the first device responsive to determining that the person is the potential interrupt-authorized contact; and

receiving, from the first device responsive to providing the information to the first device and based on a second acoustic model at the first device, an instruction to switch the operation of the speaker to the first mode of operation; and

switch the operation of the speaker to the first mode of operation to allow the voice input to pass through responsive to the instruction.

9. The peripheral device of claim 8 , wherein the first acoustic model at the peripheral device has been trained at the first device.

10. The peripheral device of claim 8 , wherein the instruction from the first device is based on:

a comparison, at the first device, of the information associated with the voice input to at least one voice profile associated with at least one contact that is identified, in secure memory at the first device, as being interrupt authorized; and

a determination, at the first device, of whether the person is the interrupt-authorized contact based on the comparison.

11. The peripheral device of claim 10 , wherein the at least one voice profile has been received at the first device from a second device of the person or from a remote server.

12. The peripheral device of claim 10 , wherein the comparison, at the first device, of the information associated with the voice input to at least one voice profile is based on:

an output of a second acoustic model at the first device responsive to the information associated with the voice input, the second acoustic model having been trained, at the first device, using the at least one voice profile.

13. The peripheral device of claim 8 , wherein the processing circuitry is configured to determine, using the first acoustic model, that the person is the potential interrupt-authorized contact by determining, using the first acoustic model, that the voice input includes at least portion of a name of the first user.

14. The peripheral device of claim 8 , wherein the processing circuitry is configured to determine, using the first acoustic model, that the person is potential interrupt-authorized contact by determining, using the first acoustic model, that the voice input corresponds to a group of interrupt-authorized contacts.

15. The peripheral device of claim 9 , wherein the processing circuitry of the peripheral device is configured to determine, at least in part using the first acoustic model at the peripheral device, whether the person has been designated, at the first device, as the interrupt-authorized contact using the first acoustic model and using location information associated with the received voice input, the location information including at least one of proximity information and directional information and having been determined using the microphone and an additional microphone of an additional peripheral device of the first user, the additional peripheral device further including an additional speaker.

16. A semiconductor device comprising processing circuitry configured to:

operate a speaker of a media output device of a first user to play audio content received from a first device of the first user without noise cancelling content in a first mode of operation;

operate the speaker to play the audio content combined with the noise cancelling content generated using a microphone of the media output device in a second mode of operation; and

while operating the speaker in the second mode of operation:

receive a voice input, with the microphone, from a person other than the first user;

determine, at least in part using a first acoustic model stored in secure memory at the media output device, whether the person has been designated, at the first device, as an interrupt-authorized contact by:

determining, using the first acoustic model, that the person is a potential interrupt-authorized contact;

providing information associated with the voice input to the first device responsive to determining that the person is the potential interrupt-authorized contact; and

receiving, from the first device responsive to providing the information to the first device and based on a second acoustic model at the first device, an instruction to switch the operation of the speaker to the first mode of operation; and

switch the operation of the speaker to the first mode of operation to allow the voice input to pass through responsive to the instruction.

17. The peripheral device of claim 8 , wherein the instruction is based in part on a recency of communication between an electronic device of the person and the first device.

18. The peripheral device of claim 8 , wherein the instruction is based in part on a frequency of communication between an electronic device of the person and the first device.

19. The semiconductor device of claim 16 , wherein the instruction is based in part on a recency of communication between an electronic device of the person and the first device.

20. The semiconductor device of claim 16 , wherein the instruction is based in part on a frequency of communication between an electronic device of the person and the first device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 15, 2021
From: PAQUIER, BAPTISTE P.; LINDAHL, ARAM M.; KRIEGEL, ADAM E.; YOU, KISUN; RANADE, SARANG S.
To: APPLE INC.
Reel/Frame 057495/0144 →
Continuity (3)
Provisional Application 63055269 · Jul 22, 2020
Provisional Application 63053459 · Jul 17, 2020
Related Publication 20220020387A1 · Jan 20, 2022
References Cited (35)
US 8155334B2 · Joho et al. · 2012 [cited by applicant]
US 10129633B1 · Patil et al. · 2018 [cited by applicant]
US 20070154046A1 · Mishan · 2007 [cited by applicant]
US 20080130908A1 · Cohen et al. · 2008 [cited by applicant]
US 20110296194A1 · Herkes · 2011 [cited by examiner]
US 20130293723A1 · Benson et al. · 2013 [cited by applicant]
US 20140314242A1 · Gollbach et al. · 2014 [cited by applicant]
US 20150279365A1 · Sharifi · 2015 [cited by examiner]
US 20160064008A1 · Graham · 2016 [cited by applicant]
US 20170345408A1 · Hong et al. · 2017 [cited by applicant]
US 20180014107A1 · Razouane et al. · 2018 [cited by applicant]
US 20190028803A1 · Benattar · 2019 [cited by applicant]
US 20190385590A1 · Omachi · 2019 [cited by examiner]
US 20200184057A1 · Mukund · 2020 [cited by applicant]
US 20210358470A1 · Kemmerer · 2021 [cited by examiner]
US 20210405148A1 · Han · 2021 [cited by examiner]
CN 103888267A · 2014 [cited by applicant]
CN 106937194A · 2017 [cited by applicant]
CN 107430858A · 2017 [cited by applicant]
CN 108989931A · 2018 [cited by applicant]
CN 109951765A · 2019 [cited by applicant]
CN 110191397A · 2019 [cited by applicant]
CN 110832484A · 2020 [cited by applicant]
GB 2526980A · 2009 [cited by applicant]
GB 2522760A · 2015 [cited by applicant]
GB 2542268A · 2017 [cited by applicant]
WO WO2011161487 · 2011 [cited by applicant]
Feng et al., “Continuous Authentication for Voice Assistants”, MobiCom'17, Oct. 16020, 2017 (Year: 2017). [cited by examiner]
Li, “Google working on ‘attention alerts’ for Pixel Buds that detect crying, barking,” retrieved from https://9to5google.com/2020/04/29/pixel-buds-attention-alerts/, Apr. 29, 2020, 6 pages. [cited by applicant]
Guo Yongliang, “Research on an Embedded Speech Command Processing and Recognition Method,” Nanjing University of Aeronautics and Astronautics, Thesis, Jan. 2010, 79 pages. [cited by applicant]
Umematsu et al., “Sudden-noise Suppression with Strike-portion Detection Based on Phase Linearity for Speech Recognition,” Jan. 19, 2017, 2016 Asia-Pacific Signal and information Processing Association Annual Summit and… [cited by applicant]
Zhang Shuai, “Design and Implementation of an Active Noise Deduction Headphone with Large Earmuffs,” University of Electronic Science and Technology of China, Thesis, 2018, 76 pages. [cited by applicant]
Chinese Office Action from Chinese Patent Application No. 202110812663.3, dated Nov. 14, 2023, 25 pages including English language summary. [cited by applicant]
Chinese Office Action from Chinese Patent Application No. 202110812663.3, dated Mar. 21, 2024, 13 pages including English language summary. [cited by applicant]
Chinese Office Action from Chinese Patent Application No. 202110812663.3, dated May 27, 2024, 12 pages including English language summary. [cited by applicant]