IP Library › Granted Patent US 12,346,631
Granted Patent B2
US 12,346,631 · App. 17/752,478 · Granted Jul 1, 2025

Audio communication device with novel visual indications and adjustable muting

Inventors: David Justin Rappaport (San Francisco, CA); Russell I. Sanchez (Seattle, WA); Flavio Protasio Ribeiro (Bellevue, WA); Woo Suk Lee (Fort Lee, NJ); Bryan K. Mamaril (Seattle, WA); Katherine M. Bailey (Seattle, WA)
Assignee: Microsoft Technology Licensing, LLC
G06F3/165G06F3/0481G10K11/17854G10L25/60H04R29/008G10K2210/3028G10K2210/3056H04R3/005
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,346,631
App. No.
17/752,478
Granted
Jul 1, 2025
Kind
B2
Abstract

Aspects of the present disclosure relate to an audio communication device with novel visual indications and adjustable muting. In examples, an audio communication device is provided. The audio communication device includes at least one processor, and memory storing instructions that, when executed by the at least one processor, cause the audio communication device to perform a set of operations. The set of operations include generating a first visual indicator. The first visual indicator corresponds to audio of one or more users. The set of operations further include receiving a user-input, muting a microphone region of the audio communication device, based on the user-input, and generating a second visual indicator. The second visual indicator replaces at least a portion of the first visual indicator. The second visual indicator corresponds to the muted region. The first visual indicator is indicative of a quality of the audio.

Claims (51)

1. An audio communication device comprising:

at least one processor; and

memory storing instructions that, when executed by the at least one processor, cause the audio communication device to perform a set of operations, the set of operations including:

generating a plurality of indicators, the plurality of indicators comprising a first indicator corresponding to audio of a first user and a second indicator corresponding to audio of a second user;

causing the first indicator to be displayed visually larger in size than the second indicator, when a noise level of the audio of the first user is higher than a noise level of the audio of the second user;

receiving a user-input;

muting a region of the audio communication device, based on the user-input; and

generating a third indicator, the third indicator replacing at least a portion of the first indicator or the second indicator, and the third indicator corresponding to the muted region,

wherein the first indicator is indicative of a quality of the audio, and wherein the quality of the audio is determined based on one or more values from the group consisting of a signal-to-noise ratio, a signal-to-reverberation ratio, a signal-to-interference ratio, and a mean opinion score.

2. The audio communication device of claim 1 , wherein the first indicator is a visual indicator that includes a first hue, when the audio quality is above a first threshold, and that includes a second hue, when the audio quality is below the first threshold.

3. The audio communication device of claim 1 , wherein the third indicator is visual indicator that has a different hue than the first indicator.

4. The audio communication device of claim 1 , wherein the muting of the region comprises performing noise-cancelling digital processing on audio data that is determined to originate from a direction corresponding to the muted region.

5. The audio communication device of claim 4 , wherein a gain of the noise-cancelling digital processing is adjustable, based on the user-input.

6. The audio communication device of claim 1 , wherein the receiving of the user-input comprises receiving a plurality of user-inputs, and wherein the generating of the third indicator comprises generating a plurality of third indicators that each replace a portion of the first indicator.

7. The audio communication device of claim 1 , wherein the receiving of the user-input comprises receiving a plurality of user-inputs, and wherein each indicator of the plurality of indicators correspond to audio of a respective one of the plurality of users.

8. The audio communication device of claim 1 , wherein the set of operations further include:

causing the first indication to be displayed visually smaller in size than the second indication, when a noise level of the first user is lower than a noise level of the second user.

9. The audio communication device of claim 1 , further comprising a base, wherein the base defines a compass, and wherein the direction corresponding to the muted region is the direction along which a polar vector extends, from the geometric center of the base, through the muted region, to a source of the noise.

10. The audio communication device of claim 9 , further comprising:

detecting a movement of the audio of the first user about the base; and

moving the first indication based on the respective movement of the audio of the first user.

11. The audio communication device of claim 1 , further comprising a touchscreen display, wherein the user-input is received via the touchscreen display.

12. The audio communication device of claim 1 , wherein the first indicator corresponding to the audio of the first user and the second indicator corresponding to the audio of the second user have different hues when receiving the audio from both the first user and the second user.

13. An audio communication device comprising:

a base defining a plane extending thereacross;

at least one processor; and

memory storing instructions that, when executed by the at least one processor, cause the audio communication device to perform a set of operations, the set of operations including:

receiving audio data;

generating a first indicator, the first indicator corresponding to a first subset of the audio data, the first subset corresponding to a first user;

generating a second indicator, the second indicator corresponding to a second subset of the audio data, the second subset corresponding to a second user;

causing the first indicator to be displayed visually larger in size than the second indicator, when a noise level of the first subset of the audio data is higher than a noise level of the second subset of the audio data;

generating a third indicator, the third indicator corresponding to a third subset of the audio data, the third subset corresponding to ambient noise, wherein one of the first indicator or the third indicator are capable of overlaying the other of the first indicator or the third indicator, with respect to the plane, to indicate a potential disturbance of the ambient noise on audio quality of the first user;

receiving a user-input, based on the third indicator; and

muting a region of the audio communication device, based on the user-input, wherein the muting of the region comprises performing digital processing on the audio data to filter out noise that is determined to originate from a direction corresponding to the muted region.

14. The audio communication device of claim 13 , wherein the base defines a compass, and wherein the direction corresponding to the muted region is the direction along which a polar vector extends, from the geometric center of the base, through the muted region, to a source of the noise.

15. The audio communication device of claim 13 , wherein the first indicator is visually indicative of a direction along which the one or more users are located.

16. An audio communication device comprising:

at least one processor; and

memory storing instructions that, when executed by the at least one processor, cause the audio communication device to perform a set of operations, the set of operations including:

receiving audio data;

identifying a plurality of users, based on the audio data;

generating a plurality of indications, each of the indications corresponding to a respective one of the plurality of users, wherein the plurality of indications comprise a first indication and a second indication, and wherein the first indication and the second indication correspond to a first user and a second user, respectively;

causing the first indication to be displayed visually larger in size than the second indication, when a noise level of the first user is higher than a noise level of the second user;

receiving a user-input, corresponding to a selection of one of the plurality of indications; and

muting audio from one of the plurality of users, based on the user-input,

wherein the muting of the audio from the one of the plurality of users comprises filtering out a subset of the audio data, wherein the subset of the audio data corresponds to the one of the plurality of users, and

wherein, when the plurality of users move about the audio communication device, the plurality of indications move, based on the respective movements of the corresponding users.

17. The audio communication device of claim 16 , wherein each of the plurality of indications comprise a different color.

18. The audio communication device of claim 16 , wherein the filtering comprises digital signal processing.

19. The audio communication device of claim 16 , wherein the identification of the plurality of users is performed by one or more trained machine-learning models.

20. The audio communication device of claim 16 , wherein the first indication decreases in size, when a noise level of the first user decreases.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 16, 2022
From: BAILEY, KATHERINE M.
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 061792/0423 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 25, 2022
From: RAPPAPORT, DAVID JUSTIN; SANCHEZ, RUSSELL I.; RIBEIRO, FLAVIO PROTASIO; LEE, WOO SUK; MAMARIL, BRYAN K.
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 060018/0516 →
Continuity (1)
Related Publication 20230385014A1 · Nov 30, 2023
References Cited (18)
US 10148912B1 · Oliver · 2018 [cited by examiner]
US 11462232B1 · Wang · 2022 [cited by examiner]
US 20070165834A1 · Redman · 2007 [cited by examiner]
US 20120163610A1 · Sakagami · 2012 [cited by examiner]
US 20130156204A1 · Schulz · 2013 [cited by examiner]
US 20160012827A1 · Alves · 2016 [cited by examiner]
US 20160093291A1 · Kim · 2016 [cited by examiner]
US 20160119459A1 · Clementson · 2016 [cited by examiner]
US 20180352315A1 · Gelling · 2018 [cited by examiner]
US 20190066456A1 · Clark · 2019 [cited by examiner]
US 20190293279A1 · Nakatsukasa · 2019 [cited by examiner]
US 20190341057A1 · Zhang · 2019 [cited by examiner]
WO WO2015046034A1 · 2015 [cited by examiner]
WO 2020076779A1 · 2020 [cited by applicant]
“International Search Report and Written Opinion Issued in PCT Application No. PCT/US23/012972”, Mailed Date: Jun. 16, 2023, 16 Pages. [cited by applicant]
“Speak 510”, Retrieved from: https://web.archive.org/web/20220126234846/https://www.jabra.com/business/speakerphones/jabra-speak-series/jabra-speak-510, Jan. 26, 2022, 12 pages. [cited by applicant]
“Stem Table”, Retrieved from: https://web.archive.org/web/20211120021742/https://www.shure.com/en-us/products/microphones/stem_table, Nov. 20, 2021, 16 Pages. [cited by applicant]
“Invitation to Pay Additional Fee Issued in PCT Application No. PCT/US23/012972”, Mailed Date: Apr. 25, 2023, 12 Pages. [cited by applicant]