IP Library › Granted Patent US 12,451,137
Granted Patent B2
US 12,451,137 · App. 18/156,674 · Granted Oct 21, 2025

Speech recognition systems and methods for concurrent voice commands

Inventors: Steven Boswell (Phoenix, AZ); Sonia Dodd (Phoenix, AZ); Shell Stacey (Phoenix, AZ)
Assignee: HONEYWELL INTERNATIONAL INC.
G10L15/32G10L15/22G10L15/30
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,451,137
App. No.
18/156,674
Filed
Jan 19, 2023
Granted
Oct 21, 2025
Kind
B2
Art Unit
2681
USPC
704/231
Abstract

Systems and methods are provided that support concurrent voice commands from different users. A speech recognition system includes a first input interface to receive a first audio input, a second input interface to receive a second audio input, an output interface, a first recognition module coupled to the first input interface and the output interface to determine a first textual representation of the first audio input and transmit a first message stream comprising the first textual representation and a first identifier associated with the first audio input via the output interface, and a second recognition module coupled to the second input interface and the output interface to determine a second textual representation of the second audio input and transmit a second message stream comprising the second textual representation and a different identifier associated with the second audio input via the output interface.

Claims (43)

1. A system comprising:

a first splitter coupled to a first audio input device, an intercom system and a first input interface to provide a first audio signal received from the first audio input device to each of the intercom system and the first input interface;

a second splitter coupled to a second audio input device, the intercom system and a second input interface to provide a second audio signal received from the second audio input device to each of the intercom system and the second input interface, wherein the intercom system is configured to combine the first audio signal and the second audio signal into a consolidated audio signal;

a first analog-to-digital converter (ADC) coupled to the first input interface to convert the first audio signal into a first input corresponding to the first audio signal;

a second analog-to-digital converter (ADC) coupled to the second input interface to convert the second audio signal into a second input corresponding to the second audio signal;

a shared output interface to be coupled to a communications bus;

a first recognition module coupled to the first ADC and the shared output interface to determine a first textual representation of the first audio signal based on the first input and transmit a first message stream comprising the first textual representation and a first identifier associated with the first audio signal via the shared output interface; and

a second recognition module coupled to the second ADC and the shared output interface to determine a second textual representation of the second audio signal based on the second input and transmit a second message stream comprising the second textual representation and a second identifier associated with the second audio signal via the shared output interface, wherein the second identifier is different from the first identifier.

2. The system of claim 1 , wherein:

the first recognition module broadcasts the first message stream comprising the first textual representation and the first identifier associated with the first audio signal over the communications bus; and

the second recognition module broadcasts the second message stream comprising the second textual representation and the second identifier associated with the second audio signal over the communications bus.

3. The system of claim 1 , further comprising a first user input device coupled to the first recognition module, wherein the first recognition module is configurable to initiate sampling the first audio signal in response to a first user input received via the first user input device.

4. The system of claim 3 , further comprising a second user input device coupled to the second recognition module, wherein:

the second user input device is different from the first user input device; and

the second recognition module is configurable to initiate sampling the second audio signal in response to a second user input received via the second user input device.

5. The system of claim 1 , further comprising a data storage element to maintain subscription information in response to subscription requests from one or more onboard systems coupled to the shared output interface via the communications bus.

6. The system of claim 5 , wherein:

the first recognition module broadcasts the first message stream comprising the first textual representation and the first identifier associated with the first audio signal over the communications bus; and

a first onboard application at the one or more onboard systems subscribed to the first identifier is configurable to receive the first message stream and initiate one or more actions associated with a voice command corresponding to the first textual representation.

7. The system of claim 6 , wherein:

the second recognition module broadcasts the second message stream comprising the second textual representation and the second identifier associated with the second audio signal over the communications bus; and

a second onboard application at the one or more onboard systems subscribed to the second identifier is configurable to receive the second message stream and initiate one or more actions associated with a second voice command corresponding to the second textual representation.

8. The system of claim 1 , wherein the first audio signal and the second audio signal are concurrently received, and the first recognition module determines the first textual representation of the first audio signal independent of the second recognition module determining the second textual representation of the second audio signal.

9. The system of claim 1 , wherein the first audio input device is associated with a first user and the second audio input device is associated with a second user different from the first user.

10. The system of claim 1 , wherein the consolidated audio signal is reproduced via one or more audio output devices.

11. The system of claim 3 , wherein the consolidated audio signal is reproduced via an audio output device integrated with the first user input device at a headset.

12. The system of claim 1 , wherein the first identifier uniquely identifies the first audio input device and the second identifier uniquely identifies the second audio input device.

13. The system of claim 1 , further comprising an avionics system coupled to the shared output interface via the communications bus, wherein a destination software application at the avionics system is configured to disambiguate a voice command corresponding to the first textual representation concurrent to a second voice command corresponding to the second textual representation using the first identifier.

14. The system of claim 1 , further comprising the intercom system including a first audio input interface coupled to the first splitter to receive the first audio signal and a second audio input interface coupled to the second splitter to receive the second audio signal.

15. A non-transitory computer-readable medium having computer-executable instructions stored thereon that, when executed by a processing system, cause the processing system to provide a speech recognition system comprising:

a first recognition module coupled to a first analog-to-digital converter (ADC) coupled to a first splitter to obtain first audio input corresponding to a first voice command comprising a first audio signal received via a first audio input device coupled to the first splitter, determine a first textual representation of the first voice command based on the first audio input, and broadcast, via a shared output interface coupled to a communications bus, a first message stream comprising the first textual representation of the first voice command in association with a first identifier associated with the first audio input device; and

a second recognition module coupled to a second analog-to-digital converter (ADC) coupled to a second splitter to obtain second audio input corresponding to a second voice command comprising a second audio signal received via a second audio input device coupled to the second splitter, wherein the second audio input device is different from the first audio input device, determine a second textual representation of the second voice command based on the second audio input, and broadcast, via the shared output interface coupled to the communications bus, a second message stream comprising the second textual representation of the second voice command in association with a second identifier associated with the second audio input device, wherein the second identifier is different from the first identifier.

16. The computer-readable medium of claim 15 , wherein the computer-executable instructions cause the processing system to determine the first identifier based at least in part on the first audio input device in response to a first subscription request from an avionics system coupled to the communications bus.

17. The computer-readable medium of claim 15 , wherein the first audio input device is associated with a first user and the second audio input device is associated with a second user different from the first user.

18. The computer-readable medium of claim 15 , wherein the first recognition module determines the first textual representation concurrent to the second recognition module determining the second textual representation.

19. A method comprising:

receiving, via a first input interface of a speech recognition system corresponding to a first speech recognition channel distinct from a second speech recognition channel associated with a second input interface of the speech recognition system, a first audio signal from a first audio input device coupled to the first input interface, wherein a second audio input device different from the first audio input device is coupled to the second input interface;

determining, at the speech recognition system, a first textual representation of the first audio signal;

determining, at the speech recognition system, a first identifier associated with the first audio input device, wherein the first identifier uniquely identifies the first audio input device and is different from a second identifier associated with the second audio input device coupled to the second input interface of the speech recognition system; and

transmitting, by the speech recognition system via a shared output interface of the speech recognition system coupled to a communications bus, a first message stream including the first identifier uniquely identifying the first audio input device, wherein the first message stream comprises the first textual representation.

20. The method of claim 19 , further comprising:

receiving, at the speech recognition system, a subscription request for the first audio input device from a system onboard a vehicle, wherein the system is coupled to the shared output interface of the speech recognition system; and

providing, by the speech recognition system, the first identifier to the system in response to the subscription request, wherein the system is configurable to monitor the shared output interface to receive the first message stream using the first identifier.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 19, 2023
From: BOSWELL, STEVEN; DODD, SONIA; STACEY, SHELL
To: HONEYWELL INTERNATIONAL INC.
Reel/Frame 062424/0493 →
Continuity (1)
Related Publication 20240249726A1 · Jul 25, 2024
References Cited (78)
US 4130884A · Hildinger · 1978 [cited by applicant]
US 6421645B1 · Beigi et al. · 2002 [cited by applicant]
US 7299187B2 · Tahara et al. · 2007 [cited by applicant]
US 7458029B2 · Agrawala et al. · 2008 [cited by applicant]
US 7620901B2 · Carpenter et al. · 2009 [cited by applicant]
US 8347215B2 · Carpenter et al. · 2013 [cited by applicant]
US 8515763B2 · Dong et al. · 2013 [cited by applicant]
US 9392326B2 · Lee et al. · 2016 [cited by applicant]
US 9569174B2 · Rogers et al. · 2017 [cited by applicant]
US 9959861B2 · Zhou et al. · 2018 [cited by applicant]
US 9965035B2 · Santamaria et al. · 2018 [cited by applicant]
US 9983664B2 · Kim et al. · 2018 [cited by applicant]
US 9996231B2 · Missig et al. · 2018 [cited by applicant]
US 10074367B2 · Tolyama · 2018 [cited by applicant]
US 10127564B2 · Heath · 2018 [cited by applicant]
US 10191619B2 · Yoon et al. · 2019 [cited by applicant]
US 10205827B1 · Pycko · 2019 [cited by examiner]
US 10445355B2 · Miller et al. · 2019 [cited by applicant]
US 10447744B2 · Feldman et al. · 2019 [cited by applicant]
US 10558351B2 · Shan · 2020 [cited by applicant]
US 10664122B2 · Choi et al. · 2020 [cited by applicant]
US 10969945B2 · Bernstein et al. · 2021 [cited by applicant]
US 10991364B1 · Hoover et al. · 2021 [cited by applicant]
US 11002558B2 · Santamaria et al. · 2021 [cited by applicant]
US 11144535B2 · Gilbertson et al. · 2021 [cited by applicant]
US 11221729B1 · Bauchot et al. · 2022 [cited by applicant]
US 11467711B2 · Ma et al. · 2022 [cited by applicant]
US 11714539B1 · Boswell et al. · 2023 [cited by applicant]
US 11960668B1 · Boswell et al. · 2024 [cited by applicant]
US 20020036660A1 · Adan et al. · 2002 [cited by applicant]
US 20030066016A1 · Wehage · 2003 [cited by applicant]
US 20050180327A1 · Banerjee et al. · 2005 [cited by applicant]
US 20060168531A1 · Sato · 2006 [cited by applicant]
US 20060212291A1 · Matsuo · 2006 [cited by applicant]
US 20070052725A1 · Ostojic et al. · 2007 [cited by applicant]
US 20070153806A1 · Celinski et al. · 2007 [cited by applicant]
US 20070226636A1 · Carpenter et al. · 2007 [cited by applicant]
US 20070288129A1 · Komer et al. · 2007 [cited by applicant]
US 20100073359A1 · Suddreth et al. · 2010 [cited by applicant]
US 20100180210A1 · Toyama et al. · 2010 [cited by applicant]
US 20100293501A1 · Russ et al. · 2010 [cited by applicant]
US 20120110403A1 · Chen et al. · 2012 [cited by applicant]
US 20130104065A1 · Stecher · 2013 [cited by applicant]
US 20130162519A1 · Ameling et al. · 2013 [cited by applicant]
US 20130241840A1 · Durojaiye · 2013 [cited by applicant]
US 20140019873A1 · Gupta et al. · 2014 [cited by applicant]
US 20140040756A1 · Bukurak et al. · 2014 [cited by applicant]
US 20140169471A1 · He · 2014 [cited by applicant]
US 20140363799A1 · Brown · 2014 [cited by applicant]
US 20160034065A1 · Yin et al. · 2016 [cited by applicant]
US 20160267773A1 · Martin · 2016 [cited by applicant]
US 20160321841A1 · Christen et al. · 2016 [cited by applicant]
US 20160360382A1 · Gross et al. · 2016 [cited by applicant]
US 20200027378A1 · Castet · 2020 [cited by examiner]
US 20200233501A1 · Jacobs · 2020 [cited by applicant]
US 20200249811A1 · Lemay et al. · 2020 [cited by applicant]
US 20200264738A1 · Lee et al. · 2020 [cited by applicant]
US 20210249009A1 · Manjunath · 2021 [cited by examiner]
US 20210263600A1 · Starrett et al. · 2021 [cited by applicant]
US 20210342785A1 · Mann et al. · 2021 [cited by applicant]
US 20220100463A1 · Crouch et al. · 2022 [cited by applicant]
US 20220335926A1 · Saptharishi et al. · 2022 [cited by applicant]
US 20220374085A1 · Nguyen et al. · 2022 [cited by applicant]
US 20220388630A1 · Saptharishi et al. · 2022 [cited by applicant]
US 20240143157A1 · Boswell et al. · 2024 [cited by applicant]
CN 104570835A · 2015 [cited by applicant]
CN 113936650A · 2022 [cited by applicant]
CN 111338555B · 2022 [cited by applicant]
CN 114327235A · 2022 [cited by applicant]
EP 1487171A1 · 2004 [cited by applicant]
EP 3998527A2 · 2022 [cited by applicant]
JP 2013239137A · 2013 [cited by applicant]
JP 7051756B2 · 2022 [cited by applicant]
WO 2018213414A1 · 2018 [cited by applicant]
WO 2019063496A1 · 2019 [cited by applicant]
WO 2021184375A1 · 2021 [cited by applicant]
WO 2022005819A1 · 2022 [cited by applicant]
WO 2022143198A1 · 2022 [cited by applicant]