IP Library › Granted Patent US 12,750,621
Granted Patent B2
US 12,750,621 · App. 18/415,544 · Granted Sep 29, 2026

Coordination of audio devices

Inventors: Glenn N. Dickins (Como, AU); Mark R.P. Thomas (Walnut Creek, CA); Alan J. Seefeldt (Alameda, CA); Joshua B. Lando (Mill Valley, CA); Daniel Arteaga (Barcelona, ES); Carlos Medaglia Dyonisio (Greystanes, AU); David Gunawan (Sydney, AU); Richard J. Cartwright (Killara, AU); Christopher Graham Hines (Sydney, AU)
Assignees: DOLBY LABORATORIES LICENSING CORPORATION; Dolby International AB
H04R5/04G06F3/165G06N20/00G10L15/08H04L67/141H04R1/326H04R1/403H04R1/406H04R3/005H04R3/12H04S7/303G10L2015/088
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,750,621
App. No.
18/415,544
Filed
Jan 17, 2024
Granted
Sep 29, 2026
Kind
B2
Examiner
LAO, LUNSEE
Art Unit
2691
USPC
381/95
Abstract

An audio session management method may involve: determining, by an audio session manager, one or more first media engine capabilities of a first media engine of a first smart audio device, the first media engine being configured for managing one or more audio media streams received by the first smart audio device and for performing first smart audio device signal processing for the one or more audio media streams according to a first media engine sample clock; receiving, by the audio session manager and via a first application communication link, first application control signals from the first application; and controlling the first smart audio device according to the first media engine capabilities, by the audio session manager, via first audio session management control signals transmitted to the first smart audio device via a first smart audio device communication link and without reference to the first media engine sample clock.

Claims (46)

1 . An audio session management method for an audio system of an audio environment, the audio session management method comprising:

establishing a first smart audio device communication link between an audio session manager and at least a first smart audio device of the audio system, the first smart audio device comprising either a single-purpose audio device or a multi-purpose audio device, the first smart audio device including one or more loudspeakers;

establishing a first application communication link between the audio session manager and a first application device executing a first software application, wherein the first software application is configured to provide media via a cloud-based service;

determining, by the audio session manager, one or more first media engine capabilities of a first media engine of the first smart audio device, the first media engine being configured for managing one or more audio media streams received by the first smart audio device and for performing first smart audio device signal processing for the one or more audio media streams according to a first media engine sample clock;

receiving, by the audio session manager and via the first application communication link, first application control signals from the first software application; and

controlling the first smart audio device according to the first media engine capabilities, by the audio session manager, via first audio session management control signals transmitted to the first smart audio device via the first smart audio device communication link, the first audio session management control signals being responsive to the first application control signals, wherein the audio session manager transmits the first audio session management control signals to the first smart audio device without reference to the first media engine sample clock.

2 . The audio session management method of claim 1 , wherein the first application communication link is established in response to a first route initiation request from the first application device.

3 . The audio session management method of claim 1 , wherein the first application control signals are transmitted from the first software application without reference to the first media engine sample clock.

4 . The audio session management method of claim 1 , wherein the first audio session management control signals cause the first smart audio device to delegate control of the first media engine to the audio session manager.

5 . The audio session management method of claim 1 , wherein a device other than the audio session manager or the first smart audio device is configured for executing the first software application.

6 . The audio session management method of claim 1 , wherein the first smart audio device is configured for executing the first software application.

7 . The audio session management method of claim 1 , wherein the first smart audio device includes a specific purpose audio session manager and wherein the audio session manager communicates with the specific purpose audio session manager via the first smart audio device communication link.

8 . The audio session management method of claim 7 , wherein the audio session manager obtains the one or more first media engine capabilities from the specific purpose audio session manager.

9 . The audio session management method of claim 1 , wherein the audio session manager acts as a gateway for all applications controlling the first media engine, whether the applications are running on the first smart audio device or on another device.

10 . The audio session management method of claim 1 , further comprising establishing at least a first audio stream corresponding to a first audio source, the first audio stream including first audio signals.

11 . The audio session management method of claim 10 , wherein establishing at least the first audio stream involves causing, via first audio session management control signals transmitted to the first smart audio device via the first smart audio device communication link, the first smart audio device to establish at least the first audio stream.

12 . The audio session management method of claim 10 , further comprising a rendering process that causes the first audio signals to be rendered to first rendered audio signals.

13 . The audio session management method of claim 12 , wherein the rendering process is performed by the first smart audio device in response to the first audio session management control signals.

14 . The audio session management method of claim 12 , further comprising:

causing, via the first audio session management control signals, the first smart audio device to establish an inter-smart audio device communication link between the first smart audio device and each of one or more other smart audio devices of the audio environment; and

causing the first smart audio device to transmit one or more of raw microphone signals, processed microphone signals, rendered audio signals or unrendered audio signals to the one or more other smart audio devices via the inter-smart audio device communication link or the inter-smart audio device communication links.

15 . The audio session management method of claim 1 , further comprising:

establishing a second smart audio device communication link between the audio session manager and at least a second smart audio device of the audio system, the second smart audio device comprising either a single-purpose audio device or a multi-purpose audio device, the second smart audio device including one or more microphones;

determining, by the audio session manager, one or more second media engine capabilities of a second media engine of the second smart audio device, the second media engine being configured for receiving microphone data from the one or more microphones and for performing second smart audio device signal processing on the microphone data; and

controlling the second smart audio device according to the second media engine capabilities, by the audio session manager, via second audio session manager control signals transmitted to the second smart audio device via the second smart audio device communication link.

16 . The audio session management method of claim 15 , wherein controlling the second smart audio device involves:

causing the second smart audio device to establish an inter-smart audio device communication link between the second smart audio device and the first smart audio device; and

causing the second smart audio device to transmit at least one of processed or unprocessed microphone data from the second media engine to the first media engine via the inter-smart audio device communication link.

17 . The audio session management method of claim 15 , wherein controlling the second smart audio device involves:

receiving, by the audio session manager and via the first application communication link, first application control signals from the first software application; and

determining the second audio session manager control signals according to the first application control signals.

18 . An apparatus, comprising:

an interface system; and

a control system configured to implement an audio session manager, the control system being further configured to:

establish, via the interface system, a first smart audio device communication link between the audio session manager and at least a first smart audio device of an audio system, the first smart audio device comprising either a single-purpose audio device or a multi-purpose audio device, the first smart audio device including one or more loudspeakers;

establish, via the interface system, a first application communication link between the audio session manager and a first application device executing a first software application, wherein the first software application is configured to provide media via a cloud-based service;

determine one or more first media engine capabilities of a first media engine of the first smart audio device, the first media engine being configured for managing one or more audio media streams received by the first smart audio device and for performing first smart audio device signal processing for the one or more audio media streams according to a first media engine sample clock;

receive, by the audio session manager and via the first application communication link, first application control signals from the first software application; and

control, by the audio session manager and via first audio session management control signals transmitted to the first smart audio device via the first smart audio device communication link, the first smart audio device according to the first media engine capabilities, the first audio session management control signals being responsive to the first application control signals, wherein the audio session manager transmits the first audio session management control signals to the first smart audio device without reference to the first media engine sample clock.

19 . A system that includes the apparatus of claim 18 .

20 . One or more non-transitory media having software encoded thereon, the software including instructions for controlling one or more devices to perform an audio session management method for an audio system of an audio environment, the audio session management method comprising:

establishing a first smart audio device communication link between an audio session manager and at least a first smart audio device of the audio system, the first smart audio device comprising either a single-purpose audio device or a multi-purpose audio device, the first smart audio device including one or more loudspeakers;

establishing a first application communication link between the audio session manager and a first application device executing a first software application, wherein the first software application is configured to provide media via a cloud-based service;

determining, by the audio session manager, one or more first media engine capabilities of a first media engine of the first smart audio device, the first media engine being configured for managing one or more audio media streams received by the first smart audio device and for performing first smart audio device signal processing for the one or more audio media streams according to a first media engine sample clock;

receiving, by the audio session manager and via the first application communication link, first application control signals from the first software application; and

controlling the first smart audio device according to the first media engine capabilities, by the audio session manager, via first audio session management control signals transmitted to the first smart audio device via the first smart audio device communication link, the first audio session management control signals being responsive to the first application control signals, wherein the audio session manager transmits the first audio session management control signals to the first smart audio device without reference to the first media engine sample clock.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 11, 2024
From: DICKINS, GLENN N.; CARTWRIGHT, RICHARD J.; GUNAWAN, DAVID; HINES, CHRISTOPHER GRAHAM; THOMAS, MARK R. P.; SEEFELDT, ALAN J.; LANDO, JOSHUA B.; DYONISIO, CARLOS MEDAGLIA; ARTEAGA, DANIEL
To: DOLBY LABORATORIES LICENSING CORPORATION; DOLBY INTERNATIONAL AB
Reel/Frame 067073/0913 →
Priority Claims (2)
ES ES201930702 · Jul 30, 2019 · national
EP 19217580 · Dec 18, 2019 · regional
Continuity (15)
Continuation 17630779 · Jul 28, 2020
Continuation 16929215 · Jul 15, 2020
Provisional Application 62705884 · Jul 20, 2020
Provisional Application 62705883 · Jul 20, 2020
Provisional Application 62705410 · Jun 25, 2020
Provisional Application 62705351 · Jun 23, 2020
Provisional Application 62705143 · Jun 12, 2020
Provisional Application 62992068 · Mar 19, 2020
Provisional Application 62971421 · Feb 7, 2020
Provisional Application 62949998 · Dec 18, 2019
Provisional Application 62880121 · Jul 30, 2019
Provisional Application 62880118 · Jul 30, 2019
Provisional Application 62880114 · Jul 30, 2019
Provisional Application 62880115 · Jul 30, 2019
Related Publication 20240163340A1 · May 16, 2024
References Cited (161)
US 5561737A · Bowen · 1996 [cited by applicant]
US 5625697A · Bowen · 1997 [cited by applicant]
US 7333622B2 · Algazi · 2008 [cited by applicant]
US 7519175B2 · Suzuki · 2009 [cited by applicant]
US 8060225B2 · Hans · 2011 [cited by applicant]
US 8068925B2 · Mckillop · 2011 [cited by applicant]
US 8130978B2 · Sun · 2012 [cited by applicant]
US 8208663B2 · Jeong · 2012 [cited by applicant]
US 8296366B2 · Huai · 2012 [cited by applicant]
US 8330794B2 · Ramanathan · 2012 [cited by applicant]
US 8483853B1 · Lambourne · 2013 [cited by applicant]
US 8574075B2 · Dickins · 2013 [cited by applicant]
US 8831761B2 · Kemp · 2014 [cited by applicant]
US 9031268B2 · Fejzo · 2015 [cited by applicant]
US 9064503B2 · Dickins · 2015 [cited by applicant]
US 9086475B2 · Kleijn · 2015 [cited by applicant]
US 9113239B2 · Kim · 2015 [cited by applicant]
US 9124965B2 · Heiman · 2015 [cited by applicant]
US 9154877B2 · Kim · 2015 [cited by applicant]
US 9215545B2 · Dublin · 2015 [cited by applicant]
US 9264806B2 · Hyun · 2016 [cited by applicant]
US 9271137B2 · Chan · 2016 [cited by applicant]
US 9316717B2 · Gicklhorn · 2016 [cited by applicant]
US 9319782B1 · Crump · 2016 [cited by applicant]
US 9396731B2 · Herre · 2016 [cited by applicant]
US 9412385B2 · Sen · 2016 [cited by applicant]
US 9549253B2 · Alexandridis · 2017 [cited by applicant]
US 9646620B1 · Oh · 2017 [cited by applicant]
US 9652196B2 · Davis · 2017 [cited by applicant]
US 9679610B2 · Cohen · 2017 [cited by applicant]
US 9723406B2 · Le Nerriec · 2017 [cited by applicant]
US 9723425B2 · Fischer · 2017 [cited by applicant]
US 9813804B2 · Franck · 2017 [cited by applicant]
US 9886234B2 · Lin · 2018 [cited by applicant]
US 9900694B1 · List · 2018 [cited by applicant]
US 9913067B2 · Ojanperä · 2018 [cited by applicant]
US 9933989B2 · Tsingos · 2018 [cited by applicant]
US 9942686B1 · Family · 2018 [cited by applicant]
US 9955253B1 · Chavez · 2018 [cited by applicant]
US 9979829B2 · Cartwright · 2018 [cited by applicant]
US 10002499B2 · Brönmark · 2018 [cited by applicant]
US 10051400B2 · Mcgrath · 2018 [cited by applicant]
US 10074373B2 · Atti · 2018 [cited by applicant]
US 10075791B2 · Milne · 2018 [cited by applicant]
US 10080088B1 · Yang · 2018 [cited by applicant]
US 10096325B2 · Terentiv · 2018 [cited by applicant]
US 10097902B2 · Rajapakse · 2018 [cited by applicant]
US 10097944B2 · Christoph · 2018 [cited by applicant]
US 10142758B2 · Sikora · 2018 [cited by applicant]
US 10146398B2 · Madonna · 2018 [cited by applicant]
US 10152297B1 · Jordahl · 2018 [cited by applicant]
US 10157033B2 · Millington · 2018 [cited by applicant]
US 10324684B2 · Millington · 2019 [cited by applicant]
US 10334384B2 · Sun · 2019 [cited by applicant]
US 10387108B2 · Mcgibney · 2019 [cited by applicant]
US 10506361B1 · Pallamsetty · 2019 [cited by applicant]
US 10743105B1 · Gokarn · 2020 [cited by applicant]
US 11023199B2 · Lemmon · 2021 [cited by applicant]
US 11036461B2 · Triplett · 2021 [cited by applicant]
US 20020072816A1 · Shdema · 2002 [cited by examiner]
US 20030088421A1 · Maes · 2003 [cited by applicant]
US 20030118200A1 · Beaucoup · 2003 [cited by applicant]
US 20050129254A1 · Connor · 2005 [cited by applicant]
US 20050138193A1 · Encarnacion · 2005 [cited by applicant]
US 20050289224A1 · Deslippe · 2005 [cited by applicant]
US 20090298420A1 · Haartsen · 2009 [cited by examiner]
US 20100284389A1 · Ramsay · 2010 [cited by applicant]
US 20110125909A1 · Maes · 2011 [cited by applicant]
US 20110316996A1 · Abe · 2011 [cited by applicant]
US 20130013096A1 · Seefeldt · 2013 [cited by applicant]
US 20130052940A1 · Brillhart · 2013 [cited by applicant]
US 20140108558A1 · Borzycki · 2014 [cited by applicant]
US 20140172435A1 · Thiergart · 2014 [cited by applicant]
US 20150016642A1 · Walsh · 2015 [cited by applicant]
US 20150128194A1 · Kuang · 2015 [cited by applicant]
US 20150131966A1 · Zurek · 2015 [cited by applicant]
US 20150189425A1 · Pang · 2015 [cited by examiner]
US 20150222991A1 · Ramos · 2015 [cited by applicant]
US 20160104491A1 · Lee · 2016 [cited by applicant]
US 20160134988A1 · Gorzel · 2016 [cited by applicant]
US 20160142763A1 · Kim · 2016 [cited by applicant]
US 20160212559A1 · Mateos Sole · 2016 [cited by applicant]
US 20160337755A1 · Bagby · 2016 [cited by applicant]
US 20170012591A1 · Rider · 2017 [cited by applicant]
US 20170032793A1 · Baumgarte · 2017 [cited by applicant]
US 20170125023A1 · Oh · 2017 [cited by applicant]
US 20170156015A1 · Stockhammer · 2017 [cited by applicant]
US 20170280264A1 · Wang · 2017 [cited by applicant]
US 20170337048A1 · Gunderson · 2017 [cited by applicant]
US 20170374465A1 · Family · 2017 [cited by applicant]
US 20180060025A1 · Hill · 2018 [cited by applicant]
US 20180098112A1 · Suyama · 2018 [cited by applicant]
US 20180152803A1 · Seefeldt · 2018 [cited by applicant]
US 20180165054A1 · Kang · 2018 [cited by applicant]
US 20180167581A1 · Goesnar · 2018 [cited by applicant]
US 20180184199A1 · Fontana · 2018 [cited by applicant]
US 20180192223A1 · Satheesh · 2018 [cited by applicant]
US 20180249267A1 · Klingler · 2018 [cited by applicant]
US 20180352329A1 · Klingler · 2018 [cited by applicant]
US 20180357038A1 · Olivieri · 2018 [cited by applicant]
US 20190058948A1 · Gupta · 2019 [cited by applicant]
US 20190124458A1 · Sheen · 2019 [cited by applicant]
US 20190158974A1 · Tsingos · 2019 [cited by applicant]
US 20190166447A1 · Seldess · 2019 [cited by applicant]
US 20190213858A1 · Kobayashi · 2019 [cited by applicant]
US 20190239013A1 · Audfray · 2019 [cited by applicant]
US 20190306607A1 · Clayton · 2019 [cited by applicant]
US 20200351606A1 · Seefeldt · 2020 [cited by applicant]
US 20210058179A1 · Bowler · 2021 [cited by examiner]
CN 102474424A · 2012 [cited by applicant]
CN 103703751A · 2014 [cited by applicant]
CN 107896355A · 2018 [cited by applicant]
CN 107948838A · 2018 [cited by applicant]
CN 107950036A · 2018 [cited by applicant]
CN 108293153A · 2018 [cited by applicant]
CN 109361994A · 2019 [cited by applicant]
DE 102013217367A1 · 2014 [cited by applicant]
EP 1605637A2 · 2005 [cited by applicant]
EP 3148224A2 · 2017 [cited by applicant]
EP 2755373B1 · 2017 [cited by applicant]
EP 3209034A1 · 2017 [cited by applicant]
EP 3467819A1 · 2019 [cited by applicant]
EP 3484184A1 · 2019 [cited by applicant]
EP 3032847B1 · 2020 [cited by applicant]
EP 3163849B1 · 2020 [cited by applicant]
EP 3223542B1 · 2021 [cited by applicant]
GB 2561844A · 2018 [cited by applicant]
JP 2006033806A · 2006 [cited by applicant]
JP 2016100741A · 2016 [cited by applicant]
JP 2016528757A · 2016 [cited by applicant]
JP 2019509679A · 2019 [cited by applicant]
KR 100830039B1 · 2008 [cited by applicant]
WO 2009086599A1 · 2009 [cited by applicant]
WO 2009086602A1 · 2009 [cited by applicant]
WO 2013049125A1 · 2013 [cited by applicant]
WO 2014007724A1 · 2014 [cited by applicant]
WO 2016048381A1 · 2016 [cited by applicant]
WO 2017039632A1 · 2017 [cited by applicant]
WO 2017118983A1 · 2017 [cited by applicant]
WO 2017147935A1 · 2017 [cited by applicant]
WO 2018064410A1 · 2018 [cited by applicant]
WO 2018202324A1 · 2018 [cited by applicant]
WO 19012131A1 · 2019 [cited by applicant]
WO 2019067445A1 · 2019 [cited by applicant]
WO 2019067620A1 · 2019 [cited by applicant]
WO 2019089322A1 · 2019 [cited by applicant]
WO 2019139991A1 · 2019 [cited by applicant]
WO 2019246457A1 · 2019 [cited by applicant]
WO WO2021021814A1 · 2021 [cited by applicant]
Author: Unavailable: CheVolume Liberate your audio, Dec. 31, 2016, http://www.chevolume.com/. [cited by applicant]
Author: Unavailable, “Combine Multiple Audio Interfaces By Creating an Aggregate Device” Apple Support, Published on Oct. 17, 2017. [cited by applicant]
Ding Lei Audio processing and the application of sound reinforcement equipment of studio in Jiangyin Broadcasting and Television Center [J] . Audio Engineering , 2016, 40( 8) : 1-9. 10 pages. [cited by applicant]
Feifer, J. “Multiple Phones Into One Big Speaker System” Sep. 22, 2015. [cited by applicant]
Fink, G. et al.“Acoustic microphone geometry calibration: An overview and experimental evaluation of state-of-the-art algorithms” published Jul. 2016, IEEE Signal Processing Society. [cited by applicant]
Fink, G. et al.“Geometry calibration of distributed microphone arrays exploiting audio-visual correspondences” Sep. 2014, IEEE Conference Location: Lisbon, Portugal. [cited by applicant]
Lee, C.H. “Location-Aware Speakers for the Virtual Reality Environments” Feb. 2017, IEEE Access, vol. 5, pp. 2636-2640, 2017. [cited by applicant]
Nielsen, Jesper Kjoer “Loudspeaker and Listening Position Estimation Using Smart Speakers” IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Calgary, AB, 2018, pp. 81-85 Date of publicat… [cited by applicant]
Papp, I. et L “Smart Audio/Video Playback Control Based on Presence Detection and User Localization in Home Environment” IEEE, published Jan. 2011. [cited by applicant]
Plinge, A. et al.“Passive Online Geometry Calibration of Acoustic Sensor Networks” IEEE Signal Processing Letters, vol. 24, No. 3, Mar. 2017. [cited by applicant]
Walker, Matt, “Crowd Mics turns your Smartphone Into a Microphone” Jul. 22, 2014, Endless events. [cited by applicant]
Yin Jiping et al., Lightweight Audio and Video Engine for Android, Computer Systems Applications, 2015, vol. 24, Issue 12, 5 pages. [cited by applicant]