IP Library › Granted Patent US 12,205,592
Granted Patent B2
US 12,205,592 · App. 18/233,369 · Granted Jan 21, 2025

Using structured audio output to detect playback and/or to adapt to misaligned playback in wireless speakers

Inventors: Nathaniel Nesiba (Mountain View, CA); Xiang Cao (Mountain View, CA)
Assignee: GOOGLE LLC
G10L15/22B60R16/0373H04M1/6091H04S7/30H04W4/80G10L2021/02087
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,205,592
App. No.
18/233,369
Granted
Jan 21, 2025
Kind
B2
Abstract

Implementations are directed to determining an audio delay, of a computing device, by causing an audio data stream to be transmitted to the computing device via a wireless communication channel. The computing device causes audio output generated using the audio data stream to be rendered via speaker(s). The rendered audio output is captured via microphone(s), and the audio delay determined by comparing the captured audio output with the audio data stream. A delay audio segment can be appended to an additional audio data stream transmitted to the computing device, where the length of the delay audio segment is determined using the audio delay. A noise reduction technique can additionally or alternatively be adapted based on the audio delay. Implementations are additionally or alternatively directed to determining if an audio data stream transmitted to a computing device for rendering through speaker(s) driven by the computing device—is actually being rendered.

Claims (50)

1. A method implemented by one or more processors, the method comprising:

causing an audio data stream including a sequence of frequency segments to be transmitted, via a wireless communication channel and by a computing device within a vehicle, to a vehicle computing device of the vehicle,

wherein transmitting the audio data stream causes the vehicle computing device to render audible output, including the sequence of frequency segments, via one or more vehicle speakers of the vehicle, and

wherein the audible output is generated by the vehicle computing device based on at least part of the audio data stream;

receiving captured audio data that is captured by at least one microphone of the computing device within the vehicle,

wherein the captured audio data captures the audible output rendered by the at least one vehicle speaker;

determining a vehicle audio delay based on comparing the sequence of frequency segments included in the captured audio data to the sequence of frequency segments included in the audio data stream; and

in response to determining the vehicle audio delay:

causing the computing device to adapt local noise cancellation based on the vehicle audio delay.

2. The method of claim 1 ,

wherein the local noise cancellation mitigates, from subsequently captured audio data, a known source audio data stream that is transmitted via the wireless communication channel for rendering by the vehicle computing device via the one or more vehicle speakers; and

wherein adapting the local noise cancellation comprises adapting, based on the vehicle audio delay, an expected time of detecting the known source audio data stream.

3. The method of claim 1 , wherein the computing device is a vehicle interface device powered by a cigarette lighter receptacle of the vehicle.

4. The method of claim 3 , wherein determining the vehicle audio delay is by the vehicle interface device.

5. The method of claim 3 , wherein determining the vehicle audio delay is by a smartphone in communication with the vehicle interface device via a communication channel, and wherein causing the computing device to adapt the local noise cancellation based on the vehicle audio delay comprises:

transmitting, to the vehicle interface device, the vehicle audio delay and/or additional data determined based on the vehicle audio delay.

6. A system comprising:

one or more processors; and

memory configured to store instructions that, when executed by the one or more processors cause the one or more processors to perform operations that include:

causing an audio data stream including a sequence of frequency segments to be transmitted, via a wireless communication channel and by a computing device within a vehicle, to a vehicle computing device of the vehicle,

wherein transmitting the audio data stream causes the vehicle computing device to render audible output, including the sequence of frequency segments, via one or more vehicle speakers of the vehicle, and

wherein the audible output is generated by the vehicle computing device based on at least part of the audio data stream;

receiving captured audio data that is captured by at least one microphone of the computing device within the vehicle,

wherein the captured audio data captures the audible output rendered by the at least one vehicle speaker;

determining a vehicle audio delay based on comparing the sequence of frequency segments included in the captured audio data to the sequence of frequency segments included in the audio data stream; and

in response to determining the vehicle audio delay:

causing the computing device to adapt local noise cancellation based on the vehicle audio delay.

7. The system of claim 6 ,

wherein the local noise cancellation mitigates, from subsequently captured audio data, a known source audio data stream that is transmitted via the wireless communication channel for rendering by the vehicle computing device via the one or more vehicle speakers; and

wherein adapting the local noise cancellation comprises adapting, based on the vehicle audio delay, an expected time of detecting the known source audio data stream.

8. The system of claim 6 , wherein the computing device is a vehicle interface device powered by a cigarette lighter receptacle of the vehicle.

9. The system of claim 8 , wherein determining the vehicle audio delay is by the vehicle interface device.

10. The system of claim 8 , wherein determining the vehicle audio delay is by a smartphone in communication with the vehicle interface device via a communication channel, and wherein causing the computing device to adapt the local noise cancellation based on the vehicle audio delay comprises:

transmitting, to the vehicle interface device, the vehicle audio delay and/or additional data determined based on the vehicle audio delay.

11. A non-transitory computer readable storage medium configured to store instructions that, when executed by one or more processors, cause the one or more processors to perform operations that include:

causing an audio data stream including a sequence of frequency segments to be transmitted, via a wireless communication channel and by a computing device within a vehicle, to a vehicle computing device of the vehicle,

wherein transmitting the audio data stream causes the vehicle computing device to render audible output, including the sequence of frequency segments, via one or more vehicle speakers of the vehicle, and

wherein the audible output is generated by the vehicle computing device based on at least part of the audio data stream;

receiving captured audio data that is captured by at least one microphone of the computing device within the vehicle,

wherein the captured audio data captures the audible output rendered by the at least one vehicle speaker;

determining a vehicle audio delay based on comparing the sequence of frequency segments included in the captured audio data to the sequence of frequency segments included in the audio data stream; and

in response to determining the vehicle audio delay:

causing the computing device to adapt local noise cancellation based on the vehicle audio delay.

12. The non-transitory computer readable storage medium of claim 11 ,

wherein the local noise cancellation mitigates, from subsequently captured audio data, a known source audio data stream that is transmitted via the wireless communication channel for rendering by the vehicle computing device via the one or more vehicle speakers; and

wherein adapting the local noise cancellation comprises adapting, based on the vehicle audio delay, an expected time of detecting the known source audio data stream.

13. The non-transitory computer readable storage medium of claim 11 , wherein the computing device is a vehicle interface device powered by a cigarette lighter receptacle of the vehicle.

14. The non-transitory computer readable storage medium of claim 13 , wherein determining the vehicle audio delay is by the vehicle interface device.

15. The non-transitory computer readable storage medium of claim 13 , wherein determining the vehicle audio delay is by a smartphone in communication with the vehicle interface device via a communication channel, and wherein causing the computing device to adapt the local noise cancellation based on the vehicle audio delay comprises:

transmitting, to the vehicle interface device, the vehicle audio delay and/or additional data determined based on the vehicle audio delay.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 14, 2023
From: NESIBA, NATHANIEL; CAO, XIANG
To: GOOGLE LLC
Reel/Frame 064579/0973 →
Continuity (4)
Continuation 17404673 · Aug 17, 2021
Continuation 16618723
Provisional Application 62798252 · Jan 29, 2019
Related Publication 20230386466A1 · Nov 30, 2023
References Cited (53)
US 5546468A · Beard · 1996 [cited by applicant]
US 6850512B1 · Bishop et al. · 2005 [cited by applicant]
US 9165567B2 · Visser et al. · 2015 [cited by applicant]
US 10009862B1 · Malovany et al. · 2018 [cited by applicant]
US 11100931B2 · Nesiba et al. · 2021 [cited by applicant]
US 20050179540A1 · Rubenstein · 2005 [cited by applicant]
US 20070110251A1 · Krantz et al. · 2007 [cited by applicant]
US 20070281648A1 · Rokusek et al. · 2007 [cited by applicant]
US 20090298474A1 · George · 2009 [cited by applicant]
US 20110098917A1 · LeBeau et al. · 2011 [cited by applicant]
US 20130222210A1 · Wang et al. · 2013 [cited by applicant]
US 20150264480A1 · Talwar · 2015 [cited by applicant]
US 20160029141A1 · Harma · 2016 [cited by applicant]
US 20160259623A1 · Sumner et al. · 2016 [cited by applicant]
US 20170344336A1 · Lotfizadeh · 2017 [cited by applicant]
US 20210375287A1 · Nesiba et al. · 2021 [cited by applicant]
CN 102883239 · 2013 [cited by applicant]
CN 107949823 · 2018 [cited by applicant]
CN 108231071 · 2018 [cited by applicant]
CN 109087660 · 2018 [cited by applicant]
CN 109087660A · 2018 [cited by examiner]
EP 2368767 · 2011 [cited by applicant]
GB 2496249 · 2013 [cited by applicant]
JP 2005079614 · 2005 [cited by applicant]
JP 2006180011 · 2006 [cited by applicant]
JP 2008046709 · 2008 [cited by applicant]
JP 2009033216 · 2009 [cited by applicant]
JP 2010034960 · 2010 [cited by applicant]
JP 2016078729 · 2016 [cited by applicant]
JP 3210980 · 2017 [cited by applicant]
JP 2017117371 · 2017 [cited by applicant]
JP 2017212660 · 2017 [cited by applicant]
WO 2015040840 · 2015 [cited by applicant]
WO WO2015040840A1 · 2015 [cited by examiner]
WO 2017204854 · 2017 [cited by applicant]
WO 2020027828 · 2020 [cited by applicant]
European Patent Office; Communication pursuant Article 94(3) EPC issued in Application No. 21179150.4; 5 pages; dated Jun. 9, 2023. [cited by applicant]
Korean Patent Office; Notice of Office Action issued in Application No. 1020217038000; 10 pages; dated Apr. 4, 2023. [cited by applicant]
Japanese Patent Office; Notice of Allowance issued in 2021-541104, 3 pages, dated Jun. 20, 2022. [cited by applicant]
Japanese Patent Office; Notice of Reasons for Rejection issued in Application No. 2021-541104, 9 pages, dated Feb. 21, 2022. [cited by applicant]
Korean Patent Office; Notice of Allowance issued in Application No. 1020217023438; 3 pages; dated Aug. 24, 2021. [cited by applicant]
European Patent Office; Communication issued in Application No. 21179150.4; 10 pages; dated Nov. 4, 2021. [cited by applicant]
European Patent Office; Communication Under Rule 71(3) EPC issued in Application No. 19707586.4; 47 pages; dated Mar. 1, 2021. [cited by applicant]
European Patent Office; International Search Report and Written Opinion issued in Application No. PCT/US2019/017647; 19 pages; dated Dec. 18, 2019. [cited by applicant]
Gonyou, Stacy, “Car Assistant”; Technical Disclosure Commons; https://www.tdcommons.org/dpubs_series/1493; 9 pages; Sep. 7, 2018. [cited by applicant]
European Patent Office; Invitation To Pay Additional Fees issued in Application No. PCT/US2019/017647; 14 pages; dated Oct. 25, 2019. [cited by applicant]
Japanese Patent Office; Notice of Reasons for Rejection issued in Application No. 2022-1117714, 8 pages, dated Aug. 21, 2023. [cited by applicant]
Korean Patent Office; Decision of Rejection issued in Application No. 20217038000; 7 pages; dated Sep. 27, 2023. [cited by applicant]
China National Intellectual Property Administration; Notification of First Office Action issued in Application No. 201980090440.1; 15 pages; dated Dec. 19, 2023. [cited by applicant]
Wu, Ruixing et al.; Improvements in HRTF dataset of 3D game audio application, 6 pages; dated Feb. 9, 2017. [cited by applicant]
Intellectual Property India; Examination Report issued in Application No. 202127029632; 6 pages; dated Feb. 27, 2024. [cited by applicant]
Hacihabiboglu, H. et al.; Perpetual Spatial Audio Recording, Simulation and Rendering; IEEE Signal Processing Magazine, vol. XX; 22 pages; dated 2017. [cited by applicant]
China National Intellectual Property Administration; Notice of Grant issued in Application No. 201980090440.1; 4 pages; dated May 22, 2024. [cited by applicant]