IP Library Granted Patent US 12,308,024
Granted Patent B2
US 12,308,024 · App. 17/235,787 · Granted May 20, 2025

Portable audio device with voice capabilities

Inventor: David Owens (Lawrence, KS)
Assignee: Harman International Industries, Incorporated
G10L15/22G06F3/167G10L15/18H04R1/025H04R1/403H04R1/406H04W48/18G10L2015/088G10L2015/223H04R2499/11H04W84/04
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,308,024
App. No.
17/235,787
Granted
May 20, 2025
Kind
B2
Abstract

A portable audio device includes a network card able to connect with a WLAN and a wireless modem to connect to a WWAN. The portable audio device detects a wake command via a set of microphones and, in response, selects whether to connect to the WWAN or the WLAN. The portable audio device further acquires, via the set of microphones, a voice query; generates a data request based on the voice query, transmits the data query via the selected one of the WWAN or the WLAN; receives a data response associated with the data request from the selected one of the WWAN or the WLAN; generates an audio signal based on the data response; and transmits the audio signal to one or more speakers included in the portable audio device to generate audio output.

Claims (62)

1. A method of processing a voice query, the method comprising:

detecting, via a set of microphones of a portable audio device, a wake command;

in response to detecting the wake command, performing the steps of:

transitioning the portable audio device from a low-power state to a normal-power state, wherein in the low-power state, a first subset of microphones in the set of microphones are powered on for monitoring for the wake command and a second subset of microphones in the set of microphones are powered off, and wherein in the normal-power state, the second subset of microphones is powered on; and

selecting whether to connect to a wireless wide area network (WWAN) via a wireless modem of the portable audio device or connect to a wireless local area network (WLAN) via a network interface of the portable audio device;

acquiring, via the set of microphones, the voice query;

generating a data request based on the voice query;

transmitting the data request to the selected one of the WWAN or the WLAN;

receiving a data response associated with the data request from the selected one of the WWAN or the WLAN;

generating an audio signal based on the data response; and

transmitting the audio signal to one or more speakers included in the portable audio device to generate audio output.

2. The method of claim 1 , wherein selecting whether to connect to the WWAN or the WLAN comprises determining which of the WWAN or the WLAN has a greatest signal strength.

3. The method of claim 1 , further comprising:

detecting a trigger event; and

in response to detecting the trigger event, re-determining whether to connect to the WWAN or the WLAN.

4. The method of claim 3 , wherein the trigger event comprises at least one of an expiration of a predetermined time period, a signal strength for a currently connected network falling below a predetermined threshold level, a schedule event of a user, or movement of the portable audio device that exceeds a predetermined threshold distance.

5. The method of claim 1 , wherein, in the low-power state, the wireless modem or the network interface are powered off.

6. The method of claim 1 , wherein, in the low-power state, the one or more speakers are powered off.

7. The method of claim 1 , wherein generating the data request based on the voice query comprises processing the voice query using natural language processing techniques.

8. One or more non-transitory computer-readable media storing instructions that, when executed by one or more processors, cause the one or more processors to perform steps to process a voice query, the steps comprising:

detecting, via a set of microphones of a portable audio device, a wake command;

in response to detecting the wake command, performing the steps of:

transitioning the portable audio device from a low-power state to a normal-power state, wherein in the low-power state, a first subset of microphones in the set of microphones are powered on for monitoring for the wake command and a second subset of microphones in the set of microphones are powered off, and wherein in the normal-power state, the second subset of microphones is powered on; and

selecting whether to connect to a wireless wide area network (WWAN) via a wireless modem of the portable audio device or connect to a wireless local area network (WLAN) via a network interface of the portable audio device;

acquiring, via the set of microphones, a voice query;

generating a data request based on the voice query;

transmitting the data request to the selected one of the WWAN or the WLAN;

receiving a data response associated with the data request from the selected one of the WWAN or the WLAN;

generating an audio signal based on the data response; and

transmitting the audio signal to one or more speakers included in the portable audio device to generate audio output.

9. The one or more non-transitory computer-readable media of claim 8 , wherein selecting whether to connect to the WWAN or the WLAN comprises determining which of the WWAN or the WLAN has a greatest signal strength.

10. The one or more non-transitory computer-readable media of claim 8 , further comprising:

detecting a trigger event; and

in response to detecting the trigger event, re-determining whether to connect to the WWAN or the WLAN.

11. The one or more non-transitory computer-readable media of claim 8 , further comprising:

in response to detecting the wake command, transitioning the portable audio device from a low-power state to a normal-power state.

12. The one or more non-transitory computer-readable media of claim 11 , wherein:

in the low-power state, a first set of components of the portable audio device used for monitoring for the wake command is powered on and a second set of components of the portable audio device that are not used for monitoring for the wake command is powered off; and

in the normal-power state, at least one component of the second set of components is powered on.

13. The one or more non-transitory computer-readable media of claim 8 , wherein:

the voice query comprises a request for a media item or an information item; and

the data response comprises the media item or the information item.

14. A portable audio device, comprising:

a one or more microphones configured to acquire a wake command and a voice query;

one or more speakers;

a wireless modem configured to connect to a wireless wide area network (WWAN);

a network interface configured to connect to a wireless local area network (WLAN);

a memory that includes an audio processing application; and

a processor that is coupled to the memory and, when executing the audio processing application, is configured to:

detect the wake command;

in response to detecting the wake command, performing the steps of:

transitioning from a low-power state to a normal-power state, wherein in the low-power state, a first subset of microphones in the set of microphones are powered on for monitoring for the wake command and a second subset of microphones in the set of microphones are powered off, and wherein in the normal-power state, the second subset of microphones is powered on; and

selecting whether to connect to the WWAN via the wireless modem or to the WLAN via the network interface;

generate a data request based on the voice query;

transmit the data request to the selected one of the WWAN or the WLAN;

receive a data response associated with the data request from the selected one of the WWAN or the WLAN;

generate an audio signal based on the data response; and

transmit the audio signal to the one or more speakers to generate audio output.

15. The portable audio device of claim 14 , wherein to select whether to connect to the WWAN or the WLAN, the audio processing application is configured to determine which of the WWAN or the WLAN has a greatest signal strength.

16. The portable audio device of claim 14 , further comprising a battery for powering at least one of the one or more microphones, the one or more speakers, the wireless modem, or the network interface.

17. The portable audio device of claim 14 , further comprising a first driver for a first frequency range and a second driver for a second frequency range.

18. The portable audio device of claim 14 , further comprising a subscriber identity module (SIM) device, wherein the processor is further configured to communicate with the WWAN based on information received via the SIM device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 22, 2021
From: OWENS, DAVID
To: HARMAN INTERNATIONAL INDUSTRIES, INCORPORATED
Reel/Frame 056007/0054 →
Continuity (3)
Continuation 16342517
Provisional Application 62409287 · Oct 17, 2016
Related Publication 20210241768A1 · Aug 5, 2021
References Cited (30)
US 8768712B1 · Sharifi · 2014 [cited by applicant]
US 8971543B1 · List · 2015 [cited by applicant]
US 9319782B1 · Crump et al. · 2016 [cited by applicant]
US 10147441B1 · Pogue et al. · 2018 [cited by applicant]
US 10332513B1 · D'Souza et al. · 2019 [cited by applicant]
US 20080113692A1 · Zhao et al. · 2008 [cited by applicant]
US 20090270127A1 · Kakimoto · 2009 [cited by applicant]
US 20110208520A1 · Lee · 2011 [cited by applicant]
US 20120163344A1 · Bakthavathsalu · 2012 [cited by examiner]
US 20130293670A1 · Ayoub et al. · 2013 [cited by applicant]
US 20150006176A1 · Pogue et al. · 2015 [cited by applicant]
US 20150099458A1 · Weisner · 2015 [cited by examiner]
US 20150138333A1 · DeVaul · 2015 [cited by examiner]
US 20150194152A1 · Katuri et al. · 2015 [cited by applicant]
US 20150278348A1 · Paruchuri et al. · 2015 [cited by applicant]
CN 1606891A · 2005 [cited by applicant]
CN 1665328A · 2005 [cited by applicant]
CN 201341236Y · 2009 [cited by applicant]
CN 101808386A · 2010 [cited by applicant]
CN 105765656A · 2016 [cited by applicant]
JP 2008017440A · 2008 [cited by applicant]
JP 2014017572A · 2014 [cited by applicant]
JP 2015207159A · 2015 [cited by applicant]
KR 1020040020203A · 2004 [cited by applicant]
KR 1020160064258A · 2016 [cited by applicant]
KR 1020160100765A · 2016 [cited by applicant]
WO 2015073125A1 · 2015 [cited by applicant]
WO 2015148046A1 · 2015 [cited by applicant]
WO 2017058648A1 · 2017 [cited by applicant]
Anonymous, “Review: Amazon Tap unboxing and hands-on review”, Retrieved from the Internet: URL: https://homeupgraded.com/2016/04/03/review-amazon-tap-unboxing-and-hands-on-review/[retrieved on Jan. 5, 2018], XP055438453… [cited by applicant]