IP Library Granted Patent US 10,638,242
Granted Patent B2
US 10,638,242 · App. 16/401,192 · Granted Apr 28, 2020

Headphones execute voice command to intelligent personal assistant and move binaural sound

Inventors: Glen A. Norris (Tokyo, JP); Philip Scott Lyren (Bangkok, TH)
H04S1/002H04M1/605H04M1/6033H04M1/72572H04M3/53366H04M3/568H04M9/085H04R5/027H04R5/033H04R5/04H04S1/007H04S3/008H04S7/303H04S7/304G10L21/028H04R27/00H04R2227/003H04S7/305H04S2400/01H04S2400/11H04S2400/15H04S2420/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,638,242
App. No.
16/401,192
Granted
Apr 28, 2020
Kind
B2
Abstract

A digital signal processor (DSP) in headphones processes sound with head-related transfer functions (HRTFs) to produce binaural sound that externally localizes away from a head of a user wearing the headphones. The headphones include a microphone that receives a voice command to an intelligent personal assistant that causes the headphones to change a location of the binaural sound.

Claims (48)

1. A method comprising:

storing, in memory in headphones, head-related transfer functions (HRTFs);

processing, by a digital signal processor (DSP) in the headphones, a voice of an intelligent personal assistant with the HRTFs so the voice externally localizes in empty space at least one meter away from a head of a user wearing the headphones; and

receiving, at a microphone in the headphones and from the user, a voice command to the intelligent personal assistant that causes the headphones to move binaural sound playing to the user from one location in empty space at least one meter away from the head of the user to another location.

2. The method of claim 1 , wherein the voice command causes the headphones to move the binaural sound to a default location that is at least one meter away from a face of the user.

3. The method of claim 1 further comprising:

detecting, at the headphones, a command that is a head gesture of the head of the user while the user is located in a room; and

moving, by the headphones and in response to detecting the head gesture of the head of the user, a sound localization point (SLP) of the binaural sound playing to the user.

4. The method of claim 1 further comprising:

sensing, with the headphones, a command that is a body gesture from the user; and

moving, by the headphones and in response to sensing the body gesture of the user, a sound localization point (SLP) of the binaural sound playing to the user.

5. The method of claim 1 further comprising:

executing, by the DSP, a command from the user to move the binaural sound playing to the user to a foreground that is closer to the user.

6. The method of claim 1 further comprising:

executing, by the DSP, a command from the user to move the binaural sound playing to the user to a background that is farther away from the user.

7. The method of claim 1 further comprising:

receiving, at a wireless interface in the headphones and from a handheld portable electronic device (HPED) of the user, a wireless transmission that includes sound of video being displayed with the HPED; and

processing, by the DSP in the headphones and with the HRTFs, the sound of the video into the binaural sound that localizes to the HPED held in a hand of the user and to locations in empty space at least one meter away from the head of the user.

8. A non-transitory computer readable storage medium storing instructions that one or more electronic devices execute, the method comprising:

retrieving, from memory in headphones, head-related transfer functions (HRTFs);

processing, by a digital signal processor (DSP) in the headphones, a voice of an intelligent personal assistant in order for the voice to originate to a user from a sound localization point (SLP) in empty space away from a head of the user wearing the headphones;

processing, by the DSP in the headphones, music with the HRTFs to produce binaural sound that emanates from a SLP in empty space away from the head of the user wearing the headphones; and

receiving, at a microphone in the headphones and from the user, a voice command to the intelligent personal assistant that causes the headphones to alter processing of the music and to move the SLP of the music to another location where the user hears the music.

9. The non-transitory computer readable storage medium of claim 8 , wherein the another location occurs at a handheld portable electronic device (HPED) in a hand of the user.

10. The non-transitory computer readable storage medium of claim 8 in which the method further comprises:

altering, by the DSP and in response to a command from the user, processing of the music to move the music to a different location in empty space outside the head of the user, wherein the command is a head gesture from the head of the user.

11. The non-transitory computer readable storage medium of claim 8 in which the method further comprises:

altering, by the DSP and in response to a command from the user, processing of the music to move the music to a different location in empty space outside the head of the user, wherein the command is a body gesture from the user.

12. The non-transitory computer readable storage medium of claim 8 in which the method further comprises:

providing, with the headphones, an alert to the user when another user changes a location of the SLP of the music.

13. The non-transitory computer readable storage medium of claim 8 in which the method further comprises:

receiving, at the headphones and from the user, a designation of a default location of an SLP in empty space that follows the user as the user moves; and

processing the music to localize to the default location that follows the user as the user moves.

14. The non-transitory computer readable storage medium of claim 8 in which the method further comprises:

changing a location of the SLP of the music when the SLP of the music conflicts with a location of a physical object.

15. The non-transitory computer readable storage medium of claim 8 , wherein the voice command moves the music to localize inside the head of the user.

16. Headphones comprising:

a memory that stores head-related transfer functions (HRTFs);

a digital signal processor (DSP) that processes a voice of an intelligent personal assistant with the HRTFs to externally localize in empty space outside a head of a user wearing the headphones and that processes sound with the HRTFs to produce binaural sound that originates from a sound localization point (SLP) in empty space outside the head of the user wearing the headphones; and

a microphone that receives a voice command to the intelligent personal assistant that causes the DSP to alter processing of the sound and to move the SLP in empty space of the sound to another SLP.

17. The headphones of claim 16 further comprising:

a sensor that senses a head gesture, wherein the headphones move the SLP in empty space of the sound in response to sensing the head gesture.

18. The headphones of claim 16 further comprising:

a wireless electromagnetic motion tracker that detects motion of a handheld portable electronic device in a hand of the user, wherein the headphones move the SLP in empty space of the sound in response to detecting the motion of the handheld portable electronic device in the hand of the user.

19. The headphones of claim 16 further comprising:

a motion sensor that senses a command that is a body gesture from the user, wherein sensing of the command that is the body gesture causes the headphones to move the SLP in empty space of the sound to another SLP in empty space.

20. The headphones of claim 16 further comprising:

a location tracker that determines a location of the user, wherein the headphones designate a location of SLP in empty space of the sound based on the location of the user.

Assignments (2)
SECURITY INTEREST Recorded Apr 7, 2022
From: EIGHT KHZ, LLC
To: LIT-US CHISUM 22-A LLC
Reel/Frame 059536/0708 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 17, 2022
From: NORRIS, GLEN A.; LYREN, PHILIP S.
To: EIGHT KHZ, LLC
Reel/Frame 059293/0646 →
Continuity (15)
Continuation 15729681 · Oct 11, 2017
Continuation 15728527 · Oct 10, 2017
Continuation 15674998 · Aug 11, 2017
Continuation 15674960 · Aug 11, 2017
Continuation 15635224 · Jun 28, 2017
Continuation 15610640 · Jun 1, 2017
Continuation 15441199 · Feb 23, 2017
Continuation 15430549 · Feb 13, 2017
Continuation 15367186 · Dec 2, 2016
Continuation 15259072 · Sep 8, 2016
Continuation 15096352 · Apr 12, 2016
Continuation 15011563 · Jan 31, 2016
Continuation 14946806 · Nov 20, 2015
Continuation 14311532 · Jun 23, 2014
Related Publication 20190261118A1 · Aug 22, 2019