IP Library › Granted Patent US 10,873,827
Granted Patent B2
US 10,873,827 · App. 16/695,113 · Granted Dec 22, 2020

Altering a graphical representation to indicate sound will externally localize as binaural sound

Inventor: Philip Scott Lyren (Bangkok, TH)
H04S7/308G06F3/0481G06T11/60H04M1/6066H04M1/72547H04R5/02H04R5/04H04R2499/11H04S7/40H04S2400/01H04S2400/11H04S2400/15H04S2420/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,873,827
App. No.
16/695,113
Granted
Dec 22, 2020
Kind
B2
Abstract

A method alters an appearance of a graphical representation based on whether a listener is wearing headphones or earphones. During an electronic communication, an electronic device of the user receives the graphical representation. The electronic device determines whether the user is wearing headphones or earphones and alters an appearance of the graphical representation based on this determination so the user knows that the sound will externally localize as binaural sound.

Claims (46)

1. A method comprising:

determining, with an electronic device, whether a user is wearing one of headphones and earphones;

displaying, with the electronic device, a graphical representation with a first appearance upon determining that the user is not wearing the one of the headphones and the earphones; and

displaying, with the electronic device, the graphical representation with a second appearance upon determining that the user is wearing the one of the headphones and the earphones, wherein the second appearance visually informs the user that upon activation of the graphical representation sound will externally localize as binaural sound away from a head of the user.

2. The method of claim 1 further comprising:

determining, with the electronic device, when the user removes the one of the headphones and the earphones; and

changing, in response to determining that the user removes the one of the headphones and the earphones, the graphical representation from having the second appearance to having the first appearance.

3. The method of claim 1 further comprising:

processing, with a digital signal processor (DSP) in the electronic device, the sound of the graphical representation to change the sound into the binaural sound in response to determining that the user is wearing the one of the headphones and the earphones; and

saving processing resources of the DSP by not processing the sound into the binaural sound in response to determining that the user is not wearing the one of the headphones and the earphones.

4. The method of claim 1 further comprising:

displaying, with the electronic device, the graphical representation with the second appearance that includes an indication showing where the sound will externally localize as the binaural sound away from the head of the user.

5. The method of claim 1 , wherein the first appearance of the graphical representation is altered by changing a color of the graphical representation being displayed to provide an indication that visually informs the user that the sound will externally localize as the binaural sound away from the head of the user.

6. The method of claim 1 , wherein the graphical representation with the second appearances includes “3D” to visually inform the user that the sound will externally localize as the binaural sound away from the head of the user.

7. The method of claim 1 , wherein the first appearance of the graphical representation is altered by adding one or more words to the graphical representation being displayed that when read by the user provides an indication that visually informs the user that the sound will externally localize as the binaural sound away from the head of the user.

8. A non-transitory computer-readable storage medium storing instructions that one or more electronic devices execute to perform a method comprising:

determining whether a user wears headphones;

displaying a graphical representation without an indication of binaural sound in response to determining that the user is not wearing the headphones; and

displaying the graphical representation with the indication of the binaural sound in response to determining that the user is wearing the headphones,

wherein the indication of the binaural sound visually shows the user that sound of the graphical representation will externally localize outside a head of the user as the binaural sound when the binaural sound of the graphical representation plays to the user through the headphones.

9. The non-transitory computer-readable storage medium of claim 8 further comprising:

processing, with a digital signal processor (DSP), the sound into the binaural sound in response to determining that the user wears the headphones; and

saving processing resources of the DSP by not convolving the sound into binaural sound in response to determining that the user is not wearing the headphones.

10. The non-transitory computer-readable storage medium of claim 8 further comprising:

adding “3D” to an appearance of the graphical representation as the indication of the binaural sound in response to determining that the user is wearing the headphones; and

removing the “3D” to the appearance of the graphical representation as the indication in response to determining that the user is not wearing the headphones, wherein the headphones include earphones.

11. The non-transitory computer-readable storage medium of claim 8 further comprising:

adding an appearance to the graphical representation in response to detecting the headphones connect with an electronic device via a wired or a wireless connection; and

removing the appearance from the graphical representation in response to detecting the headphones disconnected from the electronic device.

12. The non-transitory computer-readable storage medium of claim 8 further comprising:

providing the sound to the user as stereo sound or mono sound in response to determining that the user is not wearing the headphones; and

providing the sound to the user as the binaural sound in response to determining that the user is wearing the headphones.

13. The non-transitory computer-readable storage medium of claim 8 further comprising:

visually notifying the user that the sound from the graphical representation will externally localize as the binaural sound by flashing the graphical representation brighter and dimmer while the graphical representation is displayed, and wherein a wearable electronic device (WED) provides the binaural sound to the user.

14. A method comprising:

playing sound of graphical representation as mono sound or stereo sound upon determining that the user is not wearing a wearable electronic device (WED);

altering, in response to determining that the user is wearing the WED, an appearance of the graphical representation by adding a visual indication that shows the user that the sound will play as binaural sound that externally localizes outside a head of the user; and

displaying, with on a display, the graphical representation with the visual indication that shows the user that the sound will play as the binaural sound that externally localizes outside the head of the user.

15. The method of claim 14 , wherein the visual indication includes a term “3D”.

16. The method of claim 14 further comprising:

removing the visual indication while the graphical representation is being displayed on the display in response to determining that the sound does not play as the binaural sound, wherein the WED is one of electronic glasses and a head mounted display (HMD).

17. The method of claim 14 , wherein the visual indication includes text informing the user that the sound will externally localize as the binaural sound.

18. The method of claim 14 , wherein the visual indication includes a change in color of the graphical representation to inform the user that the sound will externally localize as the binaural sound.

19. The method of claim 14 , wherein the visual indication includes a symbol that indicates the sound will externally localize as the binaural sound.

20. The method of claim 14 further comprising:

saving processing resources by not processing the sound into the binaural sound until after the WED determines whether the sound will play as the binaural sound or the mono or stereo sounds.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 8, 2024
From: LYREN, PHILIP SCOTT
To: PELAGIC CONCEPTS LLC
Reel/Frame 069221/0896 →
Continuity (4)
Continuation 16354185 · Mar 15, 2019
Continuation 16059049 · Aug 9, 2018
Continuation 15898587 · Feb 18, 2018
Related Publication 20200100047A1 · Mar 26, 2020
Cited By (2)
US 12,245,021 US 12,464,308