IP Library › Granted Patent US 10,848,893
Granted Patent B2
US 10,848,893 · App. 16/695,119 · Granted Nov 24, 2020

Displaying graphical representations for binaural sound

Inventor: Philip Scott Lyren (Bangkok, TH)
H04S7/302G06T13/205H04S3/008H04S2400/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,848,893
App. No.
16/695,119
Granted
Nov 24, 2020
Kind
B2
Abstract

A method assists in playing sound of a graphical representation for an electronic communication between a first person with a first portable electronic device (PED) to a second person with a second PED. The method displays a first visual indication that when selected plays the sound of the graphical representation in stereo or mono sound and a second visual indication that when selected plays the sound of the graphical representation in binaural sound.

Claims (53)

1. A method executed by one or more electronic devices that assists playing sound of an augmented reality (AR) or virtual reality (VR) graphical representation sent from a first person with a first portable electronic device (PED) to a second person with a second PED, the method comprising:

receiving, at the second PED and from the first PED, the AR or VR graphical representation during an electronic communication between the first person and the second person; and

displaying, simultaneously with the AR or VR graphical representation and by the second PED, a first visual indication that when selected plays the sound of the AR or VR graphical representation in stereo sound and a second visual indication that when selected plays the sound of the AR or VR graphical representation in binaural sound.

2. The method of claim 1 , wherein the first visual indication includes the symbol 2D, and the second visual indication includes the symbol 3D.

3. The method of claim 1 further comprising:

highlighting the first visual indication compared to the second visual indication when the sound of the AR or VR graphical representation will play to the second person as the stereo sound; and

highlighting the second visual indication compared to the first visual indication when the sound of the AR or VR graphical representation will play to the second person as the binaural sound.

4. The method of claim 1 further comprising:

displaying the AR or VR graphical representation to include a head;

displaying the first visual indication inside the head of the AR or VR graphical representation to show that the sound of the AR or VR graphical representation when the first visual indication is selected plays inside a head of the second person as the stereo sound; and

displaying the second visual indication outside the head of the AR or VR graphical representation to show that the sound of the AR or VR graphical representation when the second visual indication is selected plays outside the head of the second person as the binaural sound.

5. The method of claim 1 further comprising:

removing the second visual indication from being displayed but leaving the first visual indication being displayed with the AR or VR graphical representation when the second person selects to hear the sound of the AR or VR graphical representation as the stereo sound; and

removing the first visual indication from being displayed but leaving the second visual indication being displayed with the AR or VR graphical representation when the second person selects to hear the sound of the AR or VR graphical representation as the binaural sound.

6. The method of claim 1 further comprising:

providing a recommendation to the second person to hear the sound of the AR or VR graphical representation as the binaural sound by highlighting the second visual indication compared to the first visual indication.

7. The method of claim 1 further comprising:

displaying, simultaneously with the AR or VR graphical representation and the first and second visual indications, a plurality of AR or VR graphical representations that play sound as the binaural sound and a plurality of AR or VR graphical representations that play sound as the stereo sound.

8. A non-transitory computer-readable storage medium storing instructions that one or more electronic devices execute as a method to play sound of a talking graphical representation provided from a first person with a first portable electronic device (PED) to a second person with a second PED, the method comprising:

receiving, at the second PED and from the first PED, the talking graphical representation; and

displaying, with the second PED, the talking graphical representation and simultaneously both a first visual indication indicating that the sound of the talking graphical representation when activated will play as stereo sound and a second visual indication indicating that the sound of the talking graphical representation when activated will play as binaural sound.

9. The non-transitory computer-readable storage medium of claim 8 in which the method further comprises:

tracking an amount of time that the first visual indication and the second visual indication are displayed with the second PED; and

removing the first visual indication and the second visual indication from being displayed with the second PED after the amount of time exceeds a threshold time.

10. The non-transitory computer-readable storage medium of claim 8 in which the method further comprises:

removing the first visual indication and the second visual indication from being displayed with the second PED while the talking graphical representation remains being displayed with the second PED;

sensing when the second person will activate the talking graphical representation to play the sound of the talking graphical representation; and

re-displaying, in response to sensing that the second person will activate the talking graphical representation, the first visual indication and the second visual indication to indicate two options for playing the sound of the talking graphical representation, wherein the two options include playing the sound as the stereo sound and playing the sound as the binaural sound.

11. The non-transitory computer-readable storage medium of claim 8 in which the method further comprises:

playing the sound of the talking graphical representation as the stereo sound upon receiving an activation on the first visual indication that is one of a pictogram and an ideogram; and

playing the sound of the talking graphical representation as the binaural sound upon receiving an activation on the second visual indication that is one of the pictogram and the ideogram.

12. The non-transitory computer-readable storage medium of claim 8 in which the method further comprises:

displaying, with the second PED, the first visual indication as one of a pictogram and an ideogram inside a body of the talking graphical representation; and

displaying, with the second PED, the second visual indication as one of the pictogram and ideogram outside the body of the talking graphical representation.

13. The non-transitory computer-readable storage medium of claim 8 in which the method further comprises:

repeatedly flashing, before the sound of the talking graphical representation plays, the second visual indication to indicate to the second person that the sound of the talking graphical representation will play as the binaural sound.

14. The non-transitory computer-readable storage medium of claim 8 in which the method further comprises:

displaying, with the second PED, the talking graphical representation to include a head; and

indicating that the sound of the talking graphical representation plays as the binaural sound by moving the second visual indication around the head of the talking graphical representation.

15. The non-transitory computer-readable storage medium of claim 8 in which the method further comprises:

displaying, with the second PED, the talking graphical representation to include a head; and

indicating a location where the binaural sound will externally localize to the second person by moving the second visual indication to the location with respect to the head of the talking graphical representation.

16. A method executed by one or more electronic devices that play sound of a talking graphical representation between a first person with a first portable electronic device (PED) and a second person with a second PED, the method comprising:

receiving, at the second PED and from the first person with the first PED, the talking graphical representation;

indicating that the sound of the talking graphical representation will play as one of mono sound and stereo sound upon selection of a first graphical representation displayed inside a body of the talking graphical representation; and

indicating that the sound of the talking graphical representation will play as three-dimensional (3D) sound upon selection of a second graphical representation displayed outside the body of the talking graphical representation.

17. The method of claim 16 further comprising:

displaying the second graphical representation at a location with respect to the body of the talking graphical representation to show a sound localization point (SLP) where the sound of the talking graphical representation will externally localize with respect to a head of the second person upon activation of the talking graphical representation.

18. The method of claim 16 further comprising:

displaying, with the second PED, the first graphical representation between two ears of the talking graphical representation to show that the sound of the talking graphical representation will internally localize inside a head of the second person as one of the mono sound and the stereo sound.

19. The method of claim 16 further comprising:

removing the first graphical representation from being displayed with the second PED but maintaining the second graphical representation being displayed with the second PED when the second PED receives a selection to play the sound of the talking graphical representation as the 3D sound.

20. The method of claim 16 , wherein the second graphical representation includes one of “3D” and “360” to inform the second person that the sound of the talking graphical representation is 3D sound.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 8, 2024
From: LYREN, PHILIP SCOTT
To: PELAGIC CONCEPTS LLC
Reel/Frame 069221/0803 →
Continuity (2)
Continuation 16237679 · Jan 1, 2019
Related Publication 20200213799A1 · Jul 2, 2020
Cited By (2)
US 12,245,021 US 12,464,308