IP Library Granted Patent US 12,028,699
Granted Patent B2
US 12,028,699 · App. 18/196,656 · Granted Jul 2, 2024

Playing binaural sound clips during an electronic communication

Inventor: Philip Scott Lyren (Rincon, PR)
H04S7/303G06F3/04817G06F3/0482H04M1/7243H04S3/008H04S7/302H04M1/0202H04M1/72433H04M1/72442H04R2460/13H04S2420/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,028,699
App. No.
18/196,656
Granted
Jul 2, 2024
Kind
B2
Abstract

A method plays sound clips in binaural sound to users during an electronic communication between two or more users. A processor convolves the sound clips with HRTFs so the sound externally localize away from a head of the user listening to the sound clip. The sound clips play to users during the electronic communication without transmitting the sound clips to electronic devices of the users.

Claims (46)

1. A method comprising:

expediting an electronic communication between a first user with a first electronic device (ED) and a second with a second ED by transmitting an identifier of a binaural sound clip from the first ED to the second ED without transmitting the binaural sound clip from the first ED to the second ED;

retrieving, with the second ED, the binaural sound clip based on the identifier; and

playing, with the second ED, the binaural sound clip in binaural sound that localizes in empty space outside a head of the second user.

2. The method of claim 1 further comprising:

processing, with one or more processors in the second ED and after receiving the identifier but before the second ED receives a request to play the binaural sound clip, the binaural sound clip with one or more head-related transfer functions (HRTFs) to expedite playing of the binaural sound clip when the second ED receives the request from the second user to play the binaural sound clip.

3. The method of claim 1 , wherein the binaural sound clip externally localizes at a location at least one meter away from the head of the second user at a talking virtual image displayed to the second user with the second ED, and the second ED is worn on the head of the second user.

4. The method of claim 1 further comprising:

displaying, with a display of the second ED, an emoji or an animoji selected from the identifier received from the first ED without requiring transmission of the emoji or the animoji from the first ED to the second ED.

5. The method of claim 1 further comprising:

storing the binaural sound clip in a memory of the second ED; and

retrieving, with the second ED and from the memory of the second ED, the binaural sound clip assigned to the identifier received from the first ED.

6. The method of claim 1 further comprising:

displaying, with a display of the first ED and to the first user during the electronic communication, an icon that when activated by the first user plays the binaural sound to the second user during the electronic communication without transmitting the binaural sound clip to the second ED during the electronic communication.

7. The method of claim 1 further comprising:

displaying, with the first ED, a three-dimensional (3D) emoji or 3D animoji; and

receiving, at the first ED, activation of the 3D emoji or the 3D animoji that initiates transmission of the identifier from the first ED to the second ED without transmitting the binaural sound clip from the first ED to the second ED.

8. A method comprising:

expediting playing of a sound clip in binaural sound during an electronic communication between a first user with a first electronic device (ED) and a second user with a second ED by processing the sound clip into the binaural sound with a processor at the second ED before the sound clip in the binaural sound plays to the second user; and

playing, with the second ED and during the electronic communication between the first user and the second user, the sound clip in the binaural sound to the second user in response to the first user or the second user requesting the sound clip to play.

9. The method of claim 8 further comprising:

displaying, during the electronic communication and on a display of the first ED, an emoji that when selected causes the first ED to transmit an identifier of the sound clip of the emoji to the second ED without transmitting the sound clip of the emoji between the first and second EDs.

10. The method of claim 8 further comprising:

receiving, at the first ED from the first user, selection of the sound clip that will be played in the binaural sound at the second ED of the second user;

transmitting, to the second ED, an identifier that identifies the sound clip without transmitting the sound clip to the second ED; and

playing, by the second ED, the sound clip in the binaural sound such that sound from the sound clip externally localizes in empty space outside a head of the second user.

11. The method of claim 8 further comprising:

simultaneously displaying, on a display of the first ED, a plurality of graphical representations that when activated by the first user cause the first ED to transmit to the second ED identifiers associated with the graphical representations selected by the first user such that the second ED plays the binaural sound associated with the graphical representations selected by the first user without requiring transmission of the sounds clips to the second ED.

12. The method of claim 8 further comprising:

displaying, with a display of the first ED, a graphical representation that when selected by the first user causes the first ED to transmit an identifier of the sound clip to the second ED without transmitting the sound clip to the second ED, wherein the first ED and the second ED are head mounted displays (HMDs) that display three-dimensional (3D) augmented reality (AR) images.

13. The method of claim 8 further comprising:

storing, in memory of the first ED, a list of unique identifications that each identify sound clips can be played in the binaural sound to the second user; and

associating different icons with each one of the sound clips and the unique identifications such that selection by the first user of one of the different icons causes the first ED to transmit one of the unique identifications to the second ED so the second ED can identify which of the sound clips the first user is requesting to be played to the second user.

14. The method of claim 8 further comprising:

storing, in memory of the second ED, a lookup table that includes a list of identifiers and a list of sound clips assigned to each one of the identifiers so that the second ED identifies and plays the sound clips in the binaural sound requested by the first user upon receiving one of the identifiers from the first ED without receiving a sound clip from the first ED.

15. An electronic device (ED) of a first person that facilitates electronic communication between the first person and a second person, the ED comprising:

a receiver that receives, during the electronic communication, an identifier of a sound clip without receiving the sound clip from the second person;

a memory that stores the sound clip;

one or more processors that retrieve the sound clip from the memory based on the identifier received during the electronic communication; and

speakers that play the sound clip to the first person in binaural sound that externally localizes in empty space outside a head of the first person.

16. The ED of claim 15 further comprising:

a display that displays an emoji, wherein the one or more processors process the sound clip into the binaural sound before the first person activates the emoji, wherein activation of the emoji causes the sound clip in the binaural sound to play to the first person.

17. The ED of claim 15 , wherein the one or more processors expedite playing of the sound clip in the binaural sound by processing the sound clip with head-related transfer functions (HRTFs) after receiving the identifier from the second person but before receiving a request to play the sound clip from the first person.

18. The ED of claim 15 , wherein the identifier is smaller in size than the sound clip, and processing time is reduced by enabling the first person to play the sound clip in the binaural sound by wirelessly receiving the identifier from the ED of the second person without wirelessly receiving the sound clip from the ED of the second person.

19. The ED of claim 15 , wherein processing time of the processor is reduced since the sound clip is already stored as the binaural sound in the memory before the ED receives a request from the second person to have the ED play the sound clip in the binaural sound to the first person.

20. The ED of claim 15 , wherein the memory stores sound clips in the binaural sound and a list of identifiers that identify the sound clips, wherein the ED is a wearable electronic device worn on a head of the first person, and the ED displays augmented reality (AR) images or virtual reality (VR) images to the first person.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 24, 2025
From: LYREN, PHILIP SCOTT
To: IP3 2025, SERIES 925 OF ALLIED SECURITY TRUST I
Reel/Frame 073012/0818 →
Continuity (6)
Continuation 17738061 · May 6, 2022
Continuation 17100892 · Nov 22, 2020
Continuation 16747517 · Jan 20, 2020
Continuation 16271786 · Feb 9, 2019
Continuation 15883039 · Jan 29, 2018
Related Publication 20230283978A1 · Sep 7, 2023