IP Library Granted Patent US 12,143,808
Granted Patent B2
US 12,143,808 · App. 18/241,456 · Granted Nov 12, 2024

Displaying a location of binaural sound outside a field of view

Inventor: Philip Scott Lyren (Rincon, PR)
H04S7/40G02B27/017G06F3/011G06T19/003H04S7/304
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,143,808
App. No.
18/241,456
Granted
Nov 12, 2024
Kind
B2
Abstract

A method or apparatus provides binaural sound that originates to a person at a location inside a field of view (FOV) provided to the person by an electronic device. The electronic device determines when the location of the binaural sound moves outside the FOV and assists the person in determining the location of the binaural sound. A display of the electronic device displays a visual indication that shows a direction to the location of the binaural sound outside the FOV.

Claims (36)

1. A method comprising:

displaying, during an electronic call between a first person and a second person and with a wearable electronic device (WED) worn on a head of the first person, a virtual image of a second person in a field of view (FOV) of the first person;

playing, with speakers and during the electronic call between the first person and the second person, binaural sound of a voice of the second person that originates to the first person at the virtual image of the second person in the FOV of the first person; and

displaying, with the WED and during the electronic call between the first person and the second person, a smaller version of the second person at a periphery of the FOV of the first person in response to the virtual image of the second person moving outside the FOV of the first person.

2. The method of claim 1 further comprising:

removing the smaller version of the second person being displayed at the periphery of the FOV in response to the virtual image of the second person moving back into the FOV of the first person.

3. The method of claim 1 further comprising:

displaying, with the WED and during the electronic call between the first person and the second person, the smaller version of the second person at the periphery of the FOV inside a virtual window.

4. The method of claim 1 further comprising:

displaying, with the WED and during the electronic call between the first person and the second person, the smaller version of the second person at a location of the periphery of the FOV such that the location shows the first person where to look to recapture the virtual image of the second person.

5. The method of claim 1 further comprising:

displaying, with the WED and during the electronic call between the first person and the second person, the smaller version of the second person at the periphery of the FOV as a three-dimensional virtual image that moves in real time with movements of the second person.

6. The method of claim 1 further comprising:

moving the smaller version of the second person along the periphery of the FOV as the WED moves to continue to display a direction where the virtual image of the second person exists outside the FOV.

7. The method of claim 1 further comprising:

processing the voice of the second person with head-related transfer functions (HRTFs) such that the voice of the second person originates to the first person at a location of the virtual image of the second person located outside the FOV while the WED displays the smaller version of the second person inside the FOV at the periphery.

8. The method of claim 1 further comprising:

receiving, from the first person and at one or more microphones in the WED, a verbal command to show a location of the virtual image of the second person that moved outside the FOV; and

displaying, in response to receiving the verbal command, the smaller version of the second person at the periphery of the FOV that shows the location where the virtual image of the second person exists outside the FOV.

9. A wearable electronic device (WED) worn on a head of a wearer, the WED comprising:

a display that displays a virtual image of a person in a field of view (FOV) of the WED; and

speakers that play binaural sound that externally localizes to the wearer at the virtual image of the person,

wherein in response to the WED determining the virtual image of the person moves outside the FOV, the display displays a reduced size of the virtual image of the person at a location at a perimeter of the FOV, and the location at the perimeter of the FOV provides the wearer a direction where to look to move the FOV to include the virtual image of the person.

10. The WED of claim 9 , wherein the location at the perimeter of the FOV occurs on an imaginary line that extends thru a center of the FOV to a location where the virtual image of the person exists outside the FOV.

11. The WED of claim 9 , wherein the display removes the reduced size of the virtual image of the person from the location at the perimeter of the FOV in response to the virtual image of the person moving back into the FOV of the WED.

12. The WED of claim 9 , wherein the reduced size of the virtual image of the person at the location at the perimeter of the FOV disappears after a predetermined amount of time and reappears upon receiving a verbal instruction from the wearer.

13. The WED of claim 9 , wherein the display displays the reduced size of the virtual image of the person at the location at the perimeter of the FOV inside a virtual window.

14. The WED of claim 9 , wherein the reduced size of the virtual image of the person at the location at the perimeter of the FOV moves in real time to track movements of the person while the virtual image of the person is outside the FOV and while the wearer and the person are in an electronic call with each other.

15. The WED of claim 9 , wherein the display displays the reduced size of the virtual image of the person as a three-dimensional augmented reality (AR) image that moves during an electronic call between the wearer and the person.

16. A wearable electronic device (WED) worn on a head of a wearer, the WED comprising:

a display that displays a virtual image of a person in a field of view (FOV) of the WED during an electronic call between the wearer and the person,

wherein the WED displays a smaller version of the virtual image of the person at a periphery of the FOV in response to the virtual image of the person moving outside the FOV of the WED during the electronic call between the wearer and the person.

17. The wearable electronic device of claim 16 , wherein the smaller version of the virtual image of the person at the periphery of the FOV moves in real time with movements of the person during the electronic call between the wearer and the person while the virtual image of the person is located outside the FOV of the WED.

18. The wearable electronic device of claim 16 , wherein the smaller version of the virtual image of the person is located at a location at the periphery that shows the wearer in which direction to look to recapture the virtual image of the person located outside the FOV of the WED.

19. The wearable electronic device of claim 16 wherein the display removes the smaller version of the virtual image of the person in response to the virtual image of the person moving back into the FOV of the WED.

20. The wearable electronic device of claim 16 , wherein the smaller version of the virtual image of the person is located at the periphery of the FOV along an imaginary line that extends from the WED to a location where the virtual image of the person exists outside the FOV of the WED.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 30, 2026
From: LYREN, PHILIP SCOTT
To: FOUR MILE BAY, LLC
Reel/Frame 074228/0112 →
Continuity (4)
Continuation 17199325 · Mar 11, 2021
Continuation 16826175 · Mar 21, 2020
Continuation 16268506 · Feb 6, 2019
Related Publication 20230413008A1 · Dec 21, 2023
Cited By (1)
US 12,356,177