IP Library › Granted Patent US 11,727,774
Granted Patent B2
US 11,727,774 · App. 17/472,548 · Granted Aug 15, 2023

3D audio for detecting objects in danger zones around VR players

Inventor: Matthew Tomczek (San Mateo, CA)
Assignee: Sony Interactive Entertainment Inc.
G08B13/196H04R1/406H04R5/04
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,727,774
App. No.
17/472,548
Granted
Aug 15, 2023
Kind
B2
Abstract

Three-dimensional (3D) audio can be presented during an augmented reality, mixed reality, or virtual reality simulation to notify a user that a real-world object is approaching or has crossed a boundary for an interaction space within which the user is to interact with the simulation. The 3D audio may indicate the current location of the intrusion or boundary while still leaving the user immersed in the simulation.

Claims (40)

1. A system comprising:

at least one computer medium that is not a transitory signal and that comprises instructions executable by at least one processor to:

identify an intrusion into an interaction space in the real world, the interaction space designated for use as part of a virtual reality (VR), augmented reality (AR), and/or mixed reality (MR) presentation;

based on the identification of the intrusion, present three-dimensional (3D) audio indicating a current location of the intrusion within the interaction space, wherein the intrusion comprises a living being not making vocal sounds, and the 3D audio comprises a computer-generated vocal sound of the living being.

2. The system of claim 1 , wherein the intrusion is identified using input from a camera.

3. The system of claim 1 , wherein the intrusion is identified using light detection and ranging (LIDAR).

4. The system of claim 1 , wherein the intrusion is identified using input from a microphone array and blind source separation.

5. The system of claim 4 , comprising the microphone array.

6. The system of claim 1 , wherein the 3D audio comprises a chime or tone.

7. The system of claim 1 , wherein the 3D audio comprises a computer-generated voice.

8. The system of claim 7 , wherein the intrusion comprises a person, and wherein the computer-generated voice models the person's own voice.

9. The system of claim 1 , wherein the instructions are executable to:

change a volume level at which the 3D audio is presented as the current location of the intrusion changes within the interaction space.

10. The system of claim 9 , wherein the instructions are executable to:

increase the volume level at which the 3D audio is presented as the intrusion gets closer to a current location of a user disposed within the interaction space, the user being different from the intrusion.

11. The system of claim 1 , wherein the instructions are executable to:

change a frequency with which one or more chimes or tones of the 3D audio are presented as the current location of the intrusion changes within the interaction space.

12. The system of claim 11 , wherein the instructions are executable to:

increase the frequency with which the one or more chimes or tones of the 3D audio are presented as the intrusion gets closer to a current location of a user disposed within the interaction space, the user being different from the intrusion.

13. The system of claim 1 , comprising the at least one processor.

14. A method, comprising:

identifying an encroachment across a boundary of an interaction space existing in the real world, the interaction space designated for use as part of a virtual reality (VR), augmented reality (AR), and/or mixed reality (MR) presentation; and

based on the identifying of the intrusion, presenting three-dimensional (3D) audio indicating a current location of the intrusion within the interaction space, wherein the intrusion comprises a living being not making vocal sounds, and the 3D audio comprises a computer-generated vocal sound of the living being.

15. The method of claim 14 , comprising:

identifying the encroachment at least in part by identifying an intrusion into the interaction space, the intrusion being different from a user disposed within the interaction space that is observing the presentation.

16. The method of claim 14 , comprising:

identifying the encroachment at least in part by identifying a user disposed within the interaction space as at least partially crossing the boundary.

17. The method of claim 14 , comprising:

increasing, as the encroachment gets closer to a current location of a user disposed within the interaction space, a volume level and/or frequency at which the 3D audio is presented, the user being different from the intrusion.

18. A system comprising:

at least one processor programmed with instructions to:

identify an encroachment of a physical object across a boundary of an interaction space existing in the real world, the interaction space designated for use as part of a virtual presentation; and

based on the identification of the encroachment, present three-dimensional (3D) audio indicating a current location of the encroachment within the interaction space, wherein the encroachment comprises a living being not making vocal sounds, and the 3D audio comprises a computer-generated vocal sound of the living being.

19. The system of claim 18 , wherein the instructions are executable to:

identify a first object type associated with the encroachment;

based on identification the first object type, select the 3D audio for presentation, the 3D audio associated with the first object type but not a second object type different from the first object type; and

based on selection of the 3D audio for presentation, present the 3D audio.

20. The system of claim 18 , wherein the 3D audio is first 3D audio, and wherein the instructions are executable to:

present the first 3D audio based on identifying the encroachment as having a first size; and

present second 3D audio based on identifying the encroachment as having a second size, the second size being larger than the first size, the second 3D audio being different from the first 3D audio.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 17, 2021
From: TOMCZEK, MATTHEW
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 057515/0137 →
Continuity (1)
Related Publication 20230080909A1 · Mar 16, 2023