IP Library Granted Patent US 10,186,085
Granted Patent B2
US 10,186,085 · App. 14/707,001 · Granted Jan 22, 2019

Generating a sound wavefront in augmented or virtual reality systems

Inventors: Paul M. Greco (Parkland, FL); Samuel A. Miller (Hollywood, FL)
Assignee: MAGIC LEAP, INC.
G06T19/006A63F13/56A63F13/57A63F13/577G02B27/0093G02B27/0101G02B27/017G02B27/0172G02B27/0179G06F3/005G06F3/011G06F3/012G06F3/013G06F3/014G06F3/016G06F3/017G06F3/16G06K9/00214G06K9/00577G06K9/00664G06K9/00671G06Q30/02G06T7/60G06T7/70G06T11/60G06T13/40G06T13/80G06T15/10G06T19/003H04S7/304G02B2027/014G02B2027/0138G02B2027/0178G02B2027/0187G06F3/167G06T2200/04G06T2215/16G06T2219/024H04S2400/11H04S2400/15
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,186,085
App. No.
14/707,001
Granted
Jan 22, 2019
Kind
B2
Abstract

An augmented reality display system comprises a passable world model data comprises a set of map points corresponding to one or more objects of the real world. The augmented reality system also comprises a processor to communicate with one or more individual augmented reality display systems to pass a portion of the passable world model data to the one or more individual augmented reality display systems, wherein the piece of the passable world model data is passed based at least in part on respective locations corresponding to the one or more individual augmented reality display systems.

Claims (31)

1. An augmented reality display system, comprising:

an optical apparatus to project light associated with one or more virtual objects to a user of a head-mounted augmented reality display system, wherein a perceived location of the one or more virtual objects is known, and wherein the one or more virtual objects is associated with a predetermined sound data;

a processor having at least a sound module to dynamically alter one or more parameters of the predetermined sound data based at least in part on the perceived location and movement of the one or more virtual objects in relation to the user, thereby producing a sound wavefront; and

an equalization module that equalizes sound of the sound wavefront,

wherein the predetermined sound data is associated with an audio object associated with, but located a distance from, the one or more virtual objects.

2. The augmented reality display system of claim 1 , wherein the processor determines a head pose of the user of the head-mounted augmented reality display system, and wherein the one or more parameters of the predetermined sound data is dynamically altered based at least in part on the determined head pose of the user.

3. The augmented reality display system of claim 1 , further comprising a sound design tool to dynamically alter the one or more parameters of the predetermined sound data.

4. The augmented reality display system of claim 1 , further comprising a spatial and proximity sound render to dynamically alter the one or more parameters of the predetermined sound data.

5. The augmented reality display system of claim 1 , further comprising an audio object corresponding to a further predetermined sound data, and wherein the processor dynamically alters one or more parameters of the further predetermined sound data based at least in part on a perceived location of the additional audio object, wherein the audio object is made to appear to emanate from a peripheral view or out of a field of view of the user.

6. The augmented reality display system of claim 1 , further comprising an audio object corresponding to a further predetermined sound data, and wherein the processor dynamically alters one or more parameters of the further predetermined sound data based at least in part on a perceived location of the additional audio object, wherein the perceived location corresponds to a known coordinate space of the audio object in the real world.

7. The augmented reality display system of claim 1 , wherein a spatialized sound field is rendered.

8. The augmented reality display system of claim 1 implemented as a method.

9. The augmented reality display system of claim 1 , wherein the processor renders the sound wavefront to have an echo.

10. The augmented reality display system of claim 1 , wherein the augmented reality display system further provides a plurality of autonomous navigation objects that are each independent from one another, said plurality of autonomous navigation objects including a first autonomous virtual navigation object that responds to a source of light by moving.

11. The augmented reality display system of claim 10 , wherein the augmented reality display system further provides an autonomous virtual navigation object responsive to a source of food or water.

12. The augmented reality display system of claim 1 , wherein the augmented reality display system further provides an audio or aural cue or trigger that appears to emanate from a sound source that is out of a field of view of the user to cause the user to turn in a desired direction.

13. The augmented reality display system of claim 1 , wherein the augmented reality display system dynamically adjusts microphone gain in a sound range of the sound wavefront to mix real physical features with said one or more virtual objects.

14. The augmented reality display system of claim 1 , wherein the one or more virtual objects is displayed in a virtual user interface in the form of a floating virtual screen and the augmented reality display system is responsive to user eye movement.

15. An augmented reality display system comprising:

an optical apparatus to project light associated with one or more virtual objects to a user of a head-mounted augmented reality display system, wherein a perceived location of the one or more virtual objects is known, and wherein the one or more virtual objects is associated with a predetermined sound data; and

a processor having at least a sound module to dynamically alter one or more parameters of the predetermined sound data based at least in part on the perceived location and movement of the one or more virtual objects in relation to the user, thereby producing a sound wavefront, and to dynamically alter one or more parameters of further predetermined sound data associated with an audio object associated with, but located a distance from, the one or more virtual objects,

wherein the augmented reality display system further provides a plurality of autonomous navigation objects that are each independent from one another, said plurality of autonomous navigation objects including a first autonomous virtual navigation object that responds to a source of light by moving, at least some properties of said autonomous navigation objects being adjustable.

16. The augmented reality display system of claim 15 , further comprising an equalization module that equalizes sound of the sound wavefront and the augmented reality display system providing an audio or aural cue or trigger that appears to emanate from a sound source that is out of a field of view of the user to cause the user to turn in a desired direction.

17. The augmented reality display system of claim 15 , wherein the processor renders the sound wavefront to have an echo.

18. The augmented reality display system of claim 15 , wherein the augmented reality display system further provides an autonomous virtual navigation object responsive to a source of fear or food.

19. The augmented reality display system of claim 15 , wherein the one or more virtual objects is displayed in a virtual user interface in the form of a floating virtual screen.

20. An augmented reality display system, comprising:

an optical apparatus to project light associated with one or more virtual objects to a user of a head-mounted augmented reality display system, wherein a perceived location of the one or more virtual objects is known, and wherein the one or more virtual objects is associated with a predetermined sound data;

a processor having at least a sound module to dynamically alter one or more parameters of the predetermined sound data based at least in part on the perceived location and movement of the one or more virtual objects in relation to the user, thereby producing a sound wavefront; and

an equalization module that equalizes sound of the sound wavefront,

wherein the predetermined sound data is associated with an audio object associated with, but located a distance from, the one or more virtual objects, the one or more virtual objects is displayed in a virtual user interface in the form of a floating virtual screen, the user interacts with the virtual user interface by selecting a button of the virtual user interface by squeezing a virtual icon and the augmented reality display system further provides an autonomous virtual navigation object that responds to a source of fear by moving.

Assignments (3)
ASSIGNMENT OF SECURITY INTEREST IN PATENTS Recorded Nov 7, 2019
From: JPMORGAN CHASE BANK, N.A.
To: CITIBANK, N.A.
Reel/Frame 050967/0138 →
PATENT SECURITY AGREEMENT Recorded Aug 22, 2019
From: MAGIC LEAP, INC.; MOLECULAR IMPRINTS, INC.; MENTOR ACQUISITION ONE, LLC
To: JP MORGAN CHASE BANK, N.A.
Reel/Frame 050138/0287 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 8, 2017
From: GRECO, PAUL M.; MILLER, SAMUEL A.
To: MAGIC LEAP, INC.
Reel/Frame 043233/0122 →
Continuity (5)
Continuation 14690401 · Apr 18, 2015
Continuation In Part 14331218 · Jul 14, 2014
Provisional Application 62012273 · Jun 14, 2014
Provisional Application 61981701 · Apr 18, 2014
Related Publication 20150302625A1 · Oct 22, 2015