IP Library › Granted Patent US 10,500,496
Granted Patent B2
US 10,500,496 · App. 15/870,536 · Granted Dec 10, 2019

Physical obstacle avoidance in a virtual reality environment

Inventors: Adam T. Clark (Mantorville, MN); Jeffrey K. Huebert (Rochester, MN); Aspen L. Payton (Byron, MN); John E. Petri (St. Charles, MN)
Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
A63F13/54G06K9/00671G06K9/6293G06T19/003H04S7/303
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,500,496
App. No.
15/870,536
Granted
Dec 10, 2019
Kind
B2
Abstract

While a virtual reality environment is being presented to a user, at least a first sound in a real world environment in which the user physically is located can be detected. a nature of the first sound can be determined. Based on the nature of the first sound, a second sound that matches a theme of the virtual reality environment can be selected. The first sound can be masked by presenting the second sound to the user in the virtual reality environment.

Claims (53)

1. A method, comprising:

while a virtual reality environment is being presented to a user, detecting at least a first sound emanating from a physical object in a real world environment in which the user physically is located, wherein spatial coordinates of a spatial location of the physical object in the real world environment are moving over time;

determining, using a processor, a nature of the first sound; and

based on the nature of the first sound, selecting a second sound that matches a theme of the virtual reality environment and masking the first sound by presenting the second sound to the user in the virtual reality environment, the presenting the second sound comprising mimicking movement of the physical object in the real world environment by producing audio stereo imaging effects that cause the user to perceive the second sound as being emanated at the spatial location of the physical object and spatially move over time in a direction, relative to the user, the physical object is moving by selectively controlling a volume of the second sound across a plurality of audio channels.

2. The method of claim 1 , wherein the selecting the second sound comprises selecting the second sound to match certain characteristics of the first sound.

3. The method of claim 1 , further comprising:

selecting a virtual object that matches the theme of the virtual reality environment to represent a source of the second sound and presenting the virtual object in the virtual reality environment at coordinates, relative to the user in the virtual reality environment, corresponding to coordinates of the physical object, which is a source of the first sound, relative to the user in the real world environment;

wherein the virtual object moves in the virtual reality environment further mimicking movement of the physical object in the real world environment.

4. The method of claim 3 , wherein the selecting the virtual object comprises selecting the virtual object to match at least one characteristic of the physical object that is the source of the first sound selected from a group consisting of a dimension, a size and a movement pattern.

5. The method of claim 3 , further comprising:

monitoring the movement of the physical object in the real world environment; and

translating the movement of the physical object in the real world environment to movement of the virtual object in the virtual reality environment.

6. The method of claim 3 , further comprising:

determining a first distance between the user and the physical object in the real world environment;

determining a second distance by multiplying the first distance by a scaling factor that is greater than 1 or less than 1; and

presenting the virtual object at the determined second distance from the user in the virtual reality environment.

7. The method of claim 6 , further comprising:

translating movements of the user in the real world environment to movements of the user in the virtual reality environment that are scaled to the movements of the user in the real world environment by the scaling factor.

8. An apparatus, comprising:

a processor programmed to initiate executable operations comprising:

while a virtual reality environment is being presented to a user, detecting at least a first sound emanating from a physical object in a real world environment in which the user physically is located, wherein spatial coordinates of a spatial location of the physical object in the real world environment are moving over time;

determining a nature of the first sound; and

based on the nature of the first sound, selecting a second sound that matches a theme of the virtual reality environment and masking the first sound by presenting the second sound to the user in the virtual reality environment, the presenting the second sound comprising mimicking movement of the physical object in the real world environment by producing audio stereo imaging effects that cause the user to perceive the second sound as being emanated at the spatial location of the physical object and spatially move over time in a direction, relative to the user, the physical object is moving by selectively controlling a volume of the second sound across a plurality of audio channels.

9. The apparatus of claim 8 , wherein the selecting the second sound comprises selecting the second sound to match certain characteristics of the first sound.

10. The apparatus of claim 8 , the executable operations further comprising:

selecting a virtual object that matches the theme of the virtual reality environment to represent a source of the second sound and presenting the virtual object in the virtual reality environment at coordinates, relative to the user in the virtual reality environment, corresponding to coordinates of the physical object, which is a source of the first sound, relative to the user in the real world environment;

wherein the virtual object moves in the virtual reality environment further mimicking movement of the physical object in the real world environment.

11. The apparatus of claim 10 , wherein the selecting the virtual object comprises selecting the virtual object to match at least one characteristic of the physical object that is the source of the first sound selected from a group consisting of a dimension, a size and a movement pattern.

12. The apparatus of claim 10 , the executable operations further comprising:

monitoring the movement of the physical object in the real world environment; and

translating the movement of the physical object in the real world environment to movement of the virtual object in the virtual reality environment.

13. The apparatus of claim 10 , the executable operations further comprising:

determining a first distance between the user and the physical object in the real world environment;

determining a second distance by multiplying the first distance by a scaling factor that is greater than 1 or less than 1; and

presenting the virtual object at the determined second distance from the user in the virtual reality environment.

14. The apparatus of claim 13 , the executable operations further comprising:

translating movements of the user in the real world environment to movements of the user in the virtual reality environment that are scaled to the movements of the user in the real world environment by the scaling factor.

15. A computer program product, comprising:

a computer readable storage medium having program code stored thereon, the program code executable by a data processing system to initiate operations including:

while a virtual reality environment is being presented to a user, detecting at least a first sound emanating from a physical object in a real world environment in which the user physically is located, wherein spatial coordinates of a spatial location of the physical object in the real world environment are moving over time;

determining a nature of the first sound; and

based on the nature of the first sound, selecting a second sound that matches a theme of the virtual reality environment and masking the first sound by presenting the second sound to the user in the virtual reality environment, the presenting the second sound comprising mimicking movement of the physical object in the real world environment by producing audio stereo imaging effects that cause the user to perceive the second sound as being emanated at the spatial location of the physical object and spatially move over time in a direction, relative to the user, the physical object is moving by selectively controlling a volume of the second sound across a plurality of audio channels.

16. The computer program product of claim 15 , wherein the selecting the second sound comprises selecting the second sound to match certain characteristics of the first sound.

17. The computer program product of claim 15 , the operations further comprising:

selecting a virtual object that matches the theme of the virtual reality environment to represent a source of the second sound and presenting the virtual object in the virtual reality environment at coordinates, relative to the user in the virtual reality environment, corresponding to coordinates of the physical object, which is a source of the first sound, relative to the user in the real world environment;

wherein the virtual object moves in the virtual reality environment further mimicking movement of the physical object in the real world environment.

18. The computer program product of claim 17 , wherein the selecting the virtual object comprises selecting the virtual object to match at least one characteristic of the physical object that is the source of the first sound selected from a group consisting of a dimension, a size and a movement pattern.

19. The computer program product of claim 17 , the operations further comprising:

determining a first distance between the user and the physical object in the real world environment;

determining a second distance by multiplying the first distance by a scaling factor that is greater than 1 or less than 1; and

presenting the virtual object at the determined second distance from the user in the virtual reality environment.

20. The computer program product of claim 19 , the operations further comprising:

translating movements of the user in the real world environment to movements of the user in the virtual reality environment that are scaled to the movements of the user in the real world environment by the scaling factor.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 12, 2018
From: CLARK, ADAM T.; HUEBERT, JEFFREY K.; PAYTON, ASPEN L.; PETRI, JOHN E.
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 045067/0952 →
Continuity (1)
Related Publication 20190217198A1 · Jul 18, 2019