IP Library › Granted Patent US 10,067,736
Granted Patent B2
US 10,067,736 · App. 15/394,313 · Granted Sep 4, 2018

Proximity based noise and chat

Inventors: Michael Taylor (San Mateo, CA); Dennis Dale Castleman (Fremont, CA)
Assignee: SONY INTERACTIVE ENTERTAINMENT INC.
G06F3/165
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,067,736
App. No.
15/394,313
Granted
Sep 4, 2018
Kind
B2
Abstract

Disclosed are systems, methods, and non-transitory computer-readable storage media for altering and combining real and simulated audio streams. For example, a system can determine a location of a first unmanned aerial vehicle (UAV). The system can then determine a location of an object and can receive an audio stream associated with the object. The system can then determine a distance between the location of the first UAV and the location of the object. The system can adjust the audio stream volume according to the distance. The system can then send the audio stream to a listener.

Claims (49)

1. A computer-implemented method for modifying audio streams, the method comprising:

detecting a physical location of a first unmanned aerial vehicle (UAV) within an environment, wherein the physical location of the first UAV is detected by one or more sensors monitoring the environment;

tracking a location of a simulated object within the environment, the simulated object associated with a sound emitter, wherein the tracked location is obtained from a database stored in memory;

receiving an audio stream associated with the sound emitter;

identifying a distance between the physical location of the first UAV and the tracked location of the simulated object within the environment; and

processing the audio stream before transmitting to an operator output device associated with the first UAV, wherein a volume of the audio stream is amplified or diminished according to the identified distance.

2. The computer-implemented method of claim 1 ,

wherein the simulated object has audio occlusion properties, and further comprising:

identifying that the tracked location of the simulated object is between the physical location of the first UAV and a location of a second object within the environment; and

processing an audio stream associated with the second object before transmitting to the operator output device according to the audio occlusion properties of the simulated object.

3. The computer-implemented method of claim 1 , wherein processing the audio stream includes applying a low pass filter to the audio stream based on the audio occlusion properties of the simulated object.

4. The computer-implemented method of claim 1 , wherein the simulated object is represented by a second UAV, and wherein receiving the audio stream comprises capturing audio via a microphone placed within range of an operator of the second UAV.

5. The computer-implemented method of claim 1 , further comprising receiving an audio stream from a microphone attached to the first UAV, the microphone being one of a plurality of directional microphones, wherein processing the audio stream includes combining the audio stream associated with the sound emitter with the audio stream from the microphone.

6. The computer-implemented method claim 1 , further comprising:

identifying a grouping of the simulated object; and

playing the audio stream on a device associated with a listener, wherein the audio stream being played is based on a the identified grouping of the simulated object.

7. A system for modifying audio streams, the system comprising:

a sound emitter associated with a simulated object within an environment;

one or more sensors monitoring the environment;

a processor; and

memory that stores non-transitory instructions executable by the processor to perform a method comprising:

detecting a physical location of a first unmanned aerial vehicle (UAV) within the environment, wherein the physical location of the first UAV is detected by the one or more sensors;

tracking a location of the simulated object within the environment, wherein the tracked location is obtained from a database stored in memory;

receiving an audio stream associated with the sound emitter;

identifying a distance between the physical location of the first UAV and the tracked location of the simulated object within the environment; and

processing the audio stream before transmitting to an operator output associated with the first UAV, wherein a volume of the audio stream is amplified or diminished according to the identified distance.

8. The system of claim 7 , wherein the simulated object has audio occlusion properties, and wherein the memory stores instructions executable by the processor to perform the method further comprising:

identifying that the tracked location of the simulated object is between the physical location of the first UAV and a location of a second object within the environment; and

processing an audio stream associated with the second object before transmitting to the operator output device according to the audio occlusion properties of the simulated object.

9. The system of claim 8 , wherein the processor processes the audio stream by applying a low pass filter to the audio stream based on the audio occlusion properties of the simulated object.

10. The system of claim 7 , wherein the simulated object is represented by a second UAV, and wherein receiving the audio stream comprises capturing audio via a microphone placed within range of an operator of the second UAV.

11. The system of claim 7 , wherein the further comprising receiving an audio stream from a microphone attached to the first UAV, the microphone being one of a plurality of directional microphones, wherein processing the audio stream includes combining the audio stream associated with the sound emitter with the audio stream from the microphone.

12. The system of claim 7 , wherein the memory stores instructions executable by the processor to perform the method further comprising:

identifying a grouping of the simulated object; and

playing the audio stream on a device associated with a listener, wherein the audio stream being played is based on the grouping of the simulated object.

13. A non-transitory computer-readable medium having computer readable instructions stored thereon that, when executed by a processor of a computer, cause the computer to perform a method for modifying audio streams, the method comprising:

detecting a physical location of a first unmanned aerial vehicle (UAV) within an environment, wherein the physical location of the first UAV is detected by one or more sensors monitoring the environment;

tracking a location of a simulated object within the environment, the simulated object associated with a sound emitter, wherein the tracked location is obtained from a database stored in memory;

receiving an audio stream associated with the sound emitter;

identifying a distance between the physical location of the first UAV and the tracked location of the simulated object within the environment; and

processing the audio stream before transmitting to an operator output device associated with the first UAV, wherein a volume of the audio stream is amplified or diminished according to the identified distance.

14. The non-transitory computer-readable medium of claim 13 , wherein the simulated object has audio occlusion properties, and further comprising:

identifying that the tracked location of the simulated object is between the physical location of the first UAV and a location of a second object within the environment; and

processing an audio stream associated with the second object before transmitting to the operator output device according to the audio occlusion properties of the simulated object.

15. The non-transitory computer-readable medium of claim 14 , wherein processing the audio stream includes applying a low pass filter to the audio stream based on the audio occlusion properties of the simulated object.

16. The non-transitory computer-readable medium of claim 13 , wherein the simulated object is represented by a second UAV, and wherein receiving the audio stream comprises capturing audio via a microphone placed within range of an operator of the second UAV.

17. The non-transitory computer-readable medium of claim 13 , further comprising instructions executable to:

identify a grouping of the simulated object; and

play the audio stream on a device associated with a listener, wherein the audio stream being played is based on of the identified grouping of the simulated object.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 28, 2017
From: TAYLOR, MICHAEL; CASTLEMAN, DENNIS DALE
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 041765/0856 →
Continuity (2)
Provisional Application 62402721 · Sep 30, 2016
Related Publication 20180095714A1 · Apr 5, 2018