Method and system for noise cancellation and audio enhancement based on captured depth information

1. A method, comprising:

in a monoscopic camera comprising one or more image sensors and a depth sensor:

generating video based on two-dimensional image data captured via said one or more image sensors and corresponding depth information captured via said depth sensor;

receiving audio corresponding to the video and emanating from a source;

determining, based on said captured depth information, a direct path and one or more reflection paths between the source of said corresponding audio and a microphone utilized to capture said corresponding audio emanating from said source; and

processing said corresponding audio for said generated video based on said captured depth information.

2. The method according to claim 1 , comprising mitigating noise in said corresponding audio based on said captured depth information.

3. The method according to claim 1 , comprising enhancing voice quality in said corresponding audio based on said captured depth information.

4. The method according to claim 1 , comprising enhancing audio quality in said corresponding audio based on said captured depth information.

5. The method according to claim 1 , wherein:

said processing comprises removing portions of said corresponding audio arriving at said microphone via said one or more reflection paths.

6. The method according to claim 1 , wherein said determination of said one or more sound paths comprises detecting reflective surfaces off of which audio signals from said source may reflect.

7. The method according to claim 6 , wherein said determination of said one or more sound paths comprises determining distances between:

said source and said detected reflective surfaces;

said source and said microphone; and

said surfaces and said microphone.

8. The method according to claim 1 comprising calculating a difference between an amount of time required for sound to travel a direct path between said source and said microphone and an amount of time required for sound to travel a reflection path between said source and said microphone.

9. The method according to claim 8 , comprising:

detecting echoes in said audio based on said calculated difference; and

removing said detected echoes from said audio.

10. A system comprising:

one or more processors and/or circuits for use in a monoscopic camera, said one or more processors and/or circuits comprising one or more image sensors and a depth sensor, said one or more circuits being operable to:

generate video based on two-dimensional image data captured via said one or more image sensors and corresponding depth information captured via said depth sensor;

receive audio corresponding to the video and emanating from a source;

determine, based on said captured depth information, a direct path and one or more reflection paths between a source of said corresponding audio and a microphone utilized to capture said corresponding audio emanating from said source; and

process said corresponding audio for said generated video based on said captured depth information.

11. The system according to claim 10 , wherein said one or more circuits are operable to mitigate noise in said corresponding audio based on said captured depth information.

12. The system according to claim 10 , wherein said one or more circuits are operable to enhance voice quality in said corresponding audio based on said captured depth information.

13. The system according to claim 10 , wherein said one or more circuits are operable to enhance audio quality in said corresponding audio based on said captured depth information.

14. The system according to claim 10 , wherein:

said one or more sound paths comprise a direct path and one or more reflection paths; and

said processing comprises removing portions of said corresponding audio arriving at said microphone via said one or more reflection paths.

15. The system according to claim 10 , wherein said determination of said one or more sound paths comprises detecting reflective surfaces off of which audio signals from said source may reflect.

16. The system according to claim 15 , wherein said determination of said one or more sound paths comprises determining distances between:

said source and said detected reflective surfaces;

said source and said microphone; and

said surfaces and said microphone.

17. The system according to claim 10 wherein said one or more circuits are operable to calculate a difference between an amount of time required for sound to travel a direct path between said source and said microphone and an amount of time required for sound to travel a reflection path between said source and said microphone.

18. The system according to claim 17 , wherein said one or more circuits are operable to:

detect echoes in said audio based on said calculated difference; and

remove said detected echoes from said audio.

19. The system according to claim 10 , wherein said one or more circuits are operable to:

determine a distance to an object in the video; and

process said corresponding audio for said generated video based on said determined distance.

20. A method, comprising:

in a monoscopic camera comprising one or more image sensors and a depth sensor:

generating video based on two-dimensional image data captured via said one or more image sensors and corresponding depth information captured via said depth sensor;

receiving audio corresponding to the video and emanating from a source in the video;

determining a distance from the monoscopic camera to the source based on the depth information;

determining, based on said captured distance to the source, a direct path and one or more reflection paths between the source of said corresponding audio and a microphone utilized to capture said corresponding audio emanating from said source; and

processing said corresponding audio for said generated video based on the depth information.