IP Library Patent Application 13174344
Patent Application
App. No. 13/174,344

METHOD AND SYSTEM FOR ADJUSTING AUDIO BASED ON CAPTURED DEPTH INFORMATION

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
13/174,344
Abstract

Two-dimensional image may be captured via one or more image sensors of a monoscopic camera and depth information may be captured via one or more depth sensors of the monoscopic camera. A video stream may be generated from the captured two-dimensional image data based on the captured depth information. Corresponding audio to accompany the generated video stream may be generated based on the captured depth information. The generated video stream may be a 3-D video stream. The generated corresponding audio may be adjusted based on the captured depth information. A location and/or movement of an object appearing in the captured two-dimensional image data may be determined based on the depth information and based on pixel data of the captured two-dimensional image data. Characteristics of the generated audio, such as volume, frequency, delay, and balance, may be adjusted based on the determined location and/or movement.

Claims (27)

1 . A method comprising:

capturing two-dimensional image data via one or more image sensors of a monoscopic camera;

capturing depth information via a depth sensor of said monoscopic camera; and

generating corresponding audio for a video stream generated from said captured two-dimensional image data based on said captured depth information.

2 . The method according to claim 1 , comprising generating a three-dimensional video stream from said captured two-dimensional image data utilizing said captured depth information.

3 . The method according to claim 2 , comprising adjusting said corresponding audio for generated three-dimensional video stream based one said captured depth information.

4 . The method according to claim 1 , comprising generating a multimedia stream utilizing said captured two-dimensional image data, said captured depth information and said generated corresponding audio.

5 . The method according to claim 1 , comprising determining a location and/or movement of an object appearing in said captured two-dimensional image data based on said depth information and based on pixel data of said captured two-dimensional image data.

6 . The method according to claim 5 , comprising adjusting a volume of said generated corresponding audio based on said determined location and/or movement.

7 . The method according to claim 5 , comprising adjusting a frequency of said generated corresponding audio based on said determined location and/or movement.

8 . The method according to claim 5 , comprising adjusting a delay of said generated corresponding audio based on said determined location and/or movement.

9 . The method according to claim 5 , comprising adjusting a left-right balance and/or front-back balance of said generated corresponding audio based on said determined location and/or movement.

10 . The method according to claim 1 , wherein said depth sensor utilizes infrared waves transmitted by an emitter of said camera.

11 . A system comprising:

one or more circuits for use in a monoscopic camera, said one or more circuits being operable to:

capture two-dimensional image data via one or more image sensors of a monoscopic camera;

capture depth information via a depth sensor of said monoscopic camera; and

generate corresponding audio for video generated from said captured two-dimensional image data based on said captured depth information.

12 . The system according to claim 11 , wherein said one or more circuits are operable to generate a three-dimensional video stream from said captured two-dimensional image data utilizing said captured depth information.

13 . The system according to claim 12 , wherein said one or more circuits are operable to adjust said corresponding audio for generated three-dimensional video stream based one said captured depth information.

14 . The system according to claim 11 , wherein said one or more circuits are operable to generate a multimedia stream utilizing said captured two-dimensional image data, said captured depth information and said generated corresponding audio.

15 . The system according to claim 11 , wherein said one or more circuits are operable to determine a location and/or movement of an object appearing in said captured two-dimensional image data based on said depth information and based on pixel data of said captured two-dimensional image data.

16 . The system according to claim 15 , wherein said one or more circuits are operable to adjust a volume of said generated corresponding audio based on said determined location and/or movement.

17 . The system according to claim 15 , wherein said one or more circuits are operable to adjust a frequency of said generated corresponding audio based on said determined location and/or movement.

18 . The system according to claim 15 , wherein said one or more circuits are operable to adjust a delay of said generated corresponding audio based on said determined location and/or movement.

19 . The system according to claim 15 , wherein said one or more circuits are operable to adjust a left-right balance and/or front-back balance of said generated corresponding audio based on said determined location and/or movement.

20 . The system according to claim 11 , wherein said depth sensor utilizes infrared waves transmitted by an emitter of said camera.

Assignments (4)
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS Recorded Feb 3, 2017
From: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
To: BROADCOM CORPORATION
Reel/Frame 041712/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 1, 2017
From: BROADCOM CORPORATION
To: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
Reel/Frame 041706/0001 →
PATENT SECURITY AGREEMENT Recorded Feb 11, 2016
From: BROADCOM CORPORATION
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 037806/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 10, 2011
From: SESHADRI, NAMBI; KARAOGUZ, JEYHAN; CHEN, XUEMIN; BOROSS, CHRIS
To: BROADCOM CORPORATION
Reel/Frame 026729/0420 →