IP Library Granted Patent US 8,837,747
Granted Patent B2
US 8,837,747 · App. 13/189,657 · Granted Sep 16, 2014

Apparatus, method, and program product for presenting moving image with sound

Inventor: Kaoru Suzuki (Kanagawa, JP)
Assignee: Kabushiki Kaisha Toshiba
H04S7/30H04S2400/15H04S2400/11H04S2420/01H04R2430/23
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,837,747
App. No.
13/189,657
Granted
Sep 16, 2014
Kind
B2
Abstract

According to one embodiment, an apparatus for presenting a moving image with sound includes an input unit, a setting unit, a main beam former unit, and an output control unit. The input unit inputs data on a moving image with sound including a moving image and a plurality of channels of sounds. The setting unit sets an arrival time difference according to a user operation, the arrival time difference being a difference in time between a plurality of channels of sounds coming from a desired direction. The main beam former unit generates a directional sound in which a sound in a direction having the arrival time difference set by the setting unit is enhanced, from the plurality of channels of sounds included in the data on the moving image with sound. The output control unit outputs the directional sound along with the moving image.

Claims (34)

1. An apparatus for presenting a moving image with sound, comprising:

a memory that has stores computer executable units; and

a processor configured to execute the computer executable units stored in the memory;

an input unit, stored in the memory and executed by the processor, that inputs data on a moving image with sound including a moving image and a plurality of channels of sounds;

a setting unit, stored in the memory and executed by the processor, that:

receives an operational input from a user, the operational input indicating an arrival time difference, the arrival time difference being a difference in time between a plurality of channels of sounds coming from a desired direction; and

sets the arrival time difference based on the operational input;

a main beam former unit that generates a directional sound in which a sound in a direction having the arrival time difference set by the setting unit is enhanced, from the plurality of channels of sounds included in the data on the moving image with sound; and

an output control unit that outputs the directional sound along with the moving image.

2. The apparatus according to claim 1 , further comprising:

an acquisition unit, stored in the memory and executed by the processor, that acquires position coordinates of an object specified as a source of the enhanced sound in the moving image output along with the directional sound; and

a calibration unit, executed by the processor, that calculates a calibration parameter which defines relationship between the position coordinates acquired by the acquisition unit and the arrival time difference set by the setting unit.

3. The apparatus according to claim 2 , further comprising an object tracking unit, stored in the memory and executed by the processor, that keeps track of the object in the moving image, and modifies the arrival time difference by using the calibration parameter so that the direction of the sound to enhance continues being directed to the object.

4. The apparatus according to claim 2 , further comprising:

a sub beam former unit that generates a sound in which a sound in a direction, a predetermined amount off the direction of the sound enhanced by the main beam former unit, is enhanced; and

a recalibration unit that compares output power of the directional sound and output power of the sound generated by the sub beam former unit, and if the output power of the sound generated by the sub beam former unit is higher than that of the directional sound, shifts the direction of the sound to be enhanced by the main beam former unit by the predetermined amount and recalculates the calibration parameter.

5. The apparatus according to claim 3 , further comprising:

a sub beam former unit that generates a sound in which a sound in a direction, a predetermined amount off the direction of the sound enhanced by the main beam former unit, is enhanced; and

a recalibration unit that compares output power of the directional sound and output power of the sound generated by the sub beam former unit, and if the output power of the sound generated by the sub beam former unit is higher than that of the directional sound, shifts the direction of the sound to be enhanced by the main beam former unit by the predetermined amount and recalculates the calibration parameter.

6. The apparatus according to claim 2 , wherein the output control unit outputs a mark as superimposed on the moving image, the mark indicating a range of directions of the sound that the main beam former unit enhances.

7. The apparatus according to claim 3 , wherein the output control unit outputs a mark as superimposed on the moving image, the mark indicating a range of directions of the sound that the main beam former unit enhances.

8. The apparatus according to claim 4 , wherein the output control unit outputs a mark as superimposed on the moving image, the mark indicating a range of directions of the sound that the main beam former unit enhances.

9. A method for presenting a moving image with sound, comprising:

inputting data on a moving image with sound including a moving image and a plurality of channels of sounds;

receiving an operational input from a user, the operational input indicating an arrival time difference, the arrival time difference being a difference in time between a plurality of channels of sounds coming from a desired direction;

setting the arrival time difference based on the operational input;

generating a directional sound in which a sound in a direction having the set arrival time difference is enhanced, from the plurality of channels of sounds included in the data on the moving image with sound; and

outputting the directional sound along with the moving image.

10. A program product having a non-transitory computer readable medium including programmed instructions for presenting a moving image with sound, wherein the instructions, when executed by a computer, cause the computer to perform:

inputting data on a moving image with sound including a moving image and a plurality of channels of sounds;

receiving an operational input from a user, the operational input indicating an arrival time difference, the arrival time difference being a difference in time between a plurality of channels of sounds coming from a desired direction;

setting the arrival time difference based on the operational input;

generating a directional sound in which a sound in a direction having the set arrival time difference is enhanced, from the plurality of channels of sounds included in the data on the moving image with sound; and

outputting the directional sound along with the moving image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 25, 2011
From: SUZUKI, KAORU
To: KABUSHIKI KAISHA TOSHIBA
Reel/Frame 026641/0075 →
Priority Claims (1)
JP 2010-217568 · Sep 28, 2010 · national
Continuity (1)
Related Publication 20120076304A1 · Mar 29, 2012