IP Library › Granted Patent US 10,708,707
Granted Patent B2
US 10,708,707 · App. 16/303,717 · Granted Jul 7, 2020

Audio processing apparatus and method and program

Inventors: Hiroyuki Honma (Chiba, JP); Minoru Tsuji (Chiba, JP)
Assignee: Sony Corporation
H04S7/40G06F3/0481G06F3/165H04S7/30H04S2400/11H04S2400/13
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,708,707
App. No.
16/303,717
Granted
Jul 7, 2020
Kind
B2
Abstract

The present technology relates to an audio processing apparatus and method and a program that are configured to adjust audio characteristics more easily. This audio processing apparatus has a display control unit configured, on the basis of object positional information of an audio object, to cause a display unit to display an audio object information image indicative of a position of the audio object and a selection unit configured to select the predetermined audio object from among one or a plurality of the audio objects. The present technology is applicable to video/audio processing apparatuses.

Claims (36)

1. An audio processing apparatus comprising:

a demultiplexer configured to demultiplex an input signal into a video portion, a background portion, and an audio object portion;

an audio object decoder configured to decode the audio object portion into an audio object positional information of an audio object and an audio signal of the audio object;

a background decoder configured to decode the background portion into a background sound signal;

a video decoder configured to decode the video portion into a video signal;

a display controller configured to cause a display unit to display

a video image based on the video signal, and

an audio object information image indicative of a position of the audio object, the audio object information image being displayed in a superimposed manner relative to the video image such that the video image is visible under the audio object information image; and

a selector configured to select the audio object from among a plurality of audio objects.

2. The audio processing apparatus according to claim 1 , further comprising:

a parameter setter configured to set a parameter related to audio of the audio object selected by the selector.

3. The audio processing apparatus according to claim 2 , further comprising:

a signal adjuster configured, based on the parameter, to execute processing to adjust audio characteristics on one or both of: the audio signal of the audio object and the background sound signal.

4. The audio processing apparatus according to claim 3 , wherein the parameter is a parameter for one of: volume adjustment and sound quality adjustment.

5. The audio processing apparatus according to claim 2 , further comprising:

a rendering processor configured to execute a rendering process on the audio signal of the audio object.

6. The audio processing apparatus according to claim 5 , wherein

the parameter is a parameter for specifying a position of the audio object; and

the rendering processor executes the rendering process based on the parameter.

7. The audio processing apparatus according to claim 1 , wherein the display controller causes the audio object information image to be displayed at a position determined by object positional information decoded from the audio object portion of the input signal.

8. The audio processing apparatus according to claim 7 , wherein, if the position determined by the object positional information is outside a display screen of the display unit, the display controller causes the audio object information image to be displayed at an end portion of the display screen.

9. The audio processing apparatus according to claim 7 , wherein the selector selects the audio object in accordance with a specification manipulation by a user at the position of the audio object information image on a display screen of the display unit.

10. An audio processing method comprising:

demultiplexing an input signal into a video portion, a background portion, and an audio object portion;

decoding the audio object portion into audio object positional information of an audio object and an audio signal of the audio object;

decoding the background portion into a background sound signal;

decode the video portion into a video signal;

causing a display unit to display a video image based on the video signal and an audio object information image indicative of a position of the audio object, the audio object information image being displayed in a superimposed manner relative to the video image such that the video image is visible under the audio object information image; and

selecting the audio object from among a plurality of audio objects.

11. A non-transitory computer-readable storage medium storing a program that when executed causes a computer to perform an audio processing method, wherein the method comprises:

demultiplexing an input signal into a video portion, a background portion, and an audio object portion;

decoding the audio object portion into an audio object positional information of an audio object and an audio signal of the audio object;

decoding the background portion into a background sound signal;

decode the video portion into a video signal;

causing a display unit to display a video image based on the video signal and an audio object information image indicative of a position of the audio object, the audio object information image being displayed in a superimposed manner relative to the video image such that the video image is visible under the audio object information image; and

selecting the audio object from among a plurality of audio objects.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 6, 2018
From: HONMA, HIROYUKI; TSUJI, MINORU
To: SONY CORPORATION
Reel/Frame 047734/0124 →
Priority Claims (1)
JP 2016-107043 · May 30, 2016 · national
Continuity (1)
Related Publication 20190253828A1 · Aug 15, 2019