IP Library Granted Patent US 11,170,796
Granted Patent B2
US 11,170,796 · App. 16/447,693 · Granted Nov 9, 2021

Multiple metadata part-based encoding apparatus, encoding method, decoding apparatus, decoding method, and program

Inventors: Yuki Yamamoto (Tokyo, JP); Toru Chinen (Kanagawa, JP); Minoru Tsuji (Chiba, JP)
Assignee: Sony Corporation
G10L19/167G10L19/008H04S3/008H04S7/30H04S2400/11H04S2420/03
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,170,796
App. No.
16/447,693
Granted
Nov 9, 2021
Kind
B2
Abstract

The present technology relates to an encoding apparatus, an encoding method, a decoding apparatus, a decoding method, and a program for obtaining sound of higher quality. An audio signal decoding section decodes encoded audio data to acquire an audio signal of each object. A metadata decoding section decodes encoded metadata to acquire a plurality of metadata about each object in each frame of the audio signal. A gain calculating section calculates VBAP gains of each object in the audio signal for each speaker based on the metadata. An audio signal generating section generates an audio signal to be fed to each speaker by having the audio signal of each object multiplied by the corresponding VBAP gain and by adding up the multiplied audio signals. The present technology may be applied to decoding apparatuses.

Claims (35)

1. A decoding apparatus comprising:

an acquisition section configured to acquire a bitstream including

encoded audio data obtained by encoding an audio signal of an audio object in a frame of a predetermined time segment and

encoded data of a plurality of metadata for the frame;

an audio data decoding section configured to decode the encoded audio data;

a metadata decoding section configured to decode the encoded data of the plurality of metadata; and

a rendering section configured to:

in response to determining that vector base amplitude panning (VBAP) gains of a plurality of samples in the frame of the audio signal of the audio object have been calculated, perform rendering based on the audio signal obtained by the audio data decoding section and on the metadata obtained by the metadata decoding section, and

in response to determining that the VBAP gains of the plurality of samples in the frame of the audio signal of the audio object have not been calculated, return to calculation of the VBAP gains,

wherein the number of the metadata for the frame is identified based on information included in the bitstream, and the metadata include position information indicating a position of the audio object,

wherein the rendering section calculates vector base amplitude panning VBAP gains of two or three speakers placed around the position of the audio object,

wherein each of the plurality of metadata is metadata for multiple samples in the frame of the audio signal.

2. The decoding apparatus according to claim 1 , wherein each of the plurality of metadata is metadata for multiple samples arranged by dividing the number of the samples making up the frame by the number of the metadata.

3. A decoding method comprising the steps of:

acquiring a bitstream including

encoded audio data obtained by encoding an audio signal of an audio object in a frame of a predetermined time segment and

encoded data of a plurality of metadata for the frame;

decoding the encoded audio data;

decoding the encoded data of the plurality of metadata; and

in response to determining that vector base amplitude panning (VBAP) gains of a plurality of samples in the frame of the audio signal of the audio object have been calculated, performing rendering based on the audio signal obtained by the decoding and on the metadata obtained by the decoding, and

in response to determining that the VBAP gains of the plurality of samples in the frame of the audio signal of the audio object have not been calculated, return to calculation of the VBAP gains,

wherein the number of the metadata for the frame is identified based on information included in the bitstream,

wherein the method further comprises calculating VBAP gains of two or three speakers placed around the position of the audio object,

wherein each of the plurality of metadata is metadata for multiple samples in the frame of the audio signal.

4. At least one non-transitory computer-readable storage medium encoded with executable instructions that, when executed by at least one processor, cause the at least one processor to perform a method comprising:

acquiring a bitstream including

encoded audio data obtained by encoding an audio signal of an audio object in a frame of a predetermined time segment and

encoded data of a plurality of metadata for the frame;

decoding the encoded audio data;

decoding the encoded data of the plurality of metadata; and

in response to determining that vector base amplitude panning (VBAP) gains of a plurality of samples in the frame of the audio signal of the audio object have been calculated, performing rendering based on the audio signal obtained by the decoding and on the metadata obtained by the decoding, and

in response to determining that the VBAP gains of the plurality of samples in the frame of the audio signal of the audio object have not been calculated, return to calculation of the VBAP gains,

wherein the number of the metadata for the frame is identified based on information included in the bitstream,

wherein the method further comprises calculating VBAP gains of two or three speakers placed around the position of the audio object,

wherein each of the plurality of metadata is metadata for multiple samples in the frame of the audio signal.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 7, 2019
From: YAMAMOTO, YUKI; CHINEN, TORU; TSUJI, MINORU
To: SONY CORPORATION
Reel/Frame 049991/0935 →
Priority Claims (2)
JP 2015-123589 · Jun 19, 2015 · national
JP 2015-196494 · Oct 2, 2015 · national
Continuity (2)
Continuation 15735630
Related Publication 20190304479A1 · Oct 3, 2019