Audio encoding method, to which BRIR/RIR parameterization is applied, and method and device for reproducing audio by using parameterized BRIR/RIR information

1. A method of reproducing an audio, the method comprising:

demultiplexing audio data, Head-Related Impulse Response (HRIR) data, parameterized direct part-related information, parameterized early reflection part-related information, and parameterized late reverberation part-related information from a received audio bitstream;

reconstructing direct/early reflection parts based on the parameterized direct part-related information and the parameterized early reflection part-related information;

reconstructing late reverberation parts based on the parameterized late reverberation part-related information;

reconstructing Room Impulse Response (RIR) data by combining the direct/early reflection parts and the late reverberation parts based on a mixing time in the audio bitstream;

obtaining a Binaural Room Impulse Response (BRIR) data by synthesizing the reconstructed RIR data and the HRIR data;

decoding the audio data; and

rendering the decoded audio data based on the BRIR data,

wherein reconstructing late reverberation parts comprises:

decoding a representative late reverberation part in the late reverberation part-related information, wherein the representative late reverberation part is generated by downmixing the late reverberation parts in a transmitter, and

reconstructing the late reverberation parts based on the decoded representative late reverberation part and energy difference information in the late reverberation part-related information, wherein the energy difference information is calculated by comparing energies of the representative late reverberation part and each of the late reverberation parts in the transmitter.

2. The method of claim 1 , wherein the parameterized direct part-related information includes gain information and propagation time information extracted from the direct/early reflection parts.

3. The method of claim 1 , wherein the parameterized early reflection part-related information includes a transfer function for an early reflection that is calculated based on gain information and delay information of a dominant reflection extracted from the direct/early reflection parts.

4. The method of claim 1 , wherein the mixing time is information for indicating a timing point at which the late reverberation parts start on a time axis.

5. A method of processing an audio in a transmitter, the method comprising:

separating Binaural Room Impulse Response (BRIR) data into Room Impulse Response (RIR) data and Head-Related Impulse Response (HRIR) data;

extracting a mixing time from the RIR data;

separating the RIR data into direct/early reflection parts and late reverberation parts based on the mixing time;

parameterizing direct part related information from the separated direct/early reflection parts;

parameterizing nearly reflection part-related information from the separated direct/early reflection parts;

parameterizing late reverberation part-related information from the separate late reverberation parts; and

transmitting an audio bitstream including the separated HRIR data, the parameterized direct part-related information, the parameterized early reflection part-related information, the parameterized late reverberation part-related information, and the mixing time,

wherein parameterizing late reverberation part-related information comprises:

generating a representative late reverberation part by downmixing the separated late reverberation parts,

encoding the generated representative late reverberation part, and

parameterizing a calculated energy difference information by comparing energies of the representative late reverberation part and each of the late reverberation parts.

6. The method of claim 5 , wherein the mixing time is information for indicating a timing point at which the late reverberation parts start on a time axis.

7. The method of claim 5 , wherein parameterizing direct part-related information comprises:

extracting gain information and propagation time information related to a direct part from the direct/early reflection parts, and

parameterizing the gain information and the propagation time information.

8. The method of claim 5 , wherein parameterizing early reflection part-related information comprises:

extracting gain information and delay information related to a dominant reflection from the direct/early reflection parts,

calculating a transfer function for an early reflection based on the gain information and the delay information related to the dominant reflection, and

parameterizing the transfer function.

9. An apparatus for reproducing an audio, the apparatus comprising:

a demultiplexer to demultiplex audio data, Head-Related Impulse Response (HRIR) data, parameterized direct part-related information, parameterized early reflection part-related information, and parameterized late reverberation part-related information from a received audio bitstream;

an RIR reproducing unit to reconstruct direct/early reflection parts based on the parameterized direct part-related information and the parameterized early reflection part-related information, to reconstruct late reverberation parts based on the parameterized late reverberation part-related information, and reconstruct Room Impulse Response (RIR) data by combining the direct/early reflection parts and the late reverberation parts based on a mixing time in the audio bitstream;

a BRIR synthesizing unit to obtain Binaural Room Impulse Response (BRIR) data by synthesizing the reconstructed RIR data and the HRIR data;

an audio core decoder to decode the audio data; and

a binaural renderer to render the decoded audio data based on the BRIR data,

wherein the RIR reproducing unit decodes a representative late reverberation part in the late reverberation part-related information and reconstructs the late reverberation parts based on the decoded representative late reverberation part and energy difference information in the late reverberation part-related information,

wherein the representative late reverberation part is generated by downmixing the late reverberation parts in a transmitter, and

wherein the energy difference information is calculated by comparing energies of the representative late reverberation part and each of the late reverberation parts in the transmitter.

10. The apparatus of claim 9 , wherein the parameterized direct part-related information includes gain information and propagation time information extracted from the direct/early reflection parts.

11. The apparatus of claim 9 , wherein the early reflection part-related information includes a transfer function for an early reflection that is calculated based on gain information and delay information of a dominant reflection extracted from the direct/early reflection parts.

12. The apparatus of claim 9 , wherein the mixing time is information for indicating a timing point at which the late reverberation parts start on a time axis.

13. A transmitter for processing an audio, the transmitter comprising:

a decomposition unit to separate Binaural Room Impulse Response (BRIR) data into Room Impulse Response (RIR) data and Head-Related Impulse Response (HRIR) data;

a mixing time extractor to extract a mixing time from the RIR data;

a separator to separate the RIR data into direct/early reflection parts and late reverberation parts based on the mixing time;

a first parameter generator to parameterize direct part-related information from the separated direct/early reflection parts;

a second parameter generator to parameterize early reflection part-related information from the separated direct/early reflection parts;

a third parameter generator to parameterize late reverberation part-related information from the separate late reverberation parts; and

a multiplexer to transmit an audio bitstream including the separated HRIR data, the parameterized direct part-related information, the parameterized early reflection part-related information, the parameterized late reverberation part-related information, and the mixing time,

wherein the third parameter generator comprises:

a downmixer to generate a representative late reverberation part by downmixing the separated late reverberation parts,

an encoder to encode the generated representative late reverberation part, and

a calculator to parameterize a calculated energy difference information by comparing energies of the representative late reverberation part and each of the late reverberation parts.

14. The transmitter of claim 13 ,

wherein the mixing time is information for indicating a timing point at which the late reverberation parts start on a time axis.

15. The transmitter of claim 13 , wherein the first parameter generator extracts gain information and propagation time information related to a direct part from the direct/early reflection parts and parameterizes the gain information and the propagation time information.

16. The transmitter of claim 13 , wherein the second parameter generator extracts gain information and delay information related to a dominant reflection from the direct/early reflection parts, calculates a transfer function for an early reflection based on the gain information and the delay information related to the dominant reflection, and parameterizes the transfer function.