IP Library Granted Patent US 11,445,296
Granted Patent B2
US 11,445,296 · App. 17/284,419 · Granted Sep 13, 2022

Signal processing apparatus and method, and program to reduce calculation amount based on mute information

Inventors: Hiroyuki Honma (Chiba, JP); Toru Chinen (Kanagawa, JP); Yoshiaki Oikawa (Kanagawa, JP)
Assignee: Sony Corporation
H04R3/04G10L19/02H04S7/303H04S7/307H04R2430/01H04S2420/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,445,296
App. No.
17/284,419
Granted
Sep 13, 2022
Kind
B2
Abstract

The present technology relates to a signal processing apparatus and method, and a program that make it possible to reduce an arithmetic operation amount. The signal processing apparatus performs, on the basis of audio object mute information indicative of whether or not a signal of an audio object is a mute signal, at least either one of a decoding process or a rendering process of an object signal of the audio object. The present technology can be applied to a signal processing apparatus.

Claims (31)

1. A signal processing apparatus comprising:

processing circuitry configured to:

perform, on a basis of audio object mute information indicative of whether or not a signal of an audio object is a mute signal, at least either one of a decoding process or a rendering process of an object signal of the audio object; and

perform an HRTF (Head Related Transfer Function) process on a basis of a virtual speaker signal obtained by the rendering process and used to reproduce sound by a virtual speaker and virtual speaker mute information indicative of whether or not the virtual speaker signal is a mute signal.

2. The signal processing apparatus according to claim 1 , wherein,

in at least either one of the decoding process or the rendering process, either at least part of an arithmetic operation is omitted or a value determined in advance is outputted as a value corresponding to a result of a predetermined arithmetic operation according to the audio object mute information.

3. The signal processing apparatus according to claim 1 , wherein

the processing circuitry is configured to omit, from within the HRTF process, an arithmetic operation for convoluting the virtual speaker signal determined to be a mute signal by the virtual speaker mute information and a transfer function.

4. The signal processing apparatus according to claim 1 , wherein the processing circuitry is

configured to generate the audio object mute information on a basis of information regarding a spectrum of the object signal.

5. The signal processing apparatus according to claim 4 , wherein the processing circuitry is

configured to perform the decoding process including decoding of spectral data of the object signal encoded by a context-based arithmetic encoding method, and to not perform calculation of a context of the spectral data determined as a mute signal by the audio object mute information but decodes the spectral data by using a value determined in advance as a result of the calculation of the context.

6. The signal processing apparatus according to claim 5 , wherein

the processing circuitry is configured to perform the decoding process including decoding of the spectral data and an IMDCT (Inverse Modified Discrete Cosine Transform) process for the decoded spectral data and outputs zero data without performing the IMDCT process for the decoded spectral data determined as a mute signal by the audio object mute information.

7. The signal processing apparatus according to claim 4 , wherein

the processing circuitry is configured to generate, on a basis of a result of the decoding process, another audio object mute information different from the audio object mute information used in the decoding process, and

to perform the rendering process on a basis of the other audio object mute information.

8. The signal processing apparatus according to claim 7 , wherein

the processing circuitry is configured to perform a gain calculation process of obtaining a gain of the virtual speaker for each object signal obtained by the decoding process and a gain application process of generating the virtual speaker signal on a basis of the gain and the object signal as the rendering process.

9. The signal processing apparatus according to claim 8 , wherein

the processing circuitry is configured to omit, in the gain application process, at least either one of an arithmetic operation on the virtual speaker signal determined as a mute signal by the virtual speaker mute information or an arithmetic operation based on the object signal determined as a mute signal by the other audio object mute information.

10. The signal processing apparatus according to claim 8 , wherein

the processing circuitry is configured to generate the virtual speaker mute information on a basis of a result of the calculation of the gain and the other audio object mute information.

11. The signal processing apparatus according to claim 1 , wherein

at least either one of the decoding process or the rendering process is performed on a basis of a priority degree of the audio object and the audio object mute information.

12. A signal processing method, executed by processing circuitry, the method comprising:

performing on a basis of audio object mute information indicative of whether or not a signal of an audio object is a mute signal, at least either one of a decoding process or a rendering process of an object signal of the audio object; and

performing an HRTF (Head Related Transfer Function) process on a basis of a virtual speaker signal obtained by the rendering process and used to reproduce sound by a virtual speaker and virtual speaker mute information indicative of whether or not the virtual speaker signal is a mute signal.

13. A non-transitory computer readable medium storing instructions that, when executed by processing circuitry, perform a signal processing method comprising:

performing, on a basis of audio object mute information indicative of whether or not a signal of an audio object is a mute signal, at least either one of a decoding process or a rendering process of an object signal of the audio object; and

performing an HRTF (Head Related Transfer Function) process on a basis of a virtual speaker signal obtained by the rendering process and used to reproduce sound by a virtual speaker and virtual speaker mute information indicative of whether or not the virtual speaker signal is a mute signal.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 13, 2021
From: HONMA, HIROYUKI; CHINEN, TORU; OIKAWA, YOSHIAKI
To: SONY CORPORATION
Reel/Frame 056836/0300 →
Priority Claims (1)
JP JP2018-194777 · Oct 16, 2018 · national
Continuity (1)
Related Publication 20210352408A1 · Nov 11, 2021