IP Library Granted Patent US 12,245,019
Granted Patent B2
US 12,245,019 · App. 18/088,002 · Granted Mar 4, 2025

Signal processing device, method, and program

Inventors: Hiroyuki Honma (Chiba, JP); Minoru Tsuji (Chiba, JP); Toru Chinen (Kanagawa, JP)
Assignee: Sony Group Corporation
H04S7/305G10K15/12H04S3/008G10L19/008H04S2400/01H04S2400/11
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,245,019
App. No.
18/088,002
Granted
Mar 4, 2025
Kind
B2
Abstract

The present technology relates to a signal processing device, method, and program that can improve encoding efficiency. A signal processing device includes: an acquisition unit that acquires reverb information including at least one of space reverb information specific to a space around an audio object or object reverb information specific to the audio object and an audio object signal of the audio object; and a reverb processing unit that generates a signal of a reverb component of the audio object on the basis of the reverb information and the audio object signal. The present technology can be applied to a signal processing device.

Claims (26)

1. A signal processing device comprising:

processing circuitry configured to:

acquire reverb information including at least one of space reverb information specific to a space around an audio object or object reverb information specific to the audio object and an audio object signal of the audio object;

generate a signal of a reverb component of the audio object on a basis of the reverb information and the audio object signal; and

perform rendering processing of the reverb component of the audio object and the audio object signal to generate an output audio signal.

2. The signal processing device according to claim 1 , wherein in a case where identification information indicating past reverb information is acquired, the processing circuitry is configured to generate the signal of the reverb component on a basis of the reverb information indicated by the identification information and the audio object signal.

3. The signal processing device according to claim 2 , wherein the identification information includes information indicating the object reverb information, and

the processing circuitry is configured to generate the signal of the reverb component on a basis of the object reverb information indicated by the identification information, the space reverb information, and the audio object signal.

4. The signal processing device according to claim 1 , wherein the object reverb information includes information depending on a position of the audio object.

5. The signal processing device according to claim 1 , wherein the processing circuitry is configured to generate the signal of the reverb component specific to the space on a basis of the space reverb information and the audio object signal, and to generate the signal of the reverb component specific to the audio object on a basis of the object reverb information and the audio object signal.

6. The signal processing device according to claim 1 , wherein the rendering processing includes rendering processing of the audio object signal and position information of the object reverb information to provide the output audio signal.

7. The signal processing device according to claim 1 , wherein the rendering processing includes rendering processing of the audio object signal and position information of the space reverb information to provide the output audio signal.

8. The signal processing device according to claim 1 , wherein the rendering processing includes rendering processing by VBAP (Vector Based Amplitude Panning).

9. A signal processing method executed by processing circuitry, the method comprising:

acquiring reverb information including at least one of space reverb information specific to a space around an audio object or object reverb information specific to the audio object and an audio object signal of the audio object;

generating a signal of a reverb component of the audio object on a basis of the reverb information and the audio object signal; and

performing rendering processing of the reverb component of the audio object and the audio object signal to generate an output audio signal.

10. The signal processing method according to claim 9 , wherein in a case where identification information indicating past reverb information is acquired, the signal of the reverb component is generated on a basis of the reverb information indicated by the identification information and the audio object signal.

11. The signal processing method according to claim 10 , wherein the identification information includes information indicating the object reverb information, and

the signal of the reverb component is generated on a basis of the object reverb information indicated by the identification information, the space reverb information, and the audio object signal.

12. The signal processing method according to claim 9 , wherein the object reverb information includes information depending on a position of the audio object.

13. The signal processing method according to claim 9 , wherein the signal of the reverb component is generated specific to the space on a basis of the space reverb information and the audio object signal, and the signal of the reverb component is generated specific to the audio object on a basis of the object reverb information and the audio object signal.

14. A non-transitory computer readable medium storing instructions that, when executed by a computer, cause the computer to execute processing comprising:

acquiring reverb information including at least one of space reverb information specific to a space around an audio object or object reverb information specific to the audio object and an audio object signal of the audio object;

generating a signal of a reverb component of the audio object on a basis of the reverb information and the audio object signal; and

performing rendering processing of the reverb component of the audio object and the audio object signal to generate an output audio signal.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 17, 2023
From: HONMA, HIROYUKI; TSUJI, MINORU; CHINEN, TORU
To: SONY CORPORATION
Reel/Frame 063017/0719 →
CHANGE OF NAME Recorded Mar 17, 2023
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 063115/0001 →
Priority Claims (1)
JP 2017-203877 · Oct 20, 2017 · national
Continuity (3)
Continuation 17400010 · Aug 11, 2021
Continuation 16755771
Related Publication 20230126927A1 · Apr 27, 2023
References Cited (74)
US 5742688A · Ogawa et al. · 1998 [cited by applicant]
US 11109179B2 · Honma et al. · 2021 [cited by applicant]
US 11257478B2 · Tsuji et al. · 2022 [cited by applicant]
US 11749252B2 · Tsuji et al. · 2023 [cited by applicant]
US 11805383B2 · Honma et al. · 2023 [cited by applicant]
US 20050179701A1 · Jahnke · 2005 [cited by applicant]
US 20060045283A1 · Lin et al. · 2006 [cited by applicant]
US 20070140501A1 · Schmidt et al. · 2007 [cited by applicant]
US 20120057715A1 · Johnston et al. · 2012 [cited by applicant]
US 20120070005A1 · Inou et al. · 2012 [cited by applicant]
US 20120082319A1 · Jot et al. · 2012 [cited by applicant]
US 20130179575A1 · Young et al. · 2013 [cited by applicant]
US 20150332663A1 · Jot et al. · 2015 [cited by applicant]
US 20150373475A1 · Raghuvanshi et al. · 2015 [cited by applicant]
US 20160125871A1 · Shiraakihara · 2016 [cited by applicant]
US 20160198281A1 · Oh · 2016 [cited by examiner]
US 20160219388A1 · Oh et al. · 2016 [cited by applicant]
US 20160234620A1 · Lee et al. · 2016 [cited by applicant]
US 20160249149A1 · Oh et al. · 2016 [cited by applicant]
US 20180227692A1 · Lee et al. · 2018 [cited by applicant]
US 20190253825A1 · Tsuji et al. · 2019 [cited by applicant]
US 20200327879A1 · Tsuji et al. · 2020 [cited by applicant]
US 20210195363A1 · Honma et al. · 2021 [cited by applicant]
US 20210377691A1 · Honma et al. · 2021 [cited by applicant]
US 20220148560A1 · Tsuji et al. · 2022 [cited by applicant]
US 20230368772A1 · Tsuji et al. · 2023 [cited by applicant]
CN 101014209A · 2007 [cited by applicant]
CN 101034548A · 2007 [cited by applicant]
CN 103402169A · 2013 [cited by applicant]
CN 103430574A · 2013 [cited by applicant]
CN 105519139A · 2016 [cited by applicant]
CN 105659630A · 2016 [cited by applicant]
CN 105706467A · 2016 [cited by applicant]
CN 105792090A · 2016 [cited by applicant]
EP 0036337A2 · 1981 [cited by applicant]
EP 0480561A3 · 1992 [cited by applicant]
EP 2840811A1 · 2015 [cited by applicant]
EP 3048814A1 · 2016 [cited by applicant]
EP 3048815A1 · 2016 [cited by applicant]
EP 3048816A1 · 2016 [cited by applicant]
EP 3096539A1 · 2016 [cited by applicant]
EP 3209002A1 · 2017 [cited by applicant]
EP 3407573A1 · 2018 [cited by applicant]
FR 2554615A1 · 1985 [cited by applicant]
JP S61237600A · 1986 [cited by applicant]
JP 2007513370A · 2007 [cited by applicant]
JP 2008311718A · 2008 [cited by applicant]
JP 2013541275A · 2013 [cited by applicant]
JP 2016534586A · 2016 [cited by applicant]
KR 101627652B1 · 2016 [cited by applicant]
KR 1020160094348A · 2016 [cited by applicant]
KR 20160108325A · 2016 [cited by applicant]
RU 2403674C2 · 2010 [cited by applicant]
WO WO2005055193A1 · 2005 [cited by applicant]
WO WO2011008705A1 · 2011 [cited by applicant]
WO WO2012033950A1 · 2012 [cited by applicant]
WO 2015107926A1 · 2015 [cited by applicant]
WO WO2015152661A1 · 2015 [cited by applicant]
WO 2017043309A1 · 2017 [cited by applicant]
Decision of Rejection for Chinese Application No. 201880066615.0 dated Mar. 29, 2024. [cited by applicant]
Chen, The Foundation of Sound Production. China Light Industry Press, pp. 10-11, Aug. 2015. [cited by applicant]
Notification of the Second Office Action for Chinese Application No. 201880066615.0 dated Oct. 12, 2023. [cited by applicant]
Extended European Search Report dated Nov. 27, 2020 in connection with European Application No. 18868539.0. [cited by applicant]
Extended European Search Report dated Nov. 19, 2020 in connection with European Application No. 18869347.7. [cited by applicant]
International Search Report and English translation thereof mailed Dec. 18, 2018 in connection with International Application No. PCT/JP2018/037330. [cited by applicant]
International Search Report and English translation thereof mailed Dec. 18, 2018 in connection with International Application No. PCT/JP2018/037329. [cited by applicant]
International Written Opinion and English translation thereof mailed Dec. 18, 2018 in connection with International Application No. PCT/JP2018/037330. [cited by applicant]
International Written Opinion and English translation thereof mailed Dec. 18, 2018 in connection with International Application No. PCT/JP2018/037329. [cited by applicant]
International Preliminary Report on Patentability and English translation thereof mailed Apr. 30, 2020 in connection with International Application No. PCT/JP2018/037330. [cited by applicant]
International Preliminary Report on Patentability and English translation thereof mailed Apr. 30, 2020 in connection with International Application No. PCT/JP2018/037329. [cited by applicant]
[No Author Listed], International Standard ISO/IEC 23008-3. Information technology—High efficiency coding and media delivery in heterogeneous environments—Part 3: 3D audio. Feb. 1, 2016. 439 pages. [cited by applicant]
Coleman et al., Object-based reverberation for spatial audio. Journal of the Audio Engineering Society. Feb. 16, 2017;65(1/2):66-77. [cited by applicant]
Lee et al., An Object-based 3D Audio Broadcasting System for Interactive Service. Audio Engineering Society (AES) Convention Paper 6384. May 28-31, 2005, pp. 1-8, XP002577516. Retrieved from the Internet: URL:http://www… [cited by applicant]
Pulkki, Virtual Sound Source Positioning Using Vector Base Amplitude Panning. J. Audio Eng. Soc. 1997;45(6):456-466. [cited by applicant]