IP Library Granted Patent US 11,900,956
Granted Patent B2
US 11,900,956 · App. 18/154,187 · Granted Feb 13, 2024

Signal processing device and method, and program

Inventors: Yuki Yamamoto (Chiba, JP); Toru Chinen (Kanagawa, JP); Minoru Tsuji (Chiba, JP)
Assignee: Sony Group Corporation
G10L19/20G10L19/008G10L25/51G10L19/02G10L25/78
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,900,956
App. No.
18/154,187
Granted
Feb 13, 2024
Kind
B2
Abstract

The present technology relates to a signal processing device and method, and a program making it possible to reduce the computational complexity of decoding at low cost. A signal processing device includes: a priority information generation unit configured to generate priority information about an audio object on the basis of a plurality of elements expressing a feature of the audio object. The present technology may be applied to an encoding device and a decoding device.

Claims (21)

1. A signal processing device comprising:

processing circuitry configured to generate priority information about an audio object on a basis of at least one element expressing a feature of the audio object,

wherein the element includes spread information, wherein the processing circuitry is configured to generate the priority information according to a product of a horizontal directional spread angle and a vertical directional spread angle, and wherein an audio signal of the audio object is decoded by a decoding device according to the priority information.

2. The signal processing device according to claim 1 , wherein the element comprises metadata of the audio object.

3. The signal processing device according to claim 2 , wherein the element comprises an indication of a position of the audio object in a space.

4. The signal processing device according to claim 3 , wherein the element comprises a distance from a reference position to the audio object in the space.

5. The signal processing device according to claim 3 , wherein the element comprises a horizontal direction angle indicating a position in a horizontal direction of the audio object in the space.

6. The signal processing device according to claim 2 , wherein the processing circuitry is configured to generate the priority information according to a movement speed of the audio object on a basis of the metadata.

7. The signal processing device according to claim 1 , wherein the element comprises gain information by which to multiply an audio signal of the audio object.

8. The signal processing device according to claim 7 , wherein the processing circuitry is configured to generate the priority information of a unit time to be processed, on a basis of a difference between the gain information of the unit time to be processed and an average value of the gain information of a plurality of unit times.

9. The signal processing device according to claim 7 , wherein the processing circuitry is configured to generate the priority information on a basis of a sound pressure of the audio signal multiplied by the gain information.

10. The signal processing device according to claim 1 , wherein the processing circuitry is configured to generate the priority information according to an area of a region of the audio object on a basis of the spread information.

11. The signal processing device according to claim 1 , wherein the spread information comprises angle information indicating a range of size of a sound image of the audio object.

12. The signal processing device according to claim 1 , wherein the element comprises information indicating an attribute of a sound of the audio object.

13. The signal processing device according to claim 1 , wherein the element is indicative of an audio signal of the audio object.

14. The signal processing device according to claim 13 , wherein the processing circuitry is configured to generate the priority information on a basis of a result of a voice activity detection process performed on the audio signal.

15. The signal processing device according to claim 1 , wherein the processing circuitry is configured to smooth the generated priority information in a time direction and to treat the smoothed priority information as final priority information.

16. A signal processing method executed by processing circuitry, the method comprising:

generating priority information about an audio object on a basis of at least one element expressing a feature of the audio object, wherein the element includes spread information, wherein the priority information is generated according to a product of a horizontal directional spread angle and a vertical directional spread angle, and wherein an audio signal of the audio object is decoded by a decoding device according to the priority information.

17. A non-transitory computer readable medium containing instructions that, when executed by processing circuitry, perform a process comprising:

generating priority information about an audio object on a basis of at least one element expressing a feature of the audio object, wherein the element includes spread information, wherein the priority information is generated according to a product of a horizontal directional spread angle and a vertical directional spread angle, and wherein an audio signal of the audio object is decoded by a decoding device according to the priority information.

Assignments (3)
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE STREET ADDRESS SHOULD BE "1-7-1 KONAN, MINATO-KU" PREVIOUSLY RECORDED AT REEL: 063270 FRAME: 0730. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Apr 28, 2023
From: YAMAMOTO, YUKI; CHINEN, TORU; TSUJI, MINORU
To: SONY CORPORATION
Reel/Frame 063488/0538 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 10, 2023
From: YAMAMOTO, YUKI; CHINEN, TORU; TSUJI, MINORU
To: SONY CORPORATION
Reel/Frame 063270/0730 →
CHANGE OF NAME Recorded Apr 10, 2023
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 063280/0884 →
Priority Claims (1)
JP 2017-087208 · Apr 26, 2017 · national
Continuity (2)
Continuation 16606276
Related Publication 20230154477A1 · May 18, 2023
Cited By (1)
US 12,676,156