IP Library › Granted Patent US 12,170,090
Granted Patent B2
US 12,170,090 · App. 17/771,071 · Granted Dec 17, 2024

Electronic device, method and computer program

Inventors: Franck Giron (Stuttgart, DE); Elke Schächtele (Stuttgart, DE)
Assignee: SONY GROUP CORPORATION
G10L19/008H04S1/002H04S7/30H04S2400/11
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,170,090
App. No.
17/771,071
Granted
Dec 17, 2024
Kind
B2
Abstract

An electronic device comprising circuitry configured to analyze the results of a stereo or multi-channel source separation to determine one or more time-varying parameters, and to create spatially dynamic audio objects based on the one or more time-varying parameters.

Claims (31)

1. An electronic device comprising:

circuitry configured to:

perform a stereo or multi-channel source separation resulting in a plurality of separated sources,

analyze the plurality of separated sources to determine one or more time-varying parameters, and

create spatially dynamic audio objects based on the one or more time-varying parameters.

2. The electronic device of claim 1 , wherein the circuitry is configured to determine, as the one or more time-varying parameters, at least one of a parameter describing a relative signal level-loudness between separated channels, a spectral balance parameter, a primary-ambience indicator, a dry-wet indicator, or a parameter describing a percussive-harmonic content.

3. The electronic device of claim 1 , wherein the circuitry is configured to:

determine, as the one or more time-varying parameters, a parameter describing a balance of instruments in a stereo content, and

create the spatially dynamic audio objects based on the balance of instruments in the stereo content.

4. The electronic device of claim 1 , wherein the circuitry is configured to:

determine, as the one or more time-varying parameters, a side-mid ratio of at least one of the plurality of separated sources, the side-mid ratio relating a side signal and a mid signal, and

create the spatially dynamic audio objects based on the side-mid ratio.

5. The electronic device of claim 1 , wherein the circuitry is configured to determine spatial positioning parameters for the spatially dynamic audio objects based on the one or more time-varying parameters.

6. The electronic device of claim 5 , wherein the circuitry is configured to dynamically adapt the positioning parameters of the spatially dynamic audio objects.

7. The electronic device of claim 1 , wherein the circuitry is configured to create the spatially dynamic audio objects by monopole synthesis.

8. The electronic device of claim 7 , wherein the circuitry is configured to dynamically adapt a spread in the monopole synthesis.

9. The electronic device of claim 1 , wherein the spatially dynamic audio objects are monopoles.

10. The electronic device of claim 9 , wherein the circuitry is configured to dynamically create, based on the one or more time-varying parameter, a first monopole used for rendering a left channel of one of the plurality of separated sources and a second monopole used for rendering a right channel of the one of the plurality of separated sources.

11. The electronic device of claim 1 , wherein the circuitry is configured to create, from the plurality of separated sources, a time-dependent spatial upmix which preserves an original balance of content.

12. The electronic device of claim 1 , wherein the circuitry is further configured to perform, based on the one or more time-varying parameters, a segmentation process to obtain segments of the plurality of separated sources.

13. The electronic device of claim 12 , wherein the circuitry is configured to perform a cluster detection based on the one or more time-varying parameters in the segmentation process.

14. The electronic device of claim 12 , wherein the circuitry is configured to perform automatic time-dependent spatial upmixing based on the results of a similarity analysis of each of the plurality of separated sources.

15. The electronic device of claim 12 , wherein the circuitry is configured to perform a smoothening process on the segments of the plurality of separated sources.

16. The electronic device of claim 1 , wherein the circuitry is configured to perform a beat detection process to analyze the plurality of separated sources to determine the one or more time-varying parameters.

17. The electronic device of claim 16 , wherein the one or more time-varying parameters are determined per beat, per window, or per frame of one of the separated sources or original content.

18. A method comprising:

performing a stereo or multi-channel source separation resulting in a plurality of separated sources,

analyzing the plurality of separated sources to determine one or more time-varying parameters, and

creating spatially dynamic audio objects based on the one or more time-varying parameters.

19. A non-transitory computer readable medium storing a computer program comprising instructions which, when the computer program is executed by a computer, cause the computer to carry out the method of claim 18 .

20. The electronic device of claim 10 , wherein the circuitry is further configured to position, based on the one or more time-varying parameter, the first monopole and the second monopole closer to a front when the one or more time-varying parameter is lower and closer to a back when the one or more time-varying parameter is higher.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 22, 2022
From: GIRON, FRANCK; SCHÄCHTELE, ELKE
To: SONY GROUP CORPORATION
Reel/Frame 059679/0355 →
Priority Claims (1)
EP 19207275 · Nov 5, 2019 · regional
Continuity (1)
Related Publication 20220392461A1 · Dec 8, 2022
Cited By (1)
US 12,610,204