IP Library Granted Patent US 10,595,144
Granted Patent B2
US 10,595,144 · App. 15/127,716 · Granted Mar 17, 2020

Method and apparatus for generating audio content

Inventors: Fabien Cardinaux (Stuttgart, DE); Michael Enenkl (Stuttgart, DE); Franck Giron (Waiblingen, DE); Thomas Kemp (Esslingen, DE); Stefan Uhlich (Renningen, DE)
Assignee: SONY CORPORATION
H04S7/30G10L21/0272H04S3/008
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,595,144
App. No.
15/127,716
Granted
Mar 17, 2020
Kind
B2
Abstract

In method the following is performed: receiving input audio content representing mixed audio sources; separating the mixed audio sources, thereby obtaining separated audio source signals and a residual signal; and generating output audio content by mixing the separated audio source signals and the residual signal.

Claims (24)

1. A method, comprising:

receiving input audio content representing mixed audio sources;

separating the mixed audio sources, thereby obtaining separated audio source signals and a residual signal, the residual signal being a signal which remains after the mixed audio sources have been separated, the residual signal resulting from an imperfect separation of the mixed audio sources; and

generating output audio content by mixing the separated audio source signals and the residual signal.

2. The method of claim 1 , wherein the generation of the output audio content is performed on the basis of spatial information.

3. The method of claim 1 , wherein the input audio content includes a number of input audio signals, each input audio signal representing one audio channel, and wherein the generation of the output audio content includes the mixing of the separated audio source signals such that the output audio content includes a number of output audio signals each representing one audio channel, wherein the number of output audio signals is equal to or larger than the number of input audio signals.

4. The method of claim 1 , further comprising adjusting an amplitude of the separated audio source signals, thereby minimizing an amplitude of the residual signal.

5. The method of claim 1 , wherein the generation of the output audio content includes allocating a spatial position to each of the separated audio source signals.

6. The method of claim 1 , wherein the generation of the output audio content includes allocating a spatial position to the residual signal.

7. The method of claim 1 , wherein the generation of the output audio content includes dividing the residual signal into a number of divided residual signals on the basis of the number of separated audio source signals and adding a divided residual signal respectively to a separated audio source signal.

8. The method of claim 7 , wherein the divided residual signals have the same weight.

9. The method of claim 7 , wherein the divided residual signals have a variable weight.

10. The method of claim 9 , wherein the variable weight depends on at least one of: current content of the associated separated audio source signal, previous content of the associated separated audio source signal and future content of the associated separated audio source signal.

11. The method of claim 9 , wherein the variable weight is proportional to the energy of the associated separated audio source signal.

12. An apparatus, comprising:

an audio input configured to receive input audio content representing mixed audio sources;

a source separator configured to separate the mixed audio sources, thereby obtaining separated audio source signals and a residual signal, the residual signal being a signal which remains after the mixed audio sources have been separated, the residual signal resulting from an imperfect separation of the mixed audio sources; and

an audio output generator configured to generate output audio content by mixing the separated audio source signals and the residual signal.

13. The apparatus of claim 12 , wherein the audio output generator is configured to generate output audio content by mixing the separated audio source signals and the residual signal on the basis of spatial information.

14. The apparatus of claim 12 , wherein the input audio content includes a number of input audio signals, each input audio signal representing one audio channel, and wherein the audio output generator is further configured to mix the separated audio source signals such that the output audio content includes a number of output audio signals each representing one audio channel, wherein the number of output audio signals is equal to or larger than the number of input audio signals.

15. The apparatus of claim 12 , further comprising an amplitude adjuster configured to adjust the separated audio source signals, thereby minimizing an amplitude of the residual signal.

16. The apparatus of claim 12 , wherein the audio output generator is further configured to allocate a spatial position to each of the separated audio source signals.

17. The apparatus of claim 12 , wherein the audio output generator is further configured to allocate a spatial position to the residual signal.

18. The apparatus of claim 12 , wherein the audio output generator is further configured to divide the residual signal into a number of divided residual signals on the basis of the number of separated audio source signals and to add a divided residual signal respectively to a separated audio source signal.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 20, 2016
From: CARDINAUX, FABIEN; ENENKL, MICHAEL; GIRON, FRANCK; KEMP, THOMAS; UHLICH, STEFAN
To: SONY CORPORATION
Reel/Frame 039804/0704 →
Priority Claims (1)
EP 14162675 · Mar 31, 2014 · regional
Continuity (1)
Related Publication 20180176706A1 · Jun 21, 2018
Cited By (2)
US 12,406,658 US 12,738,913