Apparatus and method for changing a segmentation of an audio piece
View Patent ↗For changing a segmentation of an audio piece after a segment class assignment, at first a short segment is selected, which has a length shorter than a predetermined minimum length. This short segment is preferably merged with the corresponding successor segment or predecessor segment using information on a segment class membership of the short segment itself, but also the successor segment or the predecessor segment, in order to obtain a changed segmentation of the audio signal. With this, a not over-segmented segment representation of the audio signal is obtained, which further includes all audio information, i.e. is not a representation of the audio piece with holes.
1. An apparatus for changing a segmentation of an audio piece into temporal segments, wherein the audio piece is structured into main parts repeatedly occurring in the audio piece, comprising:
a provider for providing a representation of the audio piece, in which the segments of the audio piece are assigned into various segment classes, wherein one segment class each is associated with a main part, wherein the provider is formed to provide a novelty value for segment boundaries of the short segment, wherein the novelty value indicates how much novelty content the short segment has with reference to a segment adjoining the segment boundary; and
a segment corrector for correcting the segmentation, wherein the segment corrector is formed to merge a short segment with a length shorter than a predetermined minimum length with a temporal predecessor segment or a temporal successor segment to obtain a changed segmentation of the audio signal, and wherein the segment corrector is formed to merge the short segment with the segment adjoining the segment boundary of the short segment, which has a novelty value indicating a lower novelty content compared with a novelty value at another segment boundary of the short segment.
2. The apparatus of claim 1 , wherein the segment corrector is formed to further use a segment class membership of the short segment for merging the short segment.
3. The apparatus of claim 1 , wherein the segment corrector is formed to determine such segments as short segments, the temporal length of which is smaller than 18 seconds and in particular smaller than 12 seconds.
4. The apparatus of claim 1 , wherein the segment corrector is formed to merge the short segment with the temporal predecessor segment of the temporal successor segment using information on a segment class membership of a temporal predecessor segment or a temporal successor segment or the short segment itself.
5. The apparatus of claim 1 , wherein the segment corrector is formed to perform the merging due to the novelty value only for short segments having a predetermined minimum length smaller than 8 seconds and in particular smaller than 6 seconds.
6. The apparatus of claim 1 , wherein the segment corrector is formed to merge only such short segments due to an examination of a novelty value that could not be merged in a previous examination using information on a segment class membership of the short segment, the temporal predecessor segment, or the temporal successor segment.
7. The apparatus of claim 1 , further comprising:
a segment assignment conflict resolver formed to calculate a first similarity value of a conflict segment to a segment in a first segment class and to calculate a second similarity value of the conflict segment to a segment in a second segment class in the case in which a conflict segment should be associated with two different segment classes by the provider, and
wherein the provider is formed to remove the conflict segment from the first segment class and assign it to the second segment class in the case in which the second similarity value indicates stronger similarity of the conflict segment to the segment of the second segment class.
8. The apparatus of claim 7 , wherein the segment assignment conflict resolver is formed to assign a tendency directed to the first segment class to the segment in the case of a removal of the segment from the first segment class or to assign a tendency directed to the second segment class to the segment in the case of a removal of the segment not having taken place.
9. The apparatus of claim 1 , wherein a segment has a tendency directed to a segment class and the segment corrector is formed to ascertain, for a segment shorter than a predetermined minimum length, whether a tendency of the segment matches a segment class to which a temporally preceding segment belongs, and to merge the segment with the temporally preceding segment in this case, or which is formed to ascertain, for a segment shorter than a predetermined minimum length, whether a tendency of the segment indicates a segment class to which a temporally following segment belongs, and to merge the segment with the temporally following segment in this case.
10. The apparatus of claim 1 , wherein the segment corrector is formed to merge temporally successive segments belonging to the same segment class.
11. The apparatus of claim 1 , wherein the segment corrector is formed to only select segments for correction that have a temporal segment length shorter than a predetermined minimum length.
12. The apparatus of claim 11 , wherein the segment corrector is formed to merge a selected segment from a second segment class, the temporal predecessor segment of which and the temporal successor segment of which belong to a first segment class, with the predecessor segment and the successor segment.
13. The apparatus of claim 11 , wherein the segment corrector is formed to merge a segment that is in a segment class only including a single segment with the preceding segment or the following segment.
14. The apparatus of claim 11 , wherein the segment corrector is formed to separately merge several selected segments that are in the same segment class with a temporally preceding segment or a temporally following segment, when all selected segments of the segment class include predecessor segments from one and the same segment class or successor segments from one and the same segment class.
15. The apparatus of claim 1 , wherein the segment corrector is formed to perform various correction measures depending on various predetermined segment lengths.
16. The apparatus of claim 1 , wherein the provider for providing the representation of the audio piece comprises:
a similarity representation providing device for providing a similarity representation for the segments, wherein the similarity representation for each segment comprises an associated plurality of similarity values, wherein the similarity values indicate how similar the segment is to each other segment of the audio piece;
a calculator for calculating a similarity threshold for a segment using the plurality of the similarity values associated with the segment; and
an assigner for assigning a segment to a segment class, when the similarity value of the segment meets a predetermined condition referring to the similarity threshold value.
17. A method of changing a segmentation of an audio piece into temporal segments, wherein the audio piece is structured into main parts repeatedly occurring in the audio piece, comprising:
providing a representation of the audio piece, in which the segments of the audio piece are assigned into various segment classes, wherein one segment class each is associated with a main part, wherein the step of providing comprises providing a novelty value for segment boundaries of the short segment, wherein the novelty value indicates how much novelty content the short segment has with reference to a segment adjoining the segment boundary; and
correcting the segmentation by merging a short segment with a length shorter than a predetermined minimum length with a temporal predecessor segment or a temporal successor segment, in order to obtain a changed segmentation of the audio signal, wherein, in the step of correcting, a short segment is merged with the segment adjoining the segment boundary of the short segment, which has a novelty value indicating a lower novelty content compared with a novelty value at another segment boundary of the short segment.
18. A computer readable medium having a computer program with a program code for performing, when the computer program is executed on a computer, the method of changing a segmentation of an audio piece into temporal segments, wherein the audio piece is structured into main parts repeatedly occurring in the audio piece, comprising:
providing a representation of the audio piece, in which the segments of the audio piece are assigned into various segment classes, wherein one segment class each is associated with a main part, wherein the step of providing comprises providing a novelty value for segment boundaries of the short segment, wherein the novelty value indicates how much novelty content the short segment has with reference to a segment adjoining the segment boundary; and
correcting the segmentation by merging a short segment with a length shorter than a predetermined minimum length with a temporal predecessor segment or a temporal successor segment, in order to obtain a changed segmentation of the audio signal, wherein, in the step of correcting, a short segment is merged with the segment adjoining the segment boundary of the short segment, which has a novelty value indicating a lower novelty content compared with a novelty value at another segment boundary of the short segment.
19. An apparatus for changing a segmentation of an audio piece into temporal segments, wherein the audio piece is structured into main parts repeatedly occurring in the audio piece, comprising:
a provider for providing a representation of the audio piece, in which the segments of the audio piece are assigned into various segment classes, wherein one segment class each is associated with a main part;
a segment corrector for correcting the segmentation, wherein the segment corrector is formed to merge a short segment with a length shorter than a predetermined minimum length with a temporal predecessor segment or a temporal successor segment to obtain a changed segmentation of the audio signal; and
a segment assignment conflict resolver formed
to calculate a first similarity value of a conflict segment to a segment in a first segment class and to calculate a second similarity value of the conflict segment to a segment in a second segment class in the case in which a conflict segment should be associated with two different segment classes by the provider, and
to assign a tendency directed to the first segment class to the segment in the case of a removal of the segment from the first segment class or to assign a tendency directed to the second segment class to the segment in the case of a removal of the segment not having taken place
wherein the provider is formed to remove the conflict segment from the first segment class and assign it to the second segment class in the case in which the second similarity value indicates stronger similarity of the conflict segment to the segment of the second segment class, and
wherein the segment corrector is formed
to ascertain, for a segment shorter than a predetermined minimum length, whether a tendency of the segment matches a segment class to which a temporally preceding segment belongs, and to merge the segment with the temporally preceding segment in this case, or
to ascertain, for a segment shorter than a predetermined minimum length, whether a tendency of the segment indicates a segment class to which a temporally following segment belongs, and to merge the segment with the temporally following segment in this case.
20. An apparatus for changing a segmentation of an audio piece into temporal segments, wherein the audio piece is structured into main parts repeatedly occurring in the audio piece, comprising:
a provider for providing a representation of the audio piece, in which the segments of the audio piece are assigned into various segment classes, wherein one segment class each is associated with a main part; and
a segment corrector for correcting the segmentation, wherein the segment corrector is formed to merge a short segment with a length shorter than a predetermined minimum length with a temporal predecessor segment or a temporal successor segment to obtain a changed segmentation of the audio signal,
wherein the segment corrector is formed to merge a selected segment from a second segment class, the temporal predecessor segment of which and the temporal successor segment of which belong to a first segment class, with the predecessor segment and the successor segment.
21. An apparatus for changing a segmentation of an audio piece into temporal segments, wherein the audio piece is structured into main parts repeatedly occurring in the audio piece, comprising:
a provider for providing a representation of the audio piece, in which the segments of the audio piece are assigned into various segment classes, wherein one segment class each is associated with a main part; and
a segment corrector for correcting the segmentation, wherein the segment corrector is formed to merge a short segment with a length shorter than a predetermined minimum length with a temporal predecessor segment or a temporal successor segment to obtain a changed segmentation of the audio signal,
wherein the segment corrector is formed to merge a segment that is in a segment class only including a single segment with the preceding segment or the following segment.
22. An apparatus for changing a segmentation of an audio piece into temporal segments, wherein the audio piece is structured into main parts repeatedly occurring in the audio piece, comprising:
a provider for providing a representation of the audio piece, in which the segments of the audio piece are assigned into various segment classes, wherein one segment class each is associated with a main part;
a segment corrector for correcting the segmentation, wherein the segment corrector is formed to merge a short segment with a length shorter than a predetermined minimum length with a temporal predecessor segment or a temporal successor segment to obtain a changed segmentation of the audio signal,
wherein the segment corrector is formed to separately merge several selected segments that are in the same segment class with a temporally preceding segment or a temporally following segment, when all selected segments of the segment class include predecessor segments from one and the same segment class or successor segments from one and the same segment class.