Audio matching with semantic audio recognition and report generation
Example articles of manufacture and apparatus for producing supplemental information for audio signature data are disclosed herein. An example apparatus includes memory including computer readable instructions. The example apparatus also includes a processor to execute the instructions to at least obtain first audio signature data associated with a first time period of media, obtain first semantic signature data associated with the first time period of the media and second semantic signature data associated with a second time period of the media, and when second audio signature data associated with the second time period of the media is unavailable, identify the media based on the first audio signature data associated with the first time period of media when the second semantic signature data associated with the second time period matches the first semantic signature data associated with the first time period of the media.
1. An apparatus comprising:
memory including computer readable instructions; and
a processor to execute the instructions to at least:
obtain first audio signature data associated with a first time period of media, the first audio signature data based on at least one of time or frequency features of the media during the first time period of media;
obtain first semantic signature data associated with the first time period of the media and second semantic signature data associated with a second time period of the media, the first semantic signature data to represent a generalized characteristic of the media during the first time period of media, the second semantic signature data to represent the generalized characteristic of the media during the second time period of media; and
when second audio signature data associated with the second time period of the media is unavailable, identify the media based on the first audio signature data associated with the first time period of media when the second semantic signature data associated with the second time period matches the first semantic signature data associated with the first time period of the media.
2. The apparatus of claim 1 , wherein the generalized characteristic includes a timber characteristic having at least one of a mean of a spectral centroid, a variance of the spectral centroid, or a percentage of low/high energy frames.
3. The apparatus of claim 1 , wherein the generalized characteristic includes a beat characteristic having at least one of an amplitude of peaks in a beat histogram, a period of peaks in the beat histogram, or a ratio between a peak and a sum of all peaks in the beat histogram.
4. The apparatus of claim 1 , wherein the generalized characteristic includes a pitch characteristic having at least one of an amplitude of prominent peaks in a pitch histogram, or a period of peaks in the pitch histogram, where the pitch histogram is on a full semitone scale or an octave independent scale.
5. The apparatus of claim 1 , wherein the first semantic signature data is based on at least one of a temporal feature, a spectral feature, a harmonic feature, or a rhythmic feature.
6. The apparatus of claim 1 , wherein the processor is to transform an audio signal of the media from a time domain to a frequency domain to generate the first audio signature data.
7. The apparatus of claim 1 , wherein the processor is to transform an audio signal of the media from a time domain to a frequency domain to generate the first semantic signature data.
8. An article of manufacture comprising instructions that, when executed, cause a processor to at least:
obtain first audio signature data associated with a first time period of media, the first audio signature data based on at least one of time or frequency features of the media during the first time period of media;
obtain first semantic signature data associated with the first time period of the media and second semantic signature data associated with a second time period of the media, the first semantic signature data to represent a generalized characteristic of the media during the first time period of media, the second semantic signature data to represent the generalized characteristic of the media during the second time period of media; and
when second audio signature data associated with the second time period of the media is unavailable, identify the media based on the first audio signature data associated with the first time period of media when the second semantic signature data associated with the second time period matches the first semantic signature data associated with the first time period of the media.
9. The article of manufacture of claim 8 , wherein the generalized characteristic includes a timber characteristic having at least one of a mean of a spectral centroid, a variance of the spectral centroid, or a percentage of low/high energy frames.
10. The article of manufacture of claim 8 , wherein the generalized characteristic includes a beat characteristic having at least one of an amplitude of peaks in a beat histogram, a period of peaks in the beat histogram, or a ratio between a peak and a sum of all peaks in the beat histogram.
11. The article of manufacture of claim 8 , wherein the generalized characteristic includes a pitch characteristic having at least one of an amplitude of prominent peaks in a pitch histogram, or a period of peaks in the pitch histogram, where the pitch histogram is on a full semitone scale or an octave independent scale.
12. The article of manufacture of claim 8 , wherein the first semantic signature data is based on at least one of a temporal feature, a spectral feature, a harmonic feature, or a rhythmic feature.
13. The article of manufacture of claim 8 , wherein the instructions, when executed, further cause the processor to transform an audio signal of the media from a time domain to a frequency domain to generate the first audio signature data.
14. A method comprising:
obtaining, by executing an instruction with a processor, first audio signature data associated with a first time period of media, the first audio signature data based on at least one of time or frequency features of the media during the first time period of media;
obtaining, by executing an instruction with the processor, first semantic signature data associated with the first time period of the media and second semantic signature data associated with a second time period of the media, the first semantic signature data to represent a generalized characteristic of the media during the first time period of media, the second semantic signature data to represent the generalized characteristic of the media during the second time period of media; and
when second audio signature data associated with the second time period of the media is unavailable, identifying, by executing an instruction with the processor, the media based on the first audio signature data associated with the first time period of media when the second semantic signature data associated with the second time period matches the first semantic signature data associated with the first time period of the media.
15. The method of claim 14 , wherein the generalized characteristic includes a timber characteristic having at least one of a mean of a spectral centroid, a variance of the spectral centroid, or a percentage of low/high energy frames.
16. The method of claim 14 , wherein the generalized characteristic includes a beat characteristic having at least one of an amplitude of peaks in a beat histogram, a period of peaks in the beat histogram, or a ratio between a peak and a sum of all peaks in the beat histogram.
17. The method of claim 14 , wherein the generalized characteristic includes a pitch characteristic having at least one of an amplitude of prominent peaks in a pitch histogram, or a period of peaks in the pitch histogram, where the pitch histogram is on a full semitone scale or an octave independent scale.
18. The method of claim 14 , wherein the first semantic signature data is based on at least one of a temporal feature, a spectral feature, a harmonic feature, or a rhythmic feature.
19. The method of claim 14 , further including transforming an audio signal of the media from a time domain to a frequency domain to generate the first audio signature data.
20. The method of claim 14 , further including transforming an audio signal of the media from a time domain to a frequency domain to generate the first semantic signature data.