Scalable similarity-based generation of compatible music mixes
Scalable similarity-based generation of compatible music mixes. Music clips are projected in a pitch interval space for computing musical compatibility between the clips as distances or similarities in the pitch interval space. The distance or similarity between clips reflects the degree to which clips are harmonically compatible. The distance or similarity in the pitch interval space between a candidate music clip and a partial mix can be used to determine if the candidate music clip is harmonically compatible with the partial mix. An indexable feature space may be both beats-per-minute (BPM)-agnostic and musical key-agnostic such that harmonic compatibility can be quickly determined among potentially millions of music clips. A graphical user interface-based user application allows users to easily discover combinations of clips from a library that result in a perceptually high-quality mix that is highly consonant and pleasant-sounding and reflects the principles of musical harmony.
1. A method comprising:
receiving a request for a music clip that is harmonically compatible with an indicated set of one or more music clips;
identifying a particular music clip that is harmonically compatible over a predetermined number of musical beats with the indicated set of music clips based on a first pitch interval space representation of the indicated set of music clips and a second pitch interval space representation of the particular music clip;
computing the second pitch interval space representation of the particular music clip based on: computing a set of beat-wise pitch interval space representations for the predetermined number of musical beats based on a chromatic saliency map for the particular music clip, and forming the second pitch interval space representation based on the set of beat-wise pitch interval space representations;
providing a response to the request, the response indicating the particular music clip that is identified as harmonically compatible over the predetermined number of musical beats with the indicated set of music clips based on the first pitch interval space representation of the indicated set of music clips and the second pitch interval space representation of the particular music clip; and
wherein the method is performed by one or more computer systems.
2. The method of claim 1 , wherein:
the indicated set of one or more music clips comprises a plurality of music clips;
each music clip of the plurality of music clips is represented by a respective pitch interval space representation; and
the method further comprises generating the first pitch interval space representation of the indicated set of music clips over the predetermined number of musical beats based on the respective pitch interval space representation for each music clip of the plurality of music clips.
3. The method of claim 1 , further comprising:
including the particular music clip in a current stack of music clips comprising the indicated set of music clips.
4. The method of claim 1 , further comprising:
identifying the particular music clip as harmonically compatible over the predetermined number of musical beats with the indicated set of music clips based on a distance or a similarity in a pitch interval space between the first pitch interval space representation and the second pitch interval space representation.
5. The method of claim 1 , wherein each of the first pitch interval space representation and the second pitch interval space representation is beats-per-minute agnostic.
6. The method of claim 1 , further comprising:
causing a graphical user interface to be presented that indicates that the particular music clip is harmonically compatible with the indicated set of music clips.
7. The method of claim 1 , wherein the request comprises the first pitch interval space representation of the indicated set of music clips.
8. The method of claim 1 , wherein the response comprises an identifier of the particular music clip.
9. The method of claim 1 , wherein the predetermined number of beats is two, four, eight, sixteen, thirty-two, or sixty four.
10. One or more non-transitory computer-readable media storing instructions configured for:
receiving a request for a music clip that is harmonically compatible with an indicated set of one or more music clips;
identifying a particular music clip that is harmonically compatible over a predetermined number of musical beats with the indicated set of music clips based on a first pitch interval space representation of the indicated set of music clips and a second pitch interval space representation of the particular music clip;
computing the second pitch interval space representation of the particular music clip based on:
computing a set of beat-wise pitch interval space representations for the predetermined number of musical beats based on a chromatic saliency map for the particular music clip, and
forming the second pitch interval space representation based on the set of beat-wise pitch interval space representations; and
providing a response to the request, the response indicating the particular music clip that is identified as harmonically compatible over the predetermined number of musical beats with the indicated set of music clips based on the first pitch interval space representation of the indicated set of music clips and the second pitch interval space representation of the particular music clip.
11. The one or more non-transitory computer-readable media of claim 10 , the instructions further configured for:
including the particular music clip in a current stack of music clips comprising the indicated set of music clips.
12. The one or more non-transitory computer-readable media of claim 10 , the instructions further configured for:
identifying the particular music clip as harmonically compatible over the predetermined number of musical beats with the indicated set of music clips based on a distance or a similarity in a pitch interval space between the first pitch interval space representation and the second pitch interval space representation.
13. The one or more non-transitory computer-readable media of claim 10 , the instructions further configured for:
causing a graphical user interface to be presented that indicates that the particular music clip is harmonically compatible with the indicated set of music clips.
14. A system comprising:
one or more computer systems having one or more hardware processors; and
instructions configured to cause the one or more computer systems to perform a set of operations comprising:
receiving a request for a music clip that is harmonically compatible with an indicated set of one or more music clips;
identifying a particular music clip that is harmonically compatible over a predetermined number of musical beats with the indicated set of music clips based on a first pitch interval space representation of the indicated set of music clips and a second pitch interval space representation of the particular music clip;
computing the second pitch interval space representation of the particular music clip based on:
computing a set of beat-wise pitch interval space representations for the predetermined number of musical beats based on a chromatic saliency map for the particular music clip; and
forming the second pitch interval space representation based on the set of beat-wise pitch interval space representations; and
providing a response to the request, the response indicating the particular music clip that is identified as harmonically compatible over the predetermined number of musical beats with the indicated set of music clips based on the first pitch interval space representation of the indicated set of music clips and the second pitch interval space representation of the particular music clip.
15. The system of claim 14 , the set of operations further comprising:
including the particular music clip in a current stack of music clips comprising the indicated set of music clips.
16. The system of claim 14 , the set of operations further comprising:
identifying the particular music clip as harmonically compatible over the predetermined number of musical beats with the indicated set of music clips based on a distance or a similarity in a pitch interval space between the first pitch interval space representation and the second pitch interval space representation.
17. The system of claim 14 , the set of operations further comprising:
causing a graphical user interface to be presented that indicates that the particular music clip is harmonically compatible with the indicated set of music clips.