IP Library › Granted Patent US 10,600,398
Granted Patent B2
US 10,600,398 · App. 14/442,330 · Granted Mar 24, 2020

Device and method for generating a real time music accompaniment for multi-modal music

Inventors: Francois Pachet (Paris, FR); Pierre Roy (Paris, FR)
Assignee: SONY CORPORATION
G10H1/36G10H1/18G10H1/383G10H1/40G10H2210/005G10H2210/031G10H2210/056G10H2210/391G10H2250/641
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,600,398
App. No.
14/442,330
Granted
Mar 24, 2020
Kind
B2
Abstract

A device for generating a real time music accompaniment includes a music input interface, a music mode classifier that classifies pieces of music received at the music input interface into one of different music modes including at least a solo mode, a bass mode, and a harmony mode, a music storage, and a music output interface. A music selector selects one or more recorded pieces of music as real time music accompaniment to an actually played piece of music received at the music input interface, wherein the one or more selected pieces of music are selected to be in a different music mode than the actually played piece of music. A music output interface outputs the selected pieces of music.

Claims (33)

1. A device for generating a real time music accompaniment, said device comprising:

circuitry configured to

receive pieces of music played by a musician,

classify the pieces of music into one of at least three different music modes, said at least three different music modes including at least a solo mode, a bass mode and a harmony mode,

calculate a chord transformation cost, the chord transformation cost being a sum c(τ j )+c(σ i ) of a chord transposition cost c(τ j ) due to transpositions between one or more recorded pieces of music and the received pieces of music and a chord substitution cost c(σ i ) due to substitutions between the one or more recorded pieces of music and the received pieces of music, wherein the chord transposition cost c(τ j ) is calculated based on a number of semitones down or up from the received pieces of music to the one or more recorded pieces of music, the chord transposition cost c(τ j ) increasing as the number of the semitones increases, and the chord substitution cost c(σ i ) is calculated based on predetermined rules for chord substitution, each of the predetermined rules having each cost such that a first predetermined rule having more harmonic quality has lower cost than a second predetermined rule having less harmonic quality,

select one or more recorded pieces of music having the chord transformation cost under a predetermined maximum chord transformation cost as real time music accompaniment to an actually played piece of music, wherein said one or more selected pieces of music are selected to be in a different one of said at least three music modes than the actually played piece of music, and

output the one or more selected pieces of music.

2. The device as claimed in claim 1 ,

wherein the circuitry is further configured to analyze a received piece of music to obtain a music piece description comprising one or more characteristics of the analyzed piece of music, and

wherein said circuitry is configured to take a music piece description of an actually played piece of music and of recorded pieces of music into account in the selection of one or more recorded pieces of music as real time music accompaniment.

3. The device as claimed in claim 2 ,

wherein said circuitry is configured to record said music piece description along with the corresponding piece of music.

4. The device as claimed in claim 2 ,

wherein said circuitry is configured to obtain a music piece description comprising one or more of pitch, bar, key, tempo, distribution of energy, average energy, peaks of energy, number of peaks, spectral centroid, energy level, style, chords, volume, density of notes, number of notes, mean pitch, mean interval, highest pitch, lowest pitch, pitch variety, harmony duration, melody duration, interval duration, chord symbols, scales, chord extensions, relative roots, zone, type of instrument(s) and tune of an analyzed piece of music.

5. The device as claimed in claim 2 ,

wherein the circuitry is further configured to receive or select a chord grid comprising a plurality of chords,

wherein said circuitry is configured to obtain a music piece description comprising at least chords of beats of the analyzed piece of music, and

wherein said circuitry is configured to take the chord grid of an actually played piece of music and the music piece description of recorded pieces of music into account in the selection of one or more recorded pieces of music as real time music accompaniment.

6. The device as claimed in claim 1 ,

wherein the circuitry is further configured to

receive or select a tempo of played music, and

take the received or selected tempo of an actually played piece of music into account in the selection of one or more recorded pieces of music as real time music accompaniment.

7. The device as claimed in claim 1 ,

wherein the circuitry is further configured to control said device to switch between recording and playback.

8. A method for generating a real time music accompaniment, said method comprising:

receiving, using circuitry, pieces of music played by a musician,

classifying, using the circuitry, the received pieces of music into one of at least three different music modes, said at least three different music modes including at least a solo mode, a bass mode and a harmony mode,

calculating, using the circuitry, a chord transformation cost, the chord transformation cost being a sum c(τ j )+c(σ i ) of a chord transposition cost c(τ j ) due to transpositions between the one or more recorded pieces of music and the received pieces of music and a chord substitution cost c(σ i ) due to substitutions between the one or more recorded pieces of music and the received pieces of music, wherein the chord transposition cost c(τ j ) is calculated based on a number of semitones down or up from the received pieces of music to the one or more recorded pieces of music, the chord transposition cost c(τ j ) increasing as the number of the semitones increases, and the chord substitution cost c(σ i ) is calculated based on predetermined rules for chord substitution, each of the predetermined rules having each cost such that a first predetermined rule having more harmonic quality has lower cost than a second predetermined rule having less harmonic quality,

selecting, using the circuitry, one or more recorded pieces of music having the chord transformation cost under a predetermined maximum chord transformation cost as real time music accompaniment to an actually played piece of music, wherein said one or more selected pieces of music are selected to be in a different one of said at least three music modes than the actually played piece of music, and

outputting, using the circuitry, the selected pieces of music.

9. A non-transitory computer-readable recording medium that stores therein a computer program product, which, when executed by a processor, causes the method according to claim 8 , to be performed.

10. The device as claimed in claim 1 ,

wherein the circuitry is configured to perform the substitutions based on a list of substitutions.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 12, 2015
From: PACHET, FRANCOIS; ROY, PIERRE
To: SONY CORPORATION
Reel/Frame 035620/0801 →
Priority Claims (2)
EP 12195673 · Dec 5, 2012 · regional
EP 13161056 · Mar 26, 2013 · regional
Continuity (1)
Related Publication 20160247496A1 · Aug 25, 2016