IP Library Granted Patent US 11,094,305
Granted Patent B2
US 11,094,305 · App. 16/726,916 · Granted Aug 17, 2021

Information processing device, tempo detection device and video processing system

Inventor: Keigo Tsutaki (Shizuoka, JP)
Assignee: Roland Corporation
G10H1/0008G10H1/40G10H2210/005G10H2210/076G10H2210/391
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,094,305
App. No.
16/726,916
Granted
Aug 17, 2021
Kind
B2
Abstract

An information processing device, a tempo detection device and a video processing system are provided. A beat of a piece of performed music is detected from a musical viewpoint. The information processing device includes: an acquisition part that acquires samples of musical sound signals in a time series; an evaluation part that has an adaptive filter using the acquired samples of the musical sound signals as reference signals and using samples of musical sound signals acquired a predetermined time earlier than the samples of the musical sound signals as input signals; and a tempo determination part that sequentially inputs the samples of the musical sound signals to the adaptive filter and determines a tempo corresponding to a musical sound based on a filter coefficient when a value of the filter coefficient of the adaptive filter converges.

Claims (56)

1. An information processing device comprising:

an acquisition part that acquires samples of musical sound signals in a time series, wherein the samples of the musical sound signals comprises a current sample of the musical sound signals and a past sample of the musical sound signals;

an evaluation part that has an adaptive filter using the current sample as a reference signal and using the past sample of the musical sound signals, acquired a predetermined time earlier than the current sample of the musical sound signals, as an input signal; and

a tempo determination part that sequentially inputs the samples of the musical sound signals to the adaptive filter and determines a tempo corresponding to a musical sound based on the predetermined time when a value of a filter coefficient of the adaptive filter converges to a predetermined value in accordance with a periodicity of the musical sound signals.

2. The information processing device according to claim 1 ,

wherein the filter coefficient comprises a plurality of coefficients, and

wherein the tempo determination part inputs a sample group of a plurality of past samples of the musical sound signals acquired within a predetermined period as the input signal to the adaptive filter.

3. The information processing device according to claim 2 , wherein the tempo determination part determines a value corresponding to a time difference between a sample of the input signal multiplied by a coefficient indicating a maximum value among a plurality of converged coefficients and the reference signal as the tempo corresponding to the musical sound.

4. A video processing system comprising:

the information processing device according to claim 3 ; and

a control device that switches between a plurality of video sources respectively corresponding to a plurality of cameras at a timing in accordance with a tempo determined by the information processing device.

5. A video processing system comprising:

the information processing device according to claim 2 ; and

a control device that switches between a plurality of video sources respectively corresponding to a plurality of cameras at a timing in accordance with a tempo determined by the information processing device.

6. The information processing device according to claim 1 ,

wherein the filter coefficient comprises a plurality of coefficients, and

wherein the input signal comprises a plurality of first input signals and a plurality of second input signals, and

wherein the tempo determination part inputs a sample group of a plurality of musical sound signals acquired within a first period as the first input signals and inputs a sample group of a plurality of musical sound signals acquired within a second period as the second input signals to the adaptive filter, and

wherein the second period has a length of a multiple of n times the first period and continues from the first period, and n is an integer equal to or greater than 2.

7. The information processing device according to claim 6 , wherein the tempo determination part determines a value corresponding to a time difference between a sample of the first and second input signals multiplied by a coefficient indicating a maximum value among a plurality of converged coefficients and the reference signal as the tempo corresponding to the musical sound.

8. A video processing system comprising:

the information processing device according to claim 6 ; and

a control device that switches between a plurality of video sources respectively corresponding to a plurality of cameras at a timing in accordance with a tempo determined by the information processing device.

9. A video processing system comprising:

the information processing device according to claim 1 ; and

a control device that switches between a plurality of video sources respectively corresponding to a plurality of cameras at a timing in accordance with a tempo determined by the information processing device.”

10. A tempo detection device comprising:

a musical sound signal acquisition part that acquires musical sound signals; and

a tempo detection part that comprises:

a sampling part that uses signals obtained after the musical sound signals are sampled at a predetermined frequency, as samples of the musical sound signals;

a signal delaying part that delays the samples of the musical sound signals by a predetermined number of time steps to generate samples, which are past samples, generated earlier than a latest time step by the predetermined number of time steps; and

an adaptive filter unit using a sample of the latest time step as a reference signal, using a sample of the past samples as an input signal, and updating a filter coefficient of the adaptive filter unit so that an error between the input signal and the reference signal is a minimum, and

wherein the tempo detection part sequentially inputs the samples of the musical sound signals and determines a tempo corresponding to a musical sound based on the predetermined number of time steps when a value of the filter coefficient of the adaptive filter unit converges to a predetermined value in accordance with a periodicity of the musical sound signals.

11. The tempo detection device according to claim 10 ,

wherein the filter coefficient comprises a plurality of coefficients, and

wherein the tempo detection part inputs a sample group of the plurality of past samples of the musical sound signals acquired within a predetermined period as the input signal to the adaptive filter unit.

12. The tempo detection device according to claim 11 , wherein the tempo detennination part determines a value corresponding to a time difference between a sample of an input signal multiplied by a coefficient indicating a maximum value among a plurality of converged coefficients and the reference signal as the tempo corresponding to the musical sound.

13. The tempo detection device according to claim 10 ,

wherein the filter coefficient comprises a plurality of coefficients,

wherein the input signal comprises a plurality of first input signals and a plurality of second input signals, and

wherein the tempo detection part inputs a sample group of a plurality of past samples of musical sound signals acquired within a first period as the first input signals and a sample group of a plurality of past samples of musical sound signals acquired within a second period as the second input signals to the adaptive filter unit, and

wherein the second period has a length of a multiple of n times the first period and continues from the first period, and n is an integer equal to or greater than 2.

14. An information processing method comprising:

acquiring samples of musical sound signals in a time series, wherein the samples of the musical sound signals comprising a current sample of the musical sound signals and a past sample of the musical sound signals;

using an adaptive filter by treating the current sample as a reference signal and using the past sample of the musical sound signals, acquired a predetermined time earlier than the current sample of the musical sound signals, as an input signal; and

sequentially inputting the samples of the musical sound signals to the adaptive filter; and

determining a tempo corresponding to a musical sound based on the predetermined time when a value of a filter coefficient of the adaptive filter converges to a predetermined value in accordance with a periodicity of the musical sound signals.

15. The information processing method according to claim 14 ,

wherein the filter coefficient comprises a plurality of coefficients, and

sequentially inputting the samples of the musical sound signals to the adaptive filter comprises inputting a sample group of a plurality of past samples of the musical sound signals acquired within a predetermined period as the input signal to the adaptive filter.

16. The information processing method according to claim 15 , wherein determining the tempo comprises determining a value corresponding to a time difference between a sample of the input signal multiplied by a coefficient indicating a maximum value among a plurality of converged coefficients and the reference signal as the tempo corresponding to the musical sound.

17. The information processing method according to claim 14 ,

wherein the filter coefficient comprises a plurality of coefficients,

wherein the input signal comprises a plurality of first input signals and a plurality of second input signals, and

wherein sequentially inputting the samples of the musical sound signals to the adaptive filter comprises inputting a sample group of a plurality of musical sound signals acquired within a first period as the first input signals and inputting a sample group of a plurality of musical sound signals acquired within a second period as the second input signals to the adaptive filter, and

wherein the second period has a length of a multiple of n times the first period and continues from the first period, and n is an integer equal to or greater than 2.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 6, 2020
From: TSUTAKI, KEIGO
To: ROLAND CORPORATION
Reel/Frame 051417/0752 →
Priority Claims (1)
JP JP2018-247689 · Dec 28, 2018 · national
Continuity (1)
Related Publication 20200211517A1 · Jul 2, 2020
Cited By (1)
US 12,423,982