IP Library › Granted Patent US 10,032,441
Granted Patent B2
US 10,032,441 · App. 15/189,306 · Granted Jul 24, 2018

Music context system, audio track structure and method of real-time synchronization of musical content

Inventor: Joseph Michael William Lyske (Kent, GB)
Assignee: TIME MACHINE CAPITAL LIMITED
G10H1/0025A63B69/00G06F17/30528G10H1/40G11B20/10527G11B27/036G11B27/038G11B27/28H04H60/06H04H60/33H04H60/65H04N21/8456A63B71/0686G06F17/30778G10H1/057G10H1/361G10H1/46G10H7/008G10H2210/051G10H2210/061G10H2210/076G10H2210/091G10H2210/105G10H2210/125G10H2210/131G10H2210/371G10H2210/375G10H2210/391G10H2220/126G10H2230/015G10H2240/085G10H2240/121G10H2240/131G10H2240/325G10H2250/035G11B27/005G11B27/105G11B2020/1062
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,032,441
App. No.
15/189,306
Granted
Jul 24, 2018
Kind
B2
Abstract

A system is described that permits identified musical phrases or themes to be synchronized and linked into changing real-world events. The achieved synchronization includes a seamless musical transition—achieved using a timing offset, such as relative advancement of an significant musical “onset”, that is inserted to align with a pre-existing but identified music signature, beat or timebase—between potentially disparate pre-identified musical phrases having different emotive themes defined by their respective time signatures, intensities, keys, musical rhythms and/or musical phrasing. The system operates to augment an overall sensory experience of a user in the real world by dynamically changing, re-ordering or repeating and then playing audio themes within the context of what is occurring in the surrounding physical environment, e.g. during different phases of a cardio workout in a step class the music rate and intensity increase during sprint periods and decrease during recovery periods.

Claims (27)

1. A method of determining onsets in a digital audio signal having transient parts and relatively stationary parts, the method comprising:

separating transient parts from relatively stationary parts to produce a time domain representation of the transient parts, wherein said relatively stationary parts are frequencies that appear across consecutive sampling windows and transient parts are frequencies that demonstrate significant changes in energy in contiguous sampling windows where each sampling window has a duration of less than about 50 milliseconds;

generating an amplitude envelope of the transient part;

setting a power threshold and detecting localised peaks in the amplitude envelope that exceed the power threshold; and

from the localized peak, iterating backwards in time on a sample-by-sample basis over the duration of the sampling window to find a sampling point at which a measurable characteristic of the digital audio signal, measured during a first period having a first duration extending backwards in time before the sampling point, is maximally different from the measurable characteristic of the digital audio signal measured during a second period also having the first duration, the second period extending forwards in time from the sampling point; and

selecting as the position of the onset, the sampling point that is maximally different.

2. The method of determining the presence of an onset in accordance with claim 1 , wherein the step of identifying the onset corresponds to a largest measured power ratio between adjacent predetermined periods.

3. The method of determining the presence of an onset in accordance with claim 1 , wherein the characteristics includes a standard deviation of the first derivative of the transient signal before and after each sampling point.

4. The method of determining the presence of an onset in accordance with claim 1 , wherein the transient parts occur at relatively high frequencies in the audio signal.

5. The method of determining the presence of an onset in accordance with claim 1 , wherein the amplitude envelope is produced by applying a convolution function.

6. The method of determining the presence of an onset in accordance with claim 1 , wherein the sampling periods is between about ten milliseconds and about fifty milliseconds.

7. A computer program product that, when executed by a processor, causes the processor to execute procedure to determine the presence of an onset in a section of an audio signal, the procedure executing the method of any one of claims 1 to 6 .

8. An audio system comprising:

a processor; arranged:

for a digital audio file containing having transient parts and relatively stationary parts, to separate the transient parts from the relatively stationary parts to produce a time domain representation, wherein said relatively stationary parts are frequencies that appear across consecutive sampling windows and transient parts are frequencies that demonstrate significant changes in energy in contiguous sampling windows where each sampling window has a duration of less than about 50 milliseconds;

to generate an amplitude envelope of the transient parts;

to set a power threshold and detect a localised peak in the amplitude envelope that exceed the power threshold; and

from the localised peak, to iterate backwards in time on a sample-by-sample basis over the duration of the sampling window to find a sample point at which a measurable characteristic of the digital audio signal, measured during a first period having a first duration extending backwards in time before the sampling point, is maximally different from the measurable characteristic of the digital audio signal measured during a second period also having the first duration, the second period extending forwards in time from the sampling point; and

to select as the onset, the sample that is maximally different.

9. The audio system of claim 8 , wherein the first contextual theme is the same as the second contextual theme.

10. The audio system of claim 8 , wherein each onset is associated with an anacrusis that is related to a selected abstract exit point or abstract entry point in each digital audio file and where each anacrusis is a note or sequence of notes that precedes the first downbeat in a bar of music in each audio section, each anacrusis therefore representing the significant audio event.

11. The audio system of claim 8 , further comprising:

a database containing a multiplicity of digital audio files each partitioned into at least one audio section characterized by a contextual theme, each of said at least one audio sections having an onset representative of a significant audio event; and

the processor is arranged to use said identified onset to transition between a first contextual theme to a second contextual theme, the first contextual theme and the second contextual theme associated with at least one of said digital audio files that are stored within the database.

12. The audio system of claim 11 , wherein the processor is arranged to preserve integrity of musical timing in the transition between the first contextual theme and the second contextual theme.

13. The audio system of claim 11 , wherein the first contextual theme is the same as the second contextual theme.

14. The audio system of claim 11 , wherein the digital music files are stored in a database and the processor is arranged remotely to access the database over a network connection, the network connection supporting one of download and streaming of digital music files to the processor of a subscriber device.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 16, 2019
From: TIME MACHINE CAPITAL LIMITED
To: MASHTRAXX LIMITED
Reel/Frame 049771/0751 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 20, 2016
From: LYSKE, JOSEPH MICHAEL WILLIAM
To: TIME MACHINE CAPITAL LIMITED
Reel/Frame 039405/0968 →
Priority Claims (1)
GB 1510907.7 · Jun 22, 2015 · national
Continuity (1)
Related Publication 20160372095A1 · Dec 22, 2016