IP Library › Granted Patent US 10,482,857
Granted Patent B2
US 10,482,857 · App. 16/263,201 · Granted Nov 19, 2019

Media-media augmentation system and method of composing a media product

Inventor: Joseph Michael William Lyske (Kent, GB)
Assignee: MASHTRAXX LIMITED
G10H1/0025A63B69/00G06F16/24575G10H1/40G11B20/10527G11B27/036G11B27/038G11B27/28H04H60/06H04H60/33H04H60/65H04N21/8456A63B71/0686G06F16/61G10H1/057G10H1/361G10H1/46G10H7/008G10H2210/051G10H2210/061G10H2210/076G10H2210/091G10H2210/105G10H2210/125G10H2210/131G10H2210/371G10H2210/375G10H2210/391G10H2220/126G10H2230/015G10H2240/085G10H2240/121G10H2240/131G10H2240/325G10H2250/035G11B27/005G11B27/105G11B2020/1062
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,482,857
App. No.
16/263,201
Granted
Nov 19, 2019
Kind
B2
Abstract

A media-content augmentation system includes a database with a multiplicity of media files and associated metadata. Each media file is mapped to at least one contextual theme defined by beginning and end timings. A processing system couples to the database; and an input couples to the processing system. The input is in the form of temporally-varying events data. The processing system resolves the input into one or more categorized contextual themes, correlates the themes with metadata associated with selected media files relevant to the themes, and then splices or fades together selected media files to reflect the events as the input varies with time, thus generating as an output, a media product in which transitions between media are aligned with the temporally-varying events. The database may contain sections of digital media files. A method aligns sections in digital media files with temporally-varying events data to compose a media product.

Claims (55)

1. A media-content augmentation system comprising:

a database containing a multiplicity of media files and associated metadata, each media file or part thereof mapped to at least one contextual theme defined by beginning and end timings;

a processing system coupled to the database and responsive to said metadata; and

an input coupled to the processing system, the input in the form of temporally-varying events data;

wherein the processing system is arranged:

to resolve the input into one or more of a plurality of categorized contextual themes;

to correlate said categorized contextual themes with metadata associated with selected media files or part thereof relevant to the one or more of the plurality of categorized contextual themes, and thereafter

to splice or fade together selected media files or part thereof to reflect said events as the input varies with time, thereby to generate, as an output, a media product in which transitions between media files or parts thereof are aligned with the temporally-varying events and wherein said temporarily-varying events take the form of one of:

a beginning and an end in the case of a sustained feature for the contextual theme, wherein the sustained features is one of a form function and a hit point over time; and

a specific point in time for a hit point.

2. The media-content augmentation system according to claim 1 , wherein the processing system selects the media file or part thereof substantially in real-time to accompany changing physical or local environmental events.

3. The media-content system according to claim 1 , wherein the system is arranged to augment an overall sensory experience of a user in the real world by dynamically changing, re-ordering or repeating and then playing selected media files or part thereof within the context of said categorized themes associated with the changing nature of events presented as the input to the processing system.

4. The media-content augmentation system according to claim 1 , wherein the processing system is a distributed set of processing systems.

5. The media-content augmentation system according to claim 1 , wherein entry and exit points respectively into and out of the media file or part thereof support seamless rhythmic transition in output between sections.

6. The media-content augmentation system according to claim 1 , wherein the form function is selected from one of the group consisting of:

a static section;

a drop-out;

a fade in intensity;

a build in intensity; and

a relative intensity of the section.

7. The media-content augmentation system according to claim 1 , wherein the hit point over time is selected from one of the group consisting of:

a sound effect;

speech;

riff; and

instrument type.

8. The media-content augmentation system according to claim 1 , wherein the input takes the form of an intensity arising from at least one of:

a relative change in light levels;

a relative change in sound levels;

changing rates in a monitorable function; and

a relative change of characteristics between a current media file or part thereof and a new media file or part thereof that is to be cut or spliced into the current media file or part thereof.

9. The media-content augmentation system according to claim 1 , wherein the input takes the form of a scaling of intensities arising from at least one of:

a relative change in light levels;

a relative change in sound levels;

changing rates in a monitorable function; and

a relative change of characteristics between a current media file or part thereof and a new media file or part thereof that is to be cut or spliced into the current media file or part thereof.

10. The media-content augmentation system according to claim 1 , wherein said beginning and end timings take the form of one of:

(i) a beginning and an end in the case of a sustained feature for the contextual theme, wherein the sustained features is one of a form function and a hit point over time; and

(ii) a specific point in time for a hit point.

11. The media-content augmentation system of claim 1 , wherein the media file is an audio file.

12. A method of aligning sections in one or more digital media files with temporally-varying events data to compose a media product, the method comprising:

receiving, as temporal input, a stream of data containing temporally-changing events data;

accessing a database containing a multiplicity of sections of media files and associated metadata, each section mapped to at least one contextual theme defined with respect to identified beginning and end timings, each contextual theme itself mapped to a section and wherein said beginning and end timings take the form of one of: (i) a beginning and an end in the case of a sustained feature for the contextual theme, wherein the sustained features is one of a form function and a hit point over time; and (ii) a specific point in time for a hit point;

resolving the temporal input into one of a plurality of relevant categorized contextual themes;

correlating said categorized contextual themes with metadata associated with selected sections relevant to the one or more of the plurality of categorized contextual themes; and

splicing or fading together selected sections from one or more selected digital media files of the database to reflect said events as the temporal input varies, thereby generating, as an output, a media product in which sections are aligned with the temporally-changing events.

13. The method of claim 12 , wherein a media file is selected to accompany changing physical or local environmental events.

14. The method of claim 12 , wherein the method augments an overall sensory experience of a user in the real-world by dynamically changing, re-ordering or repeating and then playing selected sections of the media files within the context of said categorized themes associated with the changing nature of events presented as the temporal input to the processing system.

15. A method of aligning sections of at least one digital media file containing temporally-varying events data, thereby to compose a media product, the method comprising:

receiving, as temporal input, a stream of data containing temporally-changing events data;

accessing a database containing a multiplicity of media file sections and associated metadata therefor, each media file section mapped to at least one contextual theme defined with respect to identified beginning and end timings and wherein said beginning and end timings take the form of one of: (i) a beginning and an end in the case of a sustained feature for the contextual theme, wherein the sustained features is one of a form function and a hit point over time; and (ii) a specific point in time for a hit point;

selecting at least one relevant contextual theme from a plurality of contextual themes;

correlating said at least one selected relevant contextual theme with metadata associated with selected sections relevant to the one or more of the plurality of categorized contextual themes; and

splicing or fading together selected sections from one or more selected digital media files of the database to reflect said events as the temporal input varies, thereby generating, as an output, the media product in which sections are aligned with the temporally-changing events.

16. The method of claim 15 , wherein the media file or section thereof is selected to accompany changing physical or local environmental events.

17. The method of claim 15 , wherein the method augments an overall sensory experience of a user in the real-world by dynamically changing, re-ordering or repeating and then instantiating sections within the context of said categorized themes associated with the changing nature of events presented as the temporal input to the processing system.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 16, 2019
From: TIME MACHINE CAPITAL LIMITED
To: MASHTRAXX LIMITED
Reel/Frame 049771/0751 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 12, 2019
From: LYSKE, JOSEPH MICHAEL WILLIAM
To: TIME MACHINE CAPITAL LIMITED
Reel/Frame 049746/0039 →
Priority Claims (1)
GB 1510907.7 · Jun 22, 2015 · national
Continuity (3)
Continuation 16035234 · Jul 13, 2018
Continuation 15189306 · Jun 22, 2016
Related Publication 20190164527A1 · May 30, 2019
Cited By (1)
US 12,412,105