IP Library Granted Patent US 12694459
Granted Patent B2
US 12694459 · App. 17/422,569 · Granted Jul 28, 2026

Information processing system and information processing method

Inventors: Itaru Shimizu (Tokyo, JP); Asako Kawakami (Tokyo, JP); Yuichi Tsubouchi (Tokyo, JP); Tomoko Kouno (Tokyo, JP)
Assignee: SONY GROUP CORPORATION
G06Q50/184G06N3/08G06Q2220/18
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12694459
App. No.
17/422,569
Granted
Jul 28, 2026
Kind
B2
Abstract

An information processing system including a content generation unit that generates content with use of one or more pieces of material data generated from original content, and a metadata addition unit that adds, to the content, content metadata including material information associated with the material data used for generation of the content and generation information associated with generation of the content.

Claims (83)

1 . An information processing system, comprising:

at least one processor configured to:

receive original content that includes a first musical composition;

decompose the original content into a plurality of pieces of material data of the first musical composition;

extract a plurality of feature values associated with the plurality of pieces of material data, wherein the plurality of feature values includes a tone, a scale, and a rhythm pattern;

determine, based on the plurality of feature values, a plurality of hit elements associated with the plurality of pieces of material data;

apply a machine learning model on at least one piece of material data of the plurality of pieces of material data of the first musical composition, wherein

the at least one piece of material data is associated with at least one hit element of the plurality of hit elements, and

the plurality of pieces of material data includes a plurality of bars associated with the first musical composition;

generate a specific bar based on each of the applied machine learning model and the plurality of bars, wherein

the specific bar is different form the plurality of bars, and

the plurality of bars is associated with the decomposition of the original content in a time direction;

change, based on the application of the machine learning model, the at least one piece of material data of the first musical composition;

generate specific content based on the changed at least one piece of material data of the first musical composition and the at least one hit element of the plurality of hit elements;

add content metadata to the generated specific content, wherein the content metadata includes:

material information associated with the changed at least one piece of material data of the first musical composition,

generation information associated with each of the generation of the specific content and the generated specific bar,

first information that indicates the changed at least one piece of material data of the first musical composition, and

second information associated with the extraction of the plurality of feature values;

determine, based on the addition of the content metadata to the specific content, contribution information of a right related person, wherein the at least one piece of material data of the first musical composition is associated with the right related person;

determine support information based on the contribution information; and

control a user interface (UI) to display the support information.

2 . The information processing system according to claim 1 , wherein the at least one processor is further configured to automatically generate the specific content based on a specific rule.

3 . The information processing system according to claim 1 , wherein the material information includes information associated with an identification of the changed at least one piece of material data.

4 . The information processing system according to claim 1 , wherein

the generation information corresponds to details of the generation of the specific content, and

the generation information includes information indicating at least a use mode of the changed at least one piece of material data.

5 . The information processing system according to claim 1 , wherein the at least one processor is further configured to:

add, as original creation metadata, third information to the original content, wherein the third information is associated with right relations of the changed at least one piece of material data; and

add, as material metadata, fourth information to the changed at least one piece of material data, wherein the fourth information is associated with an identification of the original content.

6 . The information processing system according to claim 1 , wherein the at least one processor is further configured to add, as metadata, third information and fourth information to the changed at least one piece of material data, wherein

the third information is associated with right relations of the changed at least one piece of material data, and

the fourth information is associated with an identification of the original content.

7 . The information processing system according to claim 1 , wherein the at least one processor is further configured to generate new content based on the original content.

8 . The information processing system according to claim 1 , wherein the at least one processor is further configured to add, as metadata, third information associated with right relations of the original content to the original content.

9 . The information processing system according to claim 1 , wherein

the generated specific content includes a second musical composition, and

the plurality of pieces of material data includes at least one of range information, sound quality information, constituent element information, or abstract element information.

10 . The information processing system according to claim 1 , wherein

the plurality of pieces of material data of the first musical composition includes at least one of a code of the first musical composition or a style of the first musical composition, and

the at least one of the code of the first musical composition or the style of the first musical composition is changed based on the application of the machine learning model.

11 . An information processing method, comprising:

receiving, by at least one processor, original content that includes a musical composition;

decomposing, by the at least one processor, the original content into a plurality of pieces of material data of the musical composition;

extracting a plurality of feature values associated with the plurality of pieces of material data, wherein the plurality of feature values includes a tone, a scale, and a rhythm pattern;

determining, based on the plurality of feature values, a plurality of hit elements associated with the plurality of pieces of material data;

applying, by the at least one processor, a machine learning model on at least one piece of material data of the plurality of pieces of material data of the musical composition, wherein

the at least one piece of material data is associated with at least one hit element of the plurality of hit elements, and

the plurality of pieces of material data includes a plurality of bars associated with the musical composition;

generating a specific bar based on each of the applied machine learning model and the plurality of bars, wherein

the specific bar is different form the plurality of bars, and

the plurality of bars is associated with the decomposition of the original content in a time direction;

changing, by the at least one processor, based on the application of the machine learning model, the at least one piece of material data of the musical composition;

generating, by the at least one processor, specific content based on the changed at least one piece of material data of the musical composition and the at least one hit element of the plurality of hit elements;

adding, by the at least one processor, content metadata to the generated specific content, wherein the content metadata includes:

material information associated with the changed at least one piece of material data of the musical composition,

generation information associated with each of the generation of the specific content and the generated specific bar,

first information that indicates the changed at least one piece of material data of the musical composition, and

second information associated with the extraction of the plurality of feature values;

determining, based on the addition of the content metadata to the specific content, contribution information of a right related person, wherein the at least one piece of material data of the musical composition is associated with the right related person;

determining support information based on the contribution information; and

controlling a user interface (UI) to display the support information.

12 . A non-transitory computer-readable medium having stored thereon, computer-executable instructions which, when executed by a computer, cause the computer to execute operations, the operations comprising:

receiving original content that includes a musical composition;

decomposing the original content into a plurality of pieces of material data of the musical composition;

extracting a plurality of feature values associated with the plurality of pieces of material data, wherein the plurality of feature values includes a tone, a scale, and a rhythm pattern;

determining, based on the plurality of feature values, a plurality of hit elements associated with the plurality of pieces of material data;

applying a machine learning model on at least one piece of material data of the plurality of pieces of material data of the musical composition, wherein

the at least one piece of material data is associated with at least one hit element of the plurality of hit elements, and

the plurality of pieces of material data includes a plurality of bars associated with the musical composition;

generating a specific bar based on each of the applied machine learning model and the plurality of bars, wherein

the specific bar is different form the plurality of bars, and

the plurality of bars is associated with the decomposition of the original content in a time direction;

changing, based on the application of the machine learning model, the at least one piece of material data of the musical composition;

generating specific content based on the changed at least one piece of material data of the musical composition and the at least one hit element of the plurality of hit elements;

adding content metadata to the generated specific content, wherein the content metadata includes:

material information associated with the changed at least one piece of material data of the musical composition,

generation information associated with each of the generation of the specific content and the generated specific bar,

first information that indicates the changed at least one piece of material data of the musical composition, and

second information associated with viewpoints of the extraction of the plurality of feature values;

determining, based on the addition of the content metadata to the specific content, contribution information of a right related person, wherein the at least one piece of material data of the musical composition is associated with the right related person;

determining support information based on the contribution information; and

controlling a user interface (UI) to display the support information.