IP Library Granted Patent US 10,186,246
Granted Patent B2
US 10,186,246 · App. 15/557,536 · Granted Jan 22, 2019

Musical piece reproducing system, data outputting apparatus, and musical piece reproducing method

Inventors: Kohei Numata (Tokyo, JP); Jin Saito (Tokyo, JP)
Assignee: COTODAMA INC.
G10H1/368G06F3/16G06T13/80G11B27/34G10H2210/061G10H2220/005G10H2220/011
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,186,246
App. No.
15/557,536
Granted
Jan 22, 2019
Kind
B2
Abstract

In a musical piece reproducing system, a reproduction control unit causes a sound device to reproduce a musical piece. A display control unit causes a display device to display motion graphics based on motion graphic data stored in a storage device. The motion graphic data defines, for each type of a musical piece portion, a corresponding motion graphic that the display device should display when a musical piece portion that belongs to a corresponding type is reproduced. The display control unit determines the type of each of musical piece portions contained in the musical piece to be reproduced, and controls the display device in such a way that when each of the musical piece portions is reproduced, the display device displays a motion graphic defined by the motion graphic data in accordance with the type of the musical piece portion.

Claims (58)

1. A musical piece reproducing system comprising:

a controller configured to control a sound device and a display device;

a storage device configured to store motion graphic data, the motion graphic data including definition data defining, for each type of a musical piece portion, a corresponding motion graphic that the display device should display when a musical piece portion that belongs to a corresponding type is reproduced; and

a communication device,

the controller carrying out processes including:

acquiring lyrics data of a musical piece through the communication device;

causing the sound device to reproduce the musical piece; and

causing the display device to display motion graphics corresponding to the musical piece in synchronization with progress of the musical piece reproduced by the sound device, based on the motion graphic data stored in the storage device and the acquired lyrics data,

wherein causing the display device to display the motion graphics includes:

determining the type of each of musical piece portions contained in the musical piece reproduced by the sound device; and

controlling the display device in such a way that the display device displays a motion graphic of a letter string representing a lyrics portion corresponding to time in the reproduction of the musical piece, in accordance with the definition data in the motion graphic data corresponding to the type of a musical piece portion reproduced by the sound device out of the musical piece portions;

wherein the lyrics data has a time code representing time when display of a corresponding letter string starts, for each of letter strings specified by dividing entire lyrics of the musical piece,

wherein the controlling includes controlling the display device in such a way that the display device displays a motion graphic relating to a letter string, to which the time code corresponding to time in the reproduction of the musical piece is attached; and

wherein the controlling includes determining a time difference between the time codes attached to a first letter string and a second letter string out of the letter strings, the first letter string and the second letter string adjacent to each other and the first letter string followed by the second letter string, and controlling the display device in such a way that the display device displays another motion graphic after display of a motion graphic relating to the first letter string but before display of a motion graphic relating to the second letter string in a case where the time difference is greater than or equal to a reference.

2. The musical piece reproducing system according to claim 1 ,

wherein the motion graphic data includes first definition data that defines the motion graphics of the letter strings and second definition data that defines motion graphics of background images, for each type of the musical piece portion,

the controlling includes controlling the display device in such a way that the display device displays the motion graphics of the background images together with the motion graphics of the letter strings, in accordance with the first definition data and the second definition data.

3. The musical piece reproducing system according to claim 1 ,

wherein the storage device stores the motion graphic data on a musical piece category basis, and

causing the display device to display motion graphics is carried out based on motion graphic data corresponding to the category of the musical piece reproduced by the sound device.

4. The musical piece reproducing system according to claim 1 , wherein the motion graphic data defines, for each type of a section that forms a musical piece, corresponding definition data.

5. The musical piece reproducing system according to claim 1 , wherein the controlling includes, in a case of switching a motion graphic displayed by the display device from a first motion graphic to a second motion graphic when the type of the reproduced musical piece portion is switched, controlling the display device in such a way that the display device displays a motion graphic for transition having characteristics that is a mixture of characteristics of the first motion graphic and characteristics of the second motion graphic before switching to the second motion graphic.

6. The musical piece reproducing system according to claim 1 , wherein the type of the musical piece portion corresponds to a type of lyrics in the musical piece portion.

7. The musical piece reproducing system according to claim 6 , wherein the type of lyrics is determined by at least one of a number of letters of the lyrics or a reproduction length.

8. The musical piece reproducing system according to claim 1 , wherein the controlling includes controlling the display device in such a way that a letter image that forms a motion graphic vibrates in synchronization with at least one of intonation or rhythm in a reproduced portion of the musical piece.

9. A musical piece reproducing method comprising:

acquiring lyrics data of a musical piece;

causing a sound device to reproduce the musical piece; and

causing a display device to display motion graphics corresponding to the musical piece in synchronization with progress of the musical piece reproduced by the sound device, based on motion graphic data stored in a storage device and the acquired lyrics data,

wherein the motion graphic data includes definition data defining, for each type of a musical piece portion, a corresponding motion graphic that the display device should display when a musical piece portion that belongs to a corresponding type is reproduced, and

the causing the display device to display the motion graphics includes:

determining the type of each of musical piece portions contained in the musical piece reproduced by the sound device; and

controlling the display device in such a way that the display device displays a motion graphic of a letter string representing a lyrics portion corresponding to time in the reproduction of the musical piece, in accordance with the definition data in the motion graphic data corresponding to the type of a musical piece portion reproduced by the sound device out of the musical piece portions;

wherein the lyrics data has a time code representing time when display of a corresponding letter string starts, for each of letter strings specified by dividing entire lyrics of the musical piece,

wherein the controlling includes controlling the display device in such a way that the display device displays a motion graphic relating to a letter string, to which the time code corresponding to time in the reproduction of the musical piece is attached; and

wherein the controlling includes determining a time difference between the time codes attached to a first letter string and a second letter string out of the letter strings, the first letter string and the second letter string adjacent to each other and the first letter string followed by the second letter string, and controlling the display device in such a way that the display device displays another motion graphic after display of a motion graphic relating to the first letter string but before display of a motion graphic relating to the second letter string in a case where the time difference is greater than or equal to a reference.

10. The musical piece reproducing method according to claim 9 ,

wherein the motion graphic data includes first definition data that defines the motion graphics of the letter strings and second definition data that defines motion graphics of background images, for each type of the musical piece portion,

the controlling includes controlling the display device in such a way that the display device displays the motion graphics of the background images together with the motion graphics of the letter strings, in accordance with the first definition data and the second definition data.

11. The musical piece reproducing method according to claim 9 ,

wherein the storage device stores the motion graphic data on a musical piece category basis, and

causing the display device to display motion graphics is carried out based on motion graphic data corresponding to the category of the musical piece reproduced by the sound device.

12. The musical piece reproducing method according to claim 9 , wherein the motion graphic data defines, for each type of a section that forms a musical piece, corresponding definition data.

13. The musical piece reproducing method according to claim 9 , wherein the controlling includes, in a case of switching a motion graphic displayed by the display device from a first motion graphic to a second motion graphic when the type of the reproduced musical piece portion is switched, controlling the display device in such a way that the display device displays a motion graphic for transition having characteristics that is a mixture of characteristics of the first motion graphic and characteristics of the second motion graphic before switching to the second motion graphic.

14. The musical piece reproducing method according to claim 9 , wherein the type of the musical piece portion corresponds to a type of lyrics in the musical piece portion.

15. The musical piece reproducing method according to claim 14 , wherein the type of lyrics is determined by at least one of a number of letters of the lyrics or a reproduction length.

16. A data outputting apparatus comprising:

a controller;

a storage device configured to store motion graphic data, the motion graphic data including definition data defining, for each type of a musical piece portion, a corresponding motion graphic that the display device should display when a musical piece portion that belongs to a corresponding type is reproduced; and

a communication device,

the controller carrying out processes including:

acquiring lyrics data of a musical piece through the communication device;

determining the type of each of musical piece portions contained in the musical piece reproduced by the sound device; and

outputting, based on the motion graphic data stored in the storage device and the acquired lyrics data, display data for causing the display device to display motion graphics corresponding to the musical piece in synchronization with progress of the musical piece reproduced by the sound device, through the communication device,

wherein the display data is configured to control the display device in such a way that, when the musical piece is reproduced by the sound device, the display device displays a motion graphic of a letter string representing a lyrics portion corresponding to time in the reproduction of the musical piece, in accordance with definition data in the motion graphic data corresponding to the type of a corresponding musical piece portion;

wherein the lyrics data has a time code representing time when display of a corresponding letter string starts, for each of letter strings specified by dividing entire lyrics of the musical piece, and

controlling the display device in such a way that the display device displays a motion graphic relating to a letter string, to which the time code corresponding to time in the reproduction of the musical piece is attached, wherein the controlling includes determining a time difference between the time codes attached to a first letter string and a second letter string out of the letter strings, the first letter string and the second letter string adjacent to each other and the first letter string followed by the second letter string, and

controlling the display device in such a way that the display device displays another motion graphic after display of a motion graphic relating to the first letter string but before display of a motion graphic relating to the second letter string in a case where the time difference is greater than or equal to a reference.

Assignments (2)
CHANGE OF NAME Recorded Feb 24, 2020
From: LYRIC ARTS INC.
To: COTODAMA INC.
Reel/Frame 052001/0807 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 13, 2017
From: NUMATA, KOHEI; SAITO, JIN
To: COTODAMA INC.
Reel/Frame 043570/0813 →
Priority Claims (1)
JP 2015-049663 · Mar 12, 2015 · national
Continuity (1)
Related Publication 20180047374A1 · Feb 15, 2018