IP Library Granted Patent US 10,410,392
Granted Patent B2
US 10,410,392 · App. 15/545,512 · Granted Sep 10, 2019

Data structure for computer graphics, information processing device, information processing method and information processing system

Inventors: Yuki Kishi (Tokyo, JP); Yasuo Higa (Tokyo, JP); Akio Iijima (Tokyo, JP); Tatsuki Tatara (Tokyo, JP)
Assignee: DENTSU INC.
G06T13/205G06T13/40G10H1/00G10H1/0008G10H1/0058G10H1/368G10H1/40G10H2210/091G10H2220/201G10H2220/455G10H2240/056
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,410,392
App. No.
15/545,512
Granted
Sep 10, 2019
Kind
B2
Abstract

The present invention is designed to allow easy synchronization of the movement of a computer graphics (CG) model with sound data. The data structure according to an embodiment of the present invention presents a data structure that relates to a computer graphics (CG) model, including first time-series information for designating the coordinates of the components of the CG model on a per beat basis, and the first time-series information is used on a computer to process the CG model.

Claims (32)

1. A non-transitory computer-readable storage medium stored thereon a computer program to process a computer graphics (CG) model using a data structure, the computer program, when executed causes a processor to perform the following:

acquiring data that contains first time-series information for designating coordinates of components of a computer graphics (CG) model, in chronological order, on a per beat basis, and that conforms to SMF (Standard MIDI File) format; and

processing the CG model based on the first time-series information and displaying the processed CG model onto a display circuit,

wherein the CG model is constituted by a skeleton, which is comprised of two joint points and bones connecting between these,

wherein, with respect to the coordinates of the components of the CG model, the first time-series information includes information related to a speed system, and

wherein the speed system-related information is an offset based on an average value of temporally neighboring data included in the first time-series information.

2. The non-transitory computer-readable storage medium according to claim 1 , wherein a channel of the SMF format corresponds to one or a plurality of pieces of the first time-series information.

3. The non-transitory computer-readable storage medium according to claim 1 , wherein a note number and a velocity of a note-on signal in the SMF format are used by the processor as information about the coordinates of the components of the CG model.

4. The non-transitory computer-readable storage medium according to claim 1 , wherein a delta time in the SMF format is used by the processor as information about a duration of a beat where coordinates of a component of the CG model change.

5. The non-transitory computer-readable storage medium according to claim 1 , wherein the first time-series information includes information about a relative angle of a bone of the CG model.

6. The non-transitory computer-readable storage medium according to claim 1 , wherein the first time-series information includes information about a relative distance from at least one of an initial position of the CG model and information about a rotation angle of a reference point of the CG model.

7. The non-transitory computer-readable storage medium according to claim 1 , wherein a velocity of a note-off signal in the SMF format is used by the processor as the speed system-related information.

8. The non-transitory computer-readable storage medium according to claim 1 , wherein the computer program, when executed causes the processor to further perform the following:

converting the first time-series information into second time-series information for designating the coordinates of the components of the CG model, in chronological order, on a per frame basis; and

processing the CG model based on the second time-series information.

9. The non-transitory computer-readable storage medium according to claim 1 , further comprising information for setting a tempo.

10. A display device comprising:

an acquisition circuit that acquires data that contains first time-series information for designating coordinates of components of a computer graphics (CG) model, in chronological order, on a per beat basis, and that conforms to SMF (Standard MIDI File) format; and

a display circuit that displays the CG model based on the first time-series information,

wherein the CG model is constituted by a skeleton, which is comprised of two joint points and bones connecting between these,

wherein, with respect to the coordinates of the components of the CG model, the first time-series information includes information related to a speed system, and

wherein the speed system-related information is an offset based on an average value of temporally neighboring data included in the first time-series information.

11. The display device according to claim 10 , wherein the display circuit displays the CG model based on a result of applying an exponential moving average to the first time-series information.

12. The display device according to claim 10 , further comprising a playback circuit that plays given data,

wherein the display circuit displays the CG model in synchronization with the given data played by the playback circuit.

13. The display device according to claim 12 , wherein the display circuit displays the CG model so that a maximum speed at which the coordinates of each component transition is equal to when the CG model is displayed at a tempo related to the data containing the first time-series information.

14. An information processing method for a computer graphics (CG) model, the method comprising:

acquiring data that contains first time-series information for designating coordinates of components of a computer graphics (CG) model, in chronological order, on a per beat basis, and that conforms to SMF (Standard MIDI File) format; and

processing the CG model based on the first time-series information and displaying the processed CG model onto a display circuit,

wherein the CG model is constituted by a skeleton, which is comprised of two joint points and bones connecting between these,

wherein, with respect to the coordinates of the components of the CG model, the first time-series information includes information related to a speed system, and

wherein the speed system-related information is an offset based on an average value of temporally neighboring data included in the first time-series information.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 13, 2022
From: DENTSU GROUP INC.
To: DENTSU INC.
Reel/Frame 059897/0876 →
CHANGE OF NAME Recorded Apr 1, 2022
From: DENTSU INC.
To: DENTSU GROUP INC.
Reel/Frame 059568/0905 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 26, 2018
From: KISHI, YUKI; HIGA, YASUO; IIJIMA, AKIO; TATARA, TATSUKI
To: DENTSU INC.
Reel/Frame 046206/0393 →
Priority Claims (2)
JP 2015-016214 · Jan 30, 2015 · national
JP 2015-077162 · Apr 3, 2015 · national
Continuity (1)
Related Publication 20180012389A1 · Jan 11, 2018