IP Library › Granted Patent US 10,748,328
Granted Patent B2
US 10,748,328 · App. 16/169,894 · Granted Aug 18, 2020

Recording medium, information processing apparatus, influence degree deriving method, and image generation method

Inventor: Tetsuya Nakajo (Tokyo, JP)
Assignee: Live2D Inc.
G06T15/205G06F9/06G06F17/11G06T7/11G06T13/80H04N13/122
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,748,328
App. No.
16/169,894
Granted
Aug 18, 2020
Kind
B2
Abstract

An information processing apparatus acquires information representing an angle concerning a view direction for each of a first view direction, a second view direction, and a third view direction and an output view direction. The apparatus derives the influence degree of the rendering representation of the target object concerning each of the first view direction, the second view direction, and the third view direction to the rendering representation of the target object concerning the output view direction based on a curve determined in advance as a reference of rotation of the target object, for which a point on a line corresponding to the angle concerning the view direction is determined.

Claims (40)

1. A non-transitory computer-readable recording medium recording a program for causing a computer to execute processing of deriving an influence degree to rendering representation for each of at least three types of view directions including a first view direction, a second view direction, and a third view direction when generating rendering representation of a target object concerning an output view direction based on the rendering representation of the target object defined for each of the at least three types of view directions, wherein the program causes the computer to execute:

acquisition processing of acquiring information representing an angle concerning a view direction for each of the first view direction, the second view direction, and the third view direction and the output view direction; and

deriving processing of deriving the influence degree of the rendering representation of the target object concerning each of the first view direction, the second view direction, and the third view direction to the rendering representation of the target object concerning the output view direction based on a curve determined in advance as a reference of rotation of the target object, for which a point on a line corresponding to the angle concerning the view direction is determined.

2. The recording medium according to claim 1 , wherein

reference coordinates are defined for the curve, and

in the deriving processing, each of coefficients of a first vector, a second vector, and a third vector when an output vector directed from the reference coordinates to a point on the curve corresponding to an angle concerning the output view direction is represented by the first vector directed from the reference coordinates to a point on the curve corresponding to an angle concerning the first view direction, the second vector directed from the reference coordinates to a point on the curve corresponding to an angle concerning the second view direction, and the third vector directed from the reference coordinates to a point on the curve corresponding to an angle concerning the third view direction is derived as the influence degree.

3. The recording medium according to claim 2 , wherein the curve is a curve having a positive curvature for the reference coordinates.

4. The recording medium according to claim 3 , wherein the curve includes a polygonal line that approximates the curve having the positive curvature.

5. The recording medium according to claim 3 , wherein the curve is a curve defined by limiting at least one of a maximum value, a change rate, and a change width of the curvature.

6. The recording medium according to claim 1 , wherein

the first view direction, the second view direction, and the third view direction are defined based on a direction to the target object on a first virtual plane defined for the target object, and

the angle concerning each of the first view direction, the second view direction, and the third view direction is an angle made by a direction vector corresponding to each view direction on the first virtual plane and a reference vector determined for the target object.

7. The recording medium according to claim 6 , wherein

the at least three types of view directions further include three types of view directions defined based on a direction to the target object on a second virtual plane crossing the first virtual plane,

in the acquisition processing, information representing an angle of two axes based on the first virtual plane and the second virtual plane is acquired for the output view direction, and

in the deriving processing, the influence degree to the rendering representation of the target object concerning some angle components of the angle of the two axes in the output view direction, which is derived for the first virtual plane, and the influence degree to the rendering representation of the target object concerning some remaining angle components of the angle of the two axes in the output view direction, which is derived for the second virtual plane, are composited, thereby deriving the influence degree of the rendering representation of the target object concerning each of the at least three types of view directions.

8. An information processing apparatus for deriving an influence degree to rendering representation for each of at least three types of view directions including a first view direction, a second view direction, and a third view direction when generating rendering representation of a target object concerning an output view direction based on the rendering representation of the target object defined for each of the at least three types of view directions, comprising:

an acquisition unit configured to acquire information representing an angle concerning a view direction for each of the first view direction, the second view direction, and the third view direction and the output view direction; and

a deriving unit configured to derive the influence degree of the rendering representation of the target object concerning each of the first view direction, the second view direction, and the third view direction to the rendering representation of the target object concerning the output view direction based on a curve determined in advance as a reference of rotation of the target object, for which a point on a line corresponding to the angle concerning the view direction is determined.

9. An influence degree deriving method of deriving an influence degree to rendering representation for each of at least three types of view directions including a first view direction, a second view direction, and a third view direction when generating rendering representation of a target object concerning an output view direction based on the rendering representation of the target object defined for each of the at least three types of view directions, comprising:

an acquisition step of acquiring information representing an angle concerning a view direction for each of the first view direction, the second view direction, and the third view direction and the output view direction; and

a deriving step of deriving the influence degree of the rendering representation of the target object concerning each of the first view direction, the second view direction, and the third view direction to the rendering representation of the target object concerning the output view direction based on a curve determined in advance as a reference of rotation of the target object, for which a point on a line corresponding to the angle concerning the view direction is determined.

10. A non-transitory computer-readable recording medium recording a program for causing a computer to execute processing of generating an output image of rendering representation of a target object concerning an output view direction, wherein the program causes the computer to execute:

decision processing of deciding the output view direction to generate the output image; and

generation processing of generating the output image based on an influence degree derived by an influence degree deriving method of claim 9 and rendering representation concerning each of the first view direction, the second view direction, and the third view direction.

11. The recording medium according to claim 10 , wherein

the rendering representation concerning each view direction is defined by pieces of information of a plurality of feature points concerning a part that forms the target object, and

in the generation processing, the output image is generated by performing weighted addition of the pieces of information of the plurality of feature points defined for each of the first view direction, the second view direction, and the third view direction based on the influence degree.

12. The recording medium according to claim 10 , wherein

the rendering representation concerning each view direction is provided as a two-dimensional image by arranging a plurality of feature points concerning a part that forms the target object at arrangement positions defined for the view direction, and

in the generation processing, the output image is generated by performing weighted addition of the arrangement positions of the feature points defined for each of the first view direction, the second view direction, and the third view direction based on the influence degree and deforming the part that forms the target object such that the feature points are arranged at positions obtained by the weighted addition.

13. The recording medium according to claim 12 , wherein each of parts that form the target object is a two-dimensional image, and a plurality of feature points are defined.

14. The recording medium according to claim 12 , wherein in the generation processing, the weighted addition is performed based on the same influence degree for all of the plurality of feature points concerning the parts that form the target object.

15. The recording medium according to claim 10 , wherein in the generation processing, in a case in which the influence degree derived by the influence degree deriving method for the output view direction does not exist, influence degrees derived by the influence degree deriving method for a plurality of view directions are composited and used to generate the output image.

16. An information processing apparatus for generating an output image of rendering representation of a target object concerning an output view direction, comprising:

a decision unit configured to decide the output view direction to generate the output image; and

a generation unit configured to generate the output image based on an influence degree derived by an influence degree deriving method of claim 9 and rendering representation concerning each of the first view direction, the second view direction, and the third view direction.

17. An image generation method of generating an output image of rendering representation of a target object concerning an output view direction, comprising:

a decision step of deciding the output view direction to generate the output image; and

a generation step of generating the output image based on an influence degree derived by an influence degree deriving method of claim 9 and rendering representation concerning each of the first view direction, the second view direction, and the third view direction.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 26, 2018
From: NAKAJO, TETSUYA
To: LIVE2D INC.
Reel/Frame 047327/0902 →
Priority Claims (1)
JP 2016-091536 · Apr 28, 2016 · national
Continuity (2)
Continuation PCTJP2017015902 · Apr 20, 2017
Related Publication 20190073823A1 · Mar 7, 2019