Video generation device, video generation program, and video generation method
View Patent ↗It is an object of the invention to realize automatic video generation displaying in an easily understandable manner the state of brush stroke as effectively maintaining immersion feeling happened by looking-around operation during reproduction of the image production of an omnidirectional image. A stroke information group is associated with valid line-of-sight information from a reproduction sequence recording the line-of-sight information and the stroke information group. The number of frames between a pair of line-of-sight information is made constant. When the line-of-sight moves from a line-of-sight A via a line-of-sight B to a line-of-sight C, the stroke information group corresponding to the line-of-sight B is reproduced in a range from “a frame of a center between the line-of-sight information A and B” to “a frame of a center between the line-of-sight information B and C”.
1. A video generation device comprising:
a memory storing a video generation program; and
a central control unit for performing a control to extract multiple occurrences of valid line-of-sight information included in a reproduction sequence upon executing the video generation program, to select a plurality of frames relating to the multiple occurrences of line-of-sight information, so that a constant number of frames will exist between a pair of the occurrences of line-of-sight information, to extract multiple occurrences of stroke information relating to the selected frames in a number adjusted so as to keep constant the number of frames between the pair of occurrences of line-of-sight information, to renew an omnidirectional image based on the line-of-sight information and drawing attribute where the stroke information includes the drawing attribute, to generate new line-of-sight information in an interpolated manner based on the extracted line-of-sight information, adjacent line-of-sight information, and the position of the extracted frame, upon completion of extraction of the entire stroke information relating to the selected frame, to make drawing the omnidirectional image on a screen image based on the interpolated line-of-sight information, and to write the screen image as an image of the selected frame.
2. The video generation device according to claim 1 , wherein the reproduction sequence includes the line-of-sight information and the stroke information, wherein the line-of-sight information includes information of line-of-sight angle and viewing angle, and wherein the stroke information includes the drawing attribute.
3. The video generation device according to claim 2 , wherein the drawing attribute includes at least one of start point coordinates, end point coordinates, color information, and line width information.
4. The video generation device according to claim 3 , wherein the stroke information includes a drawing end flag, and wherein the central control unit renews the drawing image based the drawing attribute where the stroke information includes the drawing attribute, and draws the drawing image on the omnidirectional image based on the line-of-sight information where the stroke information includes the drawing end flag, and draws the drawing image on the screen image based on the interpolated line-of-sight information and the extracted line-of-sight information.
5. The video generation device according to claim 2 , wherein the stroke information includes a drawing end flag, and wherein the central control unit renews the drawing image based the drawing attribute where the stroke information includes the drawing attribute, and draws the drawing image on the omnidirectional image based on the line-of-sight information where the stroke information includes the drawing end flag, and draws the drawing image on the screen image based on the interpolated line-of-sight information and the extracted line-of-sight information.
6. The video generation device according to claim 1 , wherein the stroke information includes a drawing end flag, and wherein the central control unit renews the drawing image based the drawing attribute where the stroke information includes the drawing attribute, and makes drawing of the drawing image to the omnidirectional image based on the line-of-sight information where the stroke information includes the drawing end flag, and makes drawing of the drawing image to the screen image based on the interpolated line-of-sight information and the extracted line-of-sight information.
7. A non-transitory recording medium in which a video generation program is recorded, execution of the video generation program by a computer making the computer to function as a central control unit to execute, the steps of:
extracting multiple occurrences of valid line-of-sight information included in a reproduction sequence upon executing the video generation program;
selecting a plurality of frames relating to the extracted multiple occurrences of line-of-sight information so that a constant number of frames exists between a pair of the occurrences of the line-of-sight information;
extracting multiple occurrences of stroke information relating to the selected frames in a number adjusted so as to keep constant the number of frames between the pair of occurrences of line-of-sight information;
renewing an omnidirectional image based on the line-of-sight information and drawing attribute where the stroke information includes the drawing attribute;
generating new line-of-sight information in an interpolated manner based on the extracted line-of-sight information, adjacent line-of-sight information, and the position of the extracted frame, upon completion of extraction of the entire stroke information relating to the selected frame;
drawing the omnidirectional image on a screen image based on the interpolated line-of-sight information; and
writing the screen image as an image of the selected frame.
8. The recording medium according to claim 7 , wherein the reproduction sequence includes the line-of-sight information and the stroke information, wherein the line-of-sight information includes information of line-of-sight angle and viewing angle, and wherein the stroke information includes the drawing attribute.
9. The recording medium according to claim 8 , wherein the drawing attribute includes at least one of start point coordinates, end point coordinates, color information, and line width information.
10. The recording medium according to claim 9 , wherein the stroke information includes a drawing end flag, and wherein the executing the video generation program includes causing the central control unit to renew the drawing image based the drawing attribute where the stroke information includes the drawing attribute, and to draw the drawing image on the omnidirectional image based on the line-of-sight information where the stroke information includes the drawing end flag, and to draw the drawing image on the screen image based on the interpolated line-of-sight information and the extracted line-of-sight information.
11. The recording medium according to claim 8 , wherein the stroke information includes a drawing end flag, and wherein the executing the video generation program includes causing the central control unit to renew the drawing image based the drawing attribute where the stroke information includes the drawing attribute, and to draw the drawing image on the omnidirectional image based on the line-of-sight information where the stroke information includes the drawing end flag, and to draw the drawing image on the screen image based on the interpolated line-of-sight information and the extracted line-of-sight information.
12. The recording medium according to claim 7 ,
wherein the stroke information includes a drawing end flag, and
wherein the executing the video generation program includes causing the central control unit to renew the drawing image based the drawing attribute where the stroke information includes the drawing attribute, and to draw the drawing image on the omnidirectional image based on the line-of-sight information where the stroke information includes the drawing end flag, and to draw the drawing image on the screen image based on the interpolated line-of-sight information and the extracted line-of-sight information.
13. A video generation method, to be performed by a central control unit of a video generation device via execution of a video generation program stored in a memory unit comprising:
extracting multiple occurrences of line-of-sight information included in a reproduction sequence;
selecting a plurality of frames relating to the extracted multiple occurrences of line-of-sight information so that a constant number of frames exists between a pair of the occurrences of the line-of-sight information;
extracting multiple occurrences of stroke information relating to the selected frames in a number adjusted so as to keep constant the number of frames between the pair of occurrences of line-of-sight information;
renewing an omnidirectional image based on the line-of-sight information and drawing attribute where one of the occurrences of the stroke information includes the drawing attribute;
generating new line-of-sight information in an interpolated manner based on the extracted line-of-sight information, line-of-sight information adjacent thereto, and the position of each selected frame, upon completion of extraction of the entire stroke information relating to said each selected frame;
drawing the omnidirectional image on a screen image based on the interpolated line-of-sight information; and
writing the screen image as an image of the selected frames.
14. The video generation method according to claim 13 , wherein the reproduction sequence includes the line-of-sight information and the stroke information, wherein the line-of-sight information includes information of line-of-sight angle and viewing angle, and wherein the stroke information includes the drawing attribute.
15. The video generation method according to claim 14 , wherein the drawing attribute includes at least one of start point coordinates, end point coordinates, color information, and line width information.
16. The video generation method according to claim 14 ,
wherein the stroke information includes a drawing end flag, and
wherein the executing the video generation program includes causing the central control unit to
renew the drawing image based the drawing attribute where the stroke information includes the drawing attribute,
draw the drawing image on the omnidirectional image based on the line-of-sight information where the stroke information includes the drawing end flag, and
draw the drawing image on the screen image based on the interpolated line-of-sight information and the extracted line-of-sight information.
17. The video generation method according to claim 13 , wherein the stroke information includes a drawing end flag, and
wherein execution of the video generation program causes the central control unit to renew the drawing image based the drawing attribute where the stroke information includes the drawing attribute, and to draw the drawing image on the omnidirectional image based on the line-of-sight information where the stroke information includes the drawing end flag, and to draw the drawing image on the screen image based on the interpolated line-of-sight information and the extracted line-of-sight information.