Information processing device and storage medium storing computer program

1 . An information processing device comprising:

a scan controller configured to cause a scanner to scan an outer appearance of an object disposed on a table and generate a scan image;

a data generator configured to generate 3-dimensional model data from the scan image;

a video generator configured to generate a video in which a 3-dimensional model based on the 3-dimensional model data is disposed in a virtual space; and

a receiver configured to receive a designation input of joint positions for the 3-dimensional model data,

wherein the data generator is configured to generate the 3-dimensional model data in association with joint information on the joint positions designated by the designation input,

wherein the video generator is configured to generate the video of the 3-dimensional model in which a joint of the 3-dimensional model data is operated based on the joint information,

wherein the receiver includes:

a manipulation receiver configured to allow a user of the information processing device to input a manipulation; and

a display,

wherein the receiver is configured to receive the designation input of the joint positions by

the display superimposing and displaying an indicator including a plurality of indexes indicating joint positions on the 3-dimensional model data, and

the manipulation receiver receiving a manipulation for matching positions of the plurality of indexes with positions of predetermined joints of the 3-dimensional model data, and

wherein the data generator is configured to:

determine embedding amounts of joint reference positions based on information regarding depths of the 3-dimensional model data at the joint positions designated by the designation input, each of the joint reference positions a being position at which a corresponding joint in the 3-dimensional model data is to be operated;

determine the joint reference positions based on the joint positions and the embedding amounts; and

associate the joint reference positions as the joint information with the 3-dimensional model data.

2 . The information processing device according to claim 1 , wherein the indicator is selected from different types of indicators in accordance with a type of the object.

3 . The information processing device according to claim 1 , wherein the indicator is commonly used irrespective of a difference in a type of the object.

4 . The information processing device according to claim 1 , wherein the data generator is configured to set each of the joint reference positions in an intermediate part of a depth range at the corresponding joint in the 3-dimensional model data.

5 . The information processing device according to claim 1 ,

wherein the data generator is configured to determine associated operation ranges based on the joint reference positions, each of the associated operation ranges being a range to be operated in the 3-dimensional model data in conjunction with an operation of a joint in the 3-dimensional model data when the joint is operated in the 3-dimensional model data, and

wherein the joint information further includes the associated operation ranges.

6 . The information processing device according to claim 5 , wherein the associated operation ranges include a range specified as a range between the joint reference positions.

7 . The information processing device according to claim 1 ,

wherein a plurality of markers are provided on a surface of a pedestal of the table on which the object is disposed, and the plurality of markers being configured such that positions and rotational directions thereof in a 3-dimensional space are acquirable, and

wherein the data generator is configured to extract information regarding the plurality of markers from the scan image, specify a position of the table on which the object is disposed, and correct a position and a direction of the 3-dimensional model data based on the position of the table.

8 . The information processing device according to claim 7 , wherein, in a correction of the position and the direction of the 3-dimensional model data, the direction of the 3-dimensional model data is corrected to be oriented in a direction matching a front face of the indicator when the indicator is superimposed and displayed on the 3-dimensional model data.

9 . The information processing device according to claim 7 , wherein the plurality of markers are Augment Reality markers.

10 . The information processing device according to claim 1 , further comprising a depth sensor configured to acquire depth information on a range in which the scanner performs scanning,

wherein the scan controller is configured to control a position and an angle of the scanner based on the depth information acquired by the depth sensor.

11 . The information processing device according to claim 10 , wherein the scan controller is configured to set a range including the object disposed on the table and the table and control a position and an angle of the scanner so that the set range is scanned.

12 . The information processing device according to claim 1 , further comprising a depth sensor configured to acquire depth information on a range in which the scanner performs scanning,

wherein the scan controller is configured to set a range including the object disposed on the table and the table and cause the scanner to only scan the set range.

13 . The information processing device according to claim 1 , wherein

receiving the designation input of the joint positions is performed on a 2-dimensional view viewing the 3 -dimensional model data in a fixed direction, and

the depths of the 3-dimensional model data at the joint positions are depths in the fixed direction.

14 . A non-transitory computer-readable storage medium that stores computer-executable program comprising instructions which, when executed by a computer, cause a computer to function as:

a scan controller configured to cause a scanner to scan an outer appearance of an object disposed on a table and to generate a scan image;

a data generator configured to generate 3-dimensional model data from the scan image;

a video generator configured to generate a video in which a 3-dimensional model based on the 3-dimensional model data is disposed in a virtual space; and

a receiver configured to receive a designation input of joint positions for the 3-dimensional model data,

wherein the data generator is configured to generate the 3-dimensional model data in association with joint information on the joint positions represented by the designation input,

wherein the video generator is configured to generate the video of the 3-dimensional model in which a joint of the 3-dimensional model data is operated based on the joint information,

wherein the receiver includes a manipulation receiver configured to allow a user to input a manipulation,

wherein the receiver is configured to receive the designation input of the joint positions by

superimposing and displaying an indicator on the 3-dimensional model data on displayed on a display, the indicator including a plurality of indexes indicating joint positions, and

receiving a manipulation for matching positions of the plurality of indexes with positions of predetermined joints of the 3-dimensional model data, and

wherein the data generator is configured to:

determine embedding amounts of joint reference positions based on information regarding depths of the 3-dimensional model data at the joint positions designated by the designation input, each of the joint reference positions a being position at which a corresponding joint in the 3-dimensional model data is to be operated;

determine the joint reference positions based on the joint positions and the embedding amounts; and

associate the joint reference positions as the joint information with the 3-dimensional model data.

15 . The non-transitory computer-readable storage medium according to claim 14 , wherein

receiving the designation input of the joint positions is performed on a 2-dimensional view viewing the 3-dimensional model data in a fixed direction, and

the depths of the 3-dimensional model data at the joint positions are depths in the fixed direction.