Information processing device, information processing method and computer readable medium

1. An information processing device that is connected to a projecting device that projects an annotation image input from an external terminal onto a projection region including an object, and is connected to an image capturing device that captures an image of the projection region, the information processing device obtaining image data to be input to and output from the projecting device and the image capturing device through a communication with the external terminal,

the information processing device comprising:

a memory that stores a database including CAD data to be used for designing the object, and attribute information thereof;

an acquiring unit that acquires identification information of the object;

an identifying unit that identifies the CAD data of the object included in the database, based on the acquired identification information of the object; and

a controller that associates data of an image captured by the image capturing device with the CAD data of the object identified by the identifying unit, and causes the memory to store the data of the captured image associated with the CAD data, so that the data of the captured image can be viewed based on the attribute information of the CAD data of the object identified by the identifying unit.

2. The information processing device as claimed in claim 1 , wherein:

the information processing device is connected to an audio input and output device that inputs sound to the external terminal and outputs sound from the external terminal, and obtains data of the sound through a communication with the external terminal; and

the controller associates the data of the captured image and the audio data with the CAD data of the object identified by the identifying unit, and causes the memory to store the data of the captured image and the audio data associated with the CAD data, so that the data of the image captured by the image capturing device and the audio data input through the audio input and output device can be viewed and listened to, based on the attribute information of the CAD data of the object identified by the identifying unit.

3. The information processing device as claimed in claim 2 , further comprising

a data converter that converts the audio data into text data,

wherein the controller associates the data of the captured image and the text data with the CAD data of the object identified by the identifying unit, and causes the memory to store the data of the captured image and the text data associated with the CAD data, so that the data of the image captured by the image capturing device and the text data converted by the data converter can be viewed, based on the attribute information of the CAD data of the object identified by the identifying unit.

4. An information processing device that communicates with a server connected to a projecting device that projects an annotation image onto a projection region including an object and to an image capturing device that captures an image of the projection region, the information processing device obtaining image data to be input to and output from the projecting device and the image capturing device through a communication with the server,

the information processing device comprising:

a memory that stores a database including CAD data to be used for designing the object, and attribute information thereof;

an acquiring unit that acquires identification information of the object;

an identifying unit that identifies the CAD data of the object included in the database, based on the acquired identification information of the object; and

a controller that associates data of an image captured by the image capturing device with the CAD data of the object identified by the identifying unit, and causes the memory to store the data of the captured image associated with the CAD data, so that the data of the captured image can be viewed based on the attribute information of the CAD data of the object identified by the identifying unit.

5. The information processing device as claimed in claim 4 , wherein:

a first audio input and output device that inputs and outputs sound is connected to the information processing device;

a second audio input and output device that inputs and outputs sound is connected to the server;

audio data of the sound is obtained through a communication between the information processing device and the server; and

the controller associates the data of the captured image and the audio data with the CAD data of the object identified by the identifying unit, and causes the memory to store the data of the captured image and the audio data associated with the CAD data, so that the data of the image captured by the image capturing device and the audio input or output through the first audio input and output device can be viewed and listened to, based on the attribute information of the CAD data of the object identified by the identifying unit.

6. The information processing device as claimed in claim 5 , further comprising

a data converter that converts the audio data input or output through the first audio input and output device into text data,

wherein the controller associates the data of the captured image and the text data with the CAD data of the object identified by the identifying unit, and causes the memory to store the data of the captured image and the text data associated with the CAD data, so that the data of the image captured by the image capturing device and the text data converted by the data converter can be viewed, based on the attribute information of the CAD data of the object identified by the identifying unit.

7. The information processing device as claimed in claim 1 , wherein, when images of a plurality of objects are captured one by one, the controller associates data of the plurality of images captured by the image capturing device with the CAD data of the object first or last identified by the identifying unit, and causes the memory to store the data of the captured images associated with the CAD data, so that the data of the captured images can be viewed based on the attribute information of the CAD data of the object first or last identified by the identifying unit.

8. The information processing device as claimed in claim 2 , wherein, when images of a plurality of objects are captured one by one and audio data files are switched at the time of switching the objects, the controller associates data of the plurality of images captured by the image capturing device and a plurality of sets of audio data input or output through the audio input and output device with the CAD data of the object first or last identified by the identifying unit, and causes the memory to store the data of the captured images and the audio data associated with the CAD data, so that the data of the captured images and the plurality of sets of audio data can be viewed and listened to, based on the attribute information of the CAD data of the object first or last identified by the identifying unit.

9. The information processing device as claimed in claim 8 , further comprising

an input unit that is used to input a temporary storage instruction or a final storage instruction,

wherein:

when the temporary storage instruction is input through the input unit, the controller causes the memory to temporarily store the captured image data of each of the objects and the audio data of each of the objects; and

when the final storage instruction is input through the input unit, the controller associates the data of the plurality of images captured by the image capturing device and the plurality of sets of audio data input or output through the audio input and output device with the CAD data of the object first or last identified by the identifying unit, and causes the memory to store the data of the captured images and the audio data associated with the CAD data, so that the data of the captured images and the plurality of sets of audio data can be viewed and listened to, based on the attribute information of the CAD data of the object first or last identified by the identifying unit.

10. An information processing method performed by a computer for processing information, the computer being connected to a projecting device that projects an annotation image input from an external terminal onto a projection region including an object, the computer being also connected to an image capturing device that captures an image of the projection region, the computer obtaining image data to be input to and output from the projecting device and the image capturing device through a communication with the external terminal,

the method comprising:

storing a database including CAD data to be used for designing the object, and attribute information thereof;

acquiring identification information of the object;

identifying the CAD data of the object included in the database, based on the acquired identification information of the object; and

associating data of an image captured by the image capturing device with the CAD data of the object identified by the identifying unit, and causing the memory to store the data of the captured image associated with the CAD data, so that the data of the captured image can be viewed based on the attribute information of the CAD data of the object identified by the identifying unit.

11. An information processing method performed by a computer for processing information, the computer communicating with a server connected to a projecting device that projects an annotation image onto a projection region including an object and to an image capturing device that captures an image of the projection region, the information processing device obtaining image data to be input to and output from the projecting device and the image capturing device through a communication with the server,

the method comprising:

storing a database including CAD data to be used for designing the object, and attribute information thereof;

acquiring identification information of the object;

identifying the CAD data of the object included in the database, based on the acquired identification information of the object; and

associating data of an image captured by the image capturing device with the CAD data of the object identified by the identifying unit, and causing the memory to store the data of the captured image associated with the CAD data, so that the data of the captured image can be viewed based on the attribute information of the CAD data of the object identified by the identifying unit.

12. A non-transitory computer readable medium storing a program causing a computer to execute a process for processing information, the computer being connected to a projecting device that projects an annotation image input from an external terminal onto a projection region including an object, the computer being also connected to an image capturing device that captures an image of the projection region, the computer obtaining image data to be input to and output from the projecting device and the image capturing device through a communication with the external terminal,

the process comprising:

storing a database including CAD data to be used for designing the object, and attribute information thereof;

acquiring identification information of the object;

identifying the CAD data of the object included in the database, based on the acquired identification information of the object; and

associating data of an image captured by the image capturing device with the CAD data of the object identified by the identifying unit, and causing the memory to store the data of the captured image associated with the CAD data, so that the data of the captured image can be viewed based on the attribute information of the CAD data of the object identified by the identifying unit.

13. A non-transitory computer readable medium storing a program causing a computer to execute a process for processing information, the computer communicating with a server connected to a projecting device that projects an annotation image onto a projection region including an object and to an image capturing device that captures an image of the projection region, the information processing device obtaining image data to be input to and output from the projecting device and the image capturing device through a communication with the server,

the process comprising:

storing a database including CAD data to be used for designing the object, and attribute information thereof;

acquiring identification information of the object;

identifying the CAD data of the object included in the database, based on the acquired identification information of the object; and

associating data of an image captured by the image capturing device with the CAD data of the object identified by the identifying unit, and causing the memory to store the data of the captured image associated with the CAD data, so that the data of the captured image can be viewed based on the attribute information of the CAD data of the object identified by the identifying unit.