Annotation device and annotation method
Provided are an annotation device and an annotation method capable of simple and highly accurate annotation. An annotation device for annotation to 3D shape data and implemented using a computer, the annotation device including: an input unit that inputs a 3D CAD model, a text, and label definition information; a calculation unit that generates an annotation data set through annotation processing; a storage unit that stores the generated annotation data set; and an output unit that outputs a processing result of the calculation unit, in which the calculation unit includes an annotation unit that obtains a partial shape of the 3D CAD model and annotation information including a label according to a named entity in the text or the label definition information, and a metadata generation unit that generates metadata that associates the annotation information with partial shapes of the 3D CAD model and heterogeneous format data derived from the 3D CAD model, and stores an annotation data set including the generated metadata, and a 3D CAD model and a text referenced by the metadata in the storage unit.
1 . An annotation device for annotation to 3D shape data, the annotation device comprising:
an input unit configured to input a 3D CAD model, a text, and label definition information; a calculation unit configured to generate an annotation data set through annotation processing; a storage unit configured to store the generated annotation data set; and an output unit configured to output a predicted annotation label obtained by a recognition unit, wherein
the calculation unit includes an annotation unit configured to obtain a partial shape of the 3D CAD model based on a selection range as one or more geometric entities of the 3D CAD model selected by the selection range, the geometric entities including at least one of a solid, a surface, an edge, and a point and annotation information including a label according to a named entity in the text or the label definition information, and a metadata generation unit configured to generate metadata that associates the annotation information with partial shapes of the 3D CAD model and heterogeneous format data derived from the 3D CAD model, and stores the annotation data set including the generated metadata, and the 3D CAD model and the text referenced by the metadata in the storage unit, wherein
the annotation data set includes the label definition information,
the calculation unit includes the recognition unit configured to learn a label annotation relation between the label definition information included in the annotation data set of the storage unit and a corresponding geometric shape and store a learning model,
the recognition unit is configured to obtain the predicted annotation label for the partial shape obtained by the annotation unit in accordance with a request from the annotation unit, and
the output unit is configured to output the predicted annotation label obtained by the recognition unit.
2 . The annotation device according to claim 1 , wherein the recognition unit is further
configured to extract the text in the annotation data set of the storage unit and a named entity label included in the label definition information, learn to recognize the named entity in the text, recognize the learned named entity from the text read by the annotation unit in accordance with the request from the annotation unit, output a result to the output unit, and record the result in the storage unit.
3 . The annotation device according to claim 1 , wherein the recognition unit is further
configured to learn the relation between the label definition information and a corresponding partial shape of the 3D CAD model, the relation indicating which partial shape of the 3D CAD model is selected with respect to the label definition information in the annotation data set of the storage unit and recommend a partial shape to be annotated for the label definition information in accordance with the request from the annotation unit.
4 . The annotation device according to claim 1 , wherein:
the metadata generation unit is configured to embed an identifier of a common partial shape into the metadata and the partial shapes of the 3D CAD model referenced by the generated metadata and heterogeneous format data derived from the 3D CAD model, wherein the common partial shape includes the partial shape of the 3D CAD model referenced by the generated metadata and a partial shape of the heterogeneous format data derived from the 3D CAD model corresponding to the partial shape of the 3D CAD model.
5 . An annotation method for annotation to 3D shape data, the annotation method comprising:
inputting a CAD model and label definition information or a text by an input unit; selecting a label definition included in the label definition information to be annotated and selecting the CAD model and a partial shape in the CAD model by a calculation unit; and designating a label value or a named entity in the text from the selected partial shape by an operation unit based on a user operation, wherein
the partial shape is one or more geometric entities of the CAD model selected by a selection range, the geometric entities including at least one of a solid, a surface, an edge, and a point, and
the calculation unit is configured to store annotated information by generating metadata including the label definition information, the CAD model, the text, the label value, and information on an identifier of the partial shape of the CAD model, and embedding the identifier described in the metadata into the partial shape of the CAD model or heterogeneous format data obtained by converting the partial shape in 3DA or another format.
6 . The annotation method according to claim 5 , wherein
when the partial shape of the CAD model is selected, the calculation unit displays a predicted label value corresponding to the label definition included in the label definition information based on the partial shape, corrects the predicted label value, or directly uses the predicted label value and adds an annotation.
7 . The annotation method according to claim 5 , wherein
the calculation unit is configured to edit or use a selection range of a partial shape for each of a plurality of partial shapes in the CAD model that are annotation candidates recognized and calculated based on the label definition information, thereby selecting one of the plurality of partial shapes as the partial shape.
8 . The annotation method according to claim 5 , wherein
the calculation unit is configured to perform an annotation operation for selecting the partial shape in the CAD model, the label definition included in the label definition information, and the text by, based on feature analysis of a data set that is already annotated, predicting the partial shape to be annotated in the CAD model, predicting the label value from the predicted partial shape, recognizing the named entity in the text, presenting a result of the recognition as an annotation result to a user, and correcting the annotation result by the user.
9 . The annotation method according to claim 5 , wherein
the calculation unit is configured to perform annotation of the CAD model and the text by associating the named entity in the text labeled according to the label definition information with the partial shape of the CAD model.