System and method for capturing and interpreting images into triple diagrams
A machine system includes an image processor to transform a raw digital image to a set of drawing objects comprising individual lines, shapes, and text; a block diagram generator to transform the set of drawing objects into a block diagram; and a flow chart generator to transform the set of drawing objects into a flow chart. A client device receives a raw image signal of a print or display graph from a camera and in response processes the raw image to reduce noise, normalize the raw image data, and reduce pixel information. A server system receives the processed image from the client device and in response operates image processor logic to transform the processed image into a format in which image lines and other geometric objects are manipulatable.
1. A triple diagram generator, comprising:
an image processor, wherein the image processor outputs a set of drawing objects comprising at least one of lines, text strings, shapes, and combinations thereof, generated by transforming a print or display graph, said set of drawing objects sent to a stencilizer, a line characterizer, and a label characterizer;
a stencilizer, wherein the stencilizer accesses a database to locate stencils corresponding to the set of drawing objects, wherein the correspondence between stencils and the set of drawing objects is based upon text strings that the stencilizer identifies as being labels for the set of drawing objects;
a line characterizer, wherein the line characterizer analyzes lines that are not part of shapes in a drawing for characteristics indicative of a line type including at least one of communication lines, stem lines, and combinations thereof, wherein lines are tagged by their characteristic type and at least one of source and destination objects for communication lines, a labeled shape object being labeled for object labels, a shape object actor for action stem lines, and combinations thereof;
a label characterizer, wherein the label characterizer analyzes the text strings in the drawing for characteristics indicative of label types and tags the text strings with their characteristic type and other attributes including at least one selected from an associated communication line, a stem line, a shape object, and combinations thereof;
a block diagrammer, wherein tagged labels, stencils, and lines are input to the block diagrammer along with drawing objects, and are transformed into a system block diagram;
a flow charter, wherein tagged labels and tagged lines are input to the flow charter along with drawing objects, and are transformed into a flow chart; and
a data flow diagrammer, wherein tagged labels and tagged lines are input to the data flow diagrammer along with drawing objects, and are transformed into a data flow diagram.
2. The triple diagram generator of claim 1 , further comprising:
a traverser, wherein the traverser generates traverse text by traversing the system block diagram, the flow chart, and the data flow diagram.
3. The triple diagram generator of claim 2 , wherein the traverse text includes a combination of the labeled shape object, the shape object actor, and the source and destination objects, wherein the combination is formed into a natural language set of one or more sentences.
4. The triple diagram generator of claim 3 , further comprising:
sequence numbers associated with the communication lines, wherein the set of one or more sentences is ordered according to the sequence numbers associated with the communication lines.