Learning-based system and process for synthesizing cursive handwriting
View Patent ↗A process and system for modeling, learning and synthesizing cursive handwriting in a user's personal handwriting style. The handwriting synthesis system and process described herein addresses the problem of learning the personal handwriting style of a user based on limited handwriting samples and producing novel scripts of the same style. The handwriting synthesis process includes segmenting handwriting samples into individual characters using a two-level writer-independent segmentation process, aligning samples of the same character into a common coordinate frame, and learning and modeling the individual character. Synthesis of handwriting is performed by generating individual letters from the models and concatenating the letters using a conditional sampling algorithm. The result is a smooth and fluid connection between letters that successfully mimics the personal handwriting style of a user.
1. A process for generating cursive handwriting, comprising:
segmenting each handwritten word in a handwriting specimen into separate characters;
learning shape characteristics of each of the characters;
building learned models of each of the characters using the learned shape characteristics;
synthesizing the cursive handwriting from the learned models; and
calculating a concatenation energy and a sampling energy of learned models of a pair of adjacent characters in the synthesized cursive handwriting to define a total energy function that is minimized to smoothly connect the adjacent characters.
2. The process as set forth in claim 1 , further comprising clustering characters having similar shape characteristics by calculating a script code for each of the characters.
3. The process as set forth in claim 1 , further comprising decomposing the characters into point vectors and extracting the point vectors.
4. The process as set forth in claim 3 , further comprising learning parameters of the shape characteristics.
5. One or more computer-readable media having computer-readable instructions thereon which, when executed by one or more processors, cause the one or more processors to implement the method of claim 1 .
6. A handwriting synthesis system, comprising:
a segmentation module that segments a handwriting sample into training samples of individual characters;
a learning module that builds learned models of each handwritten character using the training samples, the learning module further comprising:
an alignment module that takes the training samples and normalizes and aligns point vectors for each training sample; and
a modeling module that takes the aligned point vectors and learns shape characteristics of each individual character using statistical analysis such that statistical parameters are determined for the shape characteristics;
a synthesis module that synthesizes handwriting using the learned models, the synthesis module further comprising:
a concatenation module that joins synthesized characters with neighboring characters as necessary to form text and words of synthesized handwriting, the concatenation module further comprising:
a concatenation energy module that calculates a concatenation energy of a synthesized word;
a sampling energy module that calculates a sampling energy to ensure that a deformed synthesized character is consistent with a model of that individual character; and
an energy minimization module that minimizes a total energy of the combined concatenation and sampling energies to determine a point of connection of a synthesized character to its neighbors.