UNICODE BASED ESTIMATION OF TEXT INTELLIGIBILITY
A system and method for estimating text intelligibility for content provided by a computing resource. A method includes obtaining a text object from a computing resource, the object being configurable for display on at least one client device. Analyzing the text object for intelligibility, including: applying a weight to each character in the text object based on modeled Unicode weights, the modeled Unicode weights being determined from an analysis of a set of domain resources; determining a total weight for the text object based on the weight applied to each character; determining a viability rate for words in the text object; and generating an intelligibility analysis for the text object based on the total weight and viability rate; and effectuating an operational change at the computing resource based on the intelligibility analysis.
1 . A computerized method, comprising:
obtaining a text object from a computing resource, the object being configurable for display on at least one client device;
analyzing the text object for intelligibility, including:
applying a weight to each character in the text object based on modeled Unicode weights, the modeled Unicode weights being determined from an analysis of a set of domain resources;
determining a total weight for the text object based on the weight applied to each character;
determining a viability rate for words in the text object; and
generating an intelligibility analysis for the text object based on the total weight and viability rate; and
effectuating an operational change at the computing resource based on the intelligibility analysis.
2 . The method of claim 1 , wherein the computing resource includes at least one of a web server or an app server.
3 . The method of claim 1 , wherein the modeled Unicode weights are determined with a machine learning algorithm.
4 . The method of claim 1 , wherein the modeled Unicode weights include:
a first weight assigned to a first set of Unicode characters determined to have a first usage rate;
a second weight assigned to a second set of Unicode characters determined to have a second usage rate;
a third weight assigned to a third set of Unicode characters determined to have a third usage rate; and
a fourth weight assigned to a fourth set of Unicode characters determined to have a fourth usage rate.
5 . The method of claim 1 , wherein the total weight of the text object is an average of all weights applied to the characters in the text object.
6 . The method of claim 1 , wherein the viability rate for words in the text object is determined by:
randomly selecting a set of characters in the text object;
evaluating characters adjacent each selected character to judge whether a word or phrase can be formed using each selected character;
generating the viability rate based on a number of selected characters that are judged to form words or phrases.
7 . The method of claim 1 , wherein the intelligibility analysis includes:
determining each language used in the text object; and
calculating a separate viability rate for each language.
8 . The method of claim 1 , wherein the operational change effectuating at the computing resource includes altering a display output to the at least one client device to inform a user of a potential intelligibility issue.
9 . The method of claim 1 , wherein the operational change effectuating at the computing resource includes outputting an alert condition to an administrator of the computing resource.
10 . The method of claim 1 , wherein the set of domain resources share a common domain with the computing resource, the common domain being selected from a group consisting of: a web portal, a business, an industry, a technology area, a social media platform, a field of endeavor, an enterprise, a government agency, and an industry.
11 . A computing system, comprising:
a memory; and
a processor coupled to the memory and configured to analyze a text object from a computing resource for intelligibility according to a process that includes:
applying a weight to each character in the text object based on modeled Unicode weights, the modeled Unicode weights being determined from an analysis of a set of domain resources;
determining a total weight for the text object based on the weight applied to each character;
determining a viability rate for words in the text object;
generating an intelligibility analysis for the text object based on the total weight and viability rate;
effectuating an operational change at the computing resource based on the intelligibility analysis.
12 . The system of claim 11 , wherein the computing resource includes at least one of a web server or an app server.
13 . The system of claim 11 , wherein the modeled Unicode weights are determined with a machine learning algorithm.
14 . The system of claim 11 , wherein the modeled Unicode weights include:
a first weight assigned to a first set of Unicode characters determined to have a first usage rate;
a second weight assigned to a second set of Unicode characters determined to have a second usage rate;
a third weight assigned to a third set of Unicode characters determined to have a third usage rate; and
a fourth weight assigned to a fourth set of Unicode characters determined to have a fourth low usage rate.
15 . The system of claim 11 , wherein the total weight of the text object is an average of all weights applied to the characters in the text object.
16 . The system of claim 11 , wherein the viability rate for words in the text object is determined by:
randomly selecting a set of characters in the text object;
evaluating characters adjacent each selected character to judge whether a word or phrase can be formed using each selected character; and
generating the viability rate based on a number of selected characters that are judged to form words or phrases.
17 . The system of claim 11 , wherein determining the viability rate includes:
determining each language used in the text object; and
calculating a separate viability rate for each language.
18 . The system of claim 11 , wherein the operational change effectuating at the computing resource includes altering a display output to at least one client device to inform a user of a potential intelligibility issue.
19 . The system of claim 11 , wherein the operational change effectuating at the computing resource includes outputting an alert condition to an administrator of the computing resource.
20 . The system of claim 11 , wherein the set of domain resources share a common domain with the computing resource, the common domain being selected from a group consisting of: a web portal, a business, an industry, a technology area, a social media platform, a field of endeavor, an enterprise, a government agency, and an industry.