IP Library › Granted Patent US 12,406,655
Granted Patent B2
US 12,406,655 · App. 17/664,260 · Granted Sep 2, 2025

Increased accessibility of synthesized speech by replacement of difficulty to understand words

Inventors: Grzegorz Piotr Szczepanik (Cracow, PL); Piotr Kalandyk (Zielonki, PL); Łukasz Józef Matyasik (Cracow, PL); Piotr Jan Kotara (Jodłownik, PL)
Assignee: International Business Machines Corporation
G10L13/08G06F40/166G06F40/247G10L13/047
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,406,655
App. No.
17/664,260
Granted
Sep 2, 2025
Kind
B2
Abstract

A method, computer program, and computer system are provided for improving accessibility to computer reader tools. Data corresponding to one or more words to be displayed to a user is received. The received data is converted into synthesized speech. One or more words exceeding an understanding threshold value are identified from the synthesized speech. The understanding threshold value corresponds to a probability of difficulty associated with understanding the one or more words. One or more replacement words are retrieved for the one or more words exceeding the understanding threshold value. The synthesized speech is updated with the one or more replacement words.

Claims (38)

1. A method of improving accessibility to computer reader tools, the method executable by a processor and comprising:

receiving data corresponding to one or more words to be displayed to a user;

filtering the received data to remove numbers, proper nouns, and non-standard characters;

converting the filtered data into synthesized speech;

identifying, from the synthesized speech, one or more words exceeding an understanding threshold value, the understanding threshold value corresponding to a probability of difficulty associated with understanding the one or more words, wherein the identifying comprises a neural network processing the synthesized speech and identifying a confidence score associated with each word within the synthesized speech;

retrieving one or more replacement words for the one or more words exceeding the understanding threshold value, wherein the one or more replacement words are synonyms retrieved from an electronic thesaurus;

updating the synthesized speech with the one or more replacement words, wherein the updating comprises generating a new waveform of updated synthesized speech with the one or more replacement words;

generating a report indicating the one or more words and the one or more replacement words, wherein the report comprises an audio file;

updating, via the neural network, the understanding threshold value based on the report; and

playing the updated synthesized speech and the report to the user.

2. The method of claim 1 , wherein the report includes an explanation corresponding to the probability of difficulty associated with understanding the one or more words.

3. The method of claim 2 , wherein the explanation corresponding to the probability of difficulty associated with understanding the one or more words includes the one or more words being homophones or homographs of other words.

4. A computer system for improving accessibility to computer reader tools, the computer system comprising:

one or more computer-readable non-transitory storage media configured to store computer program code; and

one or more computer processors configured to access said computer program code and operate as instructed by said computer program code, said computer program code including:

receiving code configured to cause the one or more computer processors to receive data corresponding to one or more words to be displayed to a user;

filtering code configured to cause the one or more computer processors to filter the received data to remove numbers, proper nouns, and non-standard characters;

converting code configured to cause the one or more computer processors to convert the filtered data into synthesized speech;

identifying code configured to cause the one or more computer processors to identify, from synthesized speech, one or more words exceeding an understanding threshold value, the understanding threshold value corresponding to a probability of difficulty associated with understanding the one or more words, wherein the identifying comprises a neural network processing the synthesized speech and identifying a confidence score associated with each word within the synthesized speech;

retrieving code configured to cause the one or more computer processors to retrieve one or more replacement words for the one or more words exceeding the understanding threshold value, wherein the one or more replacement words are synonyms retrieved from an electronic thesaurus;

updating code configured to cause the one or more computer processors to update the synthesized speech with the one or more replacement words, wherein the updating comprises generating a new waveform of updated synthesized speech with the one or more replacement words;

generating a report indicating the one or more words and the one or more replacement words, wherein the report comprises an audio file;

updating code configured to cause the one or more computer processors to update, via the neural network, the understanding threshold value based on the report; and

playing code configured to cause the one or more computer processors to play the updated synthesized speech and the report to the user.

5. The computer system of claim 4 , wherein the report includes an explanation corresponding to the probability of difficulty associated with understanding the one or more words.

6. The computer system of claim 5 , wherein the explanation corresponding to the probability of difficulty associated with understanding the one or more words includes the one or more words being homophones or homographs of other words.

7. A non-transitory computer readable medium having stored thereon a computer program for improving accessibility to computer reader tools, the computer program configured to cause one or more computer processors to:

receive data corresponding to one or more words to be displayed to a user;

filter the received data to remove numbers, proper nouns, and non-standard characters;

convert the filtered data into synthesized speech;

identify, from synthesized speech, one or more words exceeding an understanding threshold value, the understanding threshold value corresponding to a probability of difficulty associated with understanding the one or more words, wherein the identifying comprises a neural network processing the synthesized speech and identifying a confidence score associated with each word within the synthesized speech;

retrieve one or more replacement words for the one or more words exceeding the understanding threshold value, wherein the one or more replacement words are synonyms retrieved from an electronic thesaurus;

update the synthesized speech with the one or more replacement words, wherein the update comprises generating a new waveform of updated synthesized speech with the one or more replacement words;

generating a report indicating the one or more words and the one or more replacement words, wherein the report comprises an audio file;

updating, via the neural network, the understanding threshold value based on the report; and

play the updated synthesized speech and the report to the user.

8. The computer readable medium of claim 7 , wherein the report includes an explanation corresponding to the probability of difficulty associated with understanding the one or more words.

9. The computer readable medium of claim 8 , wherein the explanation corresponding to the probability of difficulty associated with understanding the one or more words includes the one or more words being homophones or homographs of other words.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 20, 2022
From: SZCZEPANIK, GRZEGORZ PIOTR; KALANDYK, PIOTR; MATYASIK, LUKASZ JOZEF; KOTARA, PIOTR JAN
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 059970/0346 →
Continuity (1)
Related Publication 20230377559A1 · Nov 23, 2023
References Cited (28)
US 4923314A · Blanchard, Jr. · 1990 [cited by examiner]
US 9336204B1 · Amundsen · 2016 [cited by examiner]
US 10140973B1 · Dalmia · 2018 [cited by applicant]
US 10599767B1 · Mattera · 2020 [cited by examiner]
US 20050060155A1 · Chu · 2005 [cited by examiner]
US 20060111911A1 · Morford · 2006 [cited by examiner]
US 20070233461A1 · Fasciani · 2007 [cited by examiner]
US 20100250254A1 · Mizutani · 2010 [cited by examiner]
US 20110246199A1 · Nishiyama · 2011 [cited by examiner]
US 20130080172A1 · Talwar · 2013 [cited by examiner]
US 20130080173A1 · Talwar · 2013 [cited by examiner]
US 20140025381A1 · Wang · 2014 [cited by examiner]
US 20140257815A1 · Zhao · 2014 [cited by applicant]
US 20150046148A1 · Oh · 2015 [cited by examiner]
US 20150120293A1 · Wohlert · 2015 [cited by examiner]
US 20150310002A1 · Yu · 2015 [cited by examiner]
US 20170221472A1 · Sharifi · 2017 [cited by examiner]
US 20190042556A1 · Anders · 2019 [cited by examiner]
US 20190114300A1 · Miltsakaki · 2019 [cited by examiner]
US 20190295527A1 · Pore · 2019 [cited by applicant]
US 20200184017A1 · Batra · 2020 [cited by examiner]
US 20200380075A1 · Boada · 2020 [cited by examiner]
US 20210142779A1 · Sharifi · 2021 [cited by applicant]
US 20210266473A1 · Engelke · 2021 [cited by examiner]
US 20220059071A1 · Pearce · 2022 [cited by examiner]
US 20220138422A1 · Kulkarni · 2022 [cited by examiner]
US 20220284045A1 · Saha · 2022 [cited by examiner]
Mell et al., “The NIST Definition of Cloud Computing”, National Institute of Standards and Technology, Special Publication 800-145, Sep. 2011, pp. 1-7. [cited by applicant]