IP Library › Granted Patent US 12,248,757
Granted Patent B2
US 12,248,757 · App. 18/184,852 · Granted Mar 11, 2025

Transforming content to support neurodivergent comprehension of the content

Inventors: Natalia Russi-Vigoya (Round Rock, TX); Jennifer M. Hatfield (San Francisco, CA); Jill S. Dhillon (Jupiter, FL); Juhi Bharat (Highland Park, NJ); Joshua Totte (Santa Monica, CA)
Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
G06F40/42G06F40/166
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,248,757
App. No.
18/184,852
Granted
Mar 11, 2025
Kind
B2
Abstract

An embodiment for a method of supporting neurodivergent comprehension of content by proactively identifying and transforming predicted difficult comprehension areas for a given user. The embodiment may receive an activation command from a registered user. The embodiment may automatically identify, within displayed content, predicted difficult comprehension areas based on a series of preferences and behaviors associated with the registered user. The embodiment may mark a textual element associated with the predicted difficult comprehension areas that may be transformed to improve comprehensibility of the predicted difficult comprehension areas for the registered user. The embodiment may detect user interaction with the marked textual element. The embodiment may, in response to detecting user interaction with the marked textual element, transform the marked textual element and provide transformed content to the registered user.

Claims (63)

1. A computer-based method of supporting neurodivergent comprehension of content comprising:

retrieving responses to a questionnaire, the retrieved responses including a series of reading preferences and behaviors associated with a registered user;

receiving an activation command from the registered user;

automatically identifying, within displayed content, predicted difficult comprehension areas using a pre-trained natural language processing model based on the series of reading preferences and behaviors associated with the registered user;

marking a textual element associated with the predicted difficult comprehension areas that may be transformed to improve comprehensibility of the predicted difficult comprehension areas for the registered user;

detecting user interaction with the marked textual element;

in response to detecting user interaction with the marked textual element, transforming the marked textual element to address the predicted difficult comprehension areas based on the series of reading preferences and behaviors associated with the registered user;

in response to transforming the marked textual element, providing transformed content and an associated feedback questionnaire to the registered user; and

gathering feedback from the registered user in response to one or more prompts included in the associated feedback questionnaire, wherein the one or more prompts request a numerical rating from the registered user, and are related to the provided transformed content and features of a specific transformation applied to the marked textual element, storing the feedback, wherein the pre-trained natural language processing model is retrained based on the stored feedback to identify and transform additional difficult comprehension areas specific to the registered user.

2. The computer-based method of claim 1 , further comprising:

storing the retrieved series of reading preference and behaviors associated with the registered user in an accessible repository.

3. The computer-based method of claim 1 , wherein automatically identifying, within the displayed content, the predicted difficult comprehension areas based on the series of preferences and behaviors associated with the registered user further comprises:

processing the displayed content using the pre-trained natural language processing model and machine learning algorithms to identify the predicted difficult comprehension areas based on the series of preferences and behaviors associated with the registered user.

4. The computer-based method of claim 1 , wherein the detected user interaction comprises the registered user clicking on the marked textual element, and wherein transforming the marked textual elements comprises at least one of word simplifications, alternative transformed content modalities, layout transformations, font transformations, style transformations, input from external learning disorder applications, input from publicly available learning disorder websites, and summarizations.

5. The computer-based method of claim 1 , further comprising:

in response to receiving the activation command, generating and outputting a notification to the registered user; and

converting a cursor to a predetermined custom cursor.

6. The computer-based method of claim 1 , wherein automatically identifying the predicted difficult comprehension areas further comprises:

processing a displayed text of the displayed content using the pre-trained natural language processing model; and

displaying using one or more visual indicators the predicted difficult comprehension areas within the displayed text of the displayed content to the registered user.

7. The computer-based method of claim 6 , wherein the one or more visual indicators includes at least highlighting one or more words within the displayed text for which simplified synonyms are available.

8. The computer-based method of claim 1 , marking the textual element associated with the predicted difficult comprehension areas, further comprises:

demarcating, within the displayed content, each textual element within the predicted difficult comprehension areas for which a corresponding transformation is available to the registered user, wherein the demarcating includes at least underlining each of the textual elements.

9. The computer-based method of claim 8 , wherein the corresponding transformation directly corresponds to the responses to the questionnaire retrieved for the registered user.

10. A computer system, the computer system comprising:

one or more processors, one or more computer-readable memories, one or more computer-readable tangible storage medium, and program instructions stored on at least one of the one or more computer-readable tangible storage medium for execution by at least one of the one or more processors via at least one of the one or more computer-readable memories, wherein the computer system is capable of performing a method comprising:

retrieving responses to a questionnaire, the retrieved responses including a series of reading preferences and behaviors associated with a registered user;

receiving an activation command from the registered user;

automatically identifying, within displayed content, predicted difficult comprehension areas using a pre-trained natural language processing model based on the series of reading preferences and behaviors associated with the registered user;

marking a textual element associated with the predicted difficult comprehension areas that may be transformed to improve comprehensibility of the predicted difficult comprehension areas for the registered user;

detecting user interaction with the marked textual element;

in response to detecting user interaction with the marked textual element, transforming the marked textual element to address the predicted difficult comprehension areas based on the series of reading preferences and behaviors associated with the registered user;

in response to transforming the marked textual element, providing transformed content and an associated feedback questionnaire to the registered user; and

gathering feedback from the registered user in response to one or more prompts included in the associated feedback questionnaire, wherein the one or more prompts request a numerical rating from the registered user, and are related to the provided transformed content and features of a specific transformation applied to the marked textual element, storing the feedback, wherein the pre-trained natural language processing model is retrained based on the stored feedback to identify and transform additional difficult comprehension areas specific to the registered user.

11. The computer system of claim 10 , further comprising:

storing the retrieved series of reading preference and behaviors associated with the registered user in an accessible repository.

12. The computer system of claim 10 , wherein automatically identifying, within the displayed content, the predicted difficult comprehension areas based on the series of preferences and behaviors associated with the registered user further comprises:

processing the displayed content using the pre-trained natural language processing model and machine learning algorithms to identify the predicted difficult comprehension areas based on the series of preferences and behaviors associated with the registered user.

13. The computer system of claim 10 , wherein the detected user interaction comprises the registered user clicking on the marked textual element, and wherein transforming the marked textual elements comprises at least one of word simplifications, alternative transformed content modalities, layout transformations, font transformations, style transformations, input from external learning disorder applications, input from publicly available learning disorder websites, and summarizations.

14. The computer system of claim 10 , further comprising:

in response to receiving the activation command, generating and outputting a notification to the registered user; and

converting a cursor to a predetermined custom cursor.

15. The computer system of claim 10 , wherein automatically identifying the predicted difficult comprehension areas further comprises:

processing a displayed text of the displayed content using the pre-trained natural language processing model; and

displaying using one or more visual indicators the predicted difficult comprehension areas within the displayed text of the displayed content to the registered user.

16. A computer program product, the computer program product comprising:

one or more computer-readable tangible storage medium and program instructions stored on at least one of the one or more computer-readable tangible storage medium, the program instructions executable by a processor capable of performing a method, the method comprising:

retrieving responses to a questionnaire, the retrieved responses including a series of reading preferences and behaviors associated with a registered user;

receiving an activation command from the registered user;

automatically identifying, within displayed content, predicted difficult comprehension areas using a pre-trained natural language processing model based on the series of reading preferences and behaviors associated with the registered user;

marking a textual element associated with the predicted difficult comprehension areas that may be transformed to improve comprehensibility of the predicted difficult comprehension areas for the registered user;

detecting user interaction with the marked textual element;

in response to detecting user interaction with the marked textual element, transforming the marked textual element to address the predicted difficult comprehension areas based on the series of reading preferences and behaviors associated with the registered user;

in response to transforming the marked textual element, providing transformed content and an associated feedback questionnaire to the registered user; and

gathering feedback from the registered user in response to one or more prompts included in the associated feedback questionnaire, wherein the one or more prompts request a numerical rating from the registered user, and are related to the provided transformed content and features of a specific transformation applied to the marked textual element, storing the feedback, wherein the pre-trained natural language processing model is retrained based on the stored feedback to identify and transform additional difficult comprehension areas specific to the registered user.

17. The computer program product of claim 16 , further comprising:

storing the retrieved series of reading preference and behaviors associated with the registered user in an accessible repository.

18. The computer program product of claim 16 , wherein automatically identifying, within the displayed content, the predicted difficult comprehension areas based on the series of preferences and behaviors associated with the registered user further comprises:

processing the displayed content using the pre-trained natural language processing model and machine learning algorithms to identify the predicted difficult comprehension areas based on the series of preferences and behaviors associated with the registered user.

19. The computer program product of claim 16 , wherein the detected user interaction comprises the registered user clicking on the marked textual element, and wherein transforming the marked textual elements comprises at least one of word simplifications, alternative transformed content modalities, layout transformations, font transformations, style transformations, input from external learning disorder applications, input from publicly available learning disorder websites, and summarizations.

20. The computer program product of claim 16 , wherein automatically identifying the predicted difficult comprehension areas further comprises:

processing a displayed text of the displayed content using the pre-trained natural language processing model; and

displaying using one or more visual indicators the predicted difficult comprehension areas within the displayed text of the displayed content to the registered user.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 16, 2023
From: RUSSI-VIGOYA, NATALIA; HATFIELD, JENNIFER M.; DHILLON, JILL S.; BHARAT, JUHI; TOTTE, JOSHUA
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 063001/0568 →
Continuity (1)
Related Publication 20240311583A1 · Sep 19, 2024
References Cited (40)
US 7779354B2 · Ashcraft · 2010 [cited by applicant]
US 8731905B1 · Tsang · 2014 [cited by examiner]
US 10108902B1 · Lockett · 2018 [cited by applicant]
US 10387565B2 · Hoover · 2019 [cited by applicant]
US 10915697B1 · Guliak · 2021 [cited by applicant]
US 11270603B1 · Bansal · 2022 [cited by examiner]
US 11631400B2 · Lee · 2023 [cited by examiner]
US 11972211B1 · Singh · 2024 [cited by examiner]
US 20070150801A1 · Chidlovskii · 2007 [cited by applicant]
US 20080228749A1 · Brown · 2008 [cited by applicant]
US 20100190143A1 · Gal · 2010 [cited by examiner]
US 20170169120A1 · Neff · 2017 [cited by applicant]
US 20190114300A1 · Miltsakaki · 2019 [cited by applicant]
US 20190140995A1 · Roller · 2019 [cited by examiner]
US 20200118542A1 · Larson · 2020 [cited by examiner]
US 20200159986A1 · Djamasbi · 2020 [cited by applicant]
US 20220188514A1 · Thota · 2022 [cited by examiner]
WO 2022174804A1 · 2022 [cited by applicant]
Paulino et al., “Modelling Aspects of Cognitive Personalization in Microtask Design: Feasibility and Reproducibility Study with Neurodivergent People,” 2024 27th International Conference on Computer Supported Cooperativ… [cited by examiner]
Walkowiak, “Neurodiversity of the workforce and digital transformation: The case of inclusion of autistic workers at the workplace,” Technological Forecasting & Social Change 168 (2021), pp. 1-11. (Year: 2021). [cited by examiner]
Austin Learning Solutions, “Dyslexia Facts and Statistics”, https://austinlearningsolutions.com/blog/38-dyslexia-facts-and-statistics, [Accessed on Feb. 27, 2023], 5 Pages. [cited by applicant]
Disclosed Anonymously, “Method and system for Providing Personalized Content by Adapting to Learning Style of a User”, IP.com, IPCOM000252383D, Jan. 5, 2018, 3 Pages. [cited by applicant]
Disclosed Anonymously, “PM Session : The system of listening HTML content (Web Player)”, IP.com, IPCOM000193265D, Feb. 17, 2010, 3 Pages. [cited by applicant]
Disclosed Anonymously, “Machine Translation of Detailed Technical Language into Reading Level-Appropriate Language”, IP.com, IPCOM000253217D, Mar. 14, 2018, 4 Pages. [cited by applicant]
Disclosed Anonymously, “System and Method for Better Reading and Understanding in an EReader,” IP.com, IPCOM000240249D, Jan. 15, 2015, 3 Pages. [cited by applicant]
Disclosed Anonymously, “Text adjustment to help people with learning disabilities,” IP.com, IPCOM000028740D, May 28, 2004, 3 Pages. [cited by applicant]
Dyslexia Help, “Support for Dyslexics and Web Resources”, http://dyslexiahelp.umich.edu/tools/informational-websites, [Accessed on Feb. 27, 2023], 4 Pages. [cited by applicant]
Easy Reading, “Keeping the user at the digital original”, https://www.easyreading.eu/, [Accessed on Feb. 27, 2023], 6 pages. [cited by applicant]
Google Play, Gboard—the Google Keyboard, Google LLC, https://play.google.com/store/apps/details?id=com.google.android.inputmethod.latin&hl=en_US&gl=US, [Accessed on Feb. 27, 2023, 4 pages. [cited by applicant]
Grammarly, “Great Writing, Simplified”, https://www.grammarly.com/, [Accessed on Feb. 27, 2023], 6 pages. [cited by applicant]
Helperbird, “One extension for Accessibility”, https://www.helperbird.com/, [Accessed on Feb. 27, 2023], 21 pages. [cited by applicant]
IBM, “IBM AbilityLab Content Clarifier”, https://www.IBM.com/able/content-clarifier.html, [Accessed on Feb. 27, 2023], 4 Pages. [cited by applicant]
Institute of Multisensory Education, “12 Famous People Who Struggled With Dyslexia Before Changing the World”, https://journal.imse.com/12-famous-people-who-struggled-with-dyslexia-before-changing-the-world/, Nov. 21, 2… [cited by applicant]
Knebel, “Dyslexia reading strategies for students”, https://www.readandspell.com/us/dyslexia-reading-strategies, [Accessed on Feb. 27, 2023], 7 pages. [cited by applicant]
Liebenberg, “Lexico: A Dyslexia Reading Aid”, https://apps.apple.com/us/app/lexico-a-dyslexia-reading-aid/d1375659541, [Accessed on Feb. 27, 2023] 3 Pages. [cited by applicant]
Mather, et al., “Dyslexia Around the World: A Snapshot”, ResearchGate, Jan. 2020, 18 Pages. https://www.researchgate.net/publication/338910143_Dyslexia_Around_the_World_A_Snapshot. [cited by applicant]
Microsoft, “Microsoft SwiftKey Keyboard” https://www.microsoft.com/en-us/swiftkey?activetab=pivot_1:primaryr2, [Accessed on Feb. 27, 2023], 8 Pages. [cited by applicant]
Reynolds et al., “I'm Never Happy with What I Write”: Challenges and Strategies of People with Dyslexia on Social Media, Twelfth International AAAI Conference on Web and Social Media (ICWSM 2018), 10 Pages. [cited by applicant]
Speechify, The #1 Text to Speech Reader https://speechify.com/, [Accessed on Feb. 27, 2023], 14 Pages. [cited by applicant]
Stanley, “Two-Part Stimulus Integration and Specific Reading Disability”, Perceptual and Motor Skills, 1975, pp. 873-874. [cited by applicant]