IP Library › Granted Patent US 12,614,472
Granted Patent B2
US 12,614,472 · App. 17/920,300 · Granted Apr 28, 2026

Systems and methods for accessible computer-user scenarios

Inventor: Rebecca Kantar (Truro, MA)
Assignee: Roblox Corporation
G09B21/007G06F3/016G09B7/00G09B7/02G09B9/00G10L13/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,614,472
App. No.
17/920,300
Granted
Apr 28, 2026
Kind
B2
Abstract

Implementations described herein relate to methods, systems, and computer-readable media for accessible computer-user scenarios. For example, a method can include displaying a graphical user interface on a display screen. The graphical user interface includes a virtual assessment, the virtual assessment is representative of an assessment examination, and the graphical user interface further comprises a graphical region that represents a portion of a logical problem of the assessment examination. The method can also include determining placement and/or alignment of an embossed screen overlay that allows a visually-disabled person to interact with the computer.

Claims (66)

1 . A computer-implemented method of accessible computer-user scenarios, the method comprising:

displaying a graphical user interface on a display screen, wherein the graphical user interface comprises a virtual assessment, wherein the virtual assessment is representative of an assessment examination, and wherein the graphical user interface further comprises a graphical region that represents a portion of a logical problem of the assessment examination;

receiving a first signal indicative of placement of a first physical overlay onto the display screen, wherein the first physical overlay comprises an embossed inner region that includes at least one or more of: texture that represents edges of the graphical region, features identifiable by touch that represent edges of the graphical region, or braille embossing that describes at least a portion of the graphical region;

determining, based on the first signal, that the first physical overlay is at least partially aligned with the graphical region;

receiving and storing computer-user interactions between a user that physically interacts with the at least partially aligned first physical overlay and the graphical user interface;

determining that an incorrect overlay was provided based on selection by the user of a portion of the graphical user interface that does not correspond to any components of the graphical user interface;

responsive to determining that the incorrect overlay was provided, audibly prompting a request for confirmation that the first physical overlay corresponds to the graphical user interface;

based on the computer-user interactions, audibly prompting for replacement of the first physical overlay with another physical overlay; and

generating a portion of an assessment score based on the stored computer-user interactions.

2 . The computer-implemented method of claim 1 , wherein the another physical overlay is a second physical overlay, wherein the graphical region is a first graphical region, and wherein the method further comprises:

generating a second graphical region in the graphical user interface;

determining that the second physical overlay is at least partially aligned with the second graphical region;

receiving and storing additional computer-user interactions between the user that physically interacts with the at least partially aligned second physical overlay and the graphical user interface; and

generating a complete assessment score based on the stored computer-user interactions and the additional computer-user interactions.

3 . The computer-implemented method of claim 1 , wherein the first overlay includes an indicator that does not correspond to an indicator being displayed on the graphical user interface.

4 . The computer-implemented method of claim 1 , wherein the graphical user interface further comprises one or more instructional elements comprising indicia that represent instructions to complete the virtual assessment, and wherein the first physical overlay comprises one or more braille embossments that represent the indicia.

5 . The computer-implemented method of claim 4 , further comprising:

generating an audio file using a speech synthesizer, wherein the audio file comprises one or more segments of synthesized speech of the instructions to complete the virtual assessment; and

audibly playing the audio file.

6 . The computer-implemented method of claim 1 , further comprising:

generating an audio file using a speech synthesizer, wherein the audio file comprises one or more segments of synthesized speech that describe the logical problem; and

audibly playing the audio file responsive to receiving the first signal.

7 . The computer-implemented method of claim 1 , further comprising:

generating an audio file using a speech synthesizer, wherein the audio file comprises one or more segments of synthesized speech that describe the graphical region; and

audibly playing the audio file responsive to determining that the first physical overlay is at least partially aligned with the graphical region.

8 . The computer-implemented method of claim 1 , further comprising:

responsive to audibly prompting the request for confirmation, receiving a second signal indicative of placement of a second physical overlay onto the display screen;

receiving and storing additional computer-user interactions between the user that physically interacts with the second physical overlay and the graphical user interface; and

generating a complete assessment score based on the stored computer-user interactions and the additional computer-user interactions.

9 . The computer-implemented method of claim 1 , further comprising periodically audibly playing synthesized speech that describes a state of the virtual assessment.

10 . The computer-implemented method of claim 1 , further comprising periodically applying haptic feedback responsive to the computer-user interactions.

11 . A system of accessible computer-user scenarios, the system comprising:

a display device configured to display a graphical user interface, wherein the graphical user interface comprises a virtual assessment, wherein the virtual assessment is representative of an assessment examination, and wherein the graphical user interface further comprises a graphical region that represents a portion of a logical problem of the assessment examination;

a memory with instructions stored thereon; and

a processing device, coupled to the memory and to the display device, wherein the processing device is configured to access the memory and execute the instructions, and wherein the instructions, in response to execution by the processing device, cause the processing device to perform or control performance of operations comprising:

receiving a first signal indicative of placement of a first physical overlay onto the display device, wherein the first physical overlay comprises an embossed inner region that includes at least one or more of: texture that represents edges of the graphical region, features identifiable by touch that represent edges of the graphical region, or braille embossing that describes at least a portion of the graphical region;

determining, based on the first signal, that the first physical overlay is at least partially aligned with the graphical region;

receiving and storing computer-user interactions between a user that physically interacts with the at least partially aligned first physical overlay and the graphical user interface;

determining that an incorrect overlay was provided based on selection by the user of a portion of the graphical user interface that does not correspond to any components of the graphical user interface;

responsive to determining that the incorrect overlay was provided, audibly prompting a request for confirmation that the first physical overlay corresponds to the graphical user interface;

based on the computer-user interactions, audibly prompting for replacement of the first physical overlay with another physical overlay; and

generating a portion of an assessment score based on the stored computer-user interactions.

12 . The system of claim 11 , wherein the operations further include:

responsive to audibly prompting the request for confirmation, receiving a second signal indicative of placement of a second physical overlay onto the display device;

receiving and storing additional computer-user interactions between the user that physically interacts with the second physical overlay and the graphical user interface; and

generating a complete assessment score based on the stored computer-user interactions and the additional computer-user interactions.

13 . The system of claim 11 , further comprising an embossing or Braille printing apparatus configured to physically print one or more copies of the first physical overlay.

14 . The system of claim 13 , wherein the operations further comprise:

generating a data file representative of a printing sequence of a copy of the first physical overlay; and

transmitting the data file to the embossing or Braille printing apparatus.

15 . The system of claim 11 , wherein the another physical overlay is a second physical overlay, wherein the graphical region is a first graphical region, and wherein the operations further comprise:

generating a second graphical region in the graphical user interface;

determining that the second physical overlay is at least partially aligned with the second graphical region;

receiving and storing additional computer-user interactions between the user that physically interacts with the at least partially aligned second physical overlay and the graphical user interface; and

generating a complete assessment score based on the stored computer-user interactions and the additional computer-user interactions.

16 . The system of claim 11 , wherein the assessment examination is a test for assessment of a student or a vocational assessment examination for assessment of a vocational candidate.

17 . The system of claim 11 , wherein the graphical user interface further comprises one or more instructional elements comprising indicia that represent instructions to complete the virtual assessment, and wherein the first physical overlay comprises one or more braille embossments that represent the indicia.

18 . The system of claim 17 , wherein the operations further comprise:

generating an audio file using a speech synthesizer, wherein the audio file comprises one or more segments of synthesized speech of the instructions to complete the virtual assessment; and

audibly playing the audio file.

19 . The system of claim 11 , wherein the operations further comprise:

generating an audio file using a speech synthesizer, wherein the audio file comprises one or more segments of synthesized speech that describe the logical problem; and

audibly playing the audio file responsive to receiving the first signal.

20 . The system of claim 19 , wherein the operations further comprise:

generating an audio file using a speech synthesizer, wherein the audio file comprises one or more segments of synthesized speech that describe the graphical region; and

audibly playing the audio file responsive to determining that the first physical overlay is at least partially aligned with the graphical region.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 28, 2022
From: KANTAR, REBECCA
To: IMBELLUS, INC.
Reel/Frame 061584/0307 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 28, 2022
From: IMBELLUS, INC.
To: ROBLOX CORPORATION
Reel/Frame 061584/0328 →
Continuity (3)
Provisional Application 63013348 · Apr 21, 2020
Provisional Application 63013314 · Apr 21, 2020
Related Publication 20230196937A1 · Jun 22, 2023
References Cited (23)
US 5736978A · Haser et al. · 1998 [cited by applicant]
US 6030226A · Hersh · 2000 [cited by applicant]
US 8633907B2 · Mahalingam · 2014 [cited by applicant]
US 20020155419A1 · Banerjee · 2002 [cited by examiner]
US 20050175974A1 · Hansen · 2005 [cited by examiner]
US 20070117070A1 · Krass · 2007 [cited by applicant]
US 20090217164A1 · Beitle et al. · 2009 [cited by applicant]
US 20100182242A1 · Fields · 2010 [cited by examiner]
US 20100328231A1 · Pasquero et al. · 2010 [cited by applicant]
US 20120007809A1 · Mahalingam · 2012 [cited by applicant]
US 20120221251A1 · Rosenberg et al. · 2012 [cited by applicant]
US 20150331528A1 · Robinson · 2015 [cited by examiner]
US 20180018630A1 · Oni · 2018 [cited by applicant]
US 20190156703A1 · White · 2019 [cited by examiner]
US 20210117001A1 · Kadambi · 2021 [cited by examiner]
KR 1020120010283 · 2012 [cited by applicant]
KR 1020150063910 · 2015 [cited by applicant]
WO 2018222729 · 2018 [cited by applicant]
KIPO, Notice of Allowance (with English translation) for Korean Patent Application No. 10-2022-7040343, Oct. 14, 2024, 7 pages. [cited by applicant]
EPO, Extended European Search Report for European Patent Application No. 21792280.6, May 3, 2024, 10 pages. [cited by applicant]
KIPO, First Office Action (with English translation) for Korean Patent Application No. 10-2022-7040343, May 14, 2024, 12 pages. [cited by applicant]
USPTO, International Search Report for International Patent Application No. PCT/US2021/028411, Jul. 21, 2021, 2 pages. [cited by applicant]
USPTO, Written Opinion for International Patent Application No. PCT/US2021/028411, Jul. 21, 2021, 6 pages. [cited by applicant]