IP Library Granted Patent US 11,029,815
Granted Patent B1
US 11,029,815 · App. 17/169,265 · Granted Jun 8, 2021

Modular systems and methods for selectively enabling cloud-based assistive technologies

Inventors: Sean D. Bradley (Tucson, AZ); Mark D. Baker (Marietta, GA); Jeffrey O. Jones (Mountain Park, GA); Kenny P. Hefner (Buchanan, GA); Adam Finkelstein (Alpharetta, GA); Douglas J. Gilormo (Cumming, GA); Taylor R. Bodnar (Tucson, AZ); David C. Pinckney (Roswell, GA); Charlie E. Blevins (Atlanta, GA); Trevor C. Jones (Kennesaw, GA); Helena Laymon (Duluth, GA)
Assignee: AudioEye, Inc.
G06F3/04817G06F3/0482G06F3/167G06F40/117G06F40/14G06F40/143G10L13/027G10L15/22G10L15/26H04L67/22G10L13/02G10L2015/221H04L67/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,029,815
App. No.
17/169,265
Granted
Jun 8, 2021
Kind
B1
Abstract

Methods and systems for manual and programmatic remediation of websites. JavaScript code is accessed by a user device and optionally calls TTS, ASR, and RADAE modules from a remote server to thereby facilitate website navigation by people with diverse abilities.

Claims (42)

1. A web page remediation computer-implemented method of programmatically assigning a descriptive HTML attribute to an untagged element on a web page to enable an audible description of the untagged element, the web page having an associated document object model (DOM), the computer-implemented method comprising:

dynamically analyzing, by a computer system, code associated with the web page, the code comprising at least the DOM or HTML code;

detecting one or more compliance issues relating to web accessibility standards in the code, wherein at least one of the one or more compliance issues comprises the untagged element lacking an adequate descriptive HTML attribute;

applying one or more pre-existing remediations to the one or more compliance issues, wherein the one or more pre-existing remediations is generated by a remote server system performing at least:

analyzing, by the remote server system, the untagged element to determine a subject matter associated with the untagged element;

generating, by the remote server system, a descriptive HTML attribute to be associated with the untagged element based on the determined subject matter of the untagged element; and

periodically analyzing, by the remote server system, the code associated with the web page to assess validity of the assigned descriptive HTML attribute;

assigning, by the computer system, the generated descriptive HTML attribute to the untagged element in the code of the web page, the descriptive HTML attribute assigned to the untagged element adapted to enable an assistive technology to speak the descriptive attribute to a user;

receiving, by the computer system, a first user input; and

displaying, by the computer system, based on the first user input a dynamic user interface concurrently with the web page to the user, wherein the dynamic user interface enables the user to manage remediations on the web page, wherein receiving a second user input by the computer system causes the dynamic user interface to disappear.

2. The computer-implemented method of claim 1 , wherein the first user input comprises a predetermined key combination.

3. The computer-implemented method of claim 1 , wherein the first user input comprises a mouse click on an icon displayed in the web page.

4. The computer-implemented method of claim 1 , wherein the one or more pre-existing remediations are javascript.

5. The computer-implemented method of claim 1 , wherein the untagged element is an input field.

6. The computer-implemented method of claim 1 , wherein the untagged element is an image, and the analyzing the untagged element further comprises:

accessing, by the remote server system, the image to determine the subject matter of the image;

generating the subject matter of the image by inputting the accessed image into an artificial intelligence algorithm.

7. The computer-implemented method of claim 6 , wherein the image lacks the adequate descriptive HTML attribute when one or more descriptive HTML attributes of the image are erroneous.

8. The computer-implemented method of claim 1 , wherein the assigning comprises changing the DOM or HTML code associated with the web page.

9. The computer-implemented method of claim 1 , wherein the dynamic user interface is configured to enable the user to change a font size of the web page.

10. The computer-implemented method of claim 1 , wherein the dynamic user interface enable the user to manually remediate online content of the web page by targeting at least one element of the web page.

11. A non-transitory electronic storage medium with computer code stored thereon, the computer code configured to programmatically assign a descriptive HTML attribute to an element on a web page to enable an audible description of the element, the web page having an associated document object model (DOM), and the computer code configured to perform, when executed by a computer processor, the steps of:

dynamically analyzing, by a computer system, code associated with the web page, the code comprising at least the DOM or HTML code;

detecting one or more compliance issues relating to web accessibility standards in the code, wherein at least one of the one or more compliance issues comprises the element lacking an adequate descriptive HTML attribute;

applying one or more pre-existing remediations to the one or more compliance issues, wherein the one or more pre-existing remediations is generated by a remote server system performing at least:

analyzing, by the remote server system, the element to determine a subject matter associated with the element;

generating, by the remote server system, a descriptive HTML attribute to be associated with the element based on the determined subject matter of the element; and

periodically analyzing, by the remote server system, the code associated with the web page to assess validity of the assigned descriptive HTML attribute;

assigning, by the computer system, the generated descriptive HTML attribute to the element in the code of the web page, the descriptive HTML attribute assigned to the element adapted to enable an assistive technology to speak the descriptive attribute to a user;

receiving, by the computer system, a first user input; and

displaying, by the computer system, based on the first user input a dynamic user interface concurrently with the web page to the user, wherein the dynamic user interface enables the user to manage remediations on the web page, wherein receiving a second user input by the computer system causes the dynamic user interface to disappear.

12. The non-transitory electronic storage medium with computer code stored thereon of claim 11 , wherein the first user input comprises a predetermined key combination.

13. The non-transitory electronic storage medium with computer code stored thereon of claim 11 , wherein the first user input comprises a mouse click on an icon displayed in the web page.

14. The non-transitory electronic storage medium with computer code stored thereon of claim 11 , wherein the one or more pre-existing remediations are javascript.

15. The non-transitory electronic storage medium with computer code stored thereon of claim 11 , wherein the element is an input field.

16. The non-transitory electronic storage medium with computer code stored thereon of claim 11 , wherein the element is an image, and the analyzing the element further comprises:

accessing, by the remote server system, the image to determine the subject matter of the image;

generating the subject matter of the image by inputting the accessed image into an artificial intelligence algorithm.

17. The non-transitory electronic storage medium with computer code stored thereon of claim 16 , wherein the image lacks the adequate descriptive HTML attribute when one or more descriptive HTML attributes of the image are erroneous.

18. The non-transitory electronic storage medium with computer code stored thereon of claim 11 , wherein the assigning comprises changing the DOM or HTML code associated with the web page.

19. The non-transitory electronic storage medium with computer code stored thereon of claim 11 , wherein the dynamic user interface is configured to enable the user to change a font size of the web page.

20. The non-transitory electronic storage medium with computer code stored thereon of claim 11 , wherein the dynamic user interface enable the user to manually remediate online content of the web page by targeting at least one element of the web page.

Assignments (6)
SECURITY INTEREST Recorded Apr 1, 2025
From: AUDIOEYE, INC.
To: WESTERN ALLIANCE BANK
Reel/Frame 070694/0923 →
RELEASE OF SECURITY INTEREST Recorded Apr 1, 2025
From: SG CREDIT PARTNERS, INC.
To: AUDIOEYE, INC.
Reel/Frame 070697/0135 →
SECURITY AGREEMENT Recorded Jul 24, 2024
From: AUDIOEYE, INC.
To: SG CREDIT PARTNERS, INC.
Reel/Frame 068349/0117 →
SECURITY AGREEMENT Recorded Feb 16, 2024
From: AUDIOEYE, INC.
To: SG CREDIT PARTNERS, INC.
Reel/Frame 066694/0799 →
SECURITY AGREEMENT Recorded Nov 30, 2023
From: AUDIOEYE, INC.
To: SG CREDIT PARTNERS, INC.
Reel/Frame 065729/0547 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 29, 2021
From: BRADLEY, SEAN D.; BAKER, MARK D.; JONES, JEFFREY O.; HEFNER, KENNY P.; FINKELSTEIN, ADAM; GILORMO, DOUGLAS J.; BODNAR, TAYLOR R.; PINCKNEY, DAVID C.; BLEVINS, CHARLIE E.; JONES, TREVOR C.; LAYMON, HELENA
To: AUDIOEYE, INC.
Reel/Frame 056089/0174 →
Continuity (3)
Continuation 17147323 · Jan 12, 2021
Continuation 16430210 · Jun 3, 2019
Continuation 15074818 · Mar 18, 2016
Cited By (3)
US 12,333,235 US 12,443,671 US 12,547,819