IP Library Granted Patent US 10,860,173
Granted Patent B1
US 10,860,173 · App. 16/991,405 · Granted Dec 8, 2020

Modular systems and methods for selectively enabling cloud-based assistive technologies

Inventors: Sean D. Bradley (Tucson, AZ); Mark D. Baker (Marietta, GA); Jeffrey O. Jones (Roswell, GA); Kenny P. Hefner (Buchanan, GA); Adam Finkelstein (Alpharetta, GA); Douglas J. Gilormo (Cumming, GA); Taylor R. Bodnar (Tucson, AZ); David C. Pinckney (Roswell, GA); Charlie E. Blevins (Atlanta, GA); Helena Laymon (Duluth, GA); Trevor C. Jones (Kennesaw, GA)
Assignee: AUDIOEYE, INC.
G06F3/04817G06F3/0482G06F3/167G06F40/117G06F40/14G10L13/027G10L15/22G10L15/26H04L67/22G10L13/02G10L2015/221H04L67/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,860,173
App. No.
16/991,405
Granted
Dec 8, 2020
Kind
B1
Abstract

Methods and systems for manual and programmatic remediation of websites. JavaScript code is accessed by a user device and optionally calls TTS, ASR, and RADAE modules from a remote server to thereby facilitate website navigation by people with diverse abilities.

Claims (42)

1. A computer-implemented method of programmatically assigning a descriptive attribute to an untagged element on a web page to enable an audible description of the untagged element, the web page having an associated document object model (DOM), the computer-implemented method comprising:

accessing, by a computer system, a code associated with the web page, the code comprising at least HTML or the DOM;

detecting, by the computer system, one or more compliance issues relating to web accessibility standards in the code, wherein at least one of the one or more compliance issues comprises an untagged element, the untagged element is an element lacking an adequate descriptive attribute; and

selecting, by the computer system, one or more pre-existing remediation code for the one or more compliance issues, wherein the one or more pre-existing remediation code comprise at least:

determining, by the computer system, one or more contextual cues associated with the untagged element;

obtaining, by the computer system, a descriptive attribute from an artificial intelligence algorithm, wherein the artificial intelligence algorithm dynamically generates the descriptive attribute based on the one or more contextual cues; and

assigning, by the computer system, the descriptive attribute to the untagged element, the descriptive attribute assigned to the untagged element configured to enable an assistive technology to speak the descriptive attribute to a user.

2. The computer-implemented method of claim 1 , wherein the assigning comprises changing the DOM or HTML code associated with the web page.

3. The computer-implemented method of claim 1 , wherein the one or more pre-existing remediation code is javascript.

4. The computer-implemented method of claim 1 , wherein the untagged element is an input field.

5. The computer-implemented method of claim 1 , wherein the computer system comprises one or more computer systems connected via an electronic network.

6. The computer-implemented method of claim 1 , wherein the untagged element is a video.

7. The computer-implemented method of claim 1 , wherein the untagged element is a graphic.

8. The computer-implemented method of claim 1 , wherein the untagged element is a photograph.

9. The computer-implemented method of claim 1 , wherein determining the one or more contextual cues associated with the untagged element comprises inspecting a text element nearby the element on the web page.

10. The computer-implemented method of claim 1 , wherein determining the one or more contextual cues associated with the untagged element comprises determining a relative position of a text element with respect to the untagged element.

11. The computer-implemented method of claim 1 , wherein determining the one or more contextual cues associated with the untagged element comprises inspecting an HTML attribute nearby the untagged element.

12. The computer-implemented method of claim 1 , wherein determining the one or more contextual cues associated with the untagged element comprises determining a type of an HTML attribute nearby the untagged element.

13. The computer-implemented method of claim 1 , wherein determining the one or more contextual cues associated with the untagged element comprises determining a relative position of an HTML attribute with respect to the untagged element.

14. The computer-implemented method of claim 1 , wherein the untagged element is a video, and wherein determining the one or more contextual cues associated with the untagged element comprises sampling frames of the video.

15. The computer-implemented method of claim 1 , wherein the untagged element is a video, and wherein the artificial intelligence algorithm dynamically generates the descriptive attribute further based on similarities or differences between frames of the video.

16. A computer-implemented method of programmatically assigning a descriptive attribute to an untagged element on a web page to provide an audible description of the untagged element, the web page having an associated document object model (DOM), the computer-implemented method comprising:

accessing, by a computer system, code associated with the web page, the code comprising at least HTML or the DOM;

retrieving, by the computer system, at least one remediation code from a remote server; and

applying, by the computer system, the at least one remediation code to the web page, the applying comprising:

determining, by the computer system, one or more contextual cues associated with the untagged element, the untagged element is an element lacking an adequate descriptive attribute;

obtaining, by the computer system, a descriptive attribute from an artificial intelligence algorithm, wherein the artificial intelligence algorithm dynamically generates the descriptive attribute based on the one or more contextual cues; and

assigning, by the computer system, the descriptive attribute to the untagged element, the descriptive attribute assigned to the untagged element configured to enable an assistive technology to speak the descriptive attribute to a user.

17. The computer-implemented method of claim 16 , wherein the assigning comprises changing the DOM or HTML code associated with the web page.

18. The computer-implemented method of claim 16 , wherein the at least one remediation code is javascript.

19. The computer-implemented method of claim 16 , wherein the untagged element is an input field.

20. The computer-implemented method of claim 16 , wherein the untagged element is an image.

21. The computer-implemented method of claim 16 , wherein the untagged element is a video.

22. The computer-implemented method of claim 16 , wherein the untagged element is a graphic.

23. The computer-implemented method of claim 16 , wherein the untagged element is a photograph.

24. The computer-implemented method of claim 16 , wherein determining the one or more contextual cues associated with the untagged element comprises inspecting a text element nearby the element on the web page.

25. The computer-implemented method of claim 16 , wherein determining the one or more contextual cues associated with the untagged element comprises determining a relative position of a text element with respect to the untagged element.

26. The computer-implemented method of claim 16 , wherein determining the one or more contextual cues associated with the untagged element comprises inspecting an HTML attribute nearby the untagged element.

27. The computer-implemented method of claim 16 , wherein determining the one or more contextual cues associated with the untagged element comprises determining a type of an HTML attribute nearby the untagged element.

28. The computer-implemented method of claim 16 , wherein determining the one or more contextual cues associated with the untagged element comprises determining a relative position of an HTML attribute with respect to the untagged element.

29. The computer-implemented method of claim 16 , wherein the untagged element is a video, and wherein determining the one or more contextual cues associated with the untagged element comprises sampling frames of the video.

30. The computer-implemented method of claim 16 , wherein the untagged element is a video, and wherein the artificial intelligence algorithm dynamically generates the descriptive attribute further based on similarities or differences between frames of the video.

Assignments (6)
SECURITY INTEREST Recorded Apr 1, 2025
From: AUDIOEYE, INC.
To: WESTERN ALLIANCE BANK
Reel/Frame 070694/0923 →
RELEASE OF SECURITY INTEREST Recorded Apr 1, 2025
From: SG CREDIT PARTNERS, INC.
To: AUDIOEYE, INC.
Reel/Frame 070697/0135 →
SECURITY AGREEMENT Recorded Jul 24, 2024
From: AUDIOEYE, INC.
To: SG CREDIT PARTNERS, INC.
Reel/Frame 068349/0117 →
SECURITY AGREEMENT Recorded Feb 16, 2024
From: AUDIOEYE, INC.
To: SG CREDIT PARTNERS, INC.
Reel/Frame 066694/0799 →
SECURITY AGREEMENT Recorded Nov 30, 2023
From: AUDIOEYE, INC.
To: SG CREDIT PARTNERS, INC.
Reel/Frame 065729/0547 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 14, 2020
From: BRADLEY, SEAN D.; BAKER, MARK D.; JONES, JEFFREY O.; HEFNER, KENNY P.; FINKELSTEIN, ADAM; GILORMO, DOUGLAS J.; BODNAR, TAYLOR R.; PINCKNEY, DAVID C.; BLEVINS, CHARLIE E.; JONES, TREVOR C.; LAYMON, HELENA
To: AUDIOEYE, INC.
Reel/Frame 053499/0294 →
Continuity (2)
Continuation 16430210 · Jun 30, 2019
Continuation 15074818 · Mar 18, 2016
Cited By (2)
US 12,443,671 US 12,547,819