IP Library Granted Patent US 9,792,834
Granted Patent B2
US 9,792,834 · App. 12/399,073 · Granted Oct 17, 2017

Computer, method and program for effectively notifying others of problems concerning accessibility in content

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,792,834
App. No.
12/399,073
Granted
Oct 17, 2017
Kind
B2
Abstract

A computer has a display device, a speaker device and an input device, and is capable of identifying problems concerning accessibility in web content displayed on the display device to a visually impaired user of the computer. The web content includes a plurality of structured objects. The computer also has text-to-speech capability such that the web content displayed on the display device is audibly read to the user. The user provides a specification operation input when he or she is uncomfortable with the audible reading. A reporter software module executing on the computer determines which one of the structured objects is causing the discomfort.

Claims (66)

1. A computer for identifying problems concerning accessibility in content, the computer comprising:

a memory;

a processor coupled to said memory;

a persistent storage device coupled to said memory and said processor;

a display device coupled to said memory and said processor;

a screen reader software module stored in said persistent storage device;

a text-to-speech engine software module stored in said persistent storage device;

a speaker device coupled to said memory and said processor;

an input device coupled to said memory and said processor; and

a reporter software module stored in said persistent storage device;

wherein said processor is operative to:

cause said display device to display web content comprising a plurality of structured objects;

load said screen reader software module from said persistent storage into said main memory and execute said screen reader software module to convert said web content into reading information;

load said text-to-speech engine software module from said persistent storage into said main memory and execute said text-to-speech engine software module to read said reading information as an audible reading through said speaker device to a user of said computer;

obtain a specification operation input from said user, said specification operation input being indicative of a flaw in said web content manifested in said audible reading;

load said reporter software module from said persistent storage into said main memory and execute said reporter software module to:

obtain an operational history including a plurality of operations between said user and said computer controlling an order of reading said reading information, said plurality of operations including said specification operation input; and

determine which of said plurality of structured objects is associated with said flaw in said web content manifested in said audible reading,

wherein the web content is described in a document object model (DOM) and the plurality of structured objects correspond to a plurality of DOM nodes, and

wherein said processor is further operative to execute said reporter software module to determine which of said plurality of structured objects is associated with said flaw in said web content manifested in said audible reading by determining an identification result by examining at least a portion of said DOM nodes corresponding to a portion of said operational history adjacent said specification operation input.

2. The computer according to claim 1 , wherein the speaker device may change a reading order in response to operations by the user.

3. The computer according to claim 1 , wherein the reading information corresponding to one object and the reading information corresponding to another object are separate.

4. The computer according to claim 1 , wherein:

said identification result comprises a first identification result;

said input device comprises said keyboard and a pointer device;

said pointer device automatically points to an approximate screen location on said display device during said audible reading, said approximate screen location approximating a corresponding portion of said reading information;

said specification operation input is received via said keyboard;

said processor is further operative to execute said reporter software module to determine which of said plurality of structured objects is associated with said flaw in said web content manifested in said audible reading by:

determining a second identification result based on said approximate screen location; and

combining said first identification result and said second identification result to determine which of said plurality of structured objects is associated with said flaw in said web content manifested in said audible reading.

5. The computer according to claim 4 , wherein when said approximate screen location is outside a display area of the web content in the display device, said processor is further operative to execute said reporter software module to determine said second identification result from among those of said structured objects present within the display area.

6. The computer according to claim 1 , further comprising:

a communication device for communicating with other computers; and

an uploading device for uploading that one of said plurality of structured objects determined to be associated with said flaw in said web content manifested in said audible reading to the other computers through the communication device.

7. The computer according to claim 6 , wherein the uploading device uploads that one of said plurality of structured objects determined to be associated with said flaw in said web content manifested in said audible reading together with a comment by the user to at least one of the other computers.

8. The computer according to claim 6 , wherein the uploading device uploads that one of said plurality of structured objects determined to be associated with said flaw in said web content manifested in said audible reading in a mode that allows visual display of that one of said plurality of structured objects determined to be associated with said flaw in said web content manifested in said audible reading in at least one of the other computers and in a mode that allows reproduction, in at least one of the other computers, of a computing environment of said user corresponding to a time of said flaw in said web content manifested in said audible reading.

9. The computer according to claim 1 , further comprising:

a communication device for communicating with other computers; and

downloading device for downloading accessibility metadata corresponding to that one of said plurality of structured objects determined to be associated with said flaw in said web content manifested in said audible reading from at least one other computer through the communication device;

wherein the processor is further operative to execute said screen reader software module to convert said web content into said reading information based on the predetermined rules and the accessibility metadata.

10. A computer implemented method of identifying problems concerning accessibility in content, comprising the steps of:

displaying on a display device web content containing a plurality of structured objects;

converting the web content into reading information based on predetermined rules;

reading the converted reading information through a speaker device, as an audible reading, to a user of the computer;

obtaining a specification operation input from said user, said specification operation input being indicative of a flaw in said web content manifested in said audible reading;

obtaining an operational history including a plurality of operations between said user and said computer controlling an order of reading the converted reading information, said plurality of operations including said specification operation input; and

determining which of said plurality of structured objects is associated with said flaw in said web content manifested in said audible reading;

wherein the steps are carried out by a single computer,

wherein the web content is a described in a document object model (DOM) and the plurality of structured objects correspond to a plurality of DOM nodes, and

wherein the method further comprises determining an identification result by examining at least a portion of said DOM nodes corresponding to a portion of said operational history adjacent said specification operation input.

11. The method according to claim 10 , further comprising changing the reading order in response to operations by the user.

12. The method according to claim 10 , wherein:

said identification result comprises a first identification result;

said specification operation input is received via a keyboard;

further comprising automatically pointing, with a pointer device, to an approximate screen location on said display device during said reading, said approximate screen location approximating a corresponding portion of said reading information;

wherein said determining which of said plurality of structured objects is associated with said flaw in said web content manifested in said audible reading comprises:

determining a second identification result based on said approximate screen location; and

combining said first identification result and said second identification result to determine which of said plurality of structured objects is associated with said flaw in said web content manifested in said audible reading.

13. The method according to claim 12 , wherein when said approximate screen location is outside a display area of the web content in the display device, the method further comprises:

determining said second identification result from among those of said structured objects present within the display area.

14. The method according to claim 10 , further comprising:

uploading that one of said plurality of structured objects determined to be associated with said flaw in said web content manifested in said audible reading to other computers through a communication device in a mode that allows visual display of that one of said plurality of structured objects determined to be associated with said flaw in said web content manifested in said audible reading in at least one of the other computers and in a mode that allows reproduction, in at least one of the other computers, of a computing environment of said user corresponding to a time of said flaw in said web content manifested in said audible reading.

15. The method according to claim 14 , wherein the single computer and the other computers comprise terminals of a social accessibility system of a community that approves social accessibility.

16. The method according to claim 10 , further comprising:

downloading accessibility metadata corresponding to that one of said plurality of structured objects determined to be associated with said flaw in said web content manifested in said audible reading from at least one other computer through a communication device; and

converting the web content into said reading information based on the predetermined rules and the accessibility metadata.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 15, 2021
From: INTERNATIONAL BUSINESS MACHINES CORPORATION
To: AIRBNB, INC.
Reel/Frame 056427/0193 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 6, 2009
From: ASAKAWA, CHIEKO; KAWANAKA, SHINYA; SATO, DAISUKE; TAKAGI, HIRONOBU
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 022355/0772 →