Document content reordering for assistive technologies by connecting traced paths through the content
Embodiments of the present invention provide a method, system and computer program product for document content re-ordering for assistive technology processing. In an embodiment of the invention, a method for document content re-ordering for assistive technology processing is provided. The method includes sensing in a computer display a drawing of a path across different portions of displayed content in the computer display. Thereafter, a sequence of the different portions of the displayed content can be identified from the path. As such, meta-data indicative of the sequence can be generated in the memory of the computer and the content can be annotated with the generated meta-data. Finally, the portions of the content can be processed with assistive technology in an order dictated by the sequence.
1. A document data processing system configured for document content re-ordering for assistive technology processing, the system comprising:
at least one processor, memory, a touch screen display and a display driver driving a display of a single page of a document by a content reader executing in the memory on the touch screen display;
an assistive technology also executing in the memory and assistively processing portions of the single page of a document according to a sequence specified by annotations of the portions of the single page of a document; and,
a document re-ordering definition module also executing in the memory, the module comprising program code enabled upon execution to enter an ordering mode and during the ordering mode, to sense in the display a drawing of an initial path across different portions of the single page of a document beginning at an originating position of the initial path and ending at a terminating position, to identify an initial sequence from the path, to sense multiple additional, disjointed paths drawn across other different portions of the single page of the document each additional disjointed path defining an additional sequence, to add the initial sequence to a list and also adding to the list each additional sequence and while still in ordering mode, attaching a first one of the additional sequences to the initial sequence in the list, and further attaching each additional sequence to an end of a prior additional sequence in the list so as to define a traversal order of items of each of the sequences for a screen reader, to exit the ordering mode and thereafter to store the list in memory and process the list by transposing the list into meta-data indicative of a combined sequence of the initial sequence and the additional sequence in the list, and to annotate the single page of a document with the generated meta-data so as to direct a screen reader to present different corresponding portions of the single displayed page in accordance with a sequence defined by the meta-data.
2. The system of claim 1 , wherein the assistive technology is a screen reader.
3. The system of claim 1 , wherein the meta-data is a set of aria-flowto directives.
4. The system of claim 1 , wherein the meta-data is a set of draw:nav-order directives.
5. A computer program product for document content re ordering, the computer program product comprising a non-transitory computer readable storage medium having program instructions embodied therewith, the program instructions executable by a device to cause the device to perform a method comprising:
entering an ordering mode of the device and during the ordering mode, sensing in a computer display by the device of a drawing of an initial path across different portions of single displayed page of a document in the computer display beginning at an originating position of the initial path and ending at a terminating position, identifying by the device from the initial path an initial sequence of the different portions of the single displayed page of the document, sensing multiple additional, disjointed paths drawn across other different portions of the single page of the document each additional disjointed path defining an additional sequence;
adding the initial sequence to a list and also adding to the list each additional sequence and while still in ordering mode, attaching a first one of the additional sequences to the initial sequence in the list, and further attaching each additional sequence to an end of a prior additional sequence in the list so as to define a traversal order of items of each of the sequences for a screen reader; and,
exiting the ordering mode and thereafter, storing the list in memory and process the list by transposing the list into meta-data indicative of a combined sequence of the initial sequence and the additional sequence in the list and, annotating by the device the single displayed page of the document with the generated meta-data so as to direct a screen reader to present different corresponding portions of the single displayed page in accordance with a sequence defined by the meta-data.
6. The computer program product of claim 5 , further comprising program instructions executable by the device to cause the device to process by the device the portions of the single displayed page of the document with assistive technology in an order dictated by the combined sequence.
7. The computer program product of claim 6 , wherein the assistive technology is a screen reader.
8. The computer program product of claim 5 , further comprising program instructions executable by the device to cause the device to keyboard navigate the portions of the single displayed page of the document in a content viewer in an order dictated by the combined sequence.
9. The computer program product of claim 5 , wherein the meta-data is a set of aria-flowto directives.
10. The computer program product of claim 5 , wherein the meta-data is a set of draw:nav-order directives.
11. The computer program product of claim 5 , wherein the sensing is a touch sensing of a touching of the computer display during drawing of the path.