IP Library › Granted Patent US 10,795,573
Granted Patent B2
US 10,795,573 · App. 15/227,659 · Granted Oct 6, 2020

Method and apparatus for virtual braille keyboard

Inventors: Bruce J. MacIsaac (San Jose, CA); Rosanna S. Mannan (San Jose, CA); Lloyd A. Walls (Austin, TX)
Assignee: International Business Machines Corporation
G06F3/04886G06F3/016G06F3/167G06F2203/04809
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,795,573
App. No.
15/227,659
Granted
Oct 6, 2020
Kind
B2
Abstract

An apparatus includes a touchscreen having an input area and a processor. The apparatus also includes a memory that stores program code. The program code is executable by the processor to determine a location within the input area. The location corresponds to a position of at least a portion of an object relative to the input area. Further, the program code is executable by the processor to generate an output associated with an indication to move the object toward a region of the input area. The output is based on a comparison of the position of the object to the region. The region corresponds to a key of a keyboard.

Claims (48)

1. A computer-implemented method to provide a virtual Braille keyboard, the computer-implemented method comprising:

receiving an identifier of a user of a device;

accessing, based on the identifier, a layout of Braille keys that is specific to the user, the layout having associated parameters including a count of fingers of the user;

dividing an input area of a touchscreen of the device into multiple regions including a first region, wherein each region of the multiple regions corresponds to a different virtual Braille key of a Braille keyboard based on the layout;

determining an orientation of the device relative to gravity;

selectively activating, based on the orientation, one or more columns of sensors or one or more rows of sensors associated with the input area;

presenting the Braille keyboard via the touchscreen;

generating, by the device, sensor data indicative of a location of an object relative to the input area;

determining whether the location of the object is included within a first boundary of the first region, by comparing the sensor data to a threshold, wherein the location is determined based on the sensor data satisfying the threshold;

based on the determined location, generating, by the device, an audible verbal command associated with a direction to move the object towards the first region of the input area, wherein the first region corresponds to a particular virtual Braille key of the Braille keyboard, the audible verbal command ceasing when the object is within the first region;

generating, by the device, sensor data over a time period indicative of the location of the object relative to the input area over the time period;

determining a rate of travel of the object with respect to a second boundary of the first region; and

generating a second audible verbal command indicating a direction of travel of the object indicating a potential travel of the object out of the second boundary of the first region.

2. The computer-implemented method of claim 1 , further comprising:

detecting the object crossing the boundary of the first region; and

generating an indication that the location of the object is aligned with the first region.

3. The computer-implemented method of claim 1 , further comprising:

determining a separation distance between a first portion of the object and a second portion of the object relative to the touchscreen; and

determining, based on the separation distance, a first size of the first region and a second size of a second region, wherein the second region corresponds to a second virtual Braille key of the Braille keyboard.

4. A non-transitory computer-readable medium containing instructions executable to perform an operation to provide a virtual Braille keyboard, the operation comprising:

receiving an identifier of a user of a device;

accessing, based on the identifier, a layout of Braille keys that is specific to the user, the layout having associated parameters including a count of fingers of the user;

dividing an input area of a touchscreen of the device into multiple regions including a first region, wherein each region of the multiple regions corresponds to a different virtual Braille key of a Braille keyboard based on the layout;

determining an orientation of the device relative to gravity;

selectively activating, based on the orientation, one or more columns of sensors or one or more rows of sensors associated with the input area;

presenting the Braille keyboard via the touchscreen;

generating, by the device, sensor data indicative of a location of an object relative to the input area;

determining whether the location of the object is included within a first boundary of the first region, by comparing the sensor data to a threshold, wherein the location is determined based on the sensor data satisfying the threshold;

based on the determined location, generating, by the device, an audible verbal command associated with a direction to move the object towards the first region of the input area, wherein the first region corresponds to a particular virtual Braille key of the Braille keyboard, the audible verbal command ceasing when the object is within the first region;

generating, by the device, sensor data over a time period indicative of the location of the object relative to the input area over the time period;

determining a rate of travel of the object with respect to a second boundary of the first region; and

generating a second audible verbal command indicating a direction of travel of the object indicating a potential travel of the object out of the second boundary of the first region.

5. A apparatus to provide a virtual Braille keyboard, the apparatus comprising:

a touchscreen having an input area;

one or more computer processors; and

a memory storing a program executable by the one or more computer processors to perform an operation comprising:

receiving an identifier of a user;

accessing, based on the identifier, a layout of Braille keys that is specific to the user, the layout having associated parameters including a count of fingers of the user;

dividing an input area of the touchscreen into multiple regions including a first region, wherein each region of the multiple regions corresponds to a different virtual Braille key of a Braille keyboard based on the layout;

determining an orientation of the apparatus relative to gravity;

selectively activating, based on the orientation, one or more columns of sensors or one or more rows of sensors associated with the input area;

presenting the Braille keyboard via the touchscreen;

generating sensor data indicative of a location of an object relative to the input area;

determining whether the location of the object is included within a first boundary of the first region, by comparing the sensor data to a threshold, wherein the location is determined based on the sensor data satisfying the threshold;

based on the determined location, generating, an audible verbal command associated with a direction to move the object towards the first region of the input area, wherein the first region corresponds to a particular virtual Braille key of the Braille keyboard, the audible verbal command ceasing when the object is within the first region;

generating sensor data over a time period indicative of the location of the object relative to the input area over the time period;

determining a rate of travel of the object with respect to a second boundary of the first region; and

generating a second audible verbal command indicating a direction of travel of the object indicating a potential travel of the object out of the second boundary of the first region.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 3, 2016
From: MACISAAC, BRUCE J.; MANNAN, ROSANNA S.; WALLS, LLOYD A.
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 039334/0995 →
Continuity (1)
Related Publication 20180039404A1 · Feb 8, 2018
Cited By (1)
US 12,718,213