IP Library › Granted Patent US 9,870,717
Granted Patent B2
US 9,870,717 · App. 15/444,813 · Granted Jan 16, 2018

Assisting a visually impaired user to grip an object

Inventor: Mahesh Subramaniam (Bangalore, IN)
Assignee: HCL TECHNOLOGIES LIMITED
G09B21/006A41D1/002A41D19/00G06F17/3028G06F17/30268G06F17/30769G06K9/6202
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,870,717
App. No.
15/444,813
Granted
Jan 16, 2018
Kind
B2
Abstract

The present disclosure relates to system(s) and device for assisting a visually impaired user to grip objects. The system may receive an image of an object in real-time and identify a reference image corresponding to the image by comparing the image with reference images. Further, the system may identify a reference tactile image corresponding to the reference image and generate a first set of audio instructions for assisting the visually impaired user to grip the object based on the reference tactile image. Further, the system may receive a tactile image from a tactile glove of the visually impaired user and compare the tactile image with the reference tactile image to identify pressure variation data. Furthermore, the system may generate a second set of audio instructions for guiding the visually impaired user to grip the object base on a second set of audio instructions generated using the pressure variation data.

Claims (40)

1. A device configured for assisting a visually impaired user to grip an object, the device comprising:

a camera;

a central processing unit, comprising:

a memory; and

a processor coupled to the memory, wherein the processor is configured to execute program instructions stored in the memory to:

receive an image of an object in real-time, wherein the image is captured by the camera;

identify a reference image corresponding to the image by comparing the image with reference images present in a database;

identify a reference tactile image corresponding to the reference image, wherein the reference tactile image is stored in the database;

generate a first set of audio instructions for assisting a visually impaired user to grip the object based on the reference tactile image;

receive a tactile image from a tactile glove put on by the visually impaired user;

compare the tactile image with the reference tactile image to identify pressure variation data corresponding to one or more points in the tactile image and the reference tactile image; and

generate a second set of audio instructions for guiding the visually impaired user to grip the object, wherein the second set of audio instructions is generated based on the pressure variation data.

2. The device of claim 1 , wherein the tactile image corresponds to pressure exerted at one or more points of the tactile gloves while operating the object.

3. The device of claim 1 , further configured to maintain a database storing reference image and reference tactile image corresponding to each object of a set of objects, wherein each reference image is configured to store visual data of the object, and wherein each reference tactile image is configured to store pressure data for operating the object.

4. The device of claim 1 , wherein the camera is mounted over a wearable device of a visually impaired user.

5. The device of claim 1 , wherein the image is compared with reference images using image pattern matching.

6. The device of claim 1 , wherein the first set of audio instructions and second set of audio instructions are provided to the visually impaired user through a speaker on the wearable device.

7. A system for assisting a visually impaired user to grip an object, the system comprising:

a memory; and

a processor coupled to the memory, wherein the processor is configured to execute program instructions stored in the memory to:

receive an image of an object in real-time;

identify a reference image corresponding to the image by comparing the image with reference images present in a database;

identify a reference tactile image corresponding to the reference image, wherein the reference tactile image is stored in the database;

generate a first set of audio instructions for assisting the visually impaired user to grip the object based on the reference tactile image;

receive a tactile image from a tactile glove put on by the visually impaired user;

compare the tactile image with the reference tactile image to identify pressure variation data corresponding to one or more points in the tactile image and the reference tactile image; and

generate a second set of audio instructions for guiding the visually impaired user to grip the object base on a second set of audio instructions, wherein the second set of audio instructions are generated based on the pressure variation data.

8. The system of claim 7 , wherein the tactile image corresponds to pressure exerted at one or more points of the tactile gloves while operating the object.

9. The system of claim 7 , further configured to maintain a database storing reference image and reference tactile image corresponding to each object of a set of objects, wherein each reference image is configured to store visual data of the object, and wherein each reference tactile image is configured to store pressure data for operating the object.

10. The system of claim 7 , wherein the image is captured by a camera mounted over a wearable device of a visually impaired user.

11. The system of claim 7 , wherein the image is compared with reference images using image pattern matching.

12. The system of claim 7 , wherein the first set of audio instructions and second set of audio instructions are provided to the visually impaired user through a speaker on the wearable device.

13. A non-transitory computer readable medium embodying a program executable in a computing device for assisting a visually impaired user to grip an object, the computer program product comprising:

a program code for receiving an image of an object in real-time;

a program code for identifying a reference image corresponding to the image by comparing the image with reference images present in a database;

a program code for identifying a reference tactile image corresponding to the reference image, wherein the reference tactile image is stored in the database;

a program code for generating a first set of audio instructions for assisting the visually impaired user to grip the object based on the reference tactile image;

a program code for receiving a tactile image from a tactile glove put on by the visually impaired user;

a program code for comparing the tactile image with the reference tactile image to identify pressure variation data corresponding to one or more points in the tactile image and the reference tactile image; and

a program code for generating a second set of audio instructions for guiding the visually impaired user to grip the object base on a second set of audio instructions, wherein the second set of audio instructions are generated based on the pressure variation data.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 28, 2017
From: SUBRAMANIAM, MAHESH
To: HCL TECHNOLOGIES LIMITED
Reel/Frame 041399/0248 →
Priority Claims (1)
IN 201611011175 · Mar 30, 2016 · national
Continuity (1)
Related Publication 20170287360A1 · Oct 5, 2017