IP Library Granted Patent US 10,942,369
Granted Patent B2
US 10,942,369 · App. 16/037,972 · Granted Mar 9, 2021

Smart contact lens control system

Inventors: Florian Pinel (New York, NY); Shikhar Kwatra (Duham, NC); Paul Krystek (Highland, NY); Sushain Pandit (Austin, TX); Sarbajit K. Rakshit (Kolkata, IN)
Assignee: International Business Machines Corporation
G02C7/04A61B3/11A61B3/14G05B13/0265G02C7/041G02C7/081G02C11/10G06F3/011G06F3/013H04N5/23212H04N5/23219
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,942,369
App. No.
16/037,972
Granted
Mar 9, 2021
Kind
B2
Abstract

A computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a processor of a smart contact lens. Executing the instructions causes the smart contact lens to measure dimensions of a user's eye to determine a focal length of the user, measure a magnetic field proximate to the user's eye to determine a direction of focus of the user, receive a control input from the user, determine a control signal corresponding to the focal length of the user, the direction of focus of the user, and the received control input, generate the determined control signal, and control a first electronic device by transmitting, by the smart contact lens, the generated control signal to the first electronic device.

Claims (50)

1. A computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a processor of a smart contact lens to cause the processor of the smart contact lens to:

measure, by the smart contact lens, dimensions of a user's eye to determine a focal length of the user, the dimensions including a size and shape of the user's eye;

measure, by the smart contact lens, a magnetic field proximate to the user's eye to determine a direction of focus of the user;

receive, by the smart contact lens, a control input from the user;

determine, by the smart contact lens, a control signal corresponding to the focal length of the user, the direction of focus of the user, and the received control input;

generate, by the smart contact lens, the determined control signal; and

control a first electronic device by transmitting, by the smart contact lens, the generated control signal to the first electronic device.

2. The computer program product of claim 1 , wherein measuring the dimensions of the user's eye comprises capturing an infrared image of the user's eye via a back-side facing camera of the smart contact lens.

3. The computer program product of claim 2 , wherein executing the instructions further causes the processor to authenticate the user for controlling the first electronic device by scanning a retina of the user via the back-side facing camera of the smart contact lens.

4. The computer program product of claim 1 , wherein determining a direction of focus of the user further includes measuring a position and relative motion of a head of the user according to an accelerometer of the smart contact lens.

5. The computer program product of claim 1 , wherein the control input comprises at least one of a movement of the user's eyes, a movement of a head of the user, movement of eyelids of the user, or movement of a portion of a body of the user.

6. The computer program product of claim 1 , wherein executing the instructions further causes the processor to receive user feedback indicating an accuracy of an action performed by the first electronic device according to the generated control signal.

7. The computer program product of claim 1 , wherein executing the instructions further causes the processor to:

determine, by the smart contact lens, a second control signal corresponding to the focal length of the user, the direction of focus of the user, and the received control input;

generate, by the smart contact lens, the determined second control signal; and

control a second electronic device by transmitting, by the smart contact lens, the generated second control signal to the second electronic device.

8. The computer program product of claim 1 , wherein measuring the focal length of the user and the magnetic field proximate to the user's eye indicates an object on which the user is focusing.

9. The computer program product of claim 8 , wherein the object on which the user is focusing is the first electronic device.

10. The computer program product of claim 8 , wherein the object on which the user is focusing is an uncontrollable object that is not the first electronic device.

11. A computer-implemented method, comprising:

measuring, by a smart contact lens, dimensions of a user's eye to determine a focal length of the user, the dimensions including a size and shape of the user's eye;

measuring, by the smart contact lens, a magnetic field proximate to the user's eye to determine a direction of focus of the user;

receiving, by the smart contact lens, a control input from the user;

determining, by the smart contact lens, a control signal corresponding to the focal length of the user, the direction of focus of the user, and the received control input;

generating, by the smart contact lens, the determined control signal; and

controlling a first electronic device by transmitting, by the smart contact lens, the generated control signal to the first electronic device.

12. The computer-implemented method of claim 11 , wherein measuring the dimensions of the user's eye comprises capturing an infrared image of the user's eye via a back-side facing camera of the smart contact lens, and wherein measuring the focal length of the user and the magnetic field proximate to the user's eye indicates an object on which the user is focusing.

13. The computer-implemented method of claim 12 wherein the object on which the user is focusing is the first electronic device.

14. The computer-implemented method of claim 12 , wherein the object on which the user is focusing is an uncontrollable object that is not the first electronic device.

15. The computer-implemented method of claim 12 , wherein the object on which the user is focusing is an object in a virtual environment.

16. The computer-implemented method of claim 11 , further comprising

determining, by the smart contact lens, a second control signal corresponding to the focal length of the user, the direction of focus of the user, and the received control input;

generating, by the smart contact lens, the determined second control signal; and

controlling a second electronic device by transmitting, by the smart contact lens, the generated second control signal to the second electronic device.

17. A system, comprising:

a smart contact lens configured to:

determine an object on which a wearer of the smart contact lens is focusing based on a size and shape of an eye of the wearer;

determine a control input provided by the wearer of the smart contact lens;

generate a first control signal for controlling a first electronic device according to a result of a machine learning process including the determining of the object on which the wearer of the smart contact lens is focusing and the control input provided by the wearer of the smart contact lens; and

a processing device configured to:

receive a plurality of signals from the smart contact lens;

based on the received plurality of signals, determine an association between the object on which a wearer of the smart contact lens is focusing, the control input provided by the wearer of the smart contact lens, and the first control signal; and

provide the association between the object on which a wearer of the smart contact lens is focusing, the control input provided by the wearer of the smart contact lens, and the first control signal.

18. The system of claim 17 , wherein determining the object on which the wearer of the smart contact lens is focusing comprises:

measuring dimensions of the eye of the wearer of the smart contact lens to determine a focal length of the wearer of the smart contact lens, the dimensions including the size and the shape of the eye of the wearer; and

measuring a magnetic field existing proximate to the eye of the wearer of the smart contact lens, and wherein determining the control input provided by the wearer of the smart contact lens.

19. The system of claim 17 , wherein the processing device is further configured to:

receive feedback from the smart contact lens indicating an accuracy of an action corresponding to the control signal as compared to a desired action of the wearer of the smart contact lens; and

refine the result of a machine learning process according to the feedback received from the smart contact lens.

20. The system of claim 17 , wherein the object on which a wearer of the smart contact lens is focusing is an object other than the first electronic device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 17, 2018
From: PINEL, FLORIAN; KWATRA, SHIKHAR; KRYSTEK, PAUL; PANDIT, SUSHAIN; RAKSHIT, SARBAJIT K.
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 046375/0437 →
Continuity (1)
Related Publication 20200026097A1 · Jan 23, 2020
Cited By (1)
US 12,288,200