IP Library Granted Patent US 11,630,556
Granted Patent B2
US 11,630,556 · App. 17/022,651 · Granted Apr 18, 2023

Finger control of wearable devices

Inventors: Edgar Adolfo Zamora Duran (Heredia, CR); Sarbajit K. Rakshit (Kolkata, IN)
Assignee: Kyndryl, Inc.
G06F3/0484G06K9/6217G06V10/751G06V20/64G06V40/107
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,630,556
App. No.
17/022,651
Granted
Apr 18, 2023
Kind
B2
Abstract

An object approaching a wearable device of a user is identified. In response to determining that the approaching object is a previously identified target of the user, one or more applications displayed in a user interface of the wearable device, and how said one or more applications are organized on the user interface of the wearable device, are modified based on the identified approaching object. The modified user interface is displayed to the user.

Claims (80)

1. A method, the method comprising:

identifying, by one or more computer processors, an object approaching a wearable device of a user from a three-dimensional image of the approaching object, obtained via an ultrasound module, to match one or more attributes of the three-dimensional image to one or more attributes of a previously identified target of the user, wherein the previously identified target of the user includes one or more portions of one or more fingers, and the one or more attributes include a distinguishing length or mark of the one or more fingers;

responsive to determining that the approaching object is the previously identified target of the user, accessing, by the one or more computer processors, one or more applications displayed on a user interface of the wearable device, and customizing how said one or more applications are organized on the user interface of the wearable device, based on the identified approaching object;

incorporating the customized organization of said one or more applications into a learning mode of the wearable device; and

displaying to the user, by the one or more computer processors, the user interface.

2. The method of claim 1 , further comprising:

determining, by the one or more computer processors, whether the approaching object is the previously identified target of the user by:

activating, by the one or more computer processors, the ultrasound module included in the wearable device;

acquiring, by the one or more computer processors the three-dimensional image of the approaching object;

comparing, by the one or more computer processors, the one or more attributes of the acquired three-dimensional image of the approaching object to the one or more attributes of one or more stored targets including the previously identified target; and

based on the comparison of the one or more attributes of the acquired three-dimensional image, determining, by the one or more computer processors, whether the approaching object is the previously identified target of the user.

3. The method of claim 2 , wherein the one or more stored targets are the one or more fingers, or the one or more portions of the one or more fingers, of the user.

4. The method of claim 2 , wherein the one or more attributes of the one or more stored targets comprise an overall length of a finger of the user, the distinguishing length including a length of a portion of the finger of the user, a diameter of the finger of the user, and the mark including one or more identifying marks included on the finger of the user or the portion of the finger of the user.

5. The method of claim 1 , further comprising:

identifying, by the one or more computer processors, a first target of a user based on one or more attributes of the first target;

receiving, by the one or more computer processors, a confirmation from the user which confirms a correct identification of the identified first target;

receiving, by the one or more computer processors, an application mapping from the user which associates one or more applications included on the wearable device of the user with the identified first target;

storing, by the one or more computer processors, the identified first target, the one or more attributes of the identified first target, and the associated application mapping; and

responsive to determining that a pre-defined time limit has not been exceeded, identifying, by the one or more computer processors, a second target of the user based on one or more attributes of the second target.

6. The method of claim 1 , further comprising:

receiving, by the one or more computer processors, an indication of training of the wearable device;

initiating, by the one or more computer processors, the learning mode of the wearable device;

activating, by the one or more computer processors, a proximity sensor included in the wearable device; and

activating, by the one or more computer processors, the ultrasound module included in the wearable device

responsive to determining that a pre-defined time limit has been exceeded, ending the training of the wearable device.

7. The method of claim 6 , wherein at least one of the wearable device, a mobile device such as a smartphone, and a voice-enabled system of a computing device such as a tablet computer are used for the indication of the training and the initiation of the learning mode.

8. A computer program product, the computer program product comprising:

one or more computer readable storage media; and

program instructions stored on the one or more computer readable storage media, the program instructions comprising:

program instructions to identify an object approaching a wearable device of a user from a three-dimensional image of the approaching object, obtained via an ultrasound module, to match one or more attributes of the three-dimensional image to one or more attributes of a previously identified target of the user, wherein the previously identified target of the user one or more portions of one or more fingers, and the one or more attributes include a distinguishing length or mark of the one or more fingers;

responsive to determining that the approaching object is the previously identified target of the user, program instructions to access one or more applications displayed on a user interface of the wearable device, and customize how said one or more applications are organized on the user interface of the wearable device from an application mapping of the previously identified target to said one or more applications, based on the identified approaching object;

program instructions to incorporate the customized organization of said one or more applications into a learning mode of the wearable device; and

program instructions to display by one or more computer processors, said one or more applications associated with the application mapping on the user interface.

9. The computer program product of claim 8 , further comprising program instructions stored on the one or more computer readable storage media, to:

determine whether the approaching object is the previously identified target of the user comprising further program instructions to:

activate the ultrasound module included in the wearable device;

acquire the three-dimensional image of the approaching object;

compare the one or more attributes of the acquired three-dimensional image of the approaching object to the one or more attributes of one or more stored targets including the previously identified target; and

based on the comparison of the one or more attributes of the acquired three-dimensional image, determine whether the approaching object is the previously identified target of the user.

10. The computer program product of claim 9 , wherein the one or more stored targets are one or more fingers, or one or more portions of the one or more fingers, of the user.

11. The computer program product of claim 9 , wherein the attributes of the one or more stored targets comprise an overall length of a finger of the user, the distinguishing length including a length of a portion of the finger of the user, a diameter of the finger of the user, and the mark including one or more identifying marks included on the finger of the user or the portion of the finger of the user.

12. The computer program product of claim 8 , further comprising program instructions stored on the one or more computer readable storage media, to:

identify a first target of a user based on one or more attributes of the first target;

receive a confirmation from the user which confirms a correct identification of the identified first target;

receive another application mapping from the user which associates one or more applications included on the wearable device of the user with the identified first target;

store the identified first target, the one or more attributes of the identified first target, and the associated another application mapping; and

responsive to determining that a pre-defined time limit has not been exceeded, identify a second target of the user based on one or more attributes of the second target.

13. The computer program product of claim 8 , further comprising program instructions stored on the one or more computer readable storage media, to:

receive an indication of training of the wearable device;

initiate the learning mode of the wearable device;

activate a proximity sensor included in the wearable device; and

activate the ultrasound module included in the wearable device.

14. The computer program product of claim 13 , wherein at least one of the wearable device, a mobile device such as a smartphone, and a voice-enabled system of a computing device such as a tablet computer are used for the indication of the training and the initiation of the learning mode.

15. A computer system, the computer system comprising:

one or more computer processors;

one or more computer readable storage media; and

program instructions stored on the one or more computer readable storage media for execution by at least one of the one or more computer processors, the program instructions comprising:

program instructions to identify, by utilizing a machine learning, an object approaching a wearable device of a user from a three-dimensional image of the approaching object, obtained via an ultrasound module, to match one or more attributes of the three-dimensional image to one or more attributes of a previously identified target of the user, wherein the previously identified target of the user one or more portions of one or more fingers, and the one or more attributes include a distinguishing length or mark of the one or more fingers;

responsive to determining that the approaching object is the previously identified target of the user, program instructions to access one or more applications displayed on a user interface of the wearable device, and customize how said one or more applications are organized on the user interface of the wearable device from an application mapping of the previously identified target to said one or more applications, based on the identified approaching object;

incorporating the customized organization of said one or more applications into a learning mode of the wearable device; and

program instructions to display by one or more computer processors, said one or more applications associated with the application mapping on the user interface.

16. The computer system of claim 15 , further comprising program instructions stored on the one or more computer readable storage media for execution by at least one of the one or more computer processors, to:

determine whether the approaching object is the previously identified target of the user comprising further program instructions to:

activate the ultrasound module included in the wearable device;

acquire the three-dimensional image of the approaching object;

compare the one or more attributes of the acquired three-dimensional image of the approaching object to the one or more attributes of one or more stored targets including the previously identified target; and

based on the comparison of the one or more attributes of the acquired three-dimensional image, determine whether the approaching object is the previously identified target of the user.

17. The computer system of claim 16 , wherein the one or more stored targets are one or more fingers, or one or more portions of the one or more fingers, of the user.

18. The computer system of claim 16 , wherein the one or more attributes of the one or more stored targets comprise an overall length of a finger of the user, the distinguishing length including a length of a portion of the finger of the user, a diameter of the finger of the user, and the mark including one or more identifying marks included on the finger of the user or the portion of the finger of the user.

19. The computer system of claim 15 , further comprising program instructions stored on the one or more computer readable storage media for execution by at least one of the one or more computer processors, to:

identify a first target of a user approaching the wearable device, by utilizing an object recognition technology, based on one or more attributes of the first target;

receive a confirmation from the user which confirms a correct identification of the identified first target;

receive another application mapping from the user which associates one or more applications included on the wearable device of the user with the identified first target;

store the identified first target, the one or more attributes of the identified first target, and the associated another application mapping; and

responsive to determining that a pre-defined time limit has not been exceeded, identify a second target of the user based on one or more attributes of the second target.

20. The computer system of claim 15 , further comprising program instructions stored on the one or more computer readable storage media for execution by at least one of the one or more computer processors, to:

receive an indication of training of the wearable device;

initiate the learning mode of the wearable device;

activate a proximity sensor included in the wearable device; and

activate the ultrasound module included in the wearable device.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 18, 2021
From: INTERNATIONAL BUSINESS MACHINES CORPORATION
To: KYNDRYL, INC.
Reel/Frame 058213/0912 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 16, 2020
From: ZAMORA DURAN, EDGAR ADOLFO; RAKSHIT, SARBAJIT K.
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 053790/0188 →