IP Library Granted Patent US 12,340,682
Granted Patent B2
US 12,340,682 · App. 18/604,948 · Granted Jun 24, 2025

Enhanced accessibility using wearable computing devices

Inventors: Debashis Ghosh (Charlotte, NC); Carrie Anne Hanson (Charlotte, NC); Elizabeth S. Votaw (Potomac, MD)
Assignee: Wells Fargo Bank, N.A.
G08B6/00H04B1/385
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,340,682
App. No.
18/604,948
Granted
Jun 24, 2025
Kind
B2
Abstract

Disclosed in some examples are methods, systems, devices, and machine-readable mediums which provide a wearable device, such as a smart ring, that provides feedback to guide users in performing physical tasks. Tasks may include tasks associated with an application executing on a mobile device of the user.

Claims (38)

1. A method for improving accessibility of a mobile application using a wearable device, the method comprising:

at a first computing device:

determining a spatial relationship between the first computing device and a wearable computing device;

determining a desired spatial relationship between the first computing device and the wearable computing device, the desired spatial relationship based upon a location of a feature of an application executing on the first computing device;

determining a movement direction, based upon a comparison between the spatial relationship and the desired spatial relationship, to move the wearable computing device towards the feature of the application executing on the first computing device;

select a haptic feedback scheme based upon the movement direction; and

causing the haptic feedback scheme to be delivered to a user through the wearable computing device.

2. The method of claim 1 , wherein the wearable computing device is a smart ring, and wherein the haptic feedback scheme includes varying patterns of vibration to guide a finger of the user towards the feature of the application.

3. The method of claim 1 , wherein the first computing device is a smartphone, and the feature of the application is a button on a touch screen of the smartphone, the method further comprising using a camera of the smartphone to determine the spatial relationship between the smartphone and the wearable computing device.

4. The method of claim 1 , wherein the determining of the spatial relationship includes utilizing a sensor fusion algorithm that combines data from multiple sensors including at least an accelerometer and a gyroscope within the wearable computing device.

5. The method of claim 1 , wherein the haptic feedback scheme includes a sequence of haptic signals that correspond to directional cues, guiding the user through a series of movements to navigate within the application executing on the first computing device.

6. The method of claim 1 , wherein the haptic feedback scheme further comprises haptic intensity cues, which varies an intensity of the haptic feedback according to a proximity of the wearable computing device to the feature of the application.

7. The method of claim 1 , wherein the application executing on the first computing device is a digital wallet application, and the feature of the application is a payment confirmation button.

8. A computing device comprising:

a processor;

a memory, storing instructions which when performed by the processor, cause the processor to perform operations comprising:

determining a spatial relationship between the computing device and a wearable computing device;

determining a desired spatial relationship between the computing device and the wearable computing device, the desired spatial relationship based upon a location of a feature of an application executing on the computing device;

determining a movement direction, based upon a comparison between the spatial relationship and the desired spatial relationship, to move the wearable computing device towards the feature of the application executing on the computing device;

select a haptic feedback scheme based upon the movement direction; and

causing the haptic feedback scheme to be delivered to a user through the wearable computing device.

9. The computing device of claim 8 , wherein the wearable computing device is a smart ring, and wherein the haptic feedback scheme includes varying patterns of vibration to guide a finger of the user towards the feature of the application.

10. The computing device of claim 8 , wherein the computing device is a smartphone, and the feature of the application is a button on a touch screen of the smartphone, and wherein the operations further comprise using a camera of the smartphone to determine the spatial relationship between the smartphone and the wearable computing device.

11. The computing device of claim 8 , wherein the operations of determining the spatial relationship includes utilizing a sensor fusion algorithm that combines data from multiple sensors including at least an accelerometer and a gyroscope within the wearable computing device.

12. The computing device of claim 8 , wherein the haptic feedback scheme includes a sequence of haptic signals that correspond to directional cues, guiding the user through a series of movements to navigate within the application executing on the computing device.

13. The computing device of claim 8 , wherein the haptic feedback scheme further comprises haptic intensity cues, which varies an intensity of the haptic feedback according to a proximity of the wearable computing device to the feature of the application.

14. The computing device of claim 8 , wherein the application executing on the computing device is a digital wallet application, and the feature of the application is a payment confirmation button.

15. A non-transitory machine-readable medium, storing instructions, which when executed by a computing device, cause the computing device to perform operations comprising:

determining a spatial relationship between the computing device and a wearable computing device;

determining a desired spatial relationship between the computing device and the wearable computing device, the desired spatial relationship based upon a location of a feature of an application executing on the computing device;

determining a movement direction, based upon a comparison between the spatial relationship and the desired spatial relationship, to move the wearable computing device towards the feature of the application executing on the first computing device;

select a haptic feedback scheme based upon the movement direction; and

causing the haptic feedback scheme to be delivered to a user through the wearable computing device.

16. The non-transitory machine-readable medium of claim 15 , wherein the wearable computing device is a smart ring, and wherein the haptic feedback scheme includes varying patterns of vibration to guide a finger of the user towards the feature of the application.

17. The non-transitory machine-readable medium of claim 15 , wherein the computing device is a smartphone, and the feature of the application is a button on a touch screen of the smartphone, and wherein the operations further comprise using a camera of the smartphone to determine the spatial relationship between the smartphone and the wearable computing device.

18. The non-transitory machine-readable medium of claim 15 , wherein the determining of the spatial relationship includes utilizing a sensor fusion algorithm that combines data from multiple sensors including at least an accelerometer and a gyroscope within the wearable computing device.

19. The non-transitory machine-readable medium of claim 15 , wherein the haptic feedback scheme includes a sequence of haptic signals that correspond to directional cues, guiding the user through a series of movements to navigate within the application executing on the machine.

20. The non-transitory machine-readable medium of claim 15 , wherein the haptic feedback scheme further comprises haptic intensity cues, which varies an intensity of the haptic feedback according to a proximity of the wearable computing device to the feature of the application.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 26, 2024
From: GHOSH, DEBASHIS; HANSON, CARRIE ANNE; VOTAW, ELIZABETH S
To: WELLS FARGO BANK, N.A.
Reel/Frame 066897/0622 →
Continuity (3)
Continuation 18120572 · Mar 13, 2023
Continuation 17247145 · Dec 1, 2020
Related Publication 20240221476A1 · Jul 4, 2024
References Cited (43)
US 6413229B1 · Kramer et al. · 2002 [cited by applicant]
US 9477313B2 · Mistry et al. · 2016 [cited by applicant]
US 9569756B1 · Bueche, Jr. et al. · 2017 [cited by applicant]
US 9612661B2 · Wagner et al. · 2017 [cited by applicant]
US 9613505B2 · Martinson et al. · 2017 [cited by applicant]
US 9720515B2 · Wagner et al. · 2017 [cited by applicant]
US 9741215B2 · Brav et al. · 2017 [cited by applicant]
US 9829338B2 · Ward · 2017 [cited by applicant]
US 10154316B2 · Zhao · 2018 [cited by applicant]
US 10166466B2 · Brav et al. · 2019 [cited by applicant]
US 10216272B2 · Keller et al. · 2019 [cited by applicant]
US 10380993B1 · Clauer Salyers · 2019 [cited by applicant]
US 10423214B2 · Mistry et al. · 2019 [cited by applicant]
US 10444834B2 · Vescovi et al. · 2019 [cited by applicant]
US 10449445B2 · Brav et al. · 2019 [cited by applicant]
US 10574879B1 · Prasad et al. · 2020 [cited by applicant]
US 11134524B2 · Flast · 2021 [cited by examiner]
US 11605271B1 · Ghosh · 2023 [cited by examiner]
US 11961389B2 · Ghosh · 2024 [cited by examiner]
US 20060024647A1 · Chesnais et al. · 2006 [cited by applicant]
US 20160134737A1 · Pulletikurty · 2016 [cited by applicant]
US 20160296839A1 · Brav et al. · 2016 [cited by applicant]
US 20170011602A1 · Brav et al. · 2017 [cited by applicant]
US 20190324536A1 · Forest et al. · 2019 [cited by applicant]
US 20190391645A1 · Vescovi et al. · 2019 [cited by applicant]
US 20200314346A1 · Mukul · 2020 [cited by examiner]
US 20230215249A1 · Ghosh et al. · 2023 [cited by applicant]
“U.S. Appl. No. 17/247,145, Non Final Office Action mailed Jun. 8, 2022”. [cited by applicant]
“U.S. Appl. No. 17/247,145, Notice of Allowance mailed Nov. 9, 2022”. [cited by applicant]
“U.S. Appl. No. 17/247,145, Response filed Sep. 6, 2022 to Non Final Office Action mailed Jun. 8, 2022”, 10 pgs. [cited by applicant]
“U.S. Appl. No. 18/120,572, Non Final Office Action mailed Jul. 6, 2023”, 7 pgs. [cited by applicant]
“U.S. Appl. No. 18/120,572, Notice of Allowance mailed Dec. 11, 2023”, 7 pgs. [cited by applicant]
“U.S. Appl. No. 18/120,572, Response filed Oct. 6, 2023 to Non Final Office Action mailed Jul. 6, 2023”, 7 pgs. [cited by applicant]
“McLear”, [Online]. Retrieved from the Internet: <URL: https://mclear.com/>, (Accessed Oct. 5, 2020), 18 pgs. [cited by applicant]
“Motiv Ring”, [Online]. Retrieved from the Internet: <URL: https://mymotiv.com/>, (Accessed Oct. 5, 2020), 6 pgs. [cited by applicant]
“NFC Ring”, McLear Ltd., [Online]. Retrieved from the Internet: <URL: https://nfcring.com/>, (Accessed Oct. 5, 2020), 4 pgs. [cited by applicant]
“Oura”, [Online]. Retrieved from the Internet: <URL: https://ouraring.com/>, (Accessed Oct. 5, 2020), 6 pgs. [cited by applicant]
“Token”, [Online]. Retrieved from the Internet: <URL: https://tokenring.com/>, (Accessed Oct. 5, 2020), 6 pgs. [cited by applicant]
Ghiani, Giuseppe, et al., “(Abstract) Vibrotactile feedback to aid blind users of mobile guides”, Journal of Visual Languages & Computing 20 (5) pp. 305-317, (2009), 2 pgs. [cited by applicant]
Meliones, Apostolos, et al., “Blind MuseumTourer: A system for self-guided tours in museums and blind indoor navigation”, Technologies 6 (4), [Online]. Retrieved from the Internet: <URL: https://www.mdpi.com/2227-7080/6… [cited by applicant]
Satpute, Shantanu, “FingerSight: A Vibrotactile Wearable Ring to Help the Blind Locate and Reach Objects in Peripersonal Space”, Thesis, University of Pittsburgh, [Online]. Retrieved from the Internet: <URL: http://d-sc… [cited by applicant]
Shoval, Shraga, et al., “Computerized obstacle avoidance systems for the blind and visually impaired”, Intelligent systems and technologies in rehabilitation engineering, (2000), 25 pgs. [cited by applicant]
Zeng, L, et al., “HapticRein: Design and Development of an Interactive Haptic Rein for a Guidance Robot”, International Conference on Computers Helping People with Special Needs, (2018), 14 pgs. [cited by applicant]