IP Library › Granted Patent US 12,373,032
Granted Patent B2
US 12,373,032 · App. 17/917,761 · Granted Jul 29, 2025

Methods and systems for controlling a haptic display

Inventors: Jeremy Cooperstock (Westmount, CA); Antoine Weill-Duflos (Verdun, CA); Juliette Regimbal (Verdun, CA); Nusaiba Radi (Montreal, CA); Jeffrey Blum (Montreal, CA); Parisa Alirezaee (Montreal, CA); Yukai Zhang (Montreal, CA)
Assignee: THE ROYAL INSTITUTION FOR THE ADVANCEMENT OF LEARNING / MCGILL UNIVERSITY
G06F3/016A61B5/742A61B5/7455
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,373,032
App. No.
17/917,761
Granted
Jul 29, 2025
Kind
B2
Abstract

Methods and systems for controlling a haptic display are provided. Data associated with first and second data types is obtained, the data defining values for the first and second data types. The first and second data types are associated to first and second vibration features of the haptic display, respectively, the second vibration feature different from the first vibration feature. A vibration pattern comprising a plurality of vibration pulses representing the first and second vibration features within a common time interval is produced on the haptic display, wherein the first vibration feature is expressed based on the values of the data for the first data type and the second vibration feature is expressed based on the values of the data for the second data type.

Claims (40)

1. A method for controlling a haptic display, comprising:

obtaining data associated with first and second data types, the data defining values for the first and second data types, the first data type relating to a first parameter of a plurality of measurable parameters associated with an operating environment of the haptic display, and the second data type relating to a second parameter of the plurality of parameters, the second parameter different from the first parameter;

associating the first and second data types to first and second vibration features of the haptic display, respectively, the second vibration feature different from the first vibration feature; and

producing, on the haptic display, a vibration pattern comprising a plurality of vibration pulses representing the first and second vibration features within a common time interval, the first vibration feature relating to a first parameter of the vibration pattern and the second vibration feature relating to a second parameter of the vibration pattern, wherein the first vibration feature is expressed based on the values of the data for the first data type and the second vibration feature is expressed based on the values of the data for the second data type.

2. The method of claim 1 , wherein the producing of the vibration pattern comprises producing a count of vibration pulses within the common time interval at a vibration tempo, wherein the first vibration feature is the vibration tempo, and wherein the second vibration feature is the count of vibration pulses.

3. The method of claim 2 , wherein the obtaining of the data associated with the first and second data types comprises obtaining a heart rate of a subject and a blood pressure of the subject.

4. The method of claim 1 , comprising:

obtaining additional data associated with at least one third data type, the additional data defining additional values for the at least one third data type; and

associating the at least one third data type to at least one third vibration feature of the haptic display, the at least one third vibration feature different from the first and second vibration features;

wherein the producing, on the haptic display, of the vibration pattern comprises producing the plurality of vibration pulses to represent the at least one third vibration feature within the common time interval, wherein the at least one third vibration feature is expressed based on the additional values for the at least one third data type.

5. The method of claim 4 , wherein the producing of the vibration pattern comprises producing a count of vibration pulses within the common time interval at a vibration tempo, wherein the first vibration feature is the vibration tempo, wherein the second vibration feature is the count of vibration pulses, and wherein one of the at least one third vibration features is a frequency composition of the vibration pulses.

6. The method of claim 5 , wherein the obtaining of the data associated with the first and second data types comprises obtaining a heart rate of a subject and a blood pressure of the subject, and wherein the obtaining of the additional data associated with the at least one third data type comprises obtaining a level of peripheral oxygen saturation of the subject.

7. The method of claim 5 , wherein the producing of the plurality of vibration pulses to represent the at least one third vibration feature within the common time interval comprises producing the vibration pulses with one of dissonant frequency compositions and consonant frequency compositions to express the additional values for the at least one third data type.

8. The method of claim 4 , wherein the producing of the vibration pattern comprises producing a count of vibration pulses within the common time interval at a vibration tempo, wherein the first vibration feature is the vibration tempo, wherein the second vibration feature is the count of vibration pulses, and wherein one of the at least one third vibration features is an intensity of the vibration pulses.

9. The method of claim 1 , wherein the first vibration feature being expressed based on the values of the data for the first data type comprises selecting one of a plurality of first discrete states of the first vibration feature based on the values of the data of the first data type, and wherein the second vibration feature being expressed based on the values of the data for the second data type comprises selecting one of a plurality of second discrete states of the second vibration feature.

10. The method of claim 9 , wherein the first and second pluralities of discrete states are associated with low, normal, and high values for the data of the first and second data types relative to predetermined ranges for the first and second data types.

11. The method of claim 1 , further comprising:

detecting at least one change in the data associated with the first and second data types; and

producing, on the haptic display, an updated vibration pattern to reflect the at least one change as detected.

12. A system for controlling a haptic display, comprising:

a processing unit; and

a non-transitory computer-readable medium having stored thereon computer-readable instructions executable by the processing unit for:

obtaining data associated with first and second data types, the data defining values for the first and second data types, the first data type relating to a first parameter of a plurality of measurable parameters associated with an operating environment of the haptic display, and the second data type relating to a second parameter of the plurality of parameters, the second parameter different from the first parameter;

associating the first and second data types to first and second vibration features of the haptic display, respectively, the second vibration feature different from the first vibration feature; and

producing, on the haptic display, a vibration pattern comprising a plurality of vibration pulses representing the first and second vibration features within a common time interval, the first vibration feature relating to a first parameter of the vibration pattern and the second vibration feature relating to a second parameter of the vibration pattern, wherein the first vibration feature is expressed based on the values of the data for the first data type and the second vibration feature is expressed based on the values of the data for the second data type.

13. The system of claim 12 , wherein the producing of the vibration pattern comprises producing a count of vibration pulses within the common time interval at a vibration tempo, wherein the first vibration feature is the vibration tempo, and wherein the second vibration feature is the count of vibration pulses.

14. The system of claim 13 , wherein the obtaining of the data associated with the first and second data types comprises obtaining a heart rate of a subject and a blood pressure of the subject.

15. The system of claim 13 , the computer-readable instructions are executable for:

obtaining additional data associated with at least one third data type, the additional data defining additional values for the at least one third data type; and

associating the at least one third data type to at least one third vibration feature of the haptic display, the at least one third vibration feature different from the first and second vibration features;

wherein the producing, on the haptic display, of the vibration pattern comprises producing the plurality of vibration pulses to represent the at least one third vibration feature within the common time interval, wherein the at least one third vibration feature is expressed based on the additional values for the at least one third data type.

16. The system of claim 15 , wherein the producing of the vibration pattern comprises producing a count of vibration pulses within the common time interval at a vibration tempo, wherein the first vibration feature is the vibration tempo, wherein the second vibration feature is the count of vibration pulses, and wherein one of the at least one third vibration features is a frequency composition of the vibration pulses.

17. The system of claim 16 , wherein the obtaining of the data associated with the first and second data types comprises obtaining a heart rate of a subject and a blood pressure of the subject, and wherein the obtaining of the additional data associated with the at least one third data type comprises obtaining a level of peripheral oxygen saturation of the subject.

18. The system of claim 16 , wherein the producing of the plurality of vibration pulses to represent the at least one third vibration feature within the common time interval comprises producing the vibration pulses with one of dissonant frequency compositions and consonant frequency compositions to express the additional values for the at least one third data type.

19. The system of claim 15 , wherein the producing of the vibration pattern comprises producing a count of vibration pulses within the common time interval at a vibration tempo, wherein the first vibration feature is the vibration tempo, wherein the second vibration feature is the count of vibration pulses, and wherein one of the at least one third vibration features is an intensity of the vibration pulses.

20. The system of claim 12 , wherein the first vibration feature being expressed based on the values of the data for the first data type comprises selecting one of a plurality of first discrete states of the first vibration feature based on the values of the data of the first data type, and wherein the second vibration feature being expressed based on the values of the data for the second data type comprises selecting one of a plurality of second discrete states of the second vibration feature.

21. The system of claim 20 , wherein the first and second pluralities of discrete states are associated with low, normal, and high values for the data of the first and second data types relative to predetermined ranges for the first and second data types.

22. The system of claim 12 , wherein the computer-readable instructions are further executable by the processing unit for:

detecting at least one change in the data associated with the first and second data types; and

producing, on the haptic display, an updated vibration pattern to reflect the at least one change as detected.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 2, 2025
From: COOPERSTOCK, JEREMY; WEILL-DUFLOS, ANTOINE; REGIMBAL, JULIETTE; RADI, NUSAIBA; BLUM, JEFFREY; ALIREZAEE, PARISA; ZHANG, YUKAI
To: THE ROYAL INSTITUTION FOR THE ADVANCEMENT OF LEARNING / MCGILL UNIVERSITY
Reel/Frame 071594/0064 →
Continuity (2)
Provisional Application 63006141 · Apr 7, 2020
Related Publication 20230168738A1 · Jun 1, 2023
References Cited (64)
US 8004391B2 · Cruz Hernandez · 2011 [cited by examiner]
US 8390218B2 · Houston et al. · 2013 [cited by applicant]
US 9049998B2 · Brumback et al. · 2015 [cited by applicant]
US 10228764B2 · Levesque · 2019 [cited by examiner]
US 10276001B2 · Smith, IV · 2019 [cited by examiner]
US 10504339B2 · Birnbaum · 2019 [cited by examiner]
US 11376087B2 · Verner · 2022 [cited by examiner]
US 20060003812A1 · Moody et al. · 2006 [cited by applicant]
US 20190325716A1 · Khoshkava · 2019 [cited by examiner]
Maclean et al., “Perceptual Design of Haptic Icons”, 2003, University of British Columbia. [cited by applicant]
Brewster et al., “Tactons: Structured Tactile Messages for Non-Visual Information Display”, vol. 28. Australian Computer Society, 2004, 15-23. [cited by applicant]
Ryu et al., “Vibrotactile Feedback for Information Delivery in the Vehicle”, IEEE Transactions on Haptics 3(2):138-149, 2010, DOI: 10.1109/TOH.2010.1. [cited by applicant]
Alirezaee et al., Exploring the Effectiveness of Haptic Alarm Displays for Critical Care Environments, IEEE Haptics Symposium (Haptics), 2020, pp. 948-954, DOI: 10.1109/HAPTICS45997.2020.ras.HAP20.156.6c3cc0bf. [cited by applicant]
Barralon et al., “Development and Evaluation of Multidimensional Tactons for a Wearable Tactile Display”, MobileHCI '07: 9th international conference, 2007, DOI: 10.1145/1377999.137800. [cited by applicant]
Lim et al., “TouchPhoto: Enabling Independent Picture Taking and Understanding for Visually-Impaired Users”, Lecture Notes in Electrical Engineering, 2019, DOI: 10.1007/978-981-13-3194-7_62. [cited by applicant]
Fontana De Vargas et al., “Speaking Haptically: From Phonemes to Phrases With a Mobile Haptic Communication System”, IEEE Trans Haptics, 202; 14(3):479-490. doi: 10.1109/TOH.2021.3054812. [cited by applicant]
Ternes et al., “Designing Large Sets of Haptic Icons with Rhythm”, Lecture Notes in Computer Science, 2008, DOI: 10.1007/978-3-540-69057-3_24. [cited by applicant]
Yoo et al., “Consonance of Vibrotactile Chords”, IEEE Transactions on Haptics 7(1):3-13, 2014, DOI: 10.1109/TOH.2013.57. [cited by applicant]
Park et al., “Perceptual Space of Amplitude-Modulated Vibrotactile Stimuli”, IEEE World Haptics Conference, 2011, DOI: 10.1109/WHC.2011.5945462. [cited by applicant]
Culbertson et al., “WAVES: A Wearable Asymmetric Vibration Excitation System for Presenting Three-Dimensional Translation and Rotation Cues”, CHI Conference on Human Factors in Computing Systems pp. 4972-4982, 2017, DOI… [cited by applicant]
Blum et al., “Single-Actuator Vibrotactile Numeric Information Delivery in the Face of Distraction”, IEEE World Haptics Conference, 2019, DOI: 10.1109/WHC.2019.8816082. [cited by applicant]
Vyas et al., “HapToes: Vibrotactile Numeric Information Delivery via Tactile Toe Display”, IEEE Haptics Symposium, 2020, DOI: 10.1109/HAPTICS45997.2020.ras. HAP20.34.8ad689d4. [cited by applicant]
Regimbal et al., “Single-Actuator Simultaneous Haptic Rendering for Multiple Vital Signs”, Lecture Notes in Computer Science, 2020. [cited by applicant]
Houtsma, Adrianus J. M., “Estimation of mutual information from limited experimental data”, Journal of the Acoustical Society of America 74 (1983): 1626-1629. [cited by applicant]
Durlach et al., “Resolution in one dimension with random variations in background dimensions”, Attention Perception & Psychophysics, 46(3):293-296, 1989, DOI: 10.3758/BF03208094. [cited by applicant]
Azadi et al., “Evaluating Vibrotactile Dimensions for the Design of Tactons”, IEEE Transactions on Haptics, 7(1):14-23, 2014, DOI: 10.1109/TOH.2013.2296051. [cited by applicant]
Chen et al., “Design and Evaluation of Identifiable Key-Click Signals for Mobile Devices”, IEEE Transactions on Haptics, 4(4):229-241, 2011, DOI: 10.1109/TOH.2011.21. [cited by applicant]
Sherrick, Carl E., “A scale for rate of tactual vibration.” The Journal of the Acoustical Society of America vol. 78, Pt 1 (1985): 78-83, 1985, DOI: 10.1121/1.392457. [cited by applicant]
Sofia, Katherine O., “Mechanical and Pyschophysical Studies of Surface Wave Propagation during Vibrotactile Stimulation” IEEE Transactions on Haptics, vol. 6, Issue 3, 2012, DOI: 10.1109/TOH.2013.1. [cited by applicant]
Cholewiak et al., “Vibrotactile Targeting in Multimodal Systems: Accuracy and Interaction”, IEEE 14th Symposium on Haptics, 2006, DOI: 10.1109/HAPTIC.2006.1627100. [cited by applicant]
Brown et al., “Multidimensional Tactons for Non-Visual Information Presentation in Mobile Devices”, IEEE 14th Symposium on Haptics, 2006, DOI: 10.1109/HAPTIC.2006.1627100. [cited by applicant]
Lee et al., “BuzzWear: Alert Perception in Wearable Tactile Displays on the Wrist”, CHI '10: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, p. 433-442, 2010, DOI: 10.1145/1753326.17533. [cited by applicant]
Tan et al., “Information transmission with a multifinger tactual display”, Perception & Psychophysics, 61(6):993-1008, 1999. [cited by applicant]
Park et al., “Haptic Enchanters: Attachable and Detachable Vibrotactile Modules and Their Advantages”, IEEE Transactions on Haptics, vol. 12, Issue 1, 2018, DOI: 10.1109/TOH.2018.2859955. [cited by applicant]
Tan et al., “Methodology for Maximizing Information Transmission of Haptic Devices: A Survey”, Proceedings of the IEEE, vol. 108 Issue: 6, 2020, DOI: 10.1109/JPROC.2020.2992561. [cited by applicant]
Chan et al., “Learning and Identifying Haptic Icons under Workload”, First Joint Eurohaptics Conference, 2005, DOI: 10.1109/WHC.2005.86. [cited by applicant]
Rabinowitz et al., “Multidimensional tactile displays: Identification of vibratory intensity, frequency, and contactor area”, The Journal of the Acoustical Society of America 82, 1243, 1987, DOI: 10.1121/1.395260. [cited by applicant]
Blum et al., “Expressing Human State via Parameterized Haptic Feedback for Mobile Remote Implicit Communication”, Proceedings of the 7th Augmented Human International Conference, 2016. [cited by applicant]
Blum et al., “Pseudo-Ambience: Filling the Gap Between Notifications and Continuous Information Displays”, Proceedings of the 7th Augmented Human International Conference, 2016. [cited by applicant]
Stoelting, Robert K., “APSF Stresses Use of Audible Monitor Alarms”, The Official Journal of the Anesthesia Patient Safety Foundation, vol. 19, No. 2, 17-28, 2004. [cited by applicant]
Berglund et al., “Guidelines for Community Noise”, World Health Organization, 1999. [cited by applicant]
Brown et al., “A First Investigation into the Effectiveness of Tactons”, IEEE First Joint Eurohaptics Conference, 2005, DOI: 10.1109/WHC.2005.6. [cited by applicant]
Cvach, Maria, “Monitor alarm fatigue: an integrative review” Biomed Instrum Technol, 46(4):268-77, 2012, DOI: 10.2345/0899-8205-46.4.268. [cited by applicant]
Darbyshire et al., “An investigation of sound levels on intensive care units with reference to the WHO guidelines”, Crit Care, 3;17(5):R187, 2013, DOI: 10.1186/cc12870. [cited by applicant]
Ferris et al., “Continuously Informing Vibrotactile Displays in Support of Attention Management and Multitasking in Anesthesiology”, Hum Factors, 53(6):600-11, 2011, DOI: 10.1177/0018720811425043. [cited by applicant]
Formby et al., “The role of frequency selectivity in measures of auditory and vibrotactile temporal resolution”, J Acoust Soc Am, 91(1):293-305, 1992, DOI: 10.1121/1.402772. [cited by applicant]
Franzen, Ove, “Vibrotactile Frequency Discrimination”, Perception & Psychophysics, 17(5), 480-484, 1975, DOI: 10.3758/BF03203298. [cited by applicant]
Gomes et al., “The evaluation of tactile parameters and display prototype to support physiological monitoring and multitasking for anesthesia providers in the operating room”, IEEE Trans Haptics, 13(3):628-644, 2020, DO… [cited by applicant]
Katzman et al., “Evaluation of tactile cues for simulated patients' status under high and low workload”, Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 63(1):658-662, 2019, DOI: 10.1177/10711813… [cited by applicant]
Blum et al., “Habituation to Pseudo-Ambient Vibrotactile Patterns for Remote Awareness”, IEEE Haptics Symposium, 2020, DOI: 10.1109/HAPTICS45997.2020.ras.HAP20.153.550dbcba. [cited by applicant]
Ng et al., “Vibro-Monitor: A Vibrotactile display for Physiological Data Monitoring”, 2004. [cited by applicant]
Otenio et al., “Noise level in a 222 bed hospital in the 18th health region—PR”, Braz J Otorhinolaryngol, 73 (2):245-50, 2007, DOI: 10.1016/s1808-8694(15)31073-9. [cited by applicant]
Sendelbach et al., “Alarm Fatigue: A Patient Safety Concern”, AACN Adv Crit Care, 24(4):378-86, 2013, DOI: 10.1097/NCI.0b013e3182a903f9. [cited by applicant]
Van Erp et al., “Tactile Torso Display as Countermeasure to Reduce Night Vision Goggles Induced Drift” Spatial Disorientation in Military Vehicles: Causes, Consequences and Cures, 49-1-49-8, 2003. [cited by applicant]
Xie et al., “Clinical review: The impact of noise on patients' sleep and the effectiveness of noise reduction strategies in intensive care units”, Crit Care, 13(2):208, 2009, DOI: 10.1186/cc7154. [cited by applicant]
Yao et al., “Design and analysis of a recoil-type vibrotactile transducer”, The Journal of the Acoustical Society of America, vol. 128, 128(2):619-27, 2010, DOI: 10.1121/1.3458852. [cited by applicant]
Brewster et al., “Non-visual information display using tactons”, CHI '04 Extended Abstracts on Human Factors in Computing Systems, 787-788, 2004, DOI: 10.1145/985921.985936. [cited by applicant]
Brown et al., “Tactile crescendos and sforzandos: applying musical techniques to tactile icon design”, CHI '06 Extended Abstracts on Human Factors in Computing Systems, 610-615, 2006, DOI: 10.1145/1125451.1125578. [cited by applicant]
Lee et al., “Real-time perception-level translation from audio signals to vibrotactile effects”, CHI '13: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2567-2576, 2013, DOI: 10.1145/2470654… [cited by applicant]
Brewster et al., “An Investigation into the Use of Tactons to Present Progress Information”, Human-Computer Interaction—Interact 2005, 6-17, DOI: 10.1007/11555261_4. [cited by applicant]
Sullivan et al., “Multi-Sensory Stimuli Improve Distinguishability of Cutaneous Haptic Cues”, IEEE Transactions on Haptics, vol. 13, Issue 2, 2019, DOI: 10.1109/TOH.2019.2922901. [cited by applicant]
Raza et al., “Pneumatically Controlled Wearable Tactile Actuator for Multi-Modal Haptic Feedback”, IEEE Access, vol. 12, 2024, DOI: 10.1109/ACCESS.2024.3376753. [cited by applicant]
Hwang et al., “Real-Time Dual-Band Haptic Music Player for Mobile Devices”, IEEE Transactions on Haptics, vol. 6, Issue 3, 2013, DOI: 10.1109/TOH.2013.7. [cited by applicant]
Talhan et al., “Tactile Ring: Multi-Mode Finger-Worn Soft Actuator for Rich Haptic Feedback”, IEEE Access PP(99):1-1, DOI: 10.1109/ACCESS.2019.2961430. [cited by applicant]