IP Library Granted Patent US 11,899,840
Granted Patent B2
US 11,899,840 · App. 17/210,014 · Granted Feb 13, 2024

Haptic emulation of input device

Inventors: Kevin Wayne Beck (Raleigh, NC); Russell Speight VanBlon (Raleigh, NC); Thorsten Peter Stremlau (Morrisville, NC); Aaron Michael Stewart (Raleigh, NC)
Assignee: Lenovo (Singapore) Pte. Ltd.
G06F3/016G06F3/014G06F3/04886
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,899,840
App. No.
17/210,014
Granted
Feb 13, 2024
Kind
B2
Abstract

One embodiment provides a method, including: detecting, using a processor of an information handling device and in a virtual environment, a user input directed to a virtual human input device; accessing, from a data store, sensation data associated with user interaction with a real-world counterpart device of the virtual human input device; and providing, based on the sensation data and using a wearable haptic device, a haptic output responsive to the user input, wherein the haptic output emulates an interaction feel of the user input provided to the real-world counterpart device. Other aspects are described and claimed.

Claims (34)

1. A method, comprising:

detecting, using a processor of an information handling device and in a virtual environment, a user input directed to a virtual human input device;

accessing, from a data store, sensation data associated with user interaction with a real-world counterpart device of the virtual human input device, wherein acquiring the sensation data occurs during the user's normal utilization of the real-world counterpart device and comprises dynamically recording and passively collecting interaction data of the user with the real-world counterpart device, wherein the sensation data comprises a nature of a real-world environment associated with the user input directed to the virtual human input device and hand characteristic data, wherein the nature of the real-world environment comprises at least one contextual aspect of the environment; and

providing, based on the sensation data and using a wearable haptic device, a haptic output responsive to the user input, wherein the haptic output emulates an interaction feel of the user input provided to the real-world counterpart device utilizing the sensation data to adjust characteristics of the haptic output to match characteristics of the sensation data, wherein the providing comprises modifying the sensation data utilized to provide the haptic output based upon the hand characteristic data.

2. The method of claim 1 , wherein the virtual human input device is selected from the group consisting of: a virtual keyboard, a virtual touchpad, a virtual mouse, a virtual joystick, a virtual stylus, and a virtual trackball.

3. The method of claim 1 , wherein the virtual environment is one of:

an augmented reality (AR) environment and a virtual reality (VR) environment.

4. The method of claim 1 , wherein the wearable haptic device is a haptic glove.

5. The method of claim 1 , wherein the sensation data comprises interaction force data for a user interacting with the real-world counterpart device.

6. The method of claim 1 , wherein the sensation data comprises orientation data associated with a user during provision of the user input to the virtual human input device.

7. The method of claim 1 , wherein the hand characteristic data corresponds to at least one metric selected from the group consisting of: hand size data, finger size data, input posture data, input trajectory data, and input speed data.

8. The method of claim 1 , wherein the sensation data comprises audible feedback data associated with user interaction with the real-world counterpart device.

9. The method of claim 1 , wherein the sensation data is derived during a dedicated training period.

10. An information handling device, comprising:

a sensor;

a wearable haptic device;

a processor;

a memory device that stores instructions executable by the processor to:

display a virtual object;

detect, in a virtual environment, a user input directed to a virtual human input device;

access, from a data store, sensation data associated with user interaction with a real-world counterpart device of the virtual human input device, wherein acquiring the sensation data occurs during the user's normal utilization of the real-world counterpart device and comprises dynamically recording and passively collecting interaction data of the user with the real-world counterpart device, wherein the sensation data comprises a nature of a real-world environment associated with the user input directed to the virtual human input device and hand characteristic data, wherein the nature of the real-world environment comprises at least one contextual aspect of the environment; and

provide, based on the sensation data and using a wearable haptic device, a haptic output responsive to the user input, wherein the haptic output emulates an interaction feel of the user input provided to the real-world counterpart device utilizing the sensation data to adjust characteristics of the haptic output to match characteristics of the sensation data, wherein the providing comprises modifying the sensation data utilized to provide the haptic output based upon the hand characteristic data.

11. The information handling device of claim 10 , wherein the virtual human input device is selected from the group consisting of: a virtual keyboard, a virtual touchpad, a virtual mouse, a virtual joystick, a virtual stylus, and a virtual trackball.

12. The information handling device of claim 10 , wherein the virtual environment is one of: an augmented reality (AR) environment and a virtual reality (VR) environment.

13. The information handling device of claim 10 , wherein the wearable haptic device is a haptic glove.

14. The information handling device of claim 10 , wherein the sensation data comprises interaction force data for a user interacting with the real-world counterpart device.

15. The information handling device of claim 10 , wherein the sensation data comprises orientation data associated with a user during provision of the user input to the virtual human input device.

16. The information handling device of claim 10 , wherein the hand characteristic data corresponds to at least one metric selected from the group consisting of: hand size data, finger size data, input posture data, input trajectory data, and input speed data.

17. The information handling device of claim 10 , wherein the sensation data comprises audible feedback data associated with user interaction with the real-world counterpart device.

18. A product, comprising:

a storage device that stores code, the code being executable by a processor and comprising:

code that detects, in a virtual environment, a user input directed to a virtual human input device;

code that accesses, from a data store, sensation data associated with user interaction with a real-world counterpart device of the virtual human input device, wherein acquiring the sensation data occurs during the user's normal utilization of the real-world counterpart device and comprises dynamically recording and passively collecting interaction data of the user with the real-world counterpart device, wherein the sensation data comprises a nature of a real-world environment associated with the user input directed to the virtual human input device and hand characteristic data, wherein the nature of the real-world environment comprises at least one contextual aspect of the environment; and

code that provides, based on the sensation data and on a wearable haptic device, a haptic output responsive to the user input, wherein the haptic output emulates an interaction feel of the user input provided to the real-world counterpart device utilizing the sensation data to adjust characteristics of the haptic output to match characteristics of the sensation data, wherein the providing comprises modifying the sensation data utilized to provide the haptic output based upon the hand characteristic data.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 20, 2025
From: LENOVO (SINGAPORE) PTE LTD.
To: LENOVO PC INTERNATIONAL LIMITED
Reel/Frame 070266/0946 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 20, 2025
From: LENOVO PC INTERNATIONAL LIMITED
To: LENOVO SWITZERLAND INTERNATIONAL GMBH
Reel/Frame 070269/0092 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 23, 2021
From: BECK, KEVIN WAYNE; VANBLON, RUSSELL SPEIGHT; STREMLAU, THORSTEN PETER; STEWART, AARON MICHAEL
To: LENOVO (SINGAPORE) PTE. LTD.
Reel/Frame 055689/0611 →
Continuity (1)
Related Publication 20220308669A1 · Sep 29, 2022