IP Library Granted Patent US 11,666,821
Granted Patent B2
US 11,666,821 · App. 17/112,015 · Granted Jun 6, 2023

Thermo-haptics for a pointing device for gaming

Inventors: Deeder M. Aurongzeb (Austin, TX); Peng Lip Goh (Singapore, SG)
Assignee: Dell Products, LP
A63F13/285G06N20/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,666,821
App. No.
17/112,015
Granted
Jun 6, 2023
Kind
B2
Abstract

An information handling system may include a processor, a data storage device, a power management unit, a thermo-haptic mouse, including an array of thermoelectric generators of a thermo-haptic module to selectively heat or cool a portion of the thermo-haptic mouse to be felt by a user of the thermo-haptic mouse, and a piezoelectric actuator of the thermo-haptic module to selectively apply a vibration to the portions of the thermo-haptic mouse to be felt by the user of the thermo-haptic mouse, and the processor executing code of a mouse training machine learning system to: receive, as training input, captured images during the execution of a gaming application and provide, as output, image recognition dataset descriptive of recognized game action event environmental data during execution of the gaming application, the image recognition dataset to be used by the processor executing a thermo-haptic feedback model evaluation system to provide thermo-haptic signals to the array of thermoelectric generators and the piezoelectric actuator to provide thermo-haptic feedback commensurate with the game action event environment during game play.

Claims (54)

1. An information handling system, comprising:

a processor;

a data storage device;

a power management unit;

a thermo-haptic mouse, including:

an array of thermoelectric generators of a thermo-haptic module to selectively heat or cool a portion of the thermo-haptic mouse to be felt by a user of the thermo-haptic mouse; and

a piezoelectric actuator of the thermo-haptic module to selectively apply a vibration to the portions of the thermo-haptic mouse to be felt by the user of the thermo-haptic mouse; and

the processor executing code of a mouse training machine learning system to:

receive, as training input, captured images during the execution of a gaming application; and

provide, as output, image recognition dataset descriptive of recognized game action event environmental data during execution of the gaming application, the image recognition dataset to be used by the processor executing a thermo-haptic feedback model evaluation system to provide thermo-haptic signals to the array of thermoelectric generators and the piezoelectric actuator to provide thermo-haptic feedback commensurate with the game action event environment during game play.

2. The information handling system of claim 1 , wherein the execution of the thermo-haptic feedback model evaluation system by the processor determines if a threshold accuracy of the output image recognition dataset has been reached before use of the output image recognition dataset by the processor for thermo-haptic feedback during execution of the gaming application.

3. The information handling system of claim 1 , wherein the array of thermoelectric generators arranged within an interior of a portion of the thermo-haptic mouse provide a plurality of hot or cold thermal zones across a surface of the thermo-haptic mouse to be touched by the user when actuated.

4. The information handling system of claim 1 , wherein the array of thermoelectric generators includes a flexible substrate to allow the thermoelectric generators to contour against an interior surface of a housing of the thermo-haptic mouse as a palm rest to be held by the user.

5. The information handling system of claim 1 , further comprising:

pairing a piezoelectric actuator with the array of thermoelectric generators in the thermo-haptic module, the piezoelectric actuator being placed below the array of thermoelectric generators sandwiching the thermoelectric generators between the piezoelectric actuators and an interior surface of a housing of the thermo-haptic mouse.

6. The information handling system of claim 1 , the thermo-haptic mouse further comprising:

a dedicated printed circuit board including a thermoelectric driver for the array of thermoelectric generators and a piezoelectric actuator driver for the piezoelectric actuator, the thermoelectric drivers and piezoelectric drivers operating via a controller on a mouse printed circuit board to receive the thermo-haptic signals.

7. The information handling system of claim 1 , wherein each thermoelectric generator in the array of thermoelectric generators further comprises a series of p-doped and n-doped semiconductors to receive a voltage to selectively heat or cool one or more of the semiconductors.

8. A thermo-haptic feedback pointing device operatively coupled to an information handling system, comprising:

at least one input button;

a housing including a palm rest housing;

and a motion tracking system to track movement of the thermo-haptic feedback pointing device;

a controller to receive haptic feedback data from a processor of the information handling system;

a thermoelectric driver operatively coupled to an array of thermoelectric generators to receive signals from the controller to selectively heat or cool portions of the thermo-haptic feedback pointing device to be felt by the user of the thermo-haptic feedback pointing device, the plurality of thermoelectric generators including a flexible substrate to allow the plurality of thermoelectric generators to contour against an interior surface of the palm rest housing of the thermo-haptic feedback pointing device; and

a piezoelectric driver operatively coupled to a piezoelectric actuator to selectively apply a mechanical haptic feedback to the portions of the thermo-haptic feedback pointing device to be felt by the user of the thermo-haptic feedback pointing device, wherein the piezoelectric actuator is operatively coupled to the array of thermoelectric generators, the piezoelectric actuator being placed below the array of thermoelectric generators sandwiching the array of thermoelectric generators between the piezoelectric actuator and an interior surface of the palm rest housing of the thermo-haptic feedback pointing device;

wherein the thermo-haptic feedback pointing device receives instructions to activate the piezoelectric actuator and array of thermoelectric generators corresponding to game action events of an executing gaming application originating from a haptic feedback machine learning system.

9. The thermo-haptic feedback pointing device of claim 8 , further comprising:

the piezoelectric actuator of a plurality of piezoelectric actuators paired to each array of thermoelectric generators of a plurality of arrays of thermoelectric generators, the piezoelectric actuators being placed below each array of thermoelectric generators sandwiching the arrays of thermoelectric generators between the piezoelectric actuators and an interior surface of the palm rest housing of the thermo-haptic feedback pointing device.

10. The thermo-haptic feedback pointing device of claim 8 , further comprising:

a dedicated printed circuit board including a plurality of thermoelectric drivers for each of the array of thermoelectric generators to render a thermo-haptic feedback across a plurality of arrays of thermoelectric generators.

11. The thermo-haptic feedback pointing device of claim 8 , further comprising:

a dedicated printed circuit board including a plurality of piezoelectric actuator drivers for each of a plurality of piezoelectric actuators to render a vibration haptic feedback across a plurality of piezoelectric actuators.

12. The thermo-haptic feedback pointing device of claim 8 , further comprising a wired connection with the information handling system, the wired connection including signal and power lines to the controller of the thermo-haptic feedback pointing device.

13. The thermo-haptic feedback pointing device of claim 8 , wherein the instructions to the thermo-haptic feedback pointing device originates from a haptic feedback machine learning system.

14. The thermo-haptic feedback pointing device of claim 8 , further comprising:

forming discrete heat and cold zones on a surface the housing of the thermo-haptic feedback pointing device by arranged plurality of arrays of thermoelectric generators against the interior surface of a palm rest housing of the thermo-haptic feedback pointing device to heat and cool one or more of the discrete heat and cold zones.

15. A thermo-haptic feedback pointing device operatively coupled to an information handling system, comprising:

at least one input button;

a housing including a palm rest housing;

and a motion tracking system to track movement of the thermo-haptic feedback pointing device;

a controller to receive haptic feedback data from a processor of the information handling system;

a thermoelectric driver operatively coupled to an array of thermoelectric generator to receive signals from the controller to selectively heat or cool portions of the thermo-haptic feedback pointing device to be felt by the user of the thermo-haptic feedback pointing device corresponding to the haptic feedback data, the plurality of thermoelectric generators including a flexible substrate to allow the plurality of thermoelectric generators to contour against an interior surface of the palm rest housing of the thermo-haptic feedback pointing device; and

a piezoelectric driver operatively coupled to a piezoelectric actuator to selectively apply a mechanical haptic feedback to the portions of the thermo-haptic feedback pointing device to be felt by the user of the thermo-haptic feedback pointing device corresponding to the haptic feedback data, wherein the piezoelectric actuator is operatively coupled to the array of thermoelectric generators, the piezoelectric actuator being placed below the array of thermoelectric generators sandwiching the array of thermoelectric generators between the piezoelectric actuator and an interior surface of the palm rest housing of the thermo-haptic feedback pointing device;

a dedicated printed circuit board including:

a plurality of thermoelectric drivers for each of a plurality of arrays of thermoelectric generators to render the selective heating or cooling across a plurality of arrays of thermoelectric generators; and

a plurality of piezoelectric actuator drivers for each of a plurality of piezoelectric actuators to render the mechanical haptic feedback across a plurality of piezoelectric actuators.

16. The thermo-haptic feedback pointing device of claim 15 , further comprising:

the piezoelectric actuator of a plurality of piezoelectric actuators paired to each array of thermoelectric generators of a plurality of arrays of thermoelectric generators, the piezoelectric actuators being placed below each array of thermoelectric generators sandwiching the arrays of thermoelectric generators between the piezoelectric actuators and an interior surface of the palm rest housing of the thermo-haptic feedback pointing device.

17. The thermo-haptic feedback pointing device of claim 15 , further comprising a wired connection with the information handling system, the wired connection including signal and power lines to the controller of the thermo-haptic feedback pointing device.

18. The thermo-haptic feedback pointing device of claim 15 , further comprising:

a wireless transceiver to send and receive data from the information handling system; and

a battery to power the controller, thermoelectric generators, and piezoelectric actuators.

19. The thermo-haptic feedback pointing device of claim 15 , wherein discrete heat and cold zones are formed on a surface of the palm rest housing of the thermo-haptic feedback pointing device by arranging the plurality of thermoelectric generators against an interior surface of the housing of the thermo-haptic feedback pointing device to concurrently heat and cool one or more of the discrete hot and cold zones.

20. The thermo-haptic feedback pointing device of claim 15 , wherein the thermo-haptic feedback pointing device receives instructions to activate the piezoelectric actuator and array of thermoelectric generators originating from a haptic feedback machine learning system inference model.

Assignments (9)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (055479/0342) Recorded Jun 10, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: EMC IP HOLDING COMPANY LLC; DELL PRODUCTS L.P.
Reel/Frame 062021/0460 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (055479/0051) Recorded Jun 10, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: EMC IP HOLDING COMPANY LLC; DELL PRODUCTS L.P.
Reel/Frame 062021/0663 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (056136/0752) Recorded Jun 10, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: EMC IP HOLDING COMPANY LLC; DELL PRODUCTS L.P.
Reel/Frame 062021/0771 →
RELEASE OF SECURITY INTEREST AT REEL 055408 FRAME 0697 Recorded Nov 2, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 058001/0553 →
SECURITY INTEREST Recorded Mar 3, 2021
From: EMC IP HOLDING COMPANY LLC; DELL PRODUCTS L.P.
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 056136/0752 →
SECURITY INTEREST Recorded Mar 3, 2021
From: EMC IP HOLDING COMPANY LLC; DELL PRODUCTS L.P.
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 055479/0051 →
SECURITY INTEREST Recorded Mar 3, 2021
From: EMC IP HOLDING COMPANY LLC; DELL PRODUCTS L.P.
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 055479/0342 →
SECURITY AGREEMENT Recorded Feb 25, 2021
From: EMC IP HOLDING COMPANY LLC; DELL PRODUCTS L.P.
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 055408/0697 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 4, 2020
From: AURONGZEB, DEEDER M.; GOH, PENG LIP
To: DELL PRODUCTS, LP
Reel/Frame 054547/0678 →