IP Library Granted Patent US 11,571,617
Granted Patent B2
US 11,571,617 · App. 17/127,503 · Granted Feb 7, 2023

System and method for coordinating gaming haptic response across peripheral device ecosystem

Inventors: Peng Lip Goh (Singapore, SG); Rex W. Bryan (Round Rock, TX); Deeder M. Aurongzeb (Austin, TX)
Assignee: Dell Products, LP
A63F13/285G06F3/016G06F3/0219G06F3/03543G06F3/04815G06V40/20H04R1/1008H04R1/1041G06V2201/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,571,617
App. No.
17/127,503
Granted
Feb 7, 2023
Kind
B2
Abstract

A haptic peripheral device ecosystem coordination system may comprise a display device displaying a three-dimensional (3D) gaming environment, the processor identifying a gaming action event occurring in the 3D gaming environment, based on a detected action event indicator, and determining a position of the gaming action event relative to a player avatar image within the 3D gaming environment, the processor transmitting a haptic command to a controller for a triggered haptic peripheral device, the haptic command selected based on an identification of the gaming action event, the triggered haptic peripheral device selected from a plurality of peripheral devices based on the position of the gaming action event, the controller for the triggered haptic peripheral causing haptic feedback at the triggered haptic peripheral device at a position relative to the user that is correlated to the position of the gaming action event with respect to the player avatar image.

Claims (48)

1. A haptic peripheral input/output device ecosystem coordination system for an information handling system, comprising:

a display device displaying a three-dimensional (3D) gaming environment;

a processor identifying a gaming action event occurring in the 3D gaming environment, and determining a position of the action event relative to a player avatar image within the 3D gaming environment for an action event indicator;

the processor transmitting a haptic command to a controller for a triggered haptic peripheral input/output device, the haptic command selected from a plurality of haptic commands based on the action event indicator;

the triggered haptic peripheral input/output device selected from a plurality of peripheral input/output devices within a haptic peripheral input/output device ecosystem based on the position of the action event relative to the player avatar image within the 3D gaming environment relative to a known position of a haptic zone on the triggered haptic peripheral input/output device within the haptic peripheral input/output device ecosystem; and

the controller for the triggered haptic peripheral input/output device executing the received haptic command to cause haptic feedback within a haptic region of the triggered haptic peripheral device at a position relative to the user that is correlated to the position of the action event with respect to the player avatar image.

2. The information handling system of claim 1 , wherein the triggered haptic peripheral input/output device is a keyboard palm rest.

3. The information handling system of claim 1 , wherein the triggered haptic peripheral input/output device is a mouse.

4. The information handling system of claim 1 , wherein the triggered haptic peripheral input/output device is an audio headset device.

5. The information handling system of claim 1 , wherein the haptic feedback is haptic movement caused by the controller applying voltage across a piezoelectric actuator within the triggered haptic peripheral input/output device, pursuant to execution of the haptic command.

6. The information handling system of claim 1 , wherein the haptic feedback is haptic thermal change caused by the controller applying voltage to a thermoelectric generator (TEG) within the triggered haptic peripheral input/output device, pursuant to execution of the haptic command.

7. The information handling system of claim 1 further comprising:

the processor identifying the gaming action event, based on a combination of a detected visual action event indicator and a detected audio action event indicator.

8. A method of coordinating haptic feedback across a peripheral input/output device ecosystem, comprising:

displaying a three-dimensional (3D) gaming environment, via a display device;

identifying a gaming action event occurring in the 3D gaming environment, via a processor, to generate a detected action event indicator;

determining a position and type of the gaming action event within the 3D gaming environment;

transmitting a haptic command, selected from a plurality of haptic commands, based on an identification of the gaming action event, to a controller for a triggered haptic peripheral input/output device selected from a plurality of peripheral input/output devices within a haptic peripheral input/output device ecosystem, based on the position and type of the gaming action event within the 3D gaming environment relative to a known position of a haptic zone of the triggered haptic peripheral input/output device within the haptic peripheral input/output device ecosystem; and

executing the received haptic command, via the controller for the triggered haptic peripheral input/output device, to cause haptic feedback within the haptic zone of the triggered haptic peripheral input/output device that is correlated to the type of the gaming action event.

9. The method of claim 8 further comprising:

executing the received haptic command to cause a haptic thermal decrease in temperature within the haptic zone by applying voltage to a thermoelectric generator within the triggered haptic peripheral input/output device.

10. The method of claim 8 further comprising:

executing the received haptic command to cause a haptic thermal increase in temperature within the haptic zone by applying voltage to a thermoelectric generator within the triggered haptic peripheral input/output device.

11. The method of claim 8 further comprising:

identifying the gaming action event, via the processor, based on action event indicators received from the gaming application code to generate the haptic command.

12. The method of claim 8 further comprising:

identifying the gaming action event, via the processor, based on a combination of a detected visual action event indicator and the position of the gaming action event relative to the player avatar image within the 3D gaming environment.

13. The method of claim 8 further comprising:

executing code instructions of a trained image recognition model, via the processor, to identify the gaming action event and a movement of the gaming action event within the 3D gaming environment within a captured image of live gameplay as displayed via the display device; and

generating a moving haptic response across a plurality of haptic zones of the triggered haptic peripheral input/output device, corresponding to the movement of the gaming action event.

14. The method of claim 8 further comprising:

executing code instructions of a trained image recognition model, via the processor, to identify the gaming action event and a movement of the gaming action event within the 3D gaming environment within a captured image of live gameplay as displayed via the display device; and

generating a moving haptic response across the plurality of peripheral input/output devices within the haptic peripheral device ecosystem, corresponding to the movement of the gaming action event.

15. The method of claim 8 further comprising:

receiving from firmware for the display device a measured magnitude and speed of change in pixel brightness for an identified region of pixels of the display device;

identifying, via the processor, the gaming action event and a movement of the gaming action event within the 3D gaming environment based on the measured magnitude and speed of change in pixel brightness and the identified region of pixels; and

generating a moving haptic response across a plurality of haptic regions of the triggered haptic peripheral input/output device, corresponding to the movement of the gaming action event.

16. A haptic peripheral device ecosystem coordination system for an information handling system, comprising:

a display device displaying a three-dimensional (3D) gaming environment;

a processor identifying a gaming action event occurring in the 3D gaming environment, and determining a position and type of the gaming action event within the 3D gaming environment to generate a detected action event indicator;

the processor transmitting a haptic thermal command and a haptic movement command to one or more controllers for a triggered haptic peripheral input/output device;

the triggered haptic peripheral device selected from a plurality of peripheral input/output devices within a haptic peripheral input/output device ecosystem based on the position and type of the gaming action event within the 3D gaming environment relative to a known position of a haptic zone of the triggered haptic peripheral input/output device within the haptic peripheral input/output device ecosystem;

the one or more controllers for the triggered haptic peripheral input/output device executing the received haptic movement command to cause haptic movement within the haptic zone of the triggered haptic peripheral input/output device and executing the haptic thermal command to cause haptic thermal change within the haptic zone; and

the haptic zone at a position relative to the user that is correlated to the position and type of the gaming action event.

17. The information handling system of claim 16 , wherein the one or more controllers apply pulses of voltage across a piezoelectric actuator within the triggered haptic peripheral input/output device to cause the haptic movement, pursuant to execution of the haptic movement command.

18. The information handling system of claim 16 , wherein the haptic movement command identifies a magnitude of voltage applied by the one or more controllers across a piezoelectric actuator within the triggered haptic peripheral input/output device to cause the haptic movement at one of a plurality of preset intensity levels.

19. The information handling system of claim 16 , wherein the haptic movement command identifies a time duration for application of voltage by the one or more controllers across a piezoelectric actuator within the triggered haptic peripheral input/output device to cause the haptic movement for one of a plurality of preset time durations.

20. The information handling system of claim 16 , wherein the haptic thermal command identifies a time duration for application of voltage by the one or more controllers to the TEG within the triggered haptic peripheral input/output device to cause the haptic thermal change for one of a plurality of preset time durations.

Assignments (9)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (055479/0342) Recorded Jun 10, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: EMC IP HOLDING COMPANY LLC; DELL PRODUCTS L.P.
Reel/Frame 062021/0460 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (055479/0051) Recorded Jun 10, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: EMC IP HOLDING COMPANY LLC; DELL PRODUCTS L.P.
Reel/Frame 062021/0663 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (056136/0752) Recorded Jun 10, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: EMC IP HOLDING COMPANY LLC; DELL PRODUCTS L.P.
Reel/Frame 062021/0771 →
RELEASE OF SECURITY INTEREST AT REEL 055408 FRAME 0697 Recorded Nov 2, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 058001/0553 →
SECURITY INTEREST Recorded Mar 3, 2021
From: EMC IP HOLDING COMPANY LLC; DELL PRODUCTS L.P.
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 056136/0752 →
SECURITY INTEREST Recorded Mar 3, 2021
From: EMC IP HOLDING COMPANY LLC; DELL PRODUCTS L.P.
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 055479/0051 →
SECURITY INTEREST Recorded Mar 3, 2021
From: EMC IP HOLDING COMPANY LLC; DELL PRODUCTS L.P.
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 055479/0342 →
SECURITY AGREEMENT Recorded Feb 25, 2021
From: EMC IP HOLDING COMPANY LLC; DELL PRODUCTS L.P.
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 055408/0697 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 18, 2020
From: GOH, PENG LIP; BRYAN, REX W.; AURONGZEB, DEEDER M.
To: DELL PRODUCTS, LP
Reel/Frame 054698/0507 →
Continuity (1)
Related Publication 20220193538A1 · Jun 23, 2022
Cited By (1)
US 12,656,868