IP Library › Granted Patent US 12,189,123
Granted Patent B2
US 12,189,123 · App. 17/671,891 · Granted Jan 7, 2025

System and method for haptic interactive experiences

Inventor: Mark D. Wieczorek (San Diego, CA)
G02B27/017A63F13/00G02B2027/0138
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,189,123
App. No.
17/671,891
Granted
Jan 7, 2025
Kind
B2
Abstract

Systems and methods according to present principles allow haptic forces and effects to be effectively combined and employed in virtual worlds and interactions, in order to allow the enjoyment of the same in various circumstances.

Claims (31)

1. A method of providing haptics effects for users experiencing a virtual environment, comprising:

monitoring data about a character and an associated environment within a virtual environment;

from the monitoring data, determining if a haptic effect should be delivered to a user based on an event within the associated environment, the event associated with the character, the user controlling at least one aspect of the character in the virtual environment; and

if the determining is that a haptic effect should be delivered to the user, then causing the haptic effect to be delivered to the user by transmitting one or more signals to a set of end effectors associated with the haptic effect, the set being associated with a grouping of end effectors, the set of end effectors affecting one or more senses of the user,

wherein the grouping of end effectors has a first local density at a first haptic location, and the grouping of end effectors has a second local density at a second haptic location, wherein the first local density is different from the second local density, and wherein the first haptic location is configured to affect skin of the user at a first user skin location, and the second haptic location is configured to affect skin of the user at a second user skin location, and wherein mechanoreceptors within the user's skin associated with the haptic effect have a different density at the first user skin location than at the second user skin location,

wherein at least two different haptic effects are enabled, a first haptic effect including a thermal effect of heating and being caused by a grouping of heating end effectors, and a second haptic effect including a thermal effect of cooling and being caused by a grouping of cooling end effectors, and wherein at a particular location the density of cooling end effectors is two to five times the density of heating end effectors.

2. The method of claim 1 , wherein the monitoring data includes monitoring data from a game engine.

3. The method of claim 1 , wherein the heating end effectors cause capsaicin to contact skin of the user at a skin location associated with the heating end effectors.

4. The method of claim 1 , wherein the haptic effect is a pain effect, and wherein the set of end effectors include alternating heating and cooling end effectors, and wherein the pain effect is caused at skin of a user by simultaneously actuating the alternating heating and cooling end effectors.

5. A system for providing haptics effects for users experiencing a virtual environment, comprising:

a body-wearable suit configured to cover a portion of a user's body;

a first grouping of one or more end effectors of a first type, the end effectors of the first type configured to deliver a haptic effect of a first type, the first grouping distributed in a predetermined pattern on the body wearable suit; and

a second grouping of one or more end effectors of a second type, the end effectors of the second type configured to deliver a haptic effect of a second type, the second grouping distributed in a predetermined pattern on the body wearable suit,

wherein at a particular location on the body-wearable suit, an areal density of the end effectors of the first type is different from an areal density of the end effectors of the second type,

wherein multiple haptic effects are enabled, a first haptic effect including a thermal effect of heating and being caused by a grouping of heating end effectors, a second haptic effect including a thermal effect of cooling and being caused by a grouping of cooling end effectors, and wherein at a particular location the density of cooling end effectors is two to five times the density of heating end effectors.

6. The system of claim 5 , wherein the body-wearable suit is configured to fit a user's hand or leg or entire body.

7. The system of claim 5 , wherein the predetermined pattern of the first grouping is based on an expected distribution of mechanoreceptors associated with the haptic effect of the first type, and wherein the predetermined pattern of the second grouping is based on an expected distribution of mechanoreceptors associated with the haptic effect of the second type.

8. The system of claim 5 , wherein the body-wearable suit is configured to be in signal communication with a processor, the processor configured to monitor data about a character and an associated environment within a virtual environment, and from the monitored data, the processor is configured to determine if a haptic effect should be delivered to a user based on an event within the associated environment, the event associated with the character, the user controlling at least one aspect of the character in the virtual environment, and wherein if the determination is to deliver the haptic effect, the processor is configured to provide one or more signals to a first set of end effectors of the first type, or to provide one or more signals to a second set of end effectors of the second type, or both, the signals causing the haptic effect to be delivered to the user.

9. The system of claim 8 , wherein the monitored data is from a game engine.

10. The system of claim 5 , wherein the heating end effectors are configured to cause capsaicin to contact skin of the user at a skin location associated with the grouping of heating end effectors.

11. The system of claim 5 , wherein the haptic effect is a pain effect, and wherein the grouping of end effectors include alternating heating and cooling end effectors, and wherein the pain effect is caused at skin of a user by simultaneously actuating the alternating heating and cooling end effectors.

12. A method of providing haptics effects for users experiencing a virtual environment, comprising:

monitoring data about a character within a virtual environment;

from the monitoring data, determining if a haptic effect should be delivered to a user based on an event within the virtual environment, the event associated with the character, the user controlling at least one aspect of the character in the virtual environment, the haptic effect associated with a first visual feature within the virtual environment;

if the determining is that a haptic effect should be delivered to the user, then determining if the haptic effect is available, and if the haptic effect is available, then causing the haptic effect to be delivered to the user by transmitting one or more signals to a set of end effectors associated with the haptic effect, the set being a subset of a grouping of end effectors, the set of end effectors affecting one or more senses of the user; and

if the determining is that a haptic effect should be delivered to the user but the determining is that the haptic effect is unavailable, then determining if a substitute haptic effect is available, and if the substitute haptic effect is available, then causing the substitute haptic effect to be delivered to the user by transmitting one or more signals to a set of end effectors associated with the substitute haptic effect, the set being a subset of a grouping of end effectors, the set of end effectors affecting one or more senses of the user, and further modifying the virtual environment to indicate a substitute visual feature associated with the substitute haptic effect in place of the first visual feature within the virtual environment.

13. The method of claim 12 , wherein the monitoring data includes monitoring data from a game engine.

14. The method of claim 12 , wherein the haptic effect is selected from the group consisting of: a mechanical effect, an air effect, a chemical effect, or a thermal effect, or combinations thereof.

15. The method of claim 14 , wherein the haptic effect is a thermal effect, and wherein one or more of the set of end effectors causes capsaicin to contact skin of the user at a skin location associated with the set of end effectors.

16. The method of claim 14 , wherein the haptic effect is a pain effect, and wherein the set of end effectors include alternating heating and cooling elements, and wherein the pain effect is caused at skin of a user by simultaneously actuating the alternating heating and cooling elements.

17. The method of claim 12 , wherein the event is a user's character touching a soft surface within the associated environment, the determining that the haptic effect is unavailable includes determining that a haptic effect of touching a soft surface is unavailable, the substitute haptic effect is the haptic effect of touching a hard surface, and modifying or the virtual environment to indicate a substitute visual feature includes visually rendering a hard surface in place of the first visual feature of the soft surface.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 29, 2023
From: WIECZOREK, MARK
To: MARK D WIECZOREK PC
Reel/Frame 065984/0252 →
Continuity (21)
Continuation In Part 17507945 · Oct 22, 2021
Continuation 17389798 · Jul 30, 2021
Continuation 17148095 · Jan 13, 2021
Continuation In Part 17391514 · Aug 2, 2021
Continuation 17344250 · Jun 10, 2021
Continuation 17215375 · Mar 29, 2021
Continuation In Part 17094460 · Nov 10, 2020
Continuation 17094428 · Nov 10, 2020
Continuation 17086909 · Nov 2, 2020
Continuation 16945765 · Jul 31, 2020
Continuation 15931958 · May 14, 2020
Continuation 16785970 · Feb 10, 2020
Continuation 16382448 · Apr 12, 2019
Continuation 14669744 · Mar 26, 2015
Provisional Application 63149776 · Feb 16, 2021
Provisional Application 63167763 · Mar 30, 2021
Provisional Application 63186308 · May 10, 2021
Provisional Application 63135927 · Jan 11, 2021
Provisional Application 63134130 · Jan 5, 2021
Provisional Application 61970512 · Mar 26, 2014
Related Publication 20220252881A1 · Aug 11, 2022
References Cited (29)
US 5872438A · Roston · 1999 [cited by applicant]
US 6695770B1 · Choy · 2004 [cited by applicant]
US 20050116954A1 · Ripps · 2005 [cited by applicant]
US 20060015560A1 · MacAuley · 2006 [cited by applicant]
US 20060262120A1 · Rosenberg · 2006 [cited by applicant]
US 20070186007A1 · Field · 2007 [cited by applicant]
US 20080081701A1 · Shuster · 2008 [cited by applicant]
US 20080294663A1 · Heinley · 2008 [cited by applicant]
US 20090063156A1 · Squedin · 2009 [cited by applicant]
US 20110082009A1 · Ranky · 2011 [cited by applicant]
US 20120226987A1 · Wie · 2012 [cited by applicant]
US 20130271457A1 · Haswell · 2013 [cited by applicant]
US 20140009490A1 · Gardenfors · 2014 [cited by applicant]
US 20140046829A1 · Serban · 2014 [cited by applicant]
US 20140063061A1 · Reitan · 2014 [cited by applicant]
US 20140114845A1 · Rogers · 2014 [cited by applicant]
US 20140306866A1 · Miller · 2014 [cited by applicant]
US 20150002541A1 · Dillavou · 2015 [cited by applicant]
US 20150268722A1 · Wang · 2015 [cited by examiner]
US 20160035140A1 · Bickerstaff · 2016 [cited by applicant]
US 20160093108A1 · Mao · 2016 [cited by applicant]
US 20160189494A1 · Levesque · 2016 [cited by examiner]
US 20180330549A1 · Brenton · 2018 [cited by applicant]
US 20190249908A1 · Yi · 2019 [cited by examiner]
US 20210043011A1 · Gates · 2021 [cited by examiner]
Leithinger, Daniel, et al. “Shape displays: Spatial interaction with dynamic physical form.” 2015; IEEE computer graphics and applications 35.5; pp. 5-11. (Year: 2015). [cited by examiner]
García-Valle, Gonzalo, et al. “Evaluation of presence in virtual environments: haptic vest and user's haptic skills.” 2017; IEEE Access 6; pp. 7224-7233. (Year: 2017). [cited by examiner]
Loral; “Tip of the Week-Raiding in EverQuest—Jul. 3, 2007”; Jul. 3, 2007; all pages; https://www.everquest.com/news/imported-eq-enus-50487. [cited by applicant]
Information on Leap Motion, Inc., download Apr. 23, 2021 from Wikipedia at https://en.wikipedia.org/wiki/Leap_Motion (author unknown). [cited by applicant]