IP Library Granted Patent US 10,775,888
Granted Patent B2
US 10,775,888 · App. 13/768,189 · Granted Sep 15, 2020

Method and system for integrating haptic feedback into portable electronic devices

Inventors: Walter A. Aviles (San Diego, CA); Thomas G. Anderson (Albuquerque, NM); William Anderson (Albuquerque, NM); Daryl Lee (Albuquerque, NM)
Assignee: Facebook, Inc.
G06F3/016G06F9/541
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,775,888
App. No.
13/768,189
Granted
Sep 15, 2020
Kind
B2
Abstract

Methods for creating a haptic effect script for an application and producing haptic effects in response to an event occurring in an application are described Creating the haptic script includes launching an application, launching a scripting engine, monitoring a dynamic memory footprint for the application, receiving an indication of an event occurrence in the application, and determining changes to one or more values stored within the dynamic memory footprint that indicate the event occurrence. To produce the haptic effects, during execution and running of the application the dynamic memory footprint is monitored for value changes associated with an event occurrence as defined by the haptic event script and, if it is determined an event has occurred, the haptic script is executed to product a haptic effect signal.

Claims (57)

1. A method comprising:

loading, by a processing device, a haptic integration technology (HIT) software application, the HIT software application configured to produce one or more haptic effects;

launching, by the processing device, an application separate from the HIT software application, the application not configured to produce the one or more haptic effects;

monitoring, by the HIT software application, a dynamic memory footprint of the application, the dynamic memory footprint comprising one or more values associated with a state of the application, the application stored in a memory operably connected to the processing device, wherein the monitoring comprises recording a first set of values within the dynamic memory footprint associated with the application at certain time intervals;

determining, by the HIT software application, an occurrence of an event based on changes to the one or more values stored within the dynamic memory footprint of the application;

determining, by the HIT software application, a haptic effect to be associated with the event occurrence; and

adding, by the HIT software application, the haptic effect to a haptic event script associated with the application, wherein execution of the haptic event script is configured to generate the haptic effect on an output interface coupled to the processing device.

2. The method of claim 1 , further comprising:

associating, by the HIT software application, the haptic event script with the application;

monitoring, by the HIT software application, an executable file of the application to detect a subsequent launch of the application; and

in response to detecting the subsequent launch of the application:

loading the haptic event script associated with the application;

monitoring, by the HIT software application, one or more values stored within a dynamic memory footprint of the subsequently launched application;

detecting, by the HIT software application, an occurrence of an event based on changes to the one or more values, the detecting based on the haptic event script associated with the application; and

in response to detecting the occurrence of the event, generating a haptic effect on the output interface coupled to the processing device.

3. The method of claim 1 , wherein the haptic effect comprises a vibrotactile actuated effect.

4. The method of claim 1 , wherein the haptic effect comprises an electroresistive actuated effect.

5. The method of claim 1 , wherein determining changes to the one or more values stored within the dynamic memory footprint comprises:

recording an updated set of values within the dynamic memory footprint; and

comparing the set listing of values with the first set of values to determine any changes.

6. A method of producing haptic effects in response to an event occurring in an application, the method comprising:

launching, by a processing device, an application on an electronic device, the application not configured to produce one or more haptic effects;

loading, by the processing device, a haptic event script associated with the application;

monitoring, by a haptic integration technology (HIT) software application configured to produce one or more haptic effects and separate from the application, a dynamic memory footprint of the application for value changes associated with an event occurrence as defined by the haptic event script, wherein the monitoring comprises recording a first set of values within the dynamic memory footprint associated with the application at certain time intervals; and

responsive to determining, by the HIT software application, an event has occurred:

executing, by the processing device, the haptic event script to produce a haptic effect signal.

7. The method of claim 6 , further comprising transmitting, by the processing device, the haptic effect signal to one of a haptic actuator or a controller to produce haptic feedback.

8. The method of claim 7 , wherein the haptic actuator comprises a vibrotactile actuator.

9. The method of claim 7 , wherein the haptic actuator comprises an electroresistive actuator.

10. The method of claim 6 , wherein monitoring the dynamic memory footprint for value changes comprises:

determining, based upon the haptic event script, one or more event occurrence values in the dynamic memory; and

monitoring the one or more event occurrence values in the dynamic memory for any changes, wherein a change to one or more event occurrence values indicates an event occurrence in the application.

11. The method of claim 6 , wherein producing a haptic effect signal comprises:

loading, from the haptic event script, an appropriate haptic effect based upon the event occurrence;

creating, based upon the loaded appropriate haptic effect, the haptic effect signal; and

transferring the haptic effect signal to one of a haptic actuator or a controller associated with at least one haptic actuator.

12. The method of claim 6 , wherein the electronic device is a portable electronic device.

13. A non-transitory computer readable medium comprising computer executable instructions, encoded thereon that, when executed by a processor causes the processor to perform operations, the instructions comprising instructions to:

load, by the processing device, a haptic integration technology (HIT) software application, the HIT software application configured to produce one or more haptic effects;

launch, by the processing device, an application separate from the HIT software application, the application not configured to produce the one or more haptic effects;

monitor, by the HIT software application, a dynamic memory footprint of the application, the dynamic memory footprint comprising one or more values associated with a state of the application, the application stored in a memory operably connected to the processing device, wherein the monitoring comprises recording a first set of values within the dynamic memory footprint associated with the application at certain time intervals;

determine, by the HIT software application, an occurrence of an event based on changes to the one or more values stored within the dynamic memory footprint of the application;

determine, by the HIT software application, a haptic effect to be associated with the event occurrence; and

add, by the HIT software application, the haptic effect to a haptic event script associated with the application, wherein execution of the haptic event script is configured to generate the haptic effect on an output interface coupled to the processing device.

14. The non-transitory computer readable medium of claim 13 , wherein the instructions further comprise instructions to:

associate, by the HIT software application, the haptic event script with the application;

monitor, by the HIT software application, an executable file of the application to detect a subsequent launch of the application; and

in response to detecting the subsequent launch of the application:

load the haptic event script associated with the application;

monitor, by the HIT software application, one or more values stored within a dynamic memory footprint of the subsequently launched application;

detect, by the HIT software application, an occurrence of an event based on changes to the one or more values, the detecting based on the haptic event script associated with the application; and

in response to detecting the occurrence of the event, generate a haptic effect on the output interface coupled to the processing device.

15. The non-transitory computer readable medium of claim 13 , wherein the haptic effect comprises a vibrotactile actuated effect.

16. The non-transitory computer readable medium of claim 13 , wherein the haptic effect comprises an electroresistive actuated effect.

17. The non-transitory computer readable medium of claim 13 , wherein determining changes to the one or more values stored within the dynamic memory footprint comprises:

record an updated set of values within the dynamic memory footprint; and

compare the set listing of values with the first set of values to determine any changes.

Assignments (3)
CHANGE OF NAME Recorded Nov 18, 2021
From: FACEBOOK, INC.
To: META PLATFORMS, INC.
Reel/Frame 058897/0824 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 12, 2016
From: NOVINT TECHNOLOGIES INC.
To: FACEBOOK, INC.
Reel/Frame 038558/0860 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 26, 2016
From: AVILES, WALTER A.; ANDERSON, THOMAS G.; ANDERSON, WILLIAM; LEE, DARYL
To: NOVINT TECHNOLOGIES, INC.
Reel/Frame 038382/0340 →