IP Library Granted Patent US 10,007,340
Granted Patent B2
US 10,007,340 · App. 12/696,908 · Granted Jun 26, 2018

Systems and methods for interfaces featuring surface-based haptic effects

Inventors: Juan Manuel Cruz-Hernandez (Montreal, CA); Danny A. Grant (Laval, CA); Ali Modarres (Quebec, CA); Andrew Gosline (Montreal, CA)
Assignee: Immersion Corporation
G06F3/016G06F3/017G06F3/0488G06F2203/014G08B6/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,007,340
App. No.
12/696,908
Granted
Jun 26, 2018
Kind
B2
Abstract

Systems and methods for interfaces featuring surface-based haptic effects are described. One described system includes a sensor configured to detect a touch in a touch area when an object contacts a touch surface. The touch surface may correspond to the display area or may correspond to a non-display surface of a computing device or peripheral interfaced to a computing device. The system can further include an actuator in communication with the processor and coupled to the touch surface, the actuator configured to output a haptic effect and a processor configured to select a haptic effect to generate. The haptic effect can be selected based on a position of the touch and recognizing an input gesture provided by the touch and/or content displayed in a graphical user interface at a location mapped to a position in the touch area at or near the touch. The haptic effect may provide a texture, simulate an obstacle, and/or adjust the coefficient of friction of the surface.

Claims (39)

1. A system comprising:

a sensor configured to detect a touch in a touch area when an object contacts a touch surface, the touch area mapped to a display area of a graphical user interface; and a processor in communication with an electrostatic actuator and the sensor, the processor configured to:

identify text displayed in the display area responsive to a search query;

highlight the identified text displayed in the display area in response to the search query;

select a haptic effect to generate based on identifying a position of the touch and the highlighted identified text, wherein the haptic effect is selected to generate a haptic effect at an identified position in the touch area mapped to a position in the display area at or near the highlighted-identified text; and

transmit a haptic signal corresponding to the selected haptic effect to the electrostatic actuator, the electrostatic actuator configured to receive the haptic signal and to generate the selected haptic effect while the touch is occurring, the haptic effect comprising adjusting a coefficient of friction of the touch surface.

2. The system set forth in claim 1 , wherein the processor is configured to select a haptic effect based on a control displayed in the graphical user interface at a location mapped to a position in the touch area at or near the position of the touch.

3. The system set forth in claim 1 , wherein the processor is configured to select a haptic effect in response to recognizing a page turn input gesture, the haptic effect selected to vary the coefficient of friction in a direction of the page turn input gesture as the gesture is provided.

4. The system set forth in claim 1 , wherein the processor is configured to select a haptic effect in response to recognizing a gesture indicating movement of an on-screen content item from a first location to a second location.

5. The system set forth in claim 1 , further comprising a display, the display comprising a plurality of pixels and defining the display area, the display configured to output an image based at least in part on a display signal,

wherein the touch surface corresponds to the display or a material above the display, and

wherein the processor is configured to output the display signal.

6. The system set forth in claim 1 , further comprising a second actuator configured to provide a haptic effect in response to a haptic signal from the processor.

7. The system of claim 1 , wherein an adjustment of the coefficient of friction of the touch surface comprises increasing the coefficient of friction of the touch surface.

8. The system of claim 1 , wherein selecting a haptic effect to generate further comprises determining a haptic value associated with one or more pixels at the position of the touch.

9. A method, comprising:

tracking a location of a touch on a touch surface via a sensor in communication with a processor, the location tracked relative to a touch area mapped to a graphical user interface;

based on the location of the touch, identifying, by the processor, an interaction with the graphical user interface;

identifying, by the processor, text displayed in the display area responsive to a search query;

highlighting, by the processor, the identified text displayed in the display area in response to the search query;

selecting, by the processor, a haptic effect to generate based on the interaction and the highlighted identified text, wherein the haptic effect is selected to generate a haptic effect at an identified position in the touch area mapped to a position in the display area at or near the highlighted identified text; and

commanding, by the processor, at least one electrostatic actuator to generate the selected haptic effect, the haptic effect comprising an adjustment of a coefficient of friction of the touch surface, the at least one electrostatic actuator configured to vary the coefficient of friction of the touch surface.

10. The method set forth in claim 9 , wherein the interaction comprises adjusting an on-screen control and the haptic effect is selected based on a value of the on-screen control.

11. The method set forth in claim 9 , wherein the interaction comprises touching the surface at or near a location mapped to a portion of the graphical user interface containing a feature, the feature associated with the haptic effect.

12. The method set forth in claim 11 , wherein the feature comprises a textual or graphic element in the interface highlighted in response to the search query.

13. The method set forth in claim 11 , wherein the feature comprises graphical or textual content.

14. The method set forth in claim 11 , wherein the feature comprises a boundary in the graphical user interface.

15. The method set forth in claim 9 , wherein the interaction comprises an input gesture.

16. The method set forth in claim 15 , wherein the haptic effect is provided during the input gesture.

17. The method set forth in claim 15 , wherein the haptic effect is provided after the input gesture.

18. The method of claim 9 , wherein an adjustment of the coefficient of friction of the touch surface comprises increasing the coefficient of friction of the touch surface.

19. A non-transitory computer-readable medium embodying program code, which when executed by a processor is configured to cause the processor to:

track a location of a touch on a touch surface via a sensor in communication with the processor, the location tracked relative to a touch area mapped to a graphical user interface;

identify, based on the location of the touch, an interaction with the graphical user interface;

identify text displayed in the display area responsive to a search query;

highlight the identified text displayed in the display area in response to the search query;

select a haptic effect to generate based on the interaction and the highlighted identified text, wherein the haptic effect is selected to generate a haptic effect at an identified position in the touch area mapped to a position in the display area at or near the highlighted identified text; and

transmit a haptic signal corresponding to the selected haptic effect to at least one electrostatic actuator, the haptic effect comprising adjusting a coefficient of friction of the touch surface, the at least one electrostatic actuator configured to vary the coefficient of friction of the touch surface.

20. The non-transitory computer readable medium of claim 19 , wherein adjusting the coefficient of friction of the touch surface comprises increasing the coefficient of friction of the touch surface.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 1, 2010
From: CRUZ-HERNANDEZ, JUAN MANUEL; GRANT, DANNY; MODARRES, ALI; GOSLINE, ANDREW
To: IMMERSION CORPORATION
Reel/Frame 023877/0986 →
Continuity (4)
Provisional Application 61159482 · Mar 12, 2009
Provisional Application 61262041 · Nov 17, 2009
Provisional Application 61262038 · Nov 17, 2009
Related Publication 20100231539A1 · Sep 16, 2010
Cited By (3)
US 12,242,680 US 12,348,669 US 12,699,457