IP Library › Granted Patent US 9,658,693
Granted Patent B2
US 9,658,693 · App. 14/577,565 · Granted May 23, 2017

Systems and methods for haptically-enabled interactions with objects

Inventors: Vincent Levesque (Montreal, CA); Wei Zhu (Verdun, CA); Eric Gervais (Montreal, CA); Fengtian An (Montreal, CA); Eric Lajeunesse (Saint-Hubert, CA); Johnny Maalouf (Montreal, CA)
Assignee: Immersion Corporation
G06F3/016G06F3/011G06F3/0338G06F3/0425
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,658,693
App. No.
14/577,565
Granted
May 23, 2017
Kind
B2
Abstract

One illustrative computing device disclosed herein includes a sensor configured to detect a user interaction with a physical object and transmit a sensor signal associated with the user interaction. The illustrative computing device also includes a processor in communication with the sensor, the processor configured to: receive the sensor signal; determine a characteristic of the physical object based on the sensor signal; and determine a function based at least in part on the user interaction and the characteristic. The processor is also configured to determine a haptic effect associated with the function; and transmit a haptic signal associated with the haptic effect. The illustrative computing device further includes a haptic output device in communication with the processor, the haptic output device configured to receive the haptic signal and output the haptic effect.

Claims (45)

1. A computing device comprising:

a processor;

a memory on which instructions executable by the processor are stored for causing the processor to:

receive a sensor signal associated with an interaction with a physical object that is remote from the computing device, the interaction comprising a gesture; and

in response to the sensor signal:

determine a characteristic of the physical object;

determine the gesture;

determine a function based at least in part on the characteristic of the physical object and the gesture;

determine a haptic effect based at least in part on the function; and

transmit a haptic signal associated with the haptic effect; and

a haptic output device in communication with the processor, the haptic output device configured to receive the haptic signal and output the haptic effect.

2. The computing device of claim 1 , wherein the function comprises at least one of: ordering a product via a network, printing a document, opening a webpage, opening an application, sending an e-mail, adding a first entry to a list, removing a second entry from the list, sending a text message, determining information about the physical object, setting a virtual alarm clock, selecting a program option or setting, recording a sound, outputting a sound, playing media content, opening an e-book, performing a calculation, adding a third entry to an address book or a contact list, performing a price comparison, interacting with a user account for a website, downloading a MP3, or checking a bank balance.

3. The computing device of claim 1 , wherein the sensor signal is transmitted by a sensor that comprises at least one of: an accelerometer, a gyroscope, a camera, a radio frequency identification (RFID) tag, a RFID reader, an indoor proximity system, a 3D imaging system, a near field communication device, a global positioning system, an ultrasonic transducer, a wireless interface, an infrared sensor, a depth sensor, or a range sensor.

4. The computing device of claim 1 , wherein the computing device is associated with a wearable device comprising a shoe, an armband, a sleeve, a jacket, glasses, a glove, a ring, a watch, a wristband, a bracelet, an article of clothing, a hat, a headband, or jewelry, or wherein the computing device is associated with a graspable device comprising a mobile phone, a tablet, an e-reader, a portable gaming device, a wand, a stylus, or a pen.

5. The computing device of claim 1 , wherein the computing device is coupled to a shelf, a carrying device, or a packaging of the physical object.

6. The computing device of claim 1 , wherein the haptic output device is configured to output a remote haptic effect perceivable by a user performing the interaction with the physical object, the remote haptic effect comprising at least one of a vibration, a texture, a change in a perceived coefficient of friction, an ultrasonic pressure wave, or a puff of a gas.

7. The system of claim 1 , wherein the gesture comprises a predetermined movement of the physical object through real space.

8. The system of claim 1 , wherein the gesture comprises a predetermined movement of an object along a surface of the physical object.

9. The system of claim 1 , wherein the gesture comprises a predetermined movement that is oriented toward the physical object and remote from the physical object.

10. A method comprising:

receiving, by a processor of a computing device, a sensor signal associated with an interaction with a physical object that is remote from the computing device, the interaction comprising a gesture; and

in response to the sensor signal:

determining, by the processor, a characteristic of the physical object;

determining, by the processor, the gesture;

determining, by the processor, a function based at least in part on the characteristic of the physical object and the gesture;

determining, by the processor, a haptic effect based at least in part on the function; and

causing, by the processor, a haptic output device to output the haptic effect.

11. The method of claim 10 , wherein the function comprises at least one of: ordering a product via a network, printing a document, opening a webpage, opening an application, sending an e-mail, adding a first entry to a list, removing a second entry from the list, sending a text message, determining information about the physical object, setting a virtual alarm clock, selecting a program option or setting, recording a sound, outputting a sound, playing media content, opening an e-book, performing a calculation, adding a third entry to an address book or a contact list, performing a price comparison, interacting with a user account for a website, downloading a MP3, or checking a bank balance.

12. The method of claim 10 , further comprising executing the function.

13. The method of claim 10 , wherein the sensor signal is transmitted by a sensor that is positioned on a wearable device, the wearable device comprising a shoe, an armband, a sleeve, a jacket, glasses, a glove, a ring, a watch, a wristband, a bracelet, an article of clothing, a hat, a headband, or jewelry.

14. The method of claim 10 , wherein the sensor signal is transmitted by a sensor that is remote from the computing device.

15. The method of claim 14 , wherein the haptic output device is remote from the computing device and the sensor, and wherein the haptic output device is configured to output a remote haptic effect perceivable by a user performing the interaction with the physical object, the remote haptic effect comprising at least one of a vibration, a texture, a change in a perceived coefficient of friction, a squeezing sensation, an ultrasonic pressure wave, or a puff of a gas.

16. The method of claim 10 , wherein the sensor signal is transmitted by a sensor that is remote from the computing device, and wherein the sensor is coupled to a shelf, a carrying device, or a packaging of the physical object.

17. A non-transitory computer readable storage medium comprising program code, which when executed by a processor of a computing device is configured to cause the processor of the computing device to:

receive a sensor signal associated with an interaction with a physical object that is remote from the computing device, the interaction comprising a gesture; and

in response to the sensor signal:

determine a characteristic of the physical object;

determine the gesture;

determine a function based at least in part on the characteristic of the physical object and the gesture;

determine a haptic effect based at least in part on the function; and

cause a haptic output device to output the haptic effect.

18. The non-transitory computer readable storage medium of claim 17 , wherein the function comprises at least one of: ordering a product via a network, printing a document, opening a webpage, opening an application, sending an e-mail, adding a first entry to a list, removing a second entry from the list, sending a text message, determining information about the physical object, setting a virtual alarm clock, selecting a program option or setting, recording a sound, outputting a sound, playing media content, opening an e-book, performing a calculation, adding a third entry to an address book or a contact list, performing a price comparison, interacting with a user account for a website, downloading a MP3, or checking a bank balance.

19. The non-transitory computer readable storage medium of claim 17 , wherein the sensor signal is transmitted by a sensor that is associated with a wearable device, the wearable device comprising a shoe, an armband, a sleeve, a jacket, glasses, a glove, a ring, a watch, a wristband, a bracelet, an article of clothing, a hat, a headband, or jewelry, or wherein the sensor is associated with a graspable device comprising a mobile phone, a tablet, an e-reader, a portable gaming device, a wand, a stylus, or a pen.

20. The non-transitory computer readable storage medium of claim 17 , further comprising program code which when executed by a processor is configured to cause the processor to execute the function.

21. The non-transitory computer readable storage medium of claim 17 , wherein the sensor signal is transmitted by a sensor that is coupled to a shelf, a carrying device, or a packaging of the physical object.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 23, 2015
From: LEVESQUE, VINCENT; ZHU, WEI; GERVAIS, ERIC; AN, FENGTIAN; LAJEUNESSE, ERIC; MAALOUF, JOHNNY
To: IMMERSION CORPORATION
Reel/Frame 034795/0298 →
Continuity (1)
Related Publication 20160179199A1 · Jun 23, 2016