IP Library › Granted Patent US 9,990,041
Granted Patent B2
US 9,990,041 · App. 15/424,987 · Granted Jun 5, 2018

Systems and methods for object manipulation with haptic feedback

Inventors: Vincent Levesque (Montreal, CA); Wei Zhu (Verdun, CA); Eric Gervais (Montreal, CA); Fengtian An (Montreal, CA); Eric Lajeunesse (Saint-Hubert, CA); Johnny Maalouf (Montreal, CA)
Assignee: Immersion Corporation
G06F3/016G06F1/163G06F3/017
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,990,041
App. No.
15/424,987
Granted
Jun 5, 2018
Kind
B2
Abstract

One illustrative computing device disclosed herein includes a sensor configured to detect a user interaction with a physical object and transmit a sensor signal associated with the user interaction. The illustrative computing device also includes a processor in communication with the sensor, the processor configured to: receive the sensor signal; determine a characteristic of the physical object based on the sensor signal; determine a haptic effect associated with the characteristic; and transmit a haptic signal associated with the haptic effect. The illustrative computing device further includes a haptic output device in communication with the processor, the haptic output device configured to receive the haptic signal and output the haptic effect.

Claims (46)

1. A computing device comprising:

a processor; and

a memory in communication with the processor, the memory comprising program code that is executable by the processor to cause the processor to:

detect an interaction with a virtual object in an augmented reality environment, the virtual object being a virtual representation of a physical object in real space;

in response to detecting the interaction with the virtual object, determine a characteristic of the virtual object, wherein the characteristic of the virtual object is also a characteristic of the physical object in real space;

determine a haptic effect based on the characteristic; and

transmit a haptic signal associated with the haptic effect, the haptic signal being configured to cause a haptic output device to output the haptic effect.

2. The computing device of claim 1 , wherein the memory further includes program code executable by the processor to cause the processor to:

determine the haptic effect responsive to the characteristic of the virtual object satisfying at least one criterion.

3. The computing device of claim 2 , wherein the at least one criterion is based on a characteristic of a user.

4. The computing device of claim 2 , wherein the haptic effect is configured to indicate that the characteristic of the virtual object satisfies the at least one criterion.

5. The computing device of claim 1 , wherein the memory further includes program code executable by the processor to cause the processor to:

determine a characteristic of the interaction, the characteristic of the interaction comprising a gesture associated with the interaction or a location of a contact with the virtual object; and

determine the haptic effect based at least in part on the characteristic of the interaction.

6. The computing device of claim 1 , wherein the physical object comprises a product for sale in a location.

7. The computing device of claim 1 , wherein the memory further includes program code executable by the processor to cause the processor to determine the characteristic of the virtual object by wirelessly communicating over a network with a server.

8. The computing device of claim 1 , wherein the computing device is part of a wearable device comprising a shoe, an armband, a sleeve, a jacket, glasses, a glove, a ring, a watch, a wristband, a bracelet, an article of clothing, a hat, a headband, or jewelry.

9. The computing device of claim 1 , wherein the characteristic of the virtual object comprises an ingredient, a dimension, a size, a shape, a brand, a manufacturer, a distributer, a producer, a color, a price, a rating, a logo, a label, a barcode, a name, nutritional information, a sale, a weight, a restriction, an expiration date, power consumption, a noise level, a return policy, a warranty, an allergen, a material, a chemical, function or utility, quantity, availability, electrical characteristic, a speed, or compatibility information associated with the virtual object.

10. A method comprising:

detecting, by a processor of a computing device, an interaction with a virtual object in an augmented reality environment, the virtual object being a virtual representation of a physical object in real space;

determining, by the processor and in response to detecting the interaction with the virtual object, a characteristic of the virtual object, wherein the characteristic of the virtual object is also a characteristic of the physical object in real space;

determining, by the processor, a haptic effect based on the characteristic; and

causing, by the processor, a haptic output device to output the haptic effect.

11. The method of claim 10 , further comprising:

determining whether the characteristic of the virtual object matches at least one criterion; and

determining the haptic effect based on whether the characteristic of the virtual object matches the at least one criterion.

12. The method of claim 10 , wherein the augmented reality environment comprises the virtual object at least partially overlaying an image of an area in real space.

13. The method of claim 10 , further comprising:

determining a characteristic of the interaction, the characteristic of the interaction comprising a gesture associated with the interaction or a location of a contact with the virtual object; and

determining the haptic effect based at least in part on the characteristic of the interaction.

14. The method of claim 10 , wherein the physical object comprises a product for sale in a location, and further comprising determining the characteristic of the virtual object by communicating over a network with a server associated with the location.

15. The method of claim 10 , wherein the haptic effect is configured to simulate operation of the physical object.

16. The method of claim 10 , wherein the characteristic of the virtual object is a brand of the virtual object, and the haptic effect is a haptic brand corresponding to the brand of the virtual object.

17. A non-transitory computer readable medium comprising program code, which when executed by a processor is configured to cause the processor to:

detect an interaction with a virtual object in an augmented reality environment, the virtual object being a virtual representation of a physical object in real space;

in response to detecting the interaction with the virtual object, determine a characteristic of the virtual object, wherein the characteristic of the virtual object is also a characteristic of the physical object in real space;

determine a haptic effect based on the characteristic; and

transmit a haptic signal associated with the haptic effect to a haptic output device, wherein the haptic output device is configured to receive the haptic signal and output the haptic effect.

18. The non-transitory computer readable medium of claim 17 , further comprising program code, which when executed by the processor is configured to cause the processor to:

determine whether the characteristic of the virtual object matches at least one criterion; and

determine that the haptic effect is a first haptic effect in response to the characteristic of the virtual object-matching the at least one criterion; and

determine that the haptic effect is a second haptic effect in response to the characteristic of the virtual object not matching the at least one criterion, wherein the second haptic effect is different from the first haptic effect.

19. The non-transitory computer readable medium of claim 18 , wherein the at least one criterion is based on a preference of a user or a purchasing history of the user.

20. The non-transitory computer readable medium of claim 17 , further comprising program code, which when executed by the processor is configured to cause the processor to:

determine a characteristic of the interaction, the characteristic of the interaction comprising a gesture associated with the interaction or a location of a contact with the virtual object; and

determine the haptic effect based at least in part on the characteristic of the interaction.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 2, 2017
From: LEVESQUE, VINCENT; ZHU, WEI; GERVAIS, ERIC; AN, FENGTIAN; LAJEUNESSE, ERIC; MAALOUF, JOHNNY
To: IMMERSION CORPORATION
Reel/Frame 043173/0560 →
Continuity (2)
Continuation 14577461 · Dec 19, 2014
Related Publication 20170269689A1 · Sep 21, 2017