IP Library › Granted Patent US 10,593,167
Granted Patent B2
US 10,593,167 · App. 16/135,258 · Granted Mar 17, 2020

Crowd-based haptics

Inventors: Eric Gervais (Montreal, CA); Shadi Asfour (Montreal, CA); Jamal Saboune (Montreal, CA); Amer Alhalabi (Laval, CA); Vincent Levesque (Montreal, CA)
Assignee: Immersion Corporation
G08B6/00G06F3/016
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,593,167
App. No.
16/135,258
Granted
Mar 17, 2020
Kind
B2
Abstract

A system produces haptic effects. The system receives input data associated with an event, identifies an element of the event in the input data, generates the haptic effects based on the element of the event, and produces the haptic effects via a haptic output device. In one embodiment, the haptic effects are generated by haptifying the element of the event. In one embodiment, the haptic effects are designed haptic effects and are adjusted based on the element of the event. In one embodiment, the input data is associated with a crowd that attends the event, and the element of the event is caused by the crowd. In one embodiment, the input data includes haptic data collected by one or more personal devices associated with the crowd. In one embodiment, the input data is indicative of a location of the one or more personal devices associated with the crowd.

Claims (35)

1. A haptic-enabled device, comprising:

a communication device;

a display device;

a haptic output device; and

a processor configured

to receive, via the communication device, a plurality of pieces of sensor data from a plurality of respective mobile devices that are located at an event, wherein the plurality of pieces of sensor data are captured by respective sensors of the plurality of respective mobile devices,

to merge the plurality of pieces of sensor data into a haptic track by averaging the plurality of pieces of sensor data,

to control the haptic output device to generate a haptic effect with the haptic track, and

to control the display device to display video content captured from the event in synchronization with outputting of the haptic effect by the haptic output device.

2. The haptic-enabled device of claim 1 , wherein the plurality of pieces of sensor data comprises a plurality of pieces of audio data captured by respective microphones of the plurality of respective mobile devices.

3. The haptic-enabled device of claim 1 , wherein the plurality of pieces of sensor data comprises a plurality of pieces of vibration data captured by respective vibrometers of the plurality of respective mobile devices.

4. The haptic-enabled device of claim 1 , wherein the haptic-enabled device is part of a virtual reality (VR) system.

5. The haptic-enabled device of claim 4 , wherein the haptic-enabled device is a head-mounted device.

6. The haptic-enabled device of claim 1 , wherein the haptic-enabled device is another mobile device.

7. The haptic-enabled device of claim 1 , wherein the haptic-enabled device is a wearable device.

8. A haptic-enabled device, comprising:

a communication device;

a haptic output device; and

a processor configured

to receive, via the communication device, a plurality of pieces of sensor data from a plurality of respective mobile devices that are located at a plurality of respective locations at an event, wherein the plurality of pieces of sensor data are captured by respective sensors of the plurality of respective mobile devices,

to determine that a haptic effect is to be generated at the haptic-enabled device, wherein the haptic effect corresponds to an additional location at the event different than the plurality of respective locations, and

to select at least two pieces of sensor data from among the plurality of pieces of sensor data, wherein the at least two pieces of sensor data are received from mobile devices whose respective locations are, relative to other locations of the plurality of respective locations, closest to the additional location at the event,

to interpolate the at least two pieces of sensor data to generate a haptic track, and

to control the haptic output device to generate the haptic effect with the haptic track.

9. The haptic-enabled device of claim 8 , further comprising a display device, wherein the processor is configured to control the display device to display video content captured from the event in synchronization with outputting of the haptic effect with the haptic output device.

10. The haptic-enabled device of claim 8 , wherein the processor is configured to interpolate the at least two pieces of sensor data by determining a weighted average of the at least two pieces of sensor data by using respective weights that are based on quality ratings for the respective sensors of the plurality of mobile devices.

11. The haptic-enabled device of claim 8 , wherein the haptic-enabled device is part of a virtual reality (VR) system.

12. The haptic-enabled device of claim 11 , wherein the haptic-enabled device is a head-mounted device.

13. The haptic-enabled device of claim 8 , wherein the additional location is determined based on a defined user preference.

14. A non-transitory computer readable medium having instructions stored thereon that, when executed by a processor of a server, causes the processor

to receive a plurality of pieces of sensor data from a plurality of respective mobile devices that are located at a plurality of respective locations at an event, wherein the plurality of pieces of sensor data are captured by respective sensors of the plurality of respective mobile devices,

to generate a plurality of haptic tracks corresponding to the plurality of respective mobile devices and the plurality of respective locations,

to determine, for a haptic-enabled device that is not located at the event, a user preference that indicates which location from among the plurality of respective locations is preferred by a user of the haptic-enabled device,

to select, based on the user preference, a haptic track from among the plurality of haptic tracks, wherein the haptic track that is selected corresponds to the location preferred by the user of the haptic-enabled device, and

to transmit the haptic track that is selected to the haptic-enabled device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 3, 2020
From: GERVAIS, ERIC; ASFOUR, SHADI; SABOUNE, JAMAL; ALHALABI, AMER; LEVESQUE, VINCENT
To: IMMERSION CORPORATION
Reel/Frame 051701/0452 →
Continuity (4)
Continuation 15597266 · May 17, 2017
Continuation 14882683 · Oct 14, 2015
Provisional Application 62198615 · Jul 29, 2015
Related Publication 20190088093A1 · Mar 21, 2019
Cited By (1)
US 12,425,741