IP Library Granted Patent US 9,947,188
Granted Patent B2
US 9,947,188 · App. 15/439,227 · Granted Apr 17, 2018

Systems and methods for generating haptic effects associated with audio signals

Inventors: Juan Manuel Cruz-Hernandez (Montreal, CA); Jamal Saboune (Montreal, CA); Vincent Levesque (Montreal, CA); Ali Modarres (Montreal, CA)
Assignee: Immersion Corporation
G08B6/00G06F3/165
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,947,188
App. No.
15/439,227
Granted
Apr 17, 2018
Kind
B2
Abstract

Systems and methods for generating haptic effects associated with audio signals are disclosed. One disclosed system for outputting haptic effects includes a processor configured to: receive an audio signal; determine a haptic effect based in part on the audio signal by: identifying one or more components in the audio signal; and determining a haptic effect associated with the one or more components; and output a haptic signal associated with the haptic effect.

Claims (50)

1. A system for outputting haptic effects comprising:

a processor configured to:

receive an audio signal;

identify one or more audio components in the audio signal;

identify background noises in the audio signal;

determine a haptic effect associated with the one or more audio components;

store the haptic effect in a haptic track on a data store;

output a haptic signal associated with the haptic effect; and

output the audio signal to an audio output device configured to output an audible effect.

2. The system of claim 1 , wherein the processor is further configured to determine not to output a haptic effect associated with the background noises.

3. The system of claim 1 , wherein identifying one or more audio components of the audio signal comprises:

receiving a signal associated with one or more audio components;

dividing the audio signal into a plurality of segments;

analyzing one of the plurality of segments to determine if one or more of the components is present; and

classifying the segment based on a presence of one or more of the components.

4. The system of claim 3 , wherein analyzing one of the plurality of segments comprises implementing an acoustic event detection technique.

5. The system of claim 4 , wherein the acoustic event detection technique comprises automatic speech recognition.

6. The system of claim 3 , wherein classifying one of the plurality of segments comprises comparing the segment to a database of data associated with the one or more components.

7. The system of claim 3 , wherein determining a haptic effect comprises assigning a haptic effect based on the classification of the segment.

8. The system of claim 1 , wherein identifying one or more audio components of the audio signal comprises isolating speech in the audio signal.

9. The system of claim 1 , wherein identifying one or more audio components of the audio signal comprises isolating sounds associated with action effects in the audio signal.

10. The system of claim 1 , further comprising a haptic output device configured to receive the haptic signal and output the haptic effect.

11. A method for outputting haptic effects comprising:

receiving an audio signal;

identifying one or more audio components in the audio signal;

identifying background noises in the audio signal;

determining a haptic effect associated with the one or more audio components;

storing the haptic effect in a haptic track on a data store;

outputting a haptic signal associated with the haptic effect; and

outputting the audio signal to an audio output device configured to output an audible effect.

12. The method of claim 11 , further comprising determining not to output a haptic effect associated with the background noises.

13. The method of claim 11 , wherein identifying one or more audio components of the audio signal comprises:

receiving a signal associated with one or more audio components;

dividing the audio signal into a plurality of segments;

analyzing one of the plurality of segments to determine if one or more of the components is present; and

classifying the segment based on a presence of one or more of the components.

14. The method of claim 13 , wherein analyzing one of the plurality of segments comprises implementing an acoustic event detection technique.

15. The method of claim 14 , wherein the acoustic event detection technique comprises automatic speech recognition.

16. The method of claim 13 , wherein classifying one of the plurality of segments comprises comparing the segment to a database of data associated with the one or more components.

17. The method of claim 13 , wherein determining a haptic effect comprises assigning a haptic effect based on the classification of the segment.

18. The method of claim 11 , wherein identifying one or more audio components of the audio signal comprises isolating speech in the audio signal.

19. The method of claim 11 , wherein identifying one or more audio components of the audio signal comprises isolating sounds associated with action effects in the audio signal.

20. A non-transitory computer readable medium comprising program code, which when executed by a processor, is configured to cause the processor to:

receive an audio signal;

identify one or more audio components in the audio signal;

identify background noises in the audio signal;

determine a haptic effect associated with the one or more audio components;

store the haptic effect in a haptic track on a data store;

output a haptic signal associated with the haptic effect; and

output the audio signal to an audio output device configured to output an audible effect.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 14, 2017
From: CRUZ-HERNANDEZ, JUAN MANUEL; SABOUNE, JAMAL; LEVESQUE, VINCENT; MODARRES, ALI
To: IMMERSION CORPORATION
Reel/Frame 043006/0163 →
Continuity (3)
Continuation 14078445 · Nov 12, 2013
Provisional Application 61874933 · Sep 6, 2013
Related Publication 20170162010A1 · Jun 8, 2017