IP Library Granted Patent US 10,388,122
Granted Patent B2
US 10,388,122 · App. 15/918,242 · Granted Aug 20, 2019

Systems and methods for generating haptic effects associated with audio signals

Inventors: Juan Manuel Cruz-Hernandez (Montreal, CA); Jamal Saboune (Montreal, CA); Vincent Levesque (Montreal, CA); Ali Modarres (Montreal, CA)
Assignee: Immerson Corporation
G08B6/00G06F3/016G06F3/165G06F3/167G10L15/26
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,388,122
App. No.
15/918,242
Granted
Aug 20, 2019
Kind
B2
Abstract

Systems and methods for generating haptic effects associated with audio signals are disclosed. One disclosed system for outputting haptic effects includes a processor configured to: receive an audio signal; determine a haptic effect based in part on the audio signal by: identifying one or more components in the audio signal; and determining a haptic effect associated with the one or more components; and output a haptic signal associated with the haptic effect.

Claims (47)

1. A system for identifying haptic effects from audio signals comprising:

a processor configured to:

receive an audio signal configured to be output by an audio output device to output an audible effect;

identify one or more audio components in the audio signal;

identify background noises in the audio signal;

determine a haptic effect to be output by a haptic output device, the haptic effect associated with the one or more audio components; and

store the haptic effect in a haptic track on a data store.

2. The system of claim 1 , wherein the processor is further configured to determine not to output a haptic effect associated with the background noises.

3. The system of claim 1 , wherein identifying one or more audio components of the audio signal comprises:

receiving a signal associated with one or more audio components;

dividing the audio signal into a plurality of segments;

analyzing one of the plurality of segments to determine if one or more of the components is present; and

classifying the segment based on a presence of one or more of the components.

4. The system of claim 3 , wherein analyzing one of the plurality of segments comprises implementing an acoustic event detection technique.

5. The system of claim 4 , wherein the acoustic event detection technique comprises automatic speech recognition.

6. The system of claim 3 , wherein classifying one of the plurality of segments comprises comparing the segment to a database of data associated with the one or more components.

7. The system of claim 3 , wherein determining a haptic effect comprises assigning a haptic effect based on the classification of the segment.

8. The system of claim 1 , wherein identifying one or more audio components of the audio signal comprises isolating speech in the audio signal.

9. The system of claim 1 , wherein identifying one or more audio components of the audio signal comprises isolating sounds associated with action effects in the audio signal.

10. The system of claim 1 , further comprising a haptic output device configured to receive the haptic signal and output the haptic effect.

11. A method for identifying haptic effects from audio signals comprising:

receiving an audio signal configured to be output by an audio output device to output an audible effect;

identifying one or more audio components in the audio signal;

identifying background noises in the audio signal;

determining a haptic effect to be output by a haptic output device, the haptic effect associated with the one or more audio components; and

storing the haptic effect in a haptic track on a data store.

12. The method of claim 11 , further comprising determining not to output a haptic effect associated with the background noises.

13. The method of claim 11 , wherein identifying one or more audio components of the audio signal comprises:

receiving a signal associated with one or more audio components;

dividing the audio signal into a plurality of segments;

analyzing one of the plurality of segments to determine if one or more of the components is present; and

classifying the segment based on a presence of one or more of the components.

14. The method of claim 13 , wherein analyzing one of the plurality of segments comprises implementing an acoustic event detection technique.

15. The method of claim 14 , wherein the acoustic event detection technique comprises automatic speech recognition.

16. The method of claim 13 , wherein classifying one of the plurality of segments comprises comparing the segment to a database of data associated with the one or more components.

17. The method of claim 13 , wherein determining a haptic effect comprises assigning a haptic effect based on the classification of the segment.

18. The method of claim 11 , wherein identifying one or more audio components of the audio signal comprises isolating speech in the audio signal.

19. The method of claim 11 , wherein identifying one or more audio components of the audio signal comprises isolating sounds associated with action effects in the audio signal.

20. A non-transitory computer readable medium comprising program code, which when executed by a processor, is configured to cause the processor to:

receive an audio signal configured to be output by an audio output device to output an audible effect;

identify one or more audio components in the audio signal;

identify background noises in the audio signal;

determine a haptic effect to be output by a haptic output device, the haptic effect associated with the one or more audio components; and

store the haptic effect in a haptic track on a data store.

21. The system of claim 1 , wherein the processor is further configured to output a haptic signal associated with the haptic effect to the haptic output device.

22. The method of claim 11 , further comprising outputting a haptic signal associated with the haptic effect to the haptic output device.

23. The non-transitory computer readable medium of claim 20 , further comprising program code, which when executed by the processor is configured to cause the processor to output a haptic signal associated with the haptic effect to the haptic output device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 11, 2018
From: CRUZ-HERNANDEZ, JUAN MANUEL; SABOUNE, JAMAL; LEVESQUE, VINCENT; MODARRES, ALI
To: IMMERSION CORPORATION
Reel/Frame 045508/0029 →
Continuity (4)
Continuation 15439227 · Feb 22, 2017
Continuation 14078445 · Nov 12, 2013
Provisional Application 61874933 · Sep 6, 2013
Related Publication 20180204427A1 · Jul 19, 2018
Cited By (1)
US 12,190,716