IP Library › Granted Patent US 9,652,945
Granted Patent B2
US 9,652,945 · App. 14/145,650 · Granted May 16, 2017

Method and system for providing haptic effects based on information complementary to multimedia content

Inventors: Vincent Levesque (Montreal, CA); Ali Modarres (Montreal, CA); Juan Manuel Cruz-Hernandez (Montreal, CA); Jamal Saboune (Montreal, CA)
Assignee: Immersion Corporation
G08B6/00G06F3/016G06F3/165G06F3/167H04N21/4325H04N21/4348H04N21/4884
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,652,945
App. No.
14/145,650
Granted
May 16, 2017
Kind
B2
Abstract

The present disclosure is generally directed to systems and methods for providing haptic effects based on information complementary to multimedia content. For example, one disclosed method includes the steps of receiving multimedia data comprising multimedia content and complementary data, wherein the complementary data describes the multimedia content, determining a haptic effect based at least in part on the complementary data, and outputting the haptic effect while playing the multimedia content.

Claims (54)

1. A method comprising:

receiving, by a processor, an audio track or a video track associated with multimedia content;

receiving, by the processor, complementary data that describes the multimedia content;

determining, by the processor, a single haptic effect by both (i) analyzing the audio track or the video track and (ii) using the complementary data; and

outputting, by the processor, the haptic effect via a haptic output device while playing the multimedia content.

2. The method of claim 1 , wherein the complementary data comprises tag data, the tag data comprising at least one of a title, artist, author, genre, rating, review, a list of songs, or a song type.

3. The method of claim 1 , wherein determining the single haptic effect further comprises:

determining a preliminary haptic effect by analyzing the audio track or the video track;

determining a haptic theme using the complementary data; and

determining the single haptic effect by modifying a characteristic of the preliminary haptic effect based on the haptic theme.

4. A non-transitory computer readable medium comprising software program code executable by a processor, the software program code configured to cause the processor to:

receive an audio track or a video track associated with multimedia content;

receive complementary data that describes the multimedia content;

determine a single haptic effect by both (i) analyzing the audio track or the video track and (ii) using the complementary data; and

output the haptic effect, via a haptic output device, while playing the multimedia content.

5. The non-transitory computer readable medium of claim 4 , wherein the complementary data comprises tag data, the tag data comprising at least one of a title, artist, author, genre, rating, review, a list of songs, or a song type.

6. The non-transitory computer readable medium of claim 4 , wherein determining the single haptic effect further comprises:

determining a preliminary haptic effect by analyzing the audio track or the video track;

determining a haptic theme using the complementary data; and

determining the single haptic effect by modifying a characteristic of the preliminary haptic effect based on the haptic theme.

7. A system comprising:

a processor; and

a memory in communication with the processor, the memory comprising computer program code executable by the processor for causing the processor to:

receive an audio track or a video track associated with multimedia content;

receive complementary data that describes the multimedia content;

determine a single haptic effect by both (i) analyzing the audio track or the video track and (ii) using the complementary data; and

output the haptic effect, via a haptic output device, while playing the multimedia content.

8. The system of claim 7 , wherein the complementary data comprises tag data, the tag data comprising at least one of a title, artist, author, genre, rating, review, a list of songs, or a song type.

9. The system of claim 7 , wherein determining the single haptic effect further comprises:

determining a preliminary haptic effect by analyzing the audio track or the video track;

determining a haptic theme using the complementary data; and

determining the single haptic effect by modifying a characteristic of the preliminary haptic effect based on the haptic theme.

10. The method of claim 1 , wherein the single haptic effect is determined at least in part by:

analyzing the audio track to determine one or more words associated with the audio track event; and

determining the single haptic effect based at least in part on the one or more words associated with the audio track.

11. The method of claim 10 , wherein the one or more words comprises a particular phrase.

12. The method of claim 10 , wherein the single haptic effect comprises no haptic effect in response to the one or more words being surrounded by quotation marks.

13. The method of claim 1 , wherein the single haptic effect is determined at least in part:

analyzing the video track to determine one or more visual events associated with the video track; and

determining the single haptic effect based at least in part on the one or more visual events associated with the video track.

14. The method of claim 1 , wherein the complementary data comprises closed caption data or subtitle data.

15. The method of claim 1 , further comprising:

determining context information based on the complementary data; and

determining the single haptic effect by analyzing the audio track or the video track in view of the context information.

16. The method of claim 1 , wherein the single haptic effect is a first haptic effect, and further comprising:

determining a second haptic effect; and

determining a priority of the first haptic effect with respect to the second haptic effect.

17. The method of claim 16 , further comprising:

inserting the first haptic effect or the second haptic effect into a haptic track based on the priority.

18. The method of claim 1 , further comprising:

determining a weight associated with a word in the complementary data, the weight indicating a priority of the word.

19. The method of claim 1 , further comprising:

determining a haptic theme using the complementary data; and

determining that the single haptic effect is not to be modified according to a modification associated with the haptic theme.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 4, 2014
From: LEVESQUE, VINCENT; SABOUNE, JAMAL; MODARRES, ALI; CRUZ-HERNANDEZ, JUAN MANUEL
To: IMMERSION CORPORATION
Reel/Frame 032606/0984 →
Continuity (2)
Provisional Application 61874933 · Sep 6, 2013
Related Publication 20150070150A1 · Mar 12, 2015