IP Library Granted Patent US 10,013,857
Granted Patent B2
US 10,013,857 · App. 13/594,502 · Granted Jul 3, 2018

Using haptic technologies to provide enhanced media experiences

Inventors: Vinay Sridhara (Santa Clara, CA); Saumitra Mohan Das (San Jose, CA); Leonid Sheynblat (Hillsborough, CA)
Assignee: QUALCOMM Incorporated
G08B6/00H04N21/235H04N21/4131H04N21/422H04N21/435H04N21/4307H04N21/43615H04N21/43637H04N21/8547G06F3/0481
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,013,857
App. No.
13/594,502
Granted
Jul 3, 2018
Kind
B2
Abstract

Methods, apparatuses, systems, and computer-readable media for using haptic technologies to provide enhanced media experiences are presented. According to one or more aspects of the disclosure, a computing device, such as a smart phone, tablet computer, or portable media player, may establish a connection with a local content receiver. Subsequently, the computing device may receive, from the local content receiver, a sensation data signal that specifies one or more haptic effects to be provided at a particular time relative to playback of a media content item received by the local content receiver. Thereafter, the computing device may provide the one or more haptic effects.

Claims (98)

1. A method comprising:

establishing, by a computing device, a connection with a local content receiver providing a content stream for display;

receiving, by the computing device, from the local content receiver a sensation data signal associated with the content stream being provided for display, the sensation data signal including sensation data information that specifies one or more haptic effects to be provided while the content stream is displayed, wherein the sensation data information includes one or more markers within the content stream associating the one or more haptic effects with particular points of the content stream provided by the local content receiver;

detecting, by the computing device, that the content stream is being provided for display;

detecting, by the computing device, a particular portion of the content stream being provided for display while the content stream is being provided for display by the local content receiver, the particular portion being associated with the one or more haptic effects according to the sensation data information; and

providing, by the computing device, the one or more haptic effects in synchronization with the particular portion of the content stream.

2. The method of claim 1 , wherein establishing the connection with the local content receiver further includes:

detecting the local content receiver on a wireless area network; and

sending registration information to the local content receiver.

3. The method of claim 2 , wherein the registration information includes device capability information.

4. The method of claim 1 , further comprising:

notifying, by the computing device, the local content receiver of haptic feedback capabilities of the computing device; and

wherein detecting that the content stream is being provided for display occurs prior to receiving the sensation data signal and includes capturing audio data or video data corresponding to a playback of the content stream.

5. The method of claim 1 , further comprising:

prior to providing the one or more haptic effects, determining whether activity is detected.

6. The method of claim 5 , wherein determining whether activity is detected includes determining whether the computing device is in motion or at rest.

7. The method of claim 5 , wherein determining whether activity is detected includes determining whether the computing device is being held by a user.

8. The method of claim 1 , further comprising:

detecting a new content stream associated with a second media content item;

and

providing one or more additional haptic effects based on data received from the local content receiver.

9. The method of claim 8 , further comprising:

prior to providing the one or more additional haptic effects, waiting for a predetermined amount of time.

10. The method of claim 1 , wherein the one or more haptic effects have a logical relationship to associated images or associated audio of the content stream and are synchronized to occur during a display of the associated images of the content stream or a projection of the associated audio of the content stream.

11. At least one non-transitory computer-readable medium having computer-executable instructions stored thereon that, when executed, cause a computing device to:

establish, by a computing device, a connection with a local content receiver providing a content stream for display;

receive, by the computing device, from the local content receiver a sensation data signal associated with the content stream being provided for display, the sensation data signal including sensation data information that specifies one or more haptic effects to be provided while the content stream is displayed, wherein the sensation data information includes one or more markers within the content stream associating the one or more haptic effects with particular points of the content stream provided by the local content receiver;

detect, by the computing device, that the content stream is being provided for display;

detect, by the computing device, a particular portion of the content stream being provided for display while the content stream is being provided for display by the local content receiver, the particular portion being associated with the one or more haptic effects according to the sensation data information; and

provide, by the computing device, the one or more haptic effects in synchronization with the particular portion of the content stream.

12. The at least one non-transitory computer-readable medium of claim 11 , wherein establishing the connection with the local content receiver further includes:

detecting the local content receiver on a wireless area network; and

sending registration information to the local content receiver.

13. The at least one non-transitory computer-readable medium of claim 12 , wherein the registration information includes device capability information.

14. The at least one non-transitory computer-readable medium of claim 11 , further comprising:

notify, by the computing device, the local content receiver of haptic feedback capabilities of the computing device; and

wherein detecting that the content stream is being provided for display occurs prior to receiving the sensation data signal and includes capturing audio data or video data corresponding to a playback of the content stream.

15. The at least one non-transitory computer-readable medium of claim 11 , having additional computer-executable instructions stored thereon that, when executed, further cause the computing device to:

prior to providing the one or more haptic effects, determine whether activity is detected.

16. The at least one non-transitory computer-readable medium of claim 15 , wherein determining whether activity is detected includes determining whether the computing device is in motion or at rest.

17. The at least one non-transitory computer-readable medium of claim 15 , wherein determining whether activity is detected includes determining whether the computing device is being held by a user.

18. The at least one non-transitory computer-readable medium of claim 11 , having additional computer-executable instructions stored thereon that, when executed, further cause the computing device to:

detect a new content stream associated with a second media content item;

and

provide one or more additional haptic effects based on data received from the local content receiver.

19. The at least one non-transitory computer-readable medium of claim 18 , having additional computer-executable instructions stored thereon that, when executed, further cause the computing device to:

prior to providing the one or more additional haptic effects, wait for a predetermined amount of time.

20. The at least one non-transitory computer-readable medium of claim 11 , wherein the one or more haptic effects have a logical relationship to associated images or associated audio of the content stream and are synchronized to occur during a display of the associated images of the content stream or a projection of the associated audio of the content stream.

21. An apparatus comprising:

at least one processor; and

memory storing computer-readable instructions that, when executed by the at least one processor, cause the apparatus to:

establish, by a computing device, a connection with a local content receiver providing a content stream for display;

receive, by the computing device, from the local content receiver a sensation data signal associated with the content stream being provided for display, the sensation data signal including sensation data information that specifies one or more haptic effects to be provided while the content stream is displayed, wherein the sensation data information includes one or more markers within the content stream associating the one or more haptic effects with particular points of the content stream provided by the local content receiver;

detect, by the computing device, that the content stream is being provided for display;

detect, by the computing device, a particular portion of the content stream being provided for display while the content stream is being provided for display by the local content receiver, the particular portion being associated with the one or more haptic effects according to the sensation data information; and

provide, by the computing device, the one or more haptic effects in synchronization with the particular portion of the content stream.

22. The apparatus of claim 21 , wherein establishing the connection with the local content receiver further includes:

detecting the local content receiver on a wireless area network; and

sending registration information to the local content receiver.

23. The apparatus of claim 22 , wherein the registration information includes device capability information.

24. The apparatus of claim 21 , further comprising:

notify, by the computing device, the local content receiver of haptic feedback capabilities of the computing device; and

wherein detecting that the content stream is being provided for display occurs prior to receiving the sensation data signal and includes capturing audio data or video data corresponding to a playback of the content stream.

25. The apparatus of claim 21 , wherein the memory stores additional computer-readable instructions that, when executed by the at least one processor, further cause the apparatus to:

prior to providing the one or more haptic effects, determine whether activity is detected.

26. The apparatus of claim 25 , wherein determining whether activity is detected includes determining whether the apparatus is in motion or at rest.

27. The apparatus of claim 25 , wherein determining whether activity is detected includes determining whether the apparatus is being held by a user.

28. The apparatus of claim 21 , wherein the memory stores additional computer-readable instructions that, when executed by the at least one processor, further cause the apparatus to:

detect a new content stream associated with a second media content item;

and

provide one or more additional haptic effects based on data received from the local content receiver.

29. The apparatus of claim 28 , wherein the memory stores additional computer-readable instructions that, when executed by the at least one processor, further cause the apparatus to:

prior to providing the one or more additional haptic effects, wait for a predetermined amount of time.

30. The apparatus of claim 21 , wherein the one or more haptic effects have a logical relationship to associated images or associated audio of the content stream and are synchronized to occur during a display of the associated images of the content stream or a projection of the associated audio of the content stream.

31. A system comprising:

means for establishing, by a computing device, a connection with a local content receiver providing a content stream for display;

means for receiving, by the computing device, from the local content receiver a sensation data signal associated with the content stream being provided for display, the sensation data signal including sensation data information that specifies one or more haptic effects to be provided while the content stream is displayed, wherein the sensation data information includes one or more markers within the content stream associating the one or more haptic effects with particular points of the content stream provided by the local content receiver;

means for detecting, by the computing device, that the content stream is being provided for display;

means for detecting, by the computing device, a particular portion of the content stream being provided for display while the content stream is being provided for display by the local content receiver, the particular portion being associated with the one or more haptic effects according to the sensation data information; and

means for providing, by the computing device, the one or more haptic effects in synchronization with the particular portion of the content stream.

32. The system of claim 31 , wherein the means for establishing the connection with the local content receiver further includes:

means for detecting the local content receiver on a wireless area network; and

means for sending registration information to the local content receiver.

33. The system of claim 32 , wherein the registration information includes device capability information.

34. The system of claim 31 , further comprising:

means for notifying, by the computing device, the local content receiver of haptic feedback capabilities of the computing device;

wherein the means for detecting that the content stream is being provided for display occurs prior to receiving the sensation data signal and includes capturing audio data or video data corresponding to a playback of the content stream.

35. The system of claim 31 , further comprising:

means for determining whether activity is detected prior to providing the one or more haptic effects.

36. The system of claim 35 , wherein the means for determining whether activity is detected includes means for determining whether the system is in motion or at rest.

37. The system of claim 35 , wherein the means for determining whether activity is detected includes means for determining whether the system is being held by a user.

38. The system of claim 31 , further comprising:

means for detecting a new content stream associated with a second media content item;

and

means for providing one or more additional haptic effects based on data received from the local content receiver.

39. The system of claim 38 , further comprising:

means for waiting for a predetermined amount of time prior to providing the one or more additional haptic effects.

40. The system of claim 31 , wherein the one or more haptic effects have a logical relationship to associated images or associated audio of the content stream and are synchronized to occur during a display of the associated images of the content stream or a projection of the associated audio of the content stream.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 10, 2012
From: SRIDHARA, VINAY; DAS, SAUMITRA MOHAN; SHEYNBLAT, LEONID
To: QUALCOMM INCORPORATED
Reel/Frame 028925/0656 →
Continuity (2)
Provisional Application 61578685 · Dec 21, 2011
Related Publication 20130227410A1 · Aug 29, 2013
Cited By (3)
US 12,347,194 US 12,682,729 US 12,710,824