IP Library Granted Patent US 10,310,804
Granted Patent B2
US 10,310,804 · App. 15/375,402 · Granted Jun 4, 2019

Modifying haptic feedback provided to a user to account for changes in user perception of haptic feedback

Inventors: Sean Jason Keller (Kirkland, WA); Tristan Thomas Trutna (Seattle, WA); David R. Perek (Bellevue, WA); Bruce A. Cleary, III (Seattle, WA); Brian Michael Scally (Seattle, WA)
Assignee: Facebook Technologies, LLC
G06F3/165G06F3/011
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,310,804
App. No.
15/375,402
Granted
Jun 4, 2019
Kind
B2
Abstract

A system modifies data generating haptic feedback to account for changes in user perception of haptic feedback. The system identifies haptic data and determines an estimated amplitude of haptic feedback corresponding to a portion of the haptic data. Responsive to the estimated amplitude of the haptic feedback corresponding to the portion of the haptic data exceeding a threshold value, a refractory period is determined that will occur after haptic feedback corresponding to the portion of the haptic data is applied to the user. The portion of the haptic data is provided to an input interface, and a set of haptic data associated with times within a duration of the refractory period from the identified haptic data is removed to form an adjusted data set that is provided to the input interface to provide haptic feedback to the user in accordance with adjusted haptic data set.

Claims (56)

1. A system comprising:

an input interface configured to provide haptic feedback to a user in accordance with haptic data; and

a console configured to:

identify haptic data for communication to the input interface that causes the input interface to provide haptic feedback to the user,

determine an estimated amplitude of haptic feedback corresponding to a portion of the haptic data,

responsive to the estimated amplitude of the haptic feedback exceeding a threshold value, determine that a refractory period can occur after haptic feedback corresponding to the portion of the haptic data is applied to the user,

provide the portion of the haptic data to the input interface,

compare haptic feedback associated with times within a duration of the refractory period to user training data,

responsive to the comparison indicating that characteristics of a set of haptic data associated with the times within the duration of the refractory period are within ranges of characteristics that are not perceived by the user in the user training data, remove the set of haptic data associated with the times within the duration of the refractory period from the identified haptic data to form an adjusted haptic data set, and

provide to the input interface the adjusted haptic data set, wherein the input interface provides haptic feedback to the user in accordance with the adjusted haptic data set.

2. The system of claim 1 , wherein the haptic data comprises audio data.

3. The system of claim 1 , wherein determining the refractory period is based in part on a plurality of factors, the factors selected from a group consisting of: prior responses of the user to haptic feedback, characteristics of the user, a type of haptic feedback applied to the user, a portion of the user's body to which the haptic feedback is applied, a time duration of the haptic feedback applied to the user, and characteristics of haptic feedback applied to the user.

4. The system of claim 1 , wherein the console is further configured to:

determine characteristics of haptic feedback corresponding to the portion of the haptic data, wherein the characteristics are selected from a group consisting of: a plurality of amplitudes of the haptic feedback, a plurality of frequencies of the haptic feedback, and a plurality of phases of the haptic feedback;

compare the characteristics of haptic feedback corresponding to the portion of the haptic data to training data associated with the user, wherein the training data includes ranges of characteristics that are not perceived by the user; and

responsive to the comparing indicating the characteristics of the set of haptic data are within the ranges of characteristics, remove the set of haptic data.

5. The system of claim 4 , wherein the training data further comprises a pattern corresponding to frequency ranges and amplitude ranges of haptic feedback that are perceived by the user, and a pattern corresponding to frequency ranges and amplitude ranges of haptic feedback that are not perceived by the user.

6. The system of claim 1 , wherein the console is further configured to:

adjust the haptic data not to cause a refractory period.

7. The system of claim 6 , wherein adjusting the haptic data not to cause the refractory period comprises:

attenuating the amplitude of the haptic feedback corresponding to the haptic data such that the attenuated amplitude is less than a threshold value causing the refractory period.

8. A computer-implemented method comprising:

identifying haptic data for communication to an input interface that causes the input interface to provide haptic feedback to a user;

determining an estimated amplitude of haptic feedback corresponding to a portion of the haptic data;

responsive to the estimated amplitude of the haptic feedback exceeding a threshold value, determining that a refractory period can occur after haptic feedback corresponding to the portion of the haptic data is applied to the user;

providing the portion of the haptic data to the input interface;

comparing haptic feedback associated with times within a duration of the refractory period to user training data;

responsive to the comparison indicating that characteristics of a set of haptic data associated with the times within the duration of the refractory period are within ranges of characteristics that are not perceived by the user in the user training data, removing the set of haptic data associated with the times within the duration of the refractory period from the identified haptic data to form an adjusted haptic data;

providing to the input interface the adjusted haptic data set; and

providing haptic feedback to the user in accordance with the adjusted haptic data set.

9. The method of claim 8 , wherein the haptic data comprises audio data.

10. The method of claim 8 , wherein determining the refractory period is based in part on a plurality of factors, the factors selected from a group consisting of: prior responses of the user to haptic feedback, characteristics of the user, a type of haptic feedback applied to the user, a portion of the user's body to which the haptic feedback is applied, a time duration of the haptic feedback applied to the user, and characteristics of haptic feedback applied to the user.

11. The method of claim 8 , further comprising:

determining characteristics of haptic feedback corresponding to the portion of the haptic data, wherein the characteristics are selected from a group consisting of: a plurality of amplitudes of the haptic feedback, a plurality of frequencies of the haptic feedback, and a plurality of phases of the haptic feedback;

comparing the characteristics of haptic feedback corresponding to the portion of the haptic data to training data associated with the user, wherein the training data includes ranges of characteristics that are not perceived by the user; and

responsive to the comparing indicating the characteristics of the set of haptic data are within the ranges of characteristics, removing the set of haptic data.

12. The method of claim 11 , wherein the training data further comprises a pattern corresponding to frequency ranges and amplitude ranges of haptic feedback that are perceived by the user, and a pattern corresponding to frequency ranges and amplitude ranges of haptic feedback that are not perceived by the user.

13. The method of claim 8 , further comprising:

adjusting the haptic data not to cause a refractory period.

14. The method of claim 13 , wherein adjusting the haptic data not to cause the refractory period comprises:

attenuating the amplitude of the haptic feedback corresponding to the haptic data such that the attenuated amplitude is less than a threshold value causing the refractory period.

15. A non-transitory computer-readable medium comprising computer program instructions, the computer program instructions when executed by a computer processor causes the processor to perform steps including:

identifying haptic data for communication to an input interface that causes the input interface to provide haptic feedback to a user;

determining an estimated amplitude of haptic feedback corresponding to a portion of the haptic data;

responsive to the estimated amplitude of the haptic feedback exceeding a threshold value, determining that a refractory period can occur after haptic feedback corresponding to the portion of the haptic data is applied to the user;

providing the portion of the haptic data to the input interface;

comparing haptic feedback associated with times within a duration of the refractory period to user training data;

responsive to the comparison indicating that characteristics of a set of haptic data associated with the times within the duration of the refractory period are within ranges of characteristics that are not perceived by the user in the user training data, removing the set of haptic data associated with the times within the duration of the refractory period from the identified haptic data to form an adjusted haptic data;

providing to the input interface the adjusted haptic data set; and

providing haptic feedback to the user in accordance with the adjusted haptic data set.

16. The non-transitory computer-readable storage medium of claim 15 , wherein the haptic data comprises audio data.

17. The non-transitory computer-readable storage medium of claim 16 , wherein determining the refractory period is based in part on a plurality of factors, the factors selected from a group consisting of: prior responses of the user to haptic feedback, characteristics of the user, a type of haptic feedback applied to the user, a portion of the user's body to which the haptic feedback is applied, a time duration of the haptic feedback applied to the user, and characteristics of haptic feedback applied to the user.

18. The non-transitory computer-readable storage medium of claim 16 , further comprising:

determining characteristics of haptic feedback corresponding to the portion of the haptic data, wherein the characteristics comprising a plurality of amplitudes of the haptic feedback, a plurality of frequencies of the haptic feedback, a plurality of phases of the haptic feedback, or some combination thereof;

comparing the characteristics of haptic feedback corresponding to the portion of the haptic data to training data associated with the user, wherein the training data comprising characteristics ranges that are not perceived by the user; and

removing a set of haptic data in response to the comparing that indicates the characteristics of the set of haptic data are within the characteristics ranges that are not perceived by the user in the training data.

Assignments (3)
CHANGE OF NAME Recorded Jun 8, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060315/0224 →
CHANGE OF NAME Recorded Sep 12, 2018
From: OCULUS VR, LLC
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 047178/0616 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 18, 2017
From: KELLER, SEAN JASON; TRUTNA, TRISTAN THOMAS; PEREK, DAVID R.; CLEARY, BRUCE A., III; SCALLY, BRIAN MICHAEL
To: OCULUS VR, LLC
Reel/Frame 041011/0249 →
Continuity (2)
Provisional Application 62266492 · Dec 11, 2015
Related Publication 20170168773A1 · Jun 15, 2017