IP Library Granted Patent US 11,561,757
Granted Patent B2
US 11,561,757 · App. 17/021,189 · Granted Jan 24, 2023

Methods and system for adjusting level of tactile content when presenting audio content

Inventors: Morteza Khaleghimeybodi (Bothell, WA); Buye Xu (Sammamish, WA); Peter Gottlieb (Seattle, WA); Scott Porter (Woodinville, WA); Antonio John Miller (Woodinville, WA)
Assignee: Meta Platforms Technologies, LLC
G06F3/165H04R1/1016H04R29/002H04R2400/03H04R2460/13
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,561,757
App. No.
17/021,189
Granted
Jan 24, 2023
Kind
B2
Abstract

An audio system presented herein includes a transducer array, a sensor array, and a controller. The transducer array presents audio content to a user. The controller controls the transducer array to adjust a level of tactile content imparted to the user via actuation of at least one transducer in the transducer array while presenting the audio content to the user. The audio system can be part of a headset.

Claims (58)

1. An audio system comprising:

at least one transducer configured to present audio content to a user; and

a controller configured to control tactile content for presentation to the user by altering spectral content of specific acoustic signals to adjust an intensity of tactile sensations imparted to the user via actuation of the at least one transducer for improving speech perception by the user in relation to one or more consonant sounds while presenting the audio content to the user.

2. The audio system of claim 1 , wherein the controller is further configured to:

adjust an actuation parameter of the at least one transducer for a frequency band of a spectrum of the audio content to be below a threshold level, wherein values of the actuation parameter below the threshold level correspond to ranges of actuation where a portion of the tactile content for the frequency band is not perceived by the user and values at or above the threshold level correspond to ranges where the portion of the tactile content is perceived by the user.

3. The audio system of claim 2 , wherein the actuation parameter is a voltage applied to the at least one transducer for presenting the portion of the tactile content within the frequency band to the user.

4. The audio system of claim 1 , wherein the controller is further configured to alter the spectral content using a perception model for the user.

5. The audio system of claim 1 , wherein the controller is further configured to:

generate a perception model for the user by calibrating the at least one transducer; and

alter the spectral content using the perception model.

6. The audio system of claim 1 , further comprising:

a sensor array configured to detect sounds produced by the at least one transducer; and

the controller is further configured to:

derive a threshold level for an actuation parameter of the at least one transducer for a frequency band of a spectrum of the audio content, based on a portion of the detected sounds within the frequency band, and

adjust the actuation parameter to be below the threshold level when actuating the at least one transducer for presentation of a portion of the tactile content within the frequency band, values of the actuation parameter below the threshold level correspond to ranges of actuation where a portion of the tactile content for the frequency band is not perceived by the user and values at or above the threshold level correspond to ranges where the portion of the tactile content is perceived by the user.

7. The audio system of claim 1 , further comprising:

a sensor array configured to detect sounds produced by the at least one transducer; and

the controller is further configured to:

estimate a level of sensitivity of the at least one transducer for the user, based on a portion of the detected sounds in a frequency band of a spectrum of the audio content below a threshold frequency,

derive a threshold level for an actuation parameter of the at least one transducer for the frequency band, based on the estimated level of sensitivity, and

adjust the actuation parameter to be below the threshold level, wherein values of the actuation parameter below the threshold level correspond to ranges of actuation where a portion of the tactile content for the frequency band is not perceived by the user and values at or above the threshold level correspond to ranges where the portion of the tactile content is perceived by the user.

8. The audio system of claim 1 , further comprising:

a sensor array configured to detect tactility sensation within a tissue of the user; and

the controller is further configured to:

derive a threshold level for an actuation parameter of the at least one transducer for a frequency band of a spectrum of the audio content, based on a portion of the detected tactility sensation, and

adjust the actuation parameter to be below the threshold level, wherein values of the actuation parameter below the threshold level correspond to ranges of actuation where a portion of the tactile content for the frequency band is not perceived by the user and values at or above the threshold level correspond to ranges where the portion of the tactile content is perceived by the user.

9. The audio system of claim 1 , further comprising:

a sensor array configured to monitor at least one of a sound pressure and an acceleration generated by the at least one transducer when presenting an audio signal to the user; and

the controller is further configured to control the audio content presented to the user based on the at least one of the sound pressure and the acceleration such that at least one amplitude of the audio content for at least one frequency of a spectrum of the audio content is below a threshold level,

wherein values of the at least one amplitude below the threshold level correspond to the audio content where a portion of the tactile content is not perceived by the user and values at or above the threshold level correspond to the audio content where the portion of the tactile content is perceived by the user.

10. The audio system of claim 1 , wherein the at least one transducer comprises at least one of a bone conduction transducer and a cartilage conduction transducer.

11. The audio system of claim 1 , wherein the at least one transducer comprises a plurality of cartilage conduction transducers.

12. The audio system of claim 1 , wherein the at least one transducer comprises at least one of: a plurality of air conduction transducers, a plurality of bone conduction transducers, and a plurality of cartilage conduction transducers.

13. The audio system of claim 1 , wherein the audio system is part of a headset.

14. A method comprising:

controlling tactile content for presentation to a user by altering spectral content of specific acoustic signals to adjust an intensity of tactile sensations imparted to the user via actuation of at least one transducer for improving speech perception by the user in relation to one or more consonant sounds while presenting audio content to the user; and

instructing the at least one transducer to present the audio content to the user, wherein the audio content includes the adjusted intensity of the tactile sensations.

15. The method of claim 14 , further comprising:

adjusting an actuation parameter of the at least one transducer for a frequency band of a spectrum of the audio content to be below a threshold level, wherein values of the actuation parameter below the threshold level correspond to ranges of actuation where a portion of the tactile content for the frequency band is not perceived by the user and values at or above the threshold level correspond to ranges where the portion of the tactile content is perceived by the user.

16. The method of claim 14 , further comprising:

generating a perception model for the user by calibrating the at least one transducer; and

altering the spectral content using the perception model.

17. The method of claim 14 , further comprising:

detecting sounds produced by the at least one transducer;

deriving a threshold level for an actuation parameter of the at least one transducer for a frequency band of a spectrum of the audio content, based on a portion of the detected sounds within the frequency band; and

adjusting the actuation parameter to be below the threshold level when actuating the at least one transducer for presentation of a portion of the tactile content within the frequency band, values of the actuation parameter below the threshold level correspond to ranges of actuation where a portion of the tactile content for the frequency band is not perceived by the user and values at or above the threshold level correspond to ranges where the portion of the tactile content is perceived by the user.

18. The method of claim 14 , further comprising:

detecting sounds produced by the at least one transducer;

estimating a level of sensitivity of the at least one transducer for the user, based on a portion of the detected sounds in a frequency band of a spectrum of the audio content below a threshold frequency;

deriving a threshold level for an actuation parameter of the at least transducer for the frequency band, based on the estimated level of sensitivity; and

adjusting the actuation parameter to be below the threshold level, wherein values of the actuation parameter below the threshold level correspond to ranges of actuation where a portion of the tactile content for the frequency band is not perceived by the user and values at or above the threshold level correspond to ranges where the portion of the tactile content is perceived by the user.

19. The method of claim 14 , further comprising:

monitoring at least one of a sound pressure and an acceleration generated by the at least one transducer when presenting an audio signal to the user; and

controlling the audio content presented to the user based on the at least one of the sound pressure and the acceleration such that at least one amplitude level of the audio content for at least one frequency of a spectrum of the audio content is below a threshold level,

wherein values of the at least one amplitude below the threshold level correspond to the audio content where a portion of the tactile content is not perceived by the user and values at or above the threshold level correspond to the audio content where the portion of the tactile content is perceived by the user.

20. A computer program product comprising a non-transitory computer-readable storage medium having instructions encoded thereon that, when executed by one or more processors, cause the one or more processors to:

control tactile content for presentation to a user by altering spectral content of specific acoustic signals to adjust an intensity of tactile sensations imparted to the user via actuation of at least one transducer for improving speech perception by the user in relation to one or more consonant sounds while presenting audio content to the user; and

instruct the at least one transducer to present the audio content to the user, wherein the audio content includes the adjusted intensity of the tactile sensations.

Assignments (1)
CHANGE OF NAME Recorded Jun 8, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060314/0965 →
Continuity (2)
Continuation 16580528 · Sep 24, 2019
Related Publication 20210089266A1 · Mar 25, 2021