IP Library › Granted Patent US 11,729,565
Granted Patent B2
US 11,729,565 · App. 17/235,498 · Granted Aug 15, 2023

Sound normalization and frequency remapping using haptic feedback

Inventors: Rocky Chau-Hsiung Lin (Cupertino, CA); Thomas Yamasaki (Anaheim Hills, CA); Hiroyuki Toki (San Jose, CA); Koichiro Kanda (San Jose, CA)
Assignee: ALPINE ELECTRONICS OF SILICON VALLEY, INC.
H04R29/00G01H11/06H04R1/1008H04R1/1041H04R1/1091H04R5/033H04R31/00H04R2400/03H04R2420/07H04R2460/07H04R2460/13H04R2499/13
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,729,565
App. No.
17/235,498
Granted
Aug 15, 2023
Kind
B2
Abstract

Method and devices for processing audio signals based on sound profiles are provided. A sound profile can include data related to haptic movement of the audio data which is specific to a left ear or a right ear, demographic information, ethnicity information, age information, location information, social media information, intensity score of the audio data, previous usage information, or device information. A sound profile can be customized for individual user to include the inaudible frequency range at high frequency end and low frequency end. Audio data within the inaudible frequency range can be compensated by haptic movement corresponding to the inaudible frequency range. A sound profile can further include an audio frequency range and its lowest audible volume for a user. A sound profile can be provided to a user without any action from the user's part.

Claims (59)

1. A device for reproducing enhanced media content, the media content including audio data, comprising:

a haptic device with a sensor capable of being placed on a contact point on a human body;

a memory component capable of storing media content, wherein the media content includes audio data and audio metadata related to the audio data in the media content;

a network component capable of receiving a first sound profile, wherein the first sound profile is capable of containing initial preselected parameters for modifying the audio data;

wherein one or more initial preselected parameters in the first sound profile are matched to one or more pieces of information in the audio metadata related to the audio data in the media or information about the device for reproducing enhanced media content;

wherein the one or more initial preselected parameters for modifying the audio data are received without previously transmitting a user's parameters for modifying the audio data from the device; and

a processor component configured to access the stored media content including the audio data from the memory component and the information about the device for reproducing enhanced media content, access the first sound profile received by the network component, determine a first inaudible frequency range that is inaudible for a user, compensate the first inaudible frequency range under a first compensation parameter, update the first sound profile with the first compensation parameter for the first inaudible frequency range to create a second sound profile, and modify the audio data in the media content according to the second sound profile, wherein the second sound profile includes an indication of a lowest haptic intensity for haptic movement that can be detected at a contact point on the user's body.

2. The device of claim 1 , wherein the processor component is further configured to:

determine a second inaudible frequency range that is a different frequency range than the first inaudible frequency range;

compensate the second inaudible frequency range under a second compensation parameter;

update the second sound profile with the second compensation parameter to create a third sound profile; and

modify the audio data in the media content according to the third sound profile.

3. The device of claim 1 , wherein the network component is further configured to

transmit information about the device for reproducing enhanced media content, audio metadata related to the audio data in the media content, and the second sound profile over a network.

4. The device of claim 1 , wherein the processor component is configured to compensate the first inaudible frequency range by being configured to generate a haptic movement corresponding to the first inaudible frequency range.

5. The device of claim 1 , wherein the processor component is configured to compensate the first inaudible frequency range by being configured to generate compressed audio data from the first inaudible frequency range into a next audible audio frequency range for the audio data.

6. The device of claim 1 , wherein the first sound profile comprises data related to haptic movement which is specific to a left ear or a right ear, demographic information, ethnicity information, age information, location information, social media information, intensity score of the audio data, previous usage information, or device information.

7. The device of claim 1 , wherein to determine the first inaudible frequency range, the processor is further configured to:

divide an audio frequency region into a number of frequency ranges;

start from a selected frequency range among the number of frequency ranges and test the selected frequency range is inaudible or not;

continue testing whether all of the frequency ranges are inaudible;

update the sound profile with one or more parameters identifying all of the inaudible frequency ranges.

8. The device of claim 7 , wherein, to test whether the selected frequency range is inaudible the processor is configured to:

start from an audio volume at the selected frequency range that is inaudible;

increase the audio volume at the selected frequency range until it becomes audible by a testing ear or exceeds a predetermined maximum volume;

identify the frequency range as inaudible if the predetermine maximum volume is reached.

9. The device of claim 1 , wherein the processor component is further configured to:

divide an audio frequency region into a number of frequency ranges;

select a frequency range that is audible;

decrease or increase an audio volume at the selected frequency range until it becomes a lowest audible volume in the selected frequency range;

record the lowest audible volume for the selected frequency range; and

update the first sound profile with the lowest audible volume for the selected frequency range.

10. The device of claim 1 , wherein the processor component is further configured to:

play the audio data based on the first sound profile;

generate haptic movement for a haptic device connected to the device for reproducing enhanced media content;

receive feedback from a sensor connected to the haptic device; and

revise the first sound profile based on the feedback received from the sensor connected to the haptic device.

11. The device of claim 10 , wherein the haptic device is wearable on a human body, and the haptic device comprises a mechanical movement component to generate a mechanical movement on the contact point, a processing unit to process received audio haptic and to control the mechanical movement, and a sensor to collect feedback from the contact point.

12. A device for reproducing enhanced media content, the media content including audio data, comprising:

a haptic device,

a memory component capable of storing media content, wherein the media content includes audio data and audio metadata related to the audio data in the media content;

a network component capable of receiving a first sound profile, wherein the first sound profile is capable of containing initial preselected parameters for modifying the audio data;

wherein one or more initial preselected parameters in the first sound profile are matched to one or more pieces of information in the audio metadata related to the audio data in the media or information about the device for reproducing enhanced media content;

wherein the one or more initial preselected parameters for modifying the audio data are received without previously transmitting a user's parameters for modifying the audio data from the device; and

a processor component configured to access the stored media content including the audio data from the memory component and the information about the device for reproducing enhanced media content, access the first sound profile received by the receiver component, play the audio data in the media content modified according to the first sound profile, and control the haptic device movement while playing the audio data based on the first sound profile, wherein the first sound profile includes an indication of a lowest haptic intensity for haptic movement that can be detected at a contact point on the user's body.

13. The device of claim 12 , wherein the haptic device comprises an attachment component to attach the haptic device to a contact point on a human body, a mechanical movement component to generate a mechanical movement on the contact point.

14. The device of claim 12 , wherein the first sound profile comprises data related to haptic movement of the audio data which is specific to a left ear or a right ear, demographic information, ethnicity information, age information, location information, social media information, intensity score of the audio data, previous usage information, and device information.

15. The device of claim 12 , wherein the processor component is further configured to:

determine a first inaudible frequency range that is inaudible for a user;

compensate the first inaudible frequency range;

update the first sound profile with the first inaudible frequency range for the audio data to become a second sound profile; and

modify the audio data in the media content according to the second sound profile.

16. The device of claim 12 , wherein the compensating the first inaudible frequency range for the audio data is performed by generating haptic movement corresponding to the first inaudible frequency range.

17. The device of claim 12 , wherein the processor component is further configured to:

divide an audio frequency region into a number of frequency ranges;

select a frequency range that is audible;

decrease or increase an audio volume at the selected frequency range until it becomes a lowest audible volume in the selected frequency range;

record the lowest audible volume for the selected frequency range; and

update the first sound profile with the lowest audible volume for the selected frequency range.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 20, 2021
From: LIN, ROCKY CHAU-HSIUNG; YAMASAKI, THOMAS; TOKI, HIROYUKI; KANDA, KOICHIRO
To: ALPINE ELECTRONICS OF SILICON VALLEY, INC.
Reel/Frame 055977/0838 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 20, 2021
From: LIN, ROCKY CHAU-HSIUNG; YAMASAKI, THOMAS; TOKI, HIROYUKI; KANDA, KOICHIRO
To: ALPINE ELECTRONICS OF SILICON VALLEY, INC.
Reel/Frame 055979/0138 →
Continuity (8)
Continuation 15970787 · May 3, 2018
Continuation In Part 15669823 · Aug 4, 2017
Continuation 14609357 · Jan 29, 2015
Continuation 14512679 · Oct 13, 2014
Continuation In Part 14269015 · May 2, 2014
Continuation 14181512 · Feb 14, 2014
Provisional Application 61924148 · Jan 6, 2014
Related Publication 20210352422A1 · Nov 11, 2021