IP Library Granted Patent US 11,694,113
Granted Patent B2
US 11,694,113 · App. 16/809,648 · Granted Jul 4, 2023

Personalized and adaptive learning audio filtering

Inventors: Elaheh ShafieiBavani (Melbourne, AU); Fatemeh Jalali (Hawthorn East, AU); Mahtab Mirmomeni (Hawthorne East, AU); Ying Xu (Albion, AU)
Assignee: International Business Machines Corporation
G06N20/00G06F3/015G06V20/46G10L25/57
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,694,113
App. No.
16/809,648
Granted
Jul 4, 2023
Kind
B2
Abstract

Aspects of the invention include a method including collecting, by a processor, physiological data from a user in an environment and a sound waveform from the user's environment. The method detects and labels as a potential annoyance, by the processor, a set of potential annoyance data based on the collected physiological data and the sound waveform. The method decomposes, by the processor, the sound waveform into a first sound waveform segment associated with the set of potential annoyance data and a second sound waveform segment not associated with the set of potential annoyance data. The method predicts, by the processor, that the potential annoyance is an actual annoyance. The method filters and modifies, by the processor, the first sound waveform segment associated with the actual annoyance and provides, by the processor, the second sound waveform segment not associated with the actual annoyance to the user.

Claims (40)

1. A computer-implemented method comprising:

collecting, by a processor, physiological data from a user in an environment and a sound waveform from the user's environment;

detecting and labeling as a potential annoyance, by the processor, a set of potential annoyance data based on the collected physiological data and the sound waveform;

decomposing, by the processor, the sound waveform into a first sound waveform segment associated with the set of potential annoyance data and a second sound waveform segment not associated with the set of potential annoyance data;

predicting, by the processor, that the set of potential annoyance data is an actual annoyance;

filtering and modifying, by the processor, the first sound waveform segment associated with the actual annoyance; and

providing, by the processor, the second sound waveform segment not associated with the actual annoyance to the user.

2. The computer-implemented method of claim 1 , wherein predicting, by the processor, that the set of potential annoyance data is an actual annoyance is performed using machine learning.

3. The computer-implemented method of claim 2 , wherein training data for the machine learning includes an input and output pair where the input is the first sound waveform segment and the output is the potential annoyance label.

4. The computer-implemented method of claim 2 , wherein machine learning is repeated periodically.

5. The computer-implemented method of claim 1 further comprising collecting, by the processor, a video input feed of the user and using the video input feed when detecting and labeling a potential annoyance.

6. The computer implemented method of claim 1 , wherein detecting and labeling as a potential annoyance, by the processor, the set of potential annoyance data from the collected physiological data and the sound waveform comprises finding patterns of abnormal changes in the physiological data.

7. The computer-implemented method of claim 1 , wherein decomposing, by the processor, the sound waveform into a first sound waveform segment associated with the set of potential annoyance data and a second sound waveform segment not associated with the set of potential annoyance data comprises decomposing using a non-negative matrix factor 2-D deconvolution algorithm.

8. A system comprising:

a memory having computer readable instructions; and

one or more processors for executing the computer readable instructions, the computer readable instructions controlling the one or more processors to perform operations comprising:

collecting physiological data from a user in an environment and a sound waveform from the user's environment;

detecting and labeling as a potential annoyance a set of potential annoyance data based on the collected physiological data and the sound waveform;

decomposing the sound waveform into a first sound waveform segment associated with the set of potential annoyance data and a second sound waveform segment not associated with the set of potential annoyance data;

predicting that the set of potential annoyance data is an actual annoyance;

filtering and modifying the first sound waveform segment associated with the actual annoyance; and

providing the second sound waveform segment not associated with the actual annoyance to the user.

9. The system of claim 8 , wherein predicting that the set of potential annoyance data is an actual annoyance is performed using machine learning.

10. The system of claim 9 , wherein training data for the machine learning includes an input and output pair where the input is the first sound waveform segment and the output is the potential annoyance label.

11. The system of claim 10 , wherein machine learning is repeated periodically.

12. The system of claim 8 , further comprising collecting a video input feed of the user and using the video input feed when detecting and labeling a potential annoyance.

13. The system of claim 8 , wherein detecting and labeling as a potential annoyance the set of potential annoyance data from the collected physiological data and the sound waveform comprises finding patterns of abnormal changes in the physiological data.

14. The system of claim 8 , wherein decomposing the sound waveform into a first sound waveform segment associated with the set of potential annoyance data and a second sound waveform segment not associated with the set of potential annoyance data comprises decomposing using a non-negative matrix factor 2-D deconvolution algorithm.

15. A computer program product comprising one or more computer readable storage media having program instructions embodied therewith, the program instructions executable by a processor to cause the processor to perform operations comprising:

collecting physiological data from a user in an environment and a sound waveform from the user's environment;

detecting and labeling as a potential annoyance a set of potential annoyance data from the collected physiological data and the sound waveform;

decomposing the sound waveform into a first sound waveform segment associated with the set of potential annoyance data and a second sound waveform segment not associated with the set of potential annoyance data;

predicting that the set of potential annoyance data is an actual annoyance;

filtering and modifying the first sound waveform segment associated with the actual annoyance; and

providing the second sound waveform segment not associated with the actual annoyance to the user.

16. The computer program product of claim 15 , wherein predicting that the set of potential annoyance data is an actual annoyance is performed using machine learning.

17. The computer program product of claim 16 , wherein training data for the machine learning includes an input and output pair where the input is the first sound waveform segment and the output is the potential annoyance label.

18. The computer program product of claim 15 , further comprising collecting a video input feed of the user and using the video input feed when detecting and labeling a potential annoyance.

19. The computer program product of claim 15 , wherein detecting and labeling as a potential annoyance the set of potential annoyance data from the collected physiological data and the sound waveform comprises finding patterns of abnormal changes in the physiological data.

20. The computer program product of claim 15 , wherein decomposing the sound waveform into a first sound waveform segment associated with the set of potential annoyance data and a second sound waveform segment not associated with the set of potential annoyance data comprises decomposing using a non-negative matrix factor 2-D deconvolution algorithm.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 5, 2020
From: SHAFIEIBAVANI, ELAHEH; JALALI, FATEMEH; MIRMOMENI, MAHTAB; XU, YING
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 052026/0391 →
Continuity (1)
Related Publication 20210279634A1 · Sep 9, 2021