IP Library Granted Patent US 12,417,774
Granted Patent B2
US 12,417,774 · App. 17/658,094 · Granted Sep 16, 2025

System monitoring by playing sound

Inventor: Albert Alexander Chung (Cary, NC)
Assignee: International Business Machines Corporation
G10L19/0212G10L19/005G10L19/08
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,417,774
App. No.
17/658,094
Granted
Sep 16, 2025
Kind
B2
Abstract

A computer-implemented method, a computer program product, and a computer system for system monitoring. A computer system convert a time domain representation of first sound into a frequency domain representation, maps monitoring datasets of a monitored system to frequencies in the frequency domain representation, modifies the amplitudes of the respective frequencies according mapping rules defined by a user, convert the frequency domain representation into the time domain representation and generate a sound wave in a digital format which has modified amplitudes, converts the sound wave in the digital format to a sound wave in an analog format, and feeds the sound wave in the analog format to a sound system to play second sound. Performance of the monitored system is monitored by the user listening to the second sound and comparing the first and second sound.

Claims (49)

1. A computer-implemented method for system monitoring, the method comprising:

converting a time domain representation of a first sound into a frequency domain representation;

mapping respective monitoring datasets of a monitored system to respective frequencies in the frequency domain representation;

modifying amplitudes of the respective frequencies according to one or more mapping rules defined by a user by: normalizing an operating range of a respective one of the monitoring datasets to one of the respective frequencies; and proportionally increasing or decreasing the amplitude of one of the respective frequencies in response to a value of the respective one of the monitoring datasets being outside of the operating range;

converting the frequency domain representation into the time domain representation to generate a sound wave in a digital format which has modified amplitudes;

converting the sound wave in the digital format to a sound wave in an analog format;

feeding the sound wave in the analog format to a sound system to play a second sound; and

wherein performance of the monitored system is configured to be monitored by the user listening to the second sound and comparing the first sound and the second sound.

2. The computer-implemented method of claim 1 , further comprising:

loading an audio file of the first sound; and

sampling a decoded sound wave of the audio file at a predetermined sampling frequency to capture the array of the amplitudes of the first sound.

3. The computer-implemented method of claim 1 , wherein converting the time domain representation into the frequency domain representation is by performing a Fourier transform, wherein converting the frequency domain representation into the time domain representation is by performing an inverse Fourier transform.

4. The computer-implemented method of claim 1 , wherein converting the time domain representation into the frequency domain representation is by performing a Laplace transform, wherein converting the frequency domain representation into the time domain representation is by performing an inverse Laplace transform.

5. The computer-implemented method of claim 1 , wherein converting the time domain representation into the frequency domain representation is by performing a Z transform, wherein converting the frequency domain representation into the time domain representation is by performing an inverse Z transform.

6. The computer-implemented method of claim 1 , wherein one of the respective monitoring datasets is mapped to one or more of the respective frequencies.

7. The computer-implemented method of claim 1 , wherein:

the first sound comprises music selected by the user; and

the second sound played by the sound system is the same as the first sound based on the computing system performing within an expected range or the second sound played by the sound system is not the same as the first sound based on the computing system not performing within the expected range.

8. A computer program product for system monitoring, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by one or more processors, the program instructions executable to:

convert a time domain representation of a first sound into a frequency domain representation;

map respective monitoring datasets of a monitored system to respective frequencies in the frequency domain representation;

modify amplitudes of the respective frequencies according to one or more mapping rules defined by a user by normalizing an operating range of a respective one of the monitoring datasets to one of the respective frequencies;

convert the frequency domain representation into the time domain representation to generate a sound wave in a digital format which has modified amplitudes;

convert the sound wave in the digital format to a sound wave in an analog format;

feed the sound wave in the analog format to a sound system to play a second sound; and

wherein performance of the monitored system is configured to be monitored by the user listening to the second sound and comparing the first sound and the second sound.

9. The computer program product of claim 8 , further comprising the program instructions executable to:

load an audio file of the first sound; and

sample a decoded sound wave of the audio file at a predetermined sampling frequency to capture the array of the amplitudes of the first sound.

10. The computer program product of claim 8 , wherein converting the time domain representation into the frequency domain representation is by performing a Fourier transform, wherein converting the frequency domain representation into the time domain representation is by performing an inverse Fourier transform.

11. The computer program product of claim 8 , wherein converting the time domain representation into the frequency domain representation is by performing a Laplace transform, wherein converting the frequency domain representation into the time domain representation is by performing is an inverse Laplace transform.

12. The computer program product of claim 8 , wherein converting the time domain representation into the frequency domain representation is by performing a Z transform, wherein converting the frequency domain representation into the time domain representation is by performing an inverse Z transform.

13. The computer program product of claim 8 , wherein one of the respective monitoring datasets is mapped to one or more of the respective frequencies.

14. A computer system for system monitoring, one or more computer readable tangible storage devices, and program instructions stored on at least one of the one or more computer readable tangible storage devices for execution by at least one of the one or more processors, the program instructions executable to:

convert a time domain representation of a first sound into a frequency domain representation;

map respective monitoring datasets of a monitored system to respective frequencies in the frequency domain representation;

modify amplitudes of the respective frequencies by normalizing an operating range of a respective one of the monitoring datasets to one of the respective frequencies;

convert the frequency domain representation into the time domain representation to generate a sound wave which has modified amplitudes;

feed the sound wave to a sound system to play a second sound; and

wherein performance of the monitored system is configured to be monitored by the user listening to the second sound and comparing the first sound and the second sound.

15. The computer system of claim 14 , further comprising the program instructions executable to:

load an audio file of the first sound; and

sample a decoded sound wave of the audio file at a predetermined sampling frequency to capture the array of the amplitudes of the first sound.

16. The computer system of claim 14 , wherein converting the time domain representation into the frequency domain representation is by performing a Fourier transform, wherein converting the frequency domain representation into the time domain representation is by performing an inverse Fourier transform.

17. The computer system of claim 14 , wherein converting the time domain representation into the frequency domain representation is by performing a Laplace transform, wherein converting the frequency domain representation into the time domain representation is by performing an inverse Laplace transform.

18. The computer system of claim 14 , wherein converting the time domain representation into the frequency domain representation is by performing a Z transform, wherein converting the frequency domain representation into the time domain representation is by performing an inverse Z transform.

19. The computer system of claim 14 , wherein one of the respective monitoring datasets is mapped to one or more of the respective frequencies.

20. The computer system of claim 14 , wherein the modifying amplitudes of the respective frequencies further comprises:

proportionally increasing or decreasing the amplitude of one of the respective frequencies in response to a value of the respective one of the monitoring datasets being outside of the operating range.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 6, 2022
From: CHUNG, ALBERT ALEXANDER
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 059511/0011 →
Continuity (1)
Related Publication 20230326471A1 · Oct 12, 2023
References Cited (27)
US 7111241B2 · Takats et al. · 2006 [cited by applicant]
US 7137074B1 · Newton et al. · 2006 [cited by applicant]
US 7171466B2 · Van Der Meulen · 2007 [cited by applicant]
US 7839268B2 · Outlaw et al. · 2010 [cited by applicant]
US 7940162B2 · Shaouy · 2011 [cited by applicant]
US 9489866B2 · Wohlert et al. · 2016 [cited by applicant]
US 10505793B2 · Yin · 2019 [cited by applicant]
US 20060269086A1 · Page · 2006 [cited by examiner]
US 20090051507A1 · Outlaw · 2009 [cited by examiner]
US 20100075806A1 · Montgomery · 2010 [cited by examiner]
US 20100136950A1 · Backlund · 2010 [cited by examiner]
US 20170370974A1 · Liang · 2017 [cited by applicant]
US 20200349248A1 · McNulty et al. · 2020 [cited by applicant]
US 20230280820A1 · Sukumaran · 2023 [cited by examiner]
US 20230281070A1 · Harutyunyan · 2023 [cited by examiner]
WO 2016131793A1 · 2016 [cited by applicant]
P.A. Lynn, The Laplace Transform and the Z-Transform, in Electronic Signals and Systems (Palgrave, London, 1986) (“Lynn”) (Year: 1986). [cited by examiner]
“Patent Cooperation Treaty PCT Notification of Transmittal of the International Search Report and the Written Opinion of the International Searching Authority, or the Declaration”, Applicant's file reference P202105570,… [cited by applicant]
Henthorne et al., “Sonifying Performance Data to Facilitate Tuning of Complex Systems”, Onward! 2010, Oct. 17 -21, 2010 Reno/Tahoe, Nevada, USA, 8 pages. [cited by applicant]
Hahn, Michael, “Suspended Chords: Create Tension with Sus4 and Sus2”, LANDR Blog, published Mar. 4, 2020 , 10 pages, <https://blog.landr.com/suspended-chords>. [cited by applicant]
Mcfee et al., “librosa: Audio and Music Signal Analysis in Python”, Proc. of The 14th Python in Science Conf. (SCIPY 2015), 7 pages. [cited by applicant]
Mell et al., “The NIST Definition of Cloud Computing”, NIST National Institute of Standards and Technology U.S. Department of Commerce, Special Publication 800-145, Sep. 2011, 7 pages. [cited by applicant]
Nogueira, Goncalo, “Tension and Release—the fundamental way we listen to music”, medium.com (“Harmonic tension” subheading), published Oct. 17, 2020, 14pages, <https://medium.com/the-gleaming-sword/tension-and-release-t… [cited by applicant]
Scapelliti, Christopher, “Why Do Major Chords Sound Happy”, Guitar World, published Aug. 4, 2016, 12 pages, <https://www.guitarworld.com/lessons/why-do-major-chords-sound-happy>. [cited by applicant]
Wikipedia, “Discrete Fourier transform”, page was last edited on Feb. 11, 2022, 18 pages, <https://en.wikipedia.org/wiki/Discrete_Fourier_transform>. [cited by applicant]
Wikipedia, “Fourier Transform”, page was last edited on Feb. 15, 2022, 39 pages, <https://en.wikipedia.org/wiki/Fourier_transform>. [cited by applicant]
Wikipedia, “Sampling (music)”, page was last edited on Feb. 17, 2022, 9 pages, <https://en.wikipedia.org/wiki/Sampling_(music)>. [cited by applicant]