IP Library Granted Patent US 12,073,314
Granted Patent B2
US 12,073,314 · App. 17/683,125 · Granted Aug 27, 2024

Microcontroller interface for audio signal processing

Inventors: Kurt F. Busch (Laguna Hills, CA); Jeremiah H. Holleman, III (Davidson, NC); Pieter Vorenkamp (Laguna Beach, CA); Stephen W. Bailey (Irvine, CA)
Assignee: SYNTIANT
G06N3/065G06F3/16G06N3/02G06N3/04G06N3/045G06N3/08G06N3/105H04R25/507G06F3/162H04R25/505
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,073,314
App. No.
17/683,125
Granted
Aug 27, 2024
Kind
B2
Abstract

Disclosed is a neuromorphic-processing systems including, in some embodiments, a special-purpose host processor operable as a stand-alone host processor; a neuromorphic co-processor including an artificial neural network; and a communications interface between the host processor and the co-processor configured to transmit information therebetween. The co-processor is configured to enhance special-purpose processing of the host processor with the artificial neural network. Also disclosed is a method of a neuromorphic-processing system having the special-purpose host processor and the neuromorphic co-processor including, in some embodiments, enhancing the special-purpose processing of the host processor with the artificial neural network of the co-processor. In some embodiments, the host processor is a hearing-aid processor.

Claims (34)

1. A processing system comprising:

a special-purpose host processor operable as a stand-alone host processor;

a co-processor including an artificial neural network;

a communications interface between the stand-alone host processor and the co-processor configured to transmit information therebetween;

wherein the co-processor is configured to provide a frequency mask to the special-purpose host processor over the communications interface, wherein the frequency mask is a set of attenuation or amplification factors corresponding to a set of frequencies to be suppressed or boosted for each of a number of time steps of an audio sample; and

wherein the special-purpose host processor is a hearing-aid processor configured to transmit frequency elements or signal spectrum information to the co-processor in the form of Fourier transforms over the communications interface.

2. The system of claim 1 , wherein the communications interface between the stand-alone host processor and the co-processor is a serial peripheral interface (“SPI”) bus or inter-integrated circuit (“I 2 C”) bus.

3. The system of claim 1 , wherein the co-processor is configured to enhance the special-purpose processing of the hearing-aid processor by providing information to the hearing-aid processor over the communications interface, thereby enabling the hearing-aid processor to selectively suppress noise and enhance desired signals.

4. The system of claim 1 , wherein the co-processor further includes a demultiplexer configured to demultiplex serial signals from the communications interface into parallel signals for a plurality of inputs of the artificial neural network.

5. The system of claim 1 , wherein the artificial neural network is disposed in an analog multiplier array of a plurality of two-quadrant multipliers in a memory sector of the system.

6. The system of claim 1 , wherein synaptic weights of the artificial neural network are stored in firmware of the co-processor, and wherein the firmware is configured for cloud-based updates to update the synaptic weights of the artificial neural network.

7. The system of claim 1 , wherein the stand-alone host processor and the co-processor are embodied in a single monolithic integrated circuit, a stacked die assembly, a multi-chip module, or separate integrated circuits of separate modules.

8. The system of claim 1 , wherein the system is configured to operate on battery power.

9. A processor, comprising:

one or more interface circuits comprising a demultiplexer configured to demultiplex serial signals into parallel signals;

wherein the serial signals are received from a serial communications interface between the processor and a special-purpose host processor;

wherein the special-purpose host processor is a hearing-aid processor;

a multi-layered artificial neural network configured to receive the parallel signals from the interface circuits;

wherein the processor is configured to provide a frequency mask to the hearing-aid processor over the serial communications interface, wherein the frequency mask is a set of attenuation or amplification factors corresponding to a set of frequencies to be suppressed or boosted for each of a number of time steps of an audio sample; and

wherein the processor is further configured to receive frequency elements or signal spectrum information from the hearing-aid processor in the form of Fourier transforms over the serial communications interface.

10. The processor of claim 9 , wherein the processor is configured to enhance the special-purpose processing of the hearing-aid processor by providing information to the hearing-aid processor over the serial communications interface, thereby enabling the hearing-aid processor to selectively suppress noise and enhance desired signals.

11. The processor of claim 9 , by providing the frequency mask to the hearing-aid processor, the processor indicates noise frequencies to suppress and signal frequencies to boost.

12. The processor of claim 9 , wherein the artificial neural network is disposed in an analog multiplier array of a plurality of two-quadrant multipliers in a memory sector of the processor.

13. The processor of claim 9 , wherein the serial communications interface between the special-purpose host processor and the co-processor is a serial peripheral interface (“SPI”) bus or inter-integrated circuit (“I 2 C”) bus.

14. The processor of claim 9 ,

wherein synaptic weights of the artificial neural network are stored in firmware of the co-processor, and

wherein the firmware is configured for cloud-based updates to update the synaptic weights of the artificial neural network.

15. The processor of claim 9 , wherein the special-purpose host processor and the co-processor are embodied in a single monolithic integrated circuit, a stacked die assembly, a multi-chip module, or separate integrated circuits of separate modules.

16. The processor of claim 9 , wherein the processor and the special-purpose host processor are configured to operate on battery power.

17. A method of a processing system having a special-purpose host processor configured as a hearing-aid processor and a co-processor, comprising:

enhancing special-purpose processing of the hearing-aid processor with an artificial neural network of the co-processor by providing information to the hearing-aid processor over a communications interface, thereby enabling the hearing-aid processor to selectively suppress noise and enhance desired signals;

transmitting a frequency mask from the co-processor to the special-purpose host processor over a communications interface, wherein the frequency mask is a set of attenuation or amplification factors corresponding to a set of frequencies to be suppressed or boosted for each of a number of time steps of an audio sample;

transmitting frequency elements or signal spectrum information from the special-purpose host processor to the co-processor in the form of Fourier transforms over a serial communications interface; and

demultiplexing serial signals from the serial communications interface with a demultiplexer of the co-processor into parallel signals for a plurality of inputs of the artificial neural network.

Assignments (2)
SECURITY INTEREST Recorded Dec 27, 2024
From: SYNTIANT CORP.; PILOT AI LABS, INC.; SYNTIANT TAIWAN LLC; SYNTIANT HOLDINGS LLC
To: OCEAN II PLO LLC
Reel/Frame 069687/0757 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 28, 2022
From: BUSCH, KURT F.; HOLLEMAN, JEREMIAH H., III; BAILEY, STEPHEN W.; VORENKAMP, PIETER
To: SYNTIANT
Reel/Frame 059123/0640 →
Continuity (3)
Continuation 16048235 · Jul 28, 2018
Provisional Application 62539194 · Jul 31, 2017
Related Publication 20220188619A1 · Jun 16, 2022