IP Library Granted Patent US 9,699,556
Granted Patent B2
US 9,699,556 · App. 15/157,131 · Granted Jul 4, 2017

Enhancing audio using a mobile device

Inventors: Ashish Dharmpal Aggarwal (Stevenson Ranch, CA); Sharath Hariharpur Satheesh (Bangalore, IN)
Assignee: Caavo Inc
H04R3/04G06F3/165G10L21/0232G10L25/51H03G3/20H03G3/3005H03G3/32H03G5/005H03G5/165H03G7/002H03H17/04H04R1/08H04R3/00H04R25/50H04R25/505H04R29/00H04R29/004H03H2017/0472H04R29/001H04R2430/01H04R2499/11
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,699,556
App. No.
15/157,131
Granted
Jul 4, 2017
Kind
B2
Abstract

Embodiments disclosed herein enable detection and improvement of the quality of the audio signal using a mobile device by determining the loss in the audio signal and enhancing audio by streaming the remainder portion of audio. Embodiments disclosed herein enable an improvement in the sound quality rendered by rendering devices by emitting an test audio signal from the source device, measuring the test audio signal using microphones, detecting variation in the frequency response, loudness and timing characteristics using impulse responses and correcting for them. Embodiments disclosed herein also compensate for the noise in the acoustic space by determining the reverberation and ambient noise levels and their frequency characteristics and changing the digital filters and volumes of the source signal to compensate for the varying noise levels.

Claims (51)

1. A method, performed by a mobile device, for obtaining a high quality version of a first audio signal that is generated by a first audio source and is being played back on an audio system that includes a source device and at least one rendering device, the method comprising:

identifying the first audio signal;

determining whether a quality of the first audio signal is below a quality threshold, said determining comprising:

obtaining a portion of a second audio signal having a higher quality than the first audio signal from a second audio source;

time aligning the obtained portion of the second audio signal and the identified first audio signal; and

calculating a metric based on a difference between the obtained portion of the second audio signal and the identified first audio signal, wherein the metric is calculated in accordance with:

Sq =( H*H+O*O )/( H−O )*( H−O )

where H is the obtained portion of the second audio signal, O is the identified first audio signal and Sq is the quality of the identified first audio signal; and

in response to determining that the quality of the first audio signal is below the quality threshold, providing a location of the second audio source or a portion of the second audio signal to the source device for streaming thereby.

2. The method of claim 1 , wherein the identifying the first audio signal comprises:

detecting the first audio signal by at least one microphone; and

identifying the first audio signal based on audio fingerprinting.

3. The method of claim 1 , wherein the location is remote with respect to the source device and the mobile device.

4. The method of claim 1 , wherein the mobile device and the source device are the same device.

5. The method of claim 1 , further comprising:

streaming the portion of the second audio signal from the location.

6. The method of claim 1 , wherein the second audio source is a server coupled to the mobile device via a network.

7. The method of claim 1 , wherein the mobile device is a mobile phone.

8. A computer program product comprising computer executable program code recorded on a computer readable non-transitory storage medium, said computer executable program code when executed, performing a method for obtaining a high quality version of a first audio signal that is generated by a first audio source and is being played back on an audio system that includes a source device and at least one rendering device, the method comprising:

identifying the first audio signal;

determining whether a quality of the first audio signal is below a quality threshold, wherein said determining comprises:

obtaining a portion of a second audio signal having a higher quality than the first audio signal from a second audio source;

time aligning the obtained portion of the second audio signal and the identified first audio signal;

calculating a metric based on a difference between the obtained portion of the second audio signal and the identified first audio signal, wherein the metric is calculated in accordance with:

Sq =( H*H+O*O )/( H−O )*( H−O )

where H is the obtained portion of the second audio signal, O is the identified first audio signal and Sq is the quality of the identified first audio signal; and

in response to determining that the quality of the first audio signal is below the quality threshold, providing a location of the second audio source or a portion of the second audio signal to the source device.

9. The computer program product of claim 8 , wherein the identifying the first audio signal comprises:

detecting the first audio signal by at least one microphone; and

identifying the first audio signal based on audio fingerprinting.

10. The computer program product of claim 8 , wherein the at least one microphone is included in a mobile device.

11. The computer program product of claim 10 , wherein the second audio source is a server coupled to at least mobile device via a network.

12. The computer program product of claim 10 , wherein the mobile device is a mobile phone.

13. The computer program product of claim 8 , wherein the location is remote with respect to the source device and the mobile device.

14. The computer program product of claim 8 , wherein the method further comprises streaming the portion of the second audio signal from the location.

15. A mobile device configured to obtain a high quality version of a first audio signal, comprising:

at least one microphone configured to detect the first audio signal that is generated by a first audio source and is being played back by at least one rendering device coupled to a source device; and

a processing unit configured to:

identify the first audio signal;

determine whether a quality of the first audio signal is below a quality threshold, wherein said processing unit is configured to determine whether the quality of the first audio signal is below a quality threshold by:

obtaining a portion of a second audio signal having a higher quality than the first audio signal from a second audio source;

time aligning the obtained portion of the second audio signal and the identified first audio signal;

calculating a metric based on a difference between the obtained portion of the second audio signal and the identified first audio signal, wherein the metric is calculated in accordance with:

Sq =( H*H+O*O )/( H−O )*( H−O )

where H is the obtained portion of the second audio signal, O is the identified first audio signal and Sq is the quality of the identified first audio signal; and

in response to a determination that the quality of the first audio signal is below the quality threshold, provide a location of the second audio source or a portion of the second audio signal to the source device.

16. The mobile device of claim 15 , wherein the processing unit is configured to identify the first audio signal based on audio fingerprinting.

17. The mobile device of claim 15 , wherein the location is remote with respect to the source device and the mobile device.

18. The mobile device of claim 15 , wherein the processing unit is further configured to stream the portion of the second audio signal from the location.

19. The mobile device of claim 15 , wherein the second audio source is a server coupled to the mobile device via a network.

20. The mobile device of claim 15 , wherein the mobile device is a mobile phone.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 9, 2017
From: SATHEESH, SHARATH HARIHARPUR
To: SNAP NETWORKS PVT LTD
Reel/Frame 041532/0734 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 9, 2017
From: SNAP NETWORKS PVT. LTD.
To: BRANCH MEDIA LABS, INC.
Reel/Frame 041532/0754 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 9, 2017
From: AGGARWAL, ASHISH D.
To: CAAVO INC
Reel/Frame 041532/0822 →
CHANGE OF NAME Recorded Mar 9, 2017
From: BRANCH MEDIA LABS, INC.
To: CAAVO INC
Reel/Frame 041939/0936 →
Continuity (3)
Division 14449159 · Aug 1, 2014
Provisional Application 61861138 · Aug 1, 2013
Related Publication 20160259621A1 · Sep 8, 2016