IP Library Granted Patent US 9,469,247
Granted Patent B2
US 9,469,247 · App. 14/086,828 · Granted Oct 18, 2016

Using external sounds to alert vehicle occupants of external events and mask in-car conversations

Inventors: Ajay Juneja (Mountain View, CA); Stefan Marti (Oakland, CA); Davide Di Censo (San Mateo, CA)
Assignee: HARMAN INTERNATIONAL INDUSTRIES, INCORPORATED
B60Q9/00G10K11/175G10K15/02H04K3/45H04K3/46H04K3/825H04K3/41H04K3/43H04K2203/12H04K2203/22
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,469,247
App. No.
14/086,828
Granted
Oct 18, 2016
Kind
B2
Abstract

An audio processing system may selectively identify certain environmental sounds and playing back these sounds, or a representation of these sounds, in the vehicle's cabin. The audio processing system may filter the environmental sounds to identify a particular sound that matches an event such as a bouncing ball, squealing tires, footsteps, and the like. The audio processing system may then provide an audio alert to an occupant in the vehicle. For example, the system may process the identified sound (e.g., amplify and/or isolate the sound) and use a speaker to output the processed sound into the interior of the vehicle. In another embodiment, the audio processing system may use environmental sounds as an audio masking sound for creating privacy zones within the vehicle. The audio processing system may filter the environmental sounds to identify a continuous sound which is then output to generate the privacy zones.

Claims (51)

1. A vehicular audio system comprising:

an audio detector configured to sense ambient sounds external to a vehicle; and

an audio processing module configured to:

receive one or more signals representing the ambient sounds from the audio detector,

process the ambient sounds to identify an event external to the vehicle and corresponding to at least one sound within the ambient sounds, wherein the at least one sound is generated by the event, and

based on determining that a current speed of the vehicle is above a threshold speed, output the at least one sound via a speaker configured to output sound into an interior of the vehicle, or

based on determining that the current speed is below the threshold speed, output a spoken description of the event via the speaker.

2. The vehicular audio system of claim 1 , wherein identifying the event comprises:

comparing the at least one sound in the ambient sounds with predefined sounds each having a predefined association with a respective event, and

upon determining the at least one sound substantially matches one of the predefined sounds, correlating the at least one sound to the respective event associated with the matched predefined sound.

3. The vehicular audio system of claim 1 , wherein outputting the at least one sound comprises:

processing the at least one sound to change a characteristic of the at least one sound, and

outputting the processed sound via the speaker.

4. The vehicular audio system of claim 1 , wherein the audio processing module is further configured to:

process the ambient sounds to identify a continuous sound within the ambient sounds;

process the continuous sound into a masking sound; and

provide the masking sound using a speaker configured to output sound into an interior of the vehicle to generate a privacy zone within the interior of the vehicle.

5. The vehicular audio system of claim 1 , wherein the audio processing module is further configured to:

determine at least one of a distance and a direction of the event relative to the vehicle based on the at least one sound within the ambient sounds, wherein the at least one sound or the spoken description of the event is provided in manner to convey the direction or the distance of the event to an occupant in the vehicle.

6. A method for processing ambient sounds external to a vehicle, the method comprising:

receiving one or more signals representing the ambient sounds;

processing the ambient sounds to identify a plurality of events corresponding to a plurality of sounds within the ambient sounds;

assigning a weight to each of the events based on predefined criteria;

selecting one or more of the sounds to output to an occupant in the vehicle based on the weights assigned to each event;

modifying at least one auditory characteristic of the one or more sounds to enhance the ability of an occupant in the vehicle to identify the event associated with the one or more sounds; and

outputting the modified sound via a speaker in an interior of the vehicle.

7. The method of claim 6 , further comprising:

comparing at least one sound in the ambient sounds with predefined sounds, and

upon determining the at least one sound substantially matches one of the predefined sounds, correlating the at least one sound to the event associated with the matched predefined sound.

8. The method of claim 6 , wherein the modified sound is an alert to indicate to the occupant that the event is proximate to the vehicle.

9. The method of claim 6 , further comprising:

processing the ambient sounds to identify a continuous sound within the ambient sounds;

processing the continuous sound into a masking sound; and

providing the masking sound using the speaker to generate a privacy zone within the interior of the vehicle.

10. The method of claim 6 , wherein modifying the one or more sounds includes at least one of sharpening the one or more sounds and amplifying the one or more sounds.

11. The method of claim 6 , further comprising:

selecting at least two of the sounds to output to the occupant; and

modifying the characteristics of the two sounds differently based on the assigned weights.

12. A non-transitory computer-readable storage medium including instructions that, when executed by a processor, configure the processor to perform the steps of:

sensing, via an audio detector, ambient sounds external to a vehicle;

receiving one or more signals representing the ambient sounds from the audio detector;

processing the ambient sounds to identify an event external to the vehicle and corresponding to at least one sound within the ambient sounds, wherein the at least one sound is generated by the event; and

based on determining that a current speed of the vehicle is above a threshold speed, outputting the at least one sound via a speaker configured to output sound into an interior of the vehicle, or

based on determining that the current speed is below the threshold speed, outputting a spoken description of the event via the speaker.

13. A non-transitory computer-readable storage medium including instructions that, when executed by a processor, configure the processor to process ambient sounds external to a vehicle by performing the steps of:

receiving one or more signals representing the ambient sounds;

processing the ambient sounds to identify a plurality of events corresponding to a plurality of sounds within the ambient sounds;

assigning a weight to each of the events based on predefined criteria;

selecting one or more of the sounds to output to an occupant in the vehicle based on the weights assigned to each event;

modifying at least one auditory characteristic of the one or more sounds to enhance the ability of an occupant in the vehicle to identify the event associated with the one or more sounds; and

outputting the modified sound via a speaker in an interior of the vehicle.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE FIRST NAME OF THIRD INVENTOR PREVIOUSLY RECORDED AT REEL: 031915 FRAME: 0652. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Sep 13, 2016
From: JUNEJA, AJAY; MARTI, STEFAN; DI CENSO, DAVIDE
To: HARMAN INTERNATIONAL INDUSTRIES, INCORPORATED
Reel/Frame 040023/0120 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 8, 2014
From: JUNEJA, AJAY; MARTI, STEFAN; DI CENSO, DAVID
To: HARMAN INTERNATIONAL INDUSTRIES, INCORPORATED
Reel/Frame 031915/0652 →
Continuity (1)
Related Publication 20150137998A1 · May 21, 2015