Onboard information device
Onboard information device mounted on vehicle to provide information for supporting passenger includes voice acquisition unit that continually detects and acquires voice the passenger utters while the onboard information device is operating; voice recognition unit that recognizes speech contents of the voice the voice acquisition unit acquires; vehicle state detector that detects vehicle state including environmental state in the vehicle, surrounding state of the vehicle or operating state of the vehicle; output controller that creates display data or voice data from the speech contents recognized by the voice recognition unit according to the vehicle state the vehicle state detector detects, and that controls output of the display data or voice data; and output unit that outputs the display data or voice data the output controller creates. It can perform effective conversation support in real time according to recognition result obtained by continually recognizing speech contents of the passenger.
1. An onboard information device which is mounted on a vehicle to provide information for supporting a passenger, the onboard information device comprising:
a voice acquisition unit that continually detects and acquires voice the passenger utters while the onboard information device is in operation;
a voice recognition unit that recognizes speech contents of the voice acquired by the voice acquisition unit;
a keyword extraction unit that extracts a prescribed keyword from the speech contents recognized by the voice recognition unit;
a vehicle state detector that detects a vehicle state including an environmental state in the vehicle, a surrounding state of the vehicle or an operating state of the vehicle; and
an output controller that creates display data or voice data from the speech contents recognized by the voice recognition unit in accordance with the vehicle state detected by the vehicle state detector and the keyword extracted by the keyword extraction unit, and that carries out output control of the display data or voice data to an output unit.
2. The onboard information device according to claim 1 , wherein
the onboard information device is one of an onboard navigation system, an onboard audio system, and an onboard video system.
3. The onboard information device according to claim 1 , further comprising:
a conversation history storage that stores the speech contents recognized by the voice recognition unit, wherein
the output controller creates the display data or voice data using the speech contents stored in the conversation history storage.
4. The onboard information device according to claim 1 , wherein
the vehicle state detector detects as the environmental state in the vehicle a located state of one of the passenger, voice acquisition unit and output unit.
5. The onboard information device according to claim 1 , wherein
the vehicle state detector detects, as the environmental state in the vehicle, one of the S/N ratio of the voice the voice acquisition unit acquires, an operating state of an in-vehicle audio system or an air conditioner, an in-vehicle noise state, and a window or roof opening/closing state.
6. The onboard information device according to claim 1 , wherein
the vehicle state detector detects, as the environmental state in the vehicle, an emotional state of the passenger who utters the voice by estimation from voice feature information including one of a type, volume, interval, sound quality, tone, color, tempo, and frequency characteristics of the voice the voice acquisition unit acquires.
7. The onboard information device according to claim 1 , wherein
the vehicle state detector detects, as the surrounding state of the vehicle, one of the present date, time, a day of the week, and a weather state in vehicle surroundings.
8. The onboard information device according to claim 1 , wherein
the vehicle state detector detects, as the operating state of the vehicle, one of operation states of steering, gearshift lever, brakes, direction indicators, illumination, and wipers.
9. The onboard information device according to claim 1 , wherein
the vehicle state detector detects, as the operating state of the vehicle, one of the present position, speed, acceleration, direction, continuous traveling distance, continuous traveling time, traveling road type, traveling road surface state, traveling road congestion state, traveling route setting state, and traveling route guidance state of the vehicle.
10. The onboard information device according to claim 1 , wherein
the output controller creates the display data or voice data of different modes in accordance with the vehicle state detected by the vehicle state detector or the keyword extracted by the keyword extraction unit.
11. The onboard information device according to claim 10 , wherein
the display data or voice data of the different modes are comprised of display data which differs in one of a type of display characters or display images, their form, size, color, density, brightness, and layout of the display characters or display images on a screen, or voice data which differs in one of a type of the voice, its volume, interval, sound quality, tone, color, tempo, acoustic image, reverberation, number of channels, and frequency characteristics.
12. The onboard information device according to claim 1 , wherein
the output controller decides necessity of outputting all or part of the speech contents in accordance with the vehicle state detected by the vehicle state detector or the keyword extracted by the keyword extraction unit, and creates or does not create the display data or voice data of all or part of the speech contents.
13. The onboard information device according to claim 1 , wherein
the output controller decides on whether the keyword contains a prescribed expression or not, and creates, when deciding that the keyword contains the prescribed expression, the display data or voice data by converting the prescribed expression to a prescribed different expression or a prescribed image or prescribed voice.
14. The onboard information device according to claim 1 , wherein
the output controller decides on whether the keyword contains a prescribed abbreviation or a word used to replace another word or a dialect, and creates, when deciding that the keyword contains the prescribed abbreviation or the word used to replace another word or the dialect, the display data or voice data by converting the prescribed abbreviation or the word used to replace another word or the dialect to a prescribed standard expression.
15. The onboard information device according to claim 1 , wherein
the output controller decides timing of an output start or output stop of the display data or voice data in accordance with the vehicle state detected by the vehicle state detector or the keyword extracted by the keyword extraction unit, and controls the output unit so as to make the output start or output stop of the display data or voice data at the timing decided.
16. The onboard information device according to claim 1 , wherein
the output controller creates, when a plurality of passengers are in the vehicle, the display data or voice data with a mode that enables identification of the plurality of passengers who utter speech.
17. The onboard information device according to claim 1 , wherein
the output controller, when a plurality of output units are provided, selects or changes or switches the output units that will output or will not output the display data or voice data in accordance with the vehicle state detected by the vehicle state detector or the keyword extracted by the keyword extraction unit.