IP Library Granted Patent US 11,537,354
Granted Patent B2
US 11,537,354 · App. 17/275,359 · Granted Dec 27, 2022

Head-up display system

Inventors: Toshimitsu Watanabe (Kyoto, JP); Nozomu Shimoda (Kyoto, JP)
Assignee: MAXELL, LTD.
G06F3/1454B60K35/00G02B27/0101G06F3/167G09G3/001G10L15/22B60K2370/148B60K2370/157B60K2370/1526B60K2370/21G02B2027/014G02B2027/0138G09G2340/0464G09G2354/00G09G2380/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,537,354
App. No.
17/275,359
Granted
Dec 27, 2022
Kind
B2
Abstract

An HUB system 1 is equipped with an HUB device 10 for displaying a video in front of a vehicle; a communication unit 31 for connecting a mobile device 3 with the HUD device and establishing communication; a speaker 32 for outputting sounds to a driver; a microphone 33 for picking up the voices of the driver; a sound recognition unit 34 for analyzing the picked-up voices; and an in-vehicle camera 35 for photographing the face of the driver. When there is an incoming call at the mobile device, a calling indication of the mobile device 3 is displayed on the display screen of the HUD device, an incoming call sound is outputted from the speaker, and on the basis of a result of an analysis of voices uttered by the driver performed by the sound recognition unit, the conversation operations of the mobile device are started or ended.

Claims (40)

1. A head-up display system performing communication in connection with a mobile device, comprising:

a head-up display installed in a vehicle for displaying a video in front of the vehicle viewed from a driver;

a communication unit for connecting the mobile device with the HUD device and establishing communication;

a speaker for outputting sounds to the driver;

a microphone for picking up voices of the driver;

a sound recognition unit for analyzing the voices picked up by the microphone; and

an in-vehicle camera for photographing a face of the driver,

wherein the HUD device includes:

a signal processing unit that performs signal processing of sound signals and image signals that are propagated between the mobile device, the speaker, the microphone, and the in-vehicle camera; and

a display control unit that controls the display of videos on the display screen of the HUD device,

wherein conversation operations are performed with the driver via the mobile device by using the speaker and the microphone,

wherein a calling indication of the mobile device is displayed on the display screen of the HUD device, and at the same time, an incoming call sound is output from the speaker when there is an incoming call at the mobile device,

wherein on the basis of a result of an analysis of voices uttered by the driver performed by the sound recognition unit, the conversation operations of the mobile device are started or ended, and

wherein the display control unit displays an incoming call screen of the mobile device on the display screen of the HUD device when there is an incoming call to the mobile device, and, when the conversation operation is started, the incoming call screen of the mobile device displayed on the display screen of the HUD device is changed to a small area icon and moves to the lower part of the display screen of the HUD device and display.

2. The head-up display system according to claim 1 ,

wherein the sound recognition unit registers terms for indicating the start and the end of the conversation operation of the mobile device in advance and judges instruction contents of the driver by comparing the voices uttered by the driver with the registered terms.

3. The head-up display system according to claim 1 ,

wherein the signal processing unit transmits a face image of the driver photographed by the in-vehicle camera to a conversation partner via the mobile device when the conversation operation of the mobile device is started.

4. A head-up display (HUD) system performing communication in connection with a mobile device, comprising:

a head-up display device installed in a vehicle for displaying a video in front of the vehicle viewed from a driver;

a communication unit for connecting the mobile device with the HUD device and establishing communication;

a speaker for outputting sounds to the driver;

a microphone for picking up voices of the driver;

a sound recognition unit for analyzing the voices picked up by the microphone; and

an in-vehicle camera for photographing a face of the driver,

wherein the HUD device includes:

a signal processing unit that performs signal processing of sound signals and image signals that are propagated between the mobile device, the speaker, the microphone, and the in-vehicle camera; and

a display control unit that controls the display of videos on the display screen of the HUD device,

wherein conversation operations are performed by the driver via the mobile device by using the speaker and the microphone,

wherein a calling indication of the mobile device is displayed on the display screen of the HUD device, and at the same time, an incoming call sound is output from the speaker when there is an incoming call at the mobile device,

wherein on the basis of a result of an analysis of voices uttered by the driver performed by the sound recognition unit, the conversation operations of the mobile device are started or ended, and

wherein, if the signal processing unit receives an image posted to the mobile device by an external terminal while the vehicle is moving along a road that is congested with traffic or near to an accident site, the display control unit displays the received image in a superimposed manner onto the display screen of the HUD device, and at the same time, the display control unit deletes other display images so that an image display area rate in the display area becomes a regulated value or less and preferentially displays the received image.

5. The head-up display system according to claim 1 ,

wherein, in a case where a plurality of mobile devices are connected to the HUD device or in a case where the HUD device includes other speakers, the display control unit displays a plurality of sound icons on the display screen of the HUD device and displays a sound icon corresponding to a mobile device outputting sounds by blinking the sound icon.

6. The head-up display system according to claim 4 ,

wherein the sound recognition unit registers terms for indicating the start and the end of the conversation operation of the mobile device in advance and judges instruction contents of the driver by comparing the voices uttered by the driver with the registered terms.

7. The head-up display system according to claim 4 ,

wherein the signal processing unit transmits a face image of the driver photographed by the in-vehicle camera to a conversation partner via the mobile device when the conversation operation of the mobile device is started.

8. The head-up display system according to claim 4 ,

wherein, in a case where a plurality of mobile devices are connected to the HUD device or in a case where the HUD device includes other speakers, the display control unit displays a plurality of sound icons on the display screen of the HUD device and displays a sound icon corresponding to a mobile device outputting sounds by blinking the sound icon.

Assignments (3)
CHANGE OF NAME Recorded Dec 3, 2021
From: MAXELL HOLDINGS, LTD.
To: MAXELL, LTD.
Reel/Frame 058666/0407 →
MERGER Recorded Nov 29, 2021
From: MAXELL, LTD.
To: MAXELL HOLDINGS, LTD.
Reel/Frame 058255/0579 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 11, 2021
From: WATANABE, TOSHIMITSU; SHIMODA, NOZOMU
To: MAXELL, LTD.
Reel/Frame 055563/0894 →
Priority Claims (1)
JP JP2018-171348 · Sep 13, 2018 · national
Continuity (1)
Related Publication 20220050654A1 · Feb 17, 2022