IP Library › Granted Patent US 12,594,947
Granted Patent B2
US 12,594,947 · App. 18/229,712 · Granted Apr 7, 2026

Display control device, display control method, and non-transitory computer-readable medium

Inventors: Hideki Tsuda (Nagoya, JP); Toshinori Aoki (Toyota, JP)
Assignee: TOYOTA JIDOSHA KABUSHIKI KAISHA
B60W50/14B60W2050/146B60W2420/403B60W2420/408B60W2554/4041B60W2556/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,594,947
App. No.
18/229,712
Granted
Apr 7, 2026
Kind
B2
Abstract

A display control device configured to include a processor coupled to a memory, the processor calculating, based on sets of sensing information acquired from plural sensors that sense objects in front of a vehicle, a position of a detection object in front of the vehicle and, when displaying a position image representing the position of the detection object so as to overlay the position image on a foreground in a display area in front of a driver's seat, deciding whether or not to display the position image based on reliabilities of the sets of sensing information acquired from the plural sensors.

Claims (26)

1 . A display control device comprising a processor coupled to a memory, the processor executing instructions stored in the memory to perform processes of:

acquiring a plurality of sets of sensing information from a plurality of sensors on a vehicle that sense objects in front of the vehicle,

determining a reliability of each of the sets of sensing information acquired from each of the plurality of sensors,

for the set of sensing information acquired from each of the plurality of sensors, comparing the reliability that has been determined for the set of sensing information with a predetermined value and either (i) including the set of sensing information in a sensing information group when the reliability is greater than or equal to the predetermined value, or (ii) excluding the set of sensing information from being included in the sensing information group when the reliability is less than the predetermined value,

calculating a position of a detection object in front of the vehicle based on the sets of sensing information included in the sensing information group and without using any of the sets of sensing information that has been excluded from the sensing information group, and

when displaying a position image representing the position of the detection object so as to overlay the position image on a foreground in a display area in front of a driver's seat, deciding whether or not to display the position image based on the reliabilities of the plurality of sets of the sensing information that have been determined.

2 . The display control device of claim 1 , wherein the processor acquires environment information relating to a driving environment of the vehicle and, based on the acquired environment information, calculates the reliabilities of the sets of sensing information acquired from the plurality of sensors.

3 . The display control device of claim 1 , wherein the processor, in a case of not displaying the position image, displays, in a predetermined area, an object image schematically representing the detection object.

4 . The display control device of claim 1 , wherein:

the processor includes a first ECU and a second ECU,

the first ECU acquires the sets of sensing information from the plurality of sensors, determines the reliabilities of the received sets of sensing information, includes or excludes the sets of sensing information in the sensing information group based on the reliability that has been determined for each of the sets of sensing information, and calculates the position of the detection object from the sets of sensing information included in the sensing information group, and

the second ECU receives the position of the detection object and a number of the sets of sensing information included in the sensing information group from the first ECU and, based on the number of the sets of sensing information included in the sensing information group, decides whether or not to display the position image.

5 . The display control device of claim 1 , wherein the processor decides whether or not to display the position image based on the number of the sets of sensing information included in the sensing information group.

6 . The display control device of claim 5 , wherein the processor decides to display the position image when two or more of the sets of sensing information is included in the sensing information group, and decides to not display the position image when less than two of the sets of sensing information is included in the sensing information group.

7 . A display control method performed by a processor, the method comprising:

acquiring a plurality of sets of sensing information from a plurality of sensors on a vehicle that sense objects in front of the vehicle;

determining a reliability of each of the sets of sensing information acquired from each of the plurality of sensors;

for the set of sensing information acquired from each of the plurality of sensors, comparing the reliability that has been determined for the set of sensing information with a predetermined value and either (i) including the set of sensing information in a sensing information group when the reliability is greater than or equal to the predetermined value, or (ii) excluding the set of sensing information from being included in the sensing information group when the reliability is less than the predetermined value;

calculating a position of a detection object in front of the vehicle based on the sets of sensing information included in the sensing information group and without using any of the sets of sensing information that has been excluded from the sensing information group; and

when displaying a position image representing the position of the detection object so as to overlay the position image on a foreground in a display area in front of a driver's seat, deciding whether or not to display the position image based on the reliabilities of the plurality of sets of the sensing information that have been determined.

8 . A non-transitory computer-readable storage medium in which is stored a display control program executable by a processor to perform a process including:

acquiring a plurality of sets of sensing information from a plurality of sensors on a vehicle that sense objects in front of the vehicle;

determining a reliability of each of the sets of sensing information acquired from each of the plurality of sensors;

for the set of sensing information acquired from each of the plurality of sensors, comparing the reliability that has been determined for the set of sensing information with a predetermined value and either (i) including the set of sensing information in a sensing information group when the reliability is greater than or equal to the predetermined value, or (ii) excluding the set of sensing information from being included in the sensing information group when the reliability is less than the predetermined value;

calculating a position of a detection object in front of the vehicle based on the sets of sensing information included in the sensing information group and without using any of the sets of sensing information that has been excluded from the sensing information group; and,

when displaying a position image representing the position of the detection object so as to overlay the position image on a foreground in a display area in front of a driver's seat, deciding whether or not to display the position image based on the reliabilities of the plurality of sets of the sensing information that have been determined.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 3, 2023
From: TSUDA, HIDEKI; AOKI, TOSHINORI
To: TOYOTA JIDOSHA KABUSHIKI KAISHA
Reel/Frame 064478/0613 →
Priority Claims (1)
JP 2022-146351 · Sep 14, 2022 · national
Continuity (1)
Related Publication 20240083449A1 · Mar 14, 2024
References Cited (26)
US 11338821B2 · Ikeda · 2022 [cited by examiner]
US 11858424B2 · Shin · 2024 [cited by examiner]
US 12145050B2 · Iwasaki · 2024 [cited by examiner]
US 20060086022A1 · Would · 2006 [cited by examiner]
US 20160147073A1 · Onda · 2016 [cited by examiner]
US 20160216521A1 · Yachida · 2016 [cited by examiner]
US 20190248287A1 · Ono et al. · 2019 [cited by applicant]
US 20200029011A1 · Takahashi · 2020 [cited by applicant]
US 20200079379A1 · Mimura · 2020 [cited by examiner]
US 20200271449A1 · Sakano et al. · 2020 [cited by applicant]
US 20200307594A1 · Kato · 2020 [cited by examiner]
US 20210223058A1 · Horihata · 2021 [cited by examiner]
US 20210402927A1 · Satomi · 2021 [cited by examiner]
US 20220242236A1 · Eguchi · 2022 [cited by examiner]
US 20240221246A1 · Shimazu · 2024 [cited by examiner]
DE 112020002353T5 · 2022 [cited by examiner]
JP 2005067514A · 2005 [cited by examiner]
JP 2010132056A · 2010 [cited by examiner]
JP 2017143417A · 2017 [cited by applicant]
JP 2019138773A · 2019 [cited by applicant]
JP 2020017807A · 2020 [cited by applicant]
JP 2020163942A · 2020 [cited by examiner]
JP 2021111034A · 2021 [cited by applicant]
JP 2022079590A · 2022 [cited by applicant]
JP 7503239B2 · 2024 [cited by examiner]
WO WO2020230418A1 · 2020 [cited by examiner]