IP Library › Granted Patent US 12,198,399
Granted Patent B2
US 12,198,399 · App. 18/135,236 · Granted Jan 14, 2025

Display system and display method

Inventors: Seiji Murata (Tokyo, JP); Hiromitsu Mori (Tokyo, JP); Kenichi Shimada (Tokyo, JP); Kazuyoshi Yamazaki (Tokyo, JP); Mayumi Nagayoshi (Tokyo, JP)
Assignee: MAXELL, LTD.
G06V10/40G06F3/013G06V10/60G06V20/20G06V20/582G06V20/584G06V20/59G06V40/18B60K35/23B60K35/28B60K2360/177B60R2300/10B60R2300/20G06V2201/07
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,198,399
App. No.
18/135,236
Granted
Jan 14, 2025
Kind
B2
Abstract

A luminance determining unit determines a luminance distribution of an exterior circumstantial image in a line-of-sight direction of a driver, and a luminance changing unit determines a bright region of this luminance distribution. Further, the luminance changing unit determines a luminance after the change in a peripheral region of this bright region. A virtual-image creating unit creates a virtual image based on the determined luminance, and a display processing unit displays this virtual image on a display unit. In this manner, since a display system displays the virtual image for use in increasing the luminance in periphery of the bright region, the feeling of the brightness for the driver can be moderated, and therefore, the visual recognition can be improved. That is, the display system can output the virtual image depending on the circumstances.

Claims (34)

1. A display system displaying a virtual image on a display unit mounted on a movable body, comprising:

an image capturing unit configured to capture an image of a forward part of the movable body through the display unit;

a processor configured to:

determine a position of the movable body;

determine a line-of-sight direction of a user based on at least one of position or direction of at least one of the user's head or the user's eyeball;

determine an emphasis target displayed on the display unit, on the basis of the position;

determine a luminance of the image captured by the image capturing unit; and

create a virtual image;

a display processing unit configured to display the virtual image, created by the processor; and

an information storage device mounted on the movable body and configured to:

store the image;

store information of the line-of-sight direction;

store information for creating the virtual image that emphasizes an emphasis target which is determined by an analysis of the image; and

store information of relative-position based on information of a direction in which the image is captured and the information of the line-of-sight direction,

wherein the virtual image is created by masking a region of the image having a luminance that is greater than or equal to a threshold, and

wherein the virtual image is created by displaying a symbol corresponding to the emphasis target.

2. A display system displaying a virtual image on a display unit mounted on a movable body, comprising:

an image capturing unit configured to capture an image of a forward part of the movable body through the display unit;

a processor configured to:

determine a position of the movable body;

determine a line-of-sight direction of a user direction based on a line-of-sight of the user;

determine an emphasis target displayed on the display unit, which is determined by an analysis of the image of a point of view of the user; and

create a virtual image;

a display processing unit configured to display the virtual image, created by the processor; and

an information storage device to be worn on a head of a user and which stores an image of the point of view of the user and configured to:

store information for creating the virtual;

store information of the line-of-sight direction; and

store information of a relative-position based on a direction in which the image of the point of view of the user is captured and the information of the determined line-of-sight direction,

wherein the virtual image is created by masking a region of the image having a luminance that is greater than or equal to a threshold, and

wherein the virtual image is created by displaying a symbol corresponding to the emphasis target.

3. An information storage device according to claim 1 , further configured to:

store a synthesized virtual image created by the captured image, the information for creating the virtual image and the information of the line-of-sight direction.

4. An information storage device according to claim 2 , further configured to:

store a synthesized virtual image created by the image, the information for creating the virtual image and the information of the line-of-sight direction.

Continuity (2)
Continuation 16648780
Related Publication 20230249618A1 · Aug 10, 2023
References Cited (41)
US 10120188B2 · Matsuzaki · 2018 [cited by examiner]
US 10762688B2 · Ogata · 2020 [cited by examiner]
US 20030095080A1 · Colmenarez et al. · 2003 [cited by applicant]
US 20030123752A1 · Ishii et al. · 2003 [cited by applicant]
US 20090102858A1 · Eggers et al. · 2009 [cited by applicant]
US 20120320212A1 · Aimura · 2012 [cited by applicant]
US 20130293582A1 · Ng-Thow-Hing et al. · 2013 [cited by applicant]
US 20150210217A1 · Taylor · 2015 [cited by applicant]
US 20160288717A1 · Kameshima · 2016 [cited by examiner]
US 20170155867A1 · Yokota · 2017 [cited by examiner]
US 20170168562A1 · Sendai et al. · 2017 [cited by applicant]
US 20170282813A1 · Hashimoto · 2017 [cited by applicant]
US 20170309257A1 · Akita · 2017 [cited by applicant]
US 20170084056A1 · Masuya · 2017 [cited by applicant]
US 20180024354A1 · Shibata · 2018 [cited by applicant]
US 20180218711A1 · Suzuki · 2018 [cited by examiner]
US 20200211291A1 · Miller · 2020 [cited by examiner]
CA 2913650C · 2021 [cited by examiner]
CN 103273826A · 2013 [cited by applicant]
CN 107438812B · 2021 [cited by examiner]
DE 102017115318A1 · 2018 [cited by applicant]
JP 2003199094A · 2003 [cited by applicant]
JP 2004302903A · 2004 [cited by applicant]
JP 2005509984A · 2005 [cited by applicant]
JP 2009143470A · 2009 [cited by applicant]
JP 2009530695A · 2009 [cited by applicant]
JP 2010066042A · 2010 [cited by applicant]
JP 201496057A · 2014 [cited by applicant]
JP 2015523624A · 2015 [cited by applicant]
JP 201633758A · 2016 [cited by applicant]
JP 201651982A · 2016 [cited by applicant]
JP 2016070716A · 2016 [cited by applicant]
JP 2018185654A · 2018 [cited by examiner]
WO 2017002209A1 · 2017 [cited by applicant]
WO 2017113403A1 · 2017 [cited by applicant]
WO WO2018134897A1 · 2018 [cited by examiner]
WO WO2018167966A1 · 2018 [cited by examiner]
Gaze Tracking and Point Estimation Using Low-Cost Head-Mounted Devices—2020 (Year: 2020). [cited by examiner]
International Search Report of PCT/JP2017/034202 dated Nov. 7, 2017. [cited by applicant]
Chinese Office Action received in corresponding Chinese Application No. 201780094627.X dated Mar. 25, 2023. [cited by applicant]
Japanese Office Action received in corresponding Japanese Application No. 2022-099408 dated May 23, 2023. [cited by applicant]