IP Library › Granted Patent US 12,579,818
Granted Patent B2
US 12,579,818 · App. 18/574,059 · Granted Mar 17, 2026

Information processing device, and control program

Inventors: Tetsuro Murakami (Saitama, JP); Naoto Sakata (Saitama, JP); Miku Nagatsuka (Saitama, JP); Hiroshige Furugori (Saitama, JP); Masashi Koga (Saitama, JP)
Assignee: Faurecia Clarion Electronics Co., Ltd.
G06V20/56G06F3/14G06T11/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,579,818
App. No.
18/574,059
Granted
Mar 17, 2026
Kind
B2
Abstract

An image generation device calculates a projection conversion matrix serving as a first conversion information enabling conversion of coordinates of a captured image from a coordinate system of the image to a coordinate system of a vehicle, calculates a projection conversion matrix serving as second conversion information enabling conversion of coordinates of a reference range to be displayed on a display unit from the coordinate system of the vehicle to a coordinate system of the display unit, and makes an image generation unit generate a display target image using the projection conversion matrices.

Claims (20)

1 . An information processing device comprising:

an information acquisition unit configured to acquire a captured image of a surrounding of a moving body;

a display processing unit configured to make a display unit viewable by an occupant of the moving body, display a display target image;

a first conversion information acquisition unit configured to acquire first conversion information enabling conversion of coordinates of the captured image from an image coordinate system into a coordinate system of the moving body;

a reference range calculation unit configured to identify a projection center corresponding to a viewpoint of the occupant of the moving body, and calculate a reference range on a set plane set by the coordinate system of the moving body to be projected in a display range of the display unit, based on the projection center;

a second conversion information acquisition unit configured to calculate second conversion information enabling conversion of coordinates of the reference range from the coordinate system of the moving body into a coordinate system of the display unit; and

an image generation unit configured to calculate each pixel value in a display range of the display unit from each pixel value of the captured image corresponding to the reference range by using the first conversion information and the second conversion information, and generate the display target image by using each pixel value calculated.

2 . The information processing device according to claim 1 , wherein the information acquisition unit acquires user information enabling identification of at least a position of a viewpoint of the occupant, and

the reference range calculation unit identifies the projection center based on the position of the viewpoint identified from the user information.

3 . The information processing device according to claim 1 , wherein when a straight line drawn from the projection center to an upper edge of the display range of the display unit does not intersect the set plane, the reference range calculation unit changes a position of the upper edge of the display range of the display unit to a lowered position to make the straight line intersects the set plane, and calculates a reference range corresponding to the changed display range.

4 . The information processing device according to claim 3 , wherein the set plane is set to a traveling surface present at a position lower than the display range of the display unit.

5 . The information processing device according to claim 1 further comprising a dominant eye setting unit configured to set a dominant eye of the occupant, wherein

the reference range calculation unit sets the projection center at a position reflecting the dominant eye of the occupant.

6 . The information processing device according to claim 1 , wherein the first conversion information and the second conversion information are projection conversion matrices.

7 . A non-transitory computer readable medium storing computer-executable instructions executed by a processor, the computer-executable instructions comprising:

acquiring a captured image of a surrounding of a moving body;

making a display unit viewable by an occupant of the moving body, displaying a display target image;

acquiring first conversion information enabling conversion of coordinates of the captured image from an image coordinate system into a coordinate system of the moving body;

identifying a projection center corresponding to a viewpoint of the occupant of the moving body, and calculating a reference range on a set plane set by the coordinate system of the moving body to be projected in a display range of the display unit, based on the projection center;

calculating second conversion information enabling conversion of coordinates of the reference range from the coordinate system of the moving body into a coordinate system of the display unit; and calculating each pixel value in a display range of the display unit from each pixel value of the captured image corresponding to the reference range by using the first conversion information and the second conversion information, and generating the display target image by using each pixel value calculated.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE NAME FROM C/O FAURECIA CLARION ELECTRONICS CO., LTD., TO FAURECIA CLARION ELECTRONICS CO., LTD. PREVIOUSLY RECORDED ON REEL 066125 FRAME 0783. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jan 18, 2024
From: MURAKAMI, TETSURO; SAKATA, NAOTO; NAGATSUKA, MIKU; FURUGORI, HIROSHIGE; KOGA, MASASHI
To: FAURECIA CLARION ELECTRONICS CO., LTD.
Reel/Frame 066351/0186 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 25, 2023
From: MURAKAMI, TETSURO; SAKATA, NAOTO; NAGATSUKA, MIKU; FURUGORI, HIROSHIGE; KOGA, MASASHI
To: C/O FAURECIA CLARION ELECTRONICS CO., LTD.,
Reel/Frame 066125/0783 →
Priority Claims (1)
JP 2021-109394 · Jun 30, 2021 · national
Continuity (1)
Related Publication 20240371170A1 · Nov 7, 2024
References Cited (17)
US 11074447B1 · Fox · 2021 [cited by examiner]
US 20170309060A1 · John · 2017 [cited by examiner]
US 20180232097A1 · Kneuper · 2018 [cited by examiner]
US 20200056885A1 · Rutkiewicz · 2020 [cited by examiner]
US 20220373357A1 · Ganille · 2022 [cited by examiner]
US 20230134369A1 · Auerbach · 2023 [cited by examiner]
US 20240371170A1 · Murakami · 2024 [cited by examiner]
CA 3135960A1 · 2020 [cited by examiner]
CN 110211243B · 2023 [cited by examiner]
JP 2005335410A · 2005 [cited by applicant]
JP 2007096638A · 2007 [cited by applicant]
JP 2008307982A · 2008 [cited by applicant]
JP 2018160868A · 2018 [cited by applicant]
International Search Report of PCT/JP2022/020442 mailed on Jul. 19, 2022. [cited by applicant]
Written Opinion of the International Searching Authority of PCT/JP2022/020442 mailed on Jul. 19, 2022. [cited by applicant]
The Japanese Office Action mailed by Japanese Patent Office dated on Mar. 25, 2025 in corresponding Japanese patent application No. 2021-109394. [cited by applicant]
International Preliminary Report on Patentability of PCT/JP2022/020442 issued on Dec. 14, 2023. [cited by applicant]