IP Library Granted Patent US 12,573,003
Granted Patent B2
US 12,573,003 · App. 18/418,987 · Granted Mar 10, 2026

Image processing device

Inventors: Tatsuro Fujiwara (Tokyo, JP); Jumpei Morita (Tokyo, JP); Hiroki Takaku (Tokyo, JP); Kinji Yamamoto (Kariya, JP); Kazuya Watanabe (Kariya, JP)
Assignees: HONDA MOTOR CO., LTD.; AISIN CORPORATION
G06T5/50H04N13/117G06T2207/20221G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,573,003
App. No.
18/418,987
Granted
Mar 10, 2026
Kind
B2
Abstract

An image processing device includes: a processor configured to generate a surrounding image when a vehicle is viewed from a virtual viewpoint, based on captured images, generate a composite image in which a vehicle image showing the vehicle when viewed from the virtual viewpoint is combined with the surrounding image, and display the composite image on a display device. The processor is configured to: perform a first control for displaying the composite image on the display device while rotationally moving the virtual viewpoint with respect to the vehicle in a predetermined pattern, and a second control for displaying the composite image on the display device while moving the virtual viewpoint to a position according to an operation of an operation unit of the vehicle; and change a transmittance of the vehicle image when performing the first control and when performing the second control.

Claims (18)

1 . An image processing device comprising:

a processor configured to generate a surrounding image that is an image of surroundings of a vehicle when the vehicle is viewed from a virtual viewpoint, based on captured images obtained from an imaging device installed in the vehicle, generate a composite image in which a vehicle image showing the vehicle when viewed from the virtual viewpoint is combined with the surrounding image, and display the composite image on a display device, wherein

the processor is configured to:

perform an automatic rotation control for displaying the composite image on the display device while automatically and rotationally moving the virtual viewpoint with respect to the vehicle in a predetermined pattern, and a manual rotation control for displaying the composite image on the display device while manually and rotationally moving the virtual viewpoint in response to a rotation operation from a user of the vehicle to an operation unit of the vehicle; and

set a transmittance of the vehicle image to be higher when performing the automatic rotation control, as compared to when performing the manual rotation control.

2 . The image processing device according to claim 1 , wherein the virtual viewpoint includes a first virtual viewpoint outside the vehicle and a second virtual viewpoint inside the vehicle,

the processor is configured to set the transmittance of the vehicle image in the automatic rotation control in which the virtual viewpoint is the first virtual viewpoint to be higher than the transmittance of the vehicle image in the manual rotation control in which the virtual viewpoint is the first virtual viewpoint, and

the processor is configured to set the transmittance of the vehicle image in the automatic rotation control in which the virtual viewpoint is the second virtual viewpoint to be higher than the transmittance of the vehicle image in the manual rotation control in which the virtual viewpoint is the second virtual viewpoint.

3 . The image processing device according to claim 2 , wherein

the processor is configured to set the transmittance of the vehicle image in the automatic rotation control in which the virtual viewpoint is the second virtual viewpoint and the transmittance of the vehicle image in the manual rotation control in which the virtual viewpoint is the second virtual viewpoint to be higher than the transmittance of the vehicle image in the manual rotation control in which the virtual viewpoint is the first virtual viewpoint.

4 . The image processing device according to claim 1 , wherein

the virtual viewpoint is set at a position where a direction in which a straight line connecting a reference point set on the vehicle and the virtual viewpoint extends does not match a height direction of the vehicle.

5 . The image processing device according to claim 1 , wherein

the processor is configured to start the automatic rotation control using detection of an operation to fix the vehicle as a trigger.

6 . The image processing device according to claim 1 , wherein

the processor is configured to hold information on a position of the virtual viewpoint that is last set in the manual rotation control when the manual rotation control ends, and the processor is configured to start moving the virtual viewpoint from a position based on the information held at the end of the manual rotation control when switching from the manual rotation control to the first automatic rotation control.

7 . The image processing device according to claim 6 , wherein

the processor is configured to delete the held information using detection of an operation to start the vehicle as a trigger.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 23, 2024
From: FUJIWARA, TATSURO; MORITA, JUMPEI; TAKAKU, HIROKI; YAMAMOTO, KINJI; WATANABE, KAZUYA
To: HONDA MOTOR CO., LTD.; AISIN CORPORATION
Reel/Frame 066206/0079 →
Priority Claims (1)
JP 2023-011067 · Jan 27, 2023 · national
Continuity (1)
Related Publication 20240257311A1 · Aug 1, 2024
References Cited (20)
US 7161616B1 · Okamoto et al. · 2007 [cited by applicant]
US 8019505B2 · Schofield · 2011 [cited by examiner]
US 20100245573A1 · Gomi · 2010 [cited by examiner]
US 20110043632A1 · Satoh · 2011 [cited by examiner]
US 20120069188A1 · Ohno et al. · 2012 [cited by applicant]
US 20120113261A1 · Satoh · 2012 [cited by examiner]
US 20120249789A1 · Satoh · 2012 [cited by examiner]
US 20140085466A1 · Moriyama et al. · 2014 [cited by applicant]
US 20150262488A1 · Ohno et al. · 2015 [cited by applicant]
US 20180191960A1 · Hatakeyama et al. · 2018 [cited by applicant]
US 20190077368A1 · Hwang · 2019 [cited by examiner]
US 20200167996A1 · Watanabe · 2020 [cited by examiner]
US 20210287445A1 · Sato · 2021 [cited by examiner]
US 20220185183A1 · Kida · 2022 [cited by examiner]
US 20230360187A1 · Bugovics · 2023 [cited by examiner]
JP 3300334B2 · 2002 [cited by applicant]
JP 2014068308A · 2014 [cited by applicant]
JP 2014197817A · 2014 [cited by applicant]
JP 5627253B2 · 2014 [cited by applicant]
JP 2018110328A · 2018 [cited by applicant]