IP Library › Granted Patent US 12,315,050
Granted Patent B2
US 12,315,050 · App. 18/713,054 · Granted May 27, 2025

Image processing method, image displaying method, image processing device, and image displaying device

Inventors: Yusuke Musha (Kanagawa, JP); Yasuhiro Suzuki (Kanagawa, JP); Muku Takeda (Kanagawa, JP)
Assignee: Nissan Motor Co., Ltd.
G06T11/203B60R1/26G06T7/73B60R2300/105B60R2300/20B60R2300/30G06T2207/30261
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,315,050
App. No.
18/713,054
Granted
May 27, 2025
Kind
B2
Abstract

An image processing method includes: capturing, by a first image capturing device installed at a position located on a side surface outside a vehicle interior of a vehicle and anterior to a rear end of the vehicle, a first image, the first image being an image of a region including a rear lateral side of the vehicle; capturing, by a second image capturing device installed on a rear end of the vehicle, a second image, the second image being an image of a region in a rear of the vehicle; generating a synthetic image serving as an image of a rear view of the vehicle by synthesizing the first image and the second image with each other; and superimposing an outline, the outline being a line segment extending along a contour of a side surface of the vehicle, in the synthetic image.

Claims (22)

1. An image processing method comprising:

capturing, by a first image capturing device installed at a position located on a side surface outside a vehicle interior of a vehicle and anterior to a rear end of the vehicle, a first image, the first image being an image of a region including a rear lateral side of the vehicle;

capturing, by a second image capturing device installed on a rear end of the vehicle, a second image, the second image being an image of a region in a rear of the vehicle;

generating a synthetic image serving as an image of a rear view of the vehicle by synthesizing the first image and the second image with each other; and

superimposing an outline, the outline being a line segment extending along a contour of a side surface of the vehicle, in the synthetic image, wherein

the image processing method, within the synthetic image, extracts an image of a region on an outer side of a predetermined lateral direction position in a lateral direction of the synthetic image from the first image and extracts an image of a region on an inner side of the predetermined lateral direction position in the lateral direction from the second image, and

the predetermined lateral direction position is set with respect to each vertical direction position in the synthetic image and one or more of the predetermined lateral direction positions is same as one or more respective positions on the outline.

2. The image processing method according to claim 1 , wherein the predetermined lateral direction position includes a position on an outer side of a line segment extending along a contour of the vehicle in the lateral direction.

3. The image processing method according to claim 1 , wherein

the image processing method detects a contour of the vehicle from the first image, and

the outline to be superimposed in the synthetic image is a line segment extending along a contour of the vehicle detected from the first image.

4. The image processing method according to claim 1 , wherein the image processing method superimposes a transmission image of a shape of the vehicle in a region on an inner side in an image lateral direction of the outline within the synthetic image.

5. An image displaying method comprising

displaying the synthetic image generated by the image processing method according to claim 1 , and on which the outline is superimposed, on a display device in a vehicle interior of the vehicle.

6. An image processing device configured to execute processing comprising:

generating a synthetic image as an image of a rear view of a vehicle by synthesizing a first image, the first image being an image of a region including a rear lateral side of a vehicle, captured by a first image capturing device installed at a position located on a side surface outside a vehicle interior of the vehicle and anterior to a rear end of the vehicle, with a second image, the second image being an image of a region in a rear of the vehicle, captured by a second image capturing device installed on a rear end of the vehicle; and

superimposing an outline, the outline being a line segment extending along a contour of a side surface of the vehicle, in the synthetic image, wherein

the image processing device, within the synthetic image, extracts an image of a region on an outer side of a predetermined lateral direction position in a lateral direction of the synthetic image from the first image and extracts an image of a region on an inner side of the predetermined lateral direction position in the lateral direction from the second image, and

the predetermined lateral direction position is set with respect to each vertical direction position in the synthetic image and one or more of the predetermined lateral direction positions is same as one or more respective positions on the outline.

7. An image displaying device comprising:

the image processing device according to claim 6 ; and

a display screen configured to display the synthetic image generated by the image processing device and on which the outline is superimposed, in a vehicle interior of the vehicle.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 23, 2024
From: MUSHA, YUSUKE; SUZUKI, YASUHIRO; TAKEDA, MUKU
To: NISSAN MOTOR CO., LTD.
Reel/Frame 067512/0342 →
Continuity (1)
Related Publication 20250022194A1 · Jan 16, 2025
References Cited (15)
US 9106842B2 · Sumi · 2015 [cited by examiner]
US 10857942B2 · Oba · 2020 [cited by applicant]
US 10965872B2 · Asai et al. · 2021 [cited by applicant]
US 11807062B2 · Lazarevski · 2023 [cited by examiner]
US 20140046503A1 · Mulder · 2014 [cited by examiner]
US 20160044284A1 · Goseberg · 2016 [cited by examiner]
US 20190174065A1 · Asai et al. · 2019 [cited by applicant]
US 20190248288A1 · Oba · 2019 [cited by applicant]
US 20200059609A1 · Tsutsumitake · 2020 [cited by applicant]
US 20210081684A1 · Yamamoto · 2021 [cited by examiner]
US 20210287335A1 · Goto · 2021 [cited by examiner]
JP 2019101879A · 2019 [cited by applicant]
JP 2019202584A · 2019 [cited by applicant]
WO 2016088151A1 · 2016 [cited by applicant]
WO 2018012299A1 · 2018 [cited by applicant]