IP Library › Granted Patent US 12,475,620
Granted Patent B2
US 12,475,620 · App. 18/187,129 · Granted Nov 18, 2025

Image processing device, method, and program product to combine images overlapping 3D object closest to moving body

Inventor: Kazuyuki Ohhashi (Yokohama, JP)
Assignee: SOCIONEXT INC.
G06T11/60G06T7/13
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,475,620
App. No.
18/187,129
Granted
Nov 18, 2025
Kind
B2
Abstract

In an aspect, an image processing device includes a hardware processor configured to function as a determination unit and an image generation unit. The determination unit determines a boundary region in a region where spatially adjacent peripheral images of a plurality of peripheral images of a moving body overlap with each other, using position information including a plurality of detection points around the moving body and self-position information of the moving body. The image generation unit generates a combined image, using the spatially adjacent peripheral images, using the boundary region.

Claims (27)

1 . An image processing device comprising

a hardware processor configured to function as:

a determination unit that sets a boundary angle between images to be combined in an image combining process to overlap a three-dimensional object closest to a moving body and determines, using the boundary angle, a boundary region in a region where spatially adjacent peripheral images of a plurality of peripheral images of the moving body overlap with each other, using position information including a plurality of detection points around the moving body and self-position information of the moving body; and

an image generation unit that generates a combined image, using the spatially adjacent peripheral images, using the boundary region.

2 . The image processing device according to claim 1 , wherein

the determination unit determines the boundary region, based on a width of the three-dimensional object.

3 . The image processing device according to claim 1 , wherein

the determination unit determines the boundary region including a plurality of boundary regions following the three-dimensional object, using the position information and the self-position information sequentially generated, and

the image generation unit sequentially generates the combined image using the spatially adjacent peripheral images, using the plurality of boundary regions following the three-dimensional object.

4 . The image processing device according to claim 1 , wherein

the hardware processor is configured to further function as a deformation unit that deforms a reference projection surface, using the position information and the self-position information, and

the image generation unit generates the combined image, using the deformed reference projection surface and the spatially adjacent peripheral images.

5 . The image processing device according to claim 1 , wherein

the plurality of detection points are detected using the plurality of peripheral images.

6 . The image processing device according to claim 1 , wherein

the plurality of detection points are detected by a detection unit mounted on the moving body.

7 . The image processing device according to claim 1 , wherein the boundary angle is set within a width of the three-dimensional object.

8 . An image processing method executed by a computer, comprising:

setting a boundary angle between images to be combined in an image combining process to overlap a three-dimensional object closest to a moving body;

determining, using the boundary angle, a boundary region of spatially adjacent peripheral images of a plurality of peripheral images of the moving body, using position information including a plurality of detection points around the moving body and self-position information of the moving body; and

generating a combined image, using the spatially adjacent peripheral images, using the boundary region.

9 . The image processing method according to claim 8 , wherein the boundary angle is set within a width of the three-dimensional object.

10 . A computer-readable recording medium having stored therein an image processing program for causing a computer to execute:

setting a boundary angle between images to be combined in an image combining process to overlap a three-dimensional object closest to a moving body;

determining, using the boundary angle, a boundary region in a region where spatially adjacent peripheral images of a plurality of peripheral images of the moving body overlap with each other, using position information including a plurality of detection points around the moving body and self-position information of the moving body; and

generating a combined image, using the spatially adjacent peripheral images, using the boundary region.

11 . The computer-readable recording medium according to claim 10 , wherein the boundary angle is set within a width of the three-dimensional object.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 21, 2023
From: OHHASHI, KAZUYUKI
To: SOCIONEXT INC.
Reel/Frame 063044/0506 →
Continuity (2)
Continuation PCTJP2020038389 · Oct 9, 2020
Related Publication 20230245362A1 · Aug 3, 2023
References Cited (50)
US 7076116B2 · Horie · 2006 [cited by examiner]
US 7218758B2 · Ishii · 2007 [cited by examiner]
US 8319618B2 · Gomi · 2012 [cited by examiner]
US 8514282B2 · Imanishi · 2013 [cited by examiner]
US 8576285B2 · Gomi · 2013 [cited by examiner]
US 10102436B2 · Okada · 2018 [cited by examiner]
US 10262466B2 · Guo · 2019 [cited by examiner]
US 10692173B2 · Scholl · 2020 [cited by examiner]
US 10848724B2 · Watanabe · 2020 [cited by examiner]
US 10970562B2 · Michiguchi · 2021 [cited by examiner]
US 11084423B2 · Kim · 2021 [cited by examiner]
US 11302076B2 · Watanabe · 2022 [cited by examiner]
US 11634074B2 · Moriyama · 2023 [cited by examiner]
US 11787335B2 · Watanabe · 2023 [cited by examiner]
US 12045945B2 · Fujiwara · 2024 [cited by examiner]
US 12141936B2 · Ohhashi · 2024 [cited by examiner]
US 20090022423A1 · Ehlgen · 2009 [cited by examiner]
US 20090097708A1 · Mizuta · 2009 [cited by applicant]
US 20090160940A1 · Imamura · 2009 [cited by applicant]
US 20120121136A1 · Gloger et al. · 2012 [cited by applicant]
US 20120154592A1 · Mizuta · 2012 [cited by applicant]
US 20140375812A1 · Ehlgen et al. · 2014 [cited by applicant]
US 20170096106A1 · Higuchi et al. · 2017 [cited by applicant]
US 20200361378A1 · Omiya et al. · 2020 [cited by applicant]
US 20200404191A1 · Ozaki et al. · 2020 [cited by applicant]
US 20240005795A1 · Jiang · 2024 [cited by examiner]
US 20240098231A1 · Ohhashi · 2024 [cited by examiner]
US 20240212269A1 · Taniguchi · 2024 [cited by examiner]
US 20240331082A1 · Ohhashi · 2024 [cited by examiner]
CN 103299617A · 2013 [cited by applicant]
CN 106464847A · 2017 [cited by applicant]
JP 2007104373A · 2007 [cited by applicant]
JP 2007180720A · 2007 [cited by applicant]
JP 2009100095A · 2009 [cited by applicant]
JP 2009151524A · 2009 [cited by applicant]
JP 2009232310A · 2009 [cited by applicant]
JP 2013501280A · 2013 [cited by applicant]
JP 2013207637A · 2013 [cited by applicant]
JP 2014127839A · 2014 [cited by applicant]
JP 2014531078A · 2014 [cited by applicant]
JP 2019140518A · 2019 [cited by applicant]
JP 2019153138A · 2019 [cited by applicant]
Gandhi, Tarak, and Mohan M. Trivedi. “Vehicle surround capture: Survey of techniques and a novel omni-video-based approach for dynamic panoramic surround maps.” IEEE Transactions on Intelligent Transportation Systems 7.… [cited by examiner]
Gao, Yi, et al. “3-D surround view for advanced driver assistance systems.” IEEE Transactions on Intelligent Transportation Systems 19.1, pp. 320-328 (Year: 2017). [cited by examiner]
Written Opinion of the International Searching Authority dated Dec. 8, 2020 issued in International Patent Application No. PCT/JP2020/038389, with English translation. [cited by applicant]
International Search Report (ISR) issued on Dec. 8, 2020 in International (PCT) Application No. PCT/JP2020/038389, with English translation. [cited by applicant]
“Environmental Recognition of Mobile Robot: Mapping and Localization System/Control/Information”, (Journal of Institute of Systems, Control and Information Engineers), vol. 60, No. 12, pp. 509-514, 2016, with English tr… [cited by applicant]
“Environmental Recognition of Mobile Robot: Mapping and Localization System/Control/Information”, (Journal of Institute of Systems, Control and Information Engineers), Vol. 50, No. 12, pp. 509-514, 2016, with English tr… [cited by applicant]
Office Action dated Aug. 7, 2025 in the corresponding Chinese patent application No. 202080105930.7, w/ English Translation. [cited by applicant]
Fu Jundong and Yao Xiaoming, “Real-scene Image Stitching and Roaming Control Technology Therefor”, Southwest Jiaotong University Press, First edition, Jun. 30, 2011, http://press.swjtu.edu.cn. [cited by applicant]