IP Library › Granted Patent US 12,548,108
Granted Patent B2
US 12,548,108 · App. 18/068,565 · Granted Feb 10, 2026

Image processing apparatus, image processing method, and storage medium that generate a perspective projection image from a wide-angle image

Inventor: Masaaki Kobayashi (Tokyo, JP)
Assignee: Canon Kabushiki Kaisha
G06T3/047G06T5/92G06T7/11G06T7/70G06T11/00G06T2207/20132
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,548,108
App. No.
18/068,565
Granted
Feb 10, 2026
Kind
B2
Abstract

An image processing apparatus configured to generate a perspective projection image from a wide-angle image. The image processing apparatus includes one or more memories storing instructions and one or more processors executing the instructions to function as a first generation unit configured to generate the perspective projection image from the wide-angle image based on a first parameter related to a predetermined viewing angle, and an output unit configured to output the generated perspective projection image. The perspective projection image includes region information indicating an image region corresponding to the predetermined viewing angle in the wide-angle image.

Claims (33)

1 . An image processing apparatus configured to generate a perspective projection image from a wide-angle image, the image processing apparatus comprising:

one or more memories storing instructions; and

one or more processors executing the instructions to function as:

a first generation unit configured to generate the perspective projection image from the wide-angle image based on a first parameter related to a predetermined viewing angle;

a parameter obtainment unit configured to obtain a second parameter related to the wide-angle image and a third parameter related to the perspective projection image, wherein the second parameter includes an angle of view of the wide-angle image, and the third parameter includes an angle of view of the perspective projection image and a coordinate in the wide-angle image corresponding to a criterial coordinate in the perspective projection image; and

an output unit configured to output the generated perspective projection image, wherein the perspective projection image includes region information indicating an image region corresponding to the predetermined viewing angle in the wide-angle image,

wherein the region information includes a frame indicating the image region corresponding to the predetermined viewing angle and the region information includes a character string indicating the viewing angle, and

the first generation unit generates the perspective projection image from the wide-angle image based on the first parameter, the second parameter, and the third parameter.

2 . The image processing apparatus according to claim 1 , wherein the viewing angle is a viewing angle of a predetermined head-mounted display (HMD), and

the region information includes a character string indicating a model of the predetermined HMD.

3 . The image processing apparatus according to claim 1 , wherein the wide-angle image is one of an image that is obtained based on a projection method of a fisheye lens, an equidistant cylindrical image, and an omnidirectional image.

4 . The image processing apparatus according to claim 1 , wherein the region information includes region information on a plurality of image regions related to a plurality of viewing angles.

5 . The image processing apparatus according to claim 1 , further comprising:

a coordinate value obtainment unit configured to obtain a coordinate value that designates a coordinate in the wide-angle image,

wherein the first generation unit determines a position at which the region information is superimposed in the perspective projection image based on a coordinate value obtained by the coordinate value obtainment unit.

6 . The image processing apparatus according to claim 5 , wherein the coordinate value obtainment unit obtains a coordinate value at which a specific object in the wide-angle image is positioned.

7 . The image processing apparatus according to claim 1 , wherein the first generation unit generates the perspective projection image so as to change at least one of brightness and contrast between an inside and an outside of the image region.

8 . The image processing apparatus according to claim 1 , further comprising:

a second generation unit configured to generate an image for a head-mounted display (HMD) by cutting out the image region based on the region information,

wherein the output unit outputs the perspective projection image and the image for the HMD to different display devices, respectively.

9 . An image processing method to generate a perspective projection image from a wide-angle image, the image processing method comprising:

generating the perspective projection image from the wide-angle image based on a first parameter related to a predetermined viewing angle;

obtaining a second parameter related to the wide-angle image and a third parameter related to the perspective projection image, wherein the second parameter includes an angle of view of the wide-angle image, and the third parameter includes an angle of view of the perspective projection image and a coordinate in the wide-angle image corresponding to a criterial coordinate in the perspective projection image; and

outputting the generated perspective projection image, wherein the perspective projection image includes region information indicating an image region corresponding to the predetermined viewing angle in the wide-angle image,

wherein the region information includes a frame indicating the image region corresponding to the predetermined viewing angle and the region information includes a character string indicating the viewing angle, and

the generating generates the perspective projection image from the wide-angle image based on the first parameter, the second parameter, and the third parameter.

10 . A non-transitory computer readable storage medium storing a program causing a computer to execute an image processing method to generate a perspective projection image from a wide-angle image, the image processing method comprising:

obtaining a first parameter related to a predetermined viewing angle;

generating the perspective projection image from the wide-angle image based on the first parameter;

obtaining a second parameter related to the wide-angle image and a third parameter related to the perspective projection image, wherein the second parameter includes an angle of view of the wide-angle image, and the third parameter includes an angle of view of the perspective projection image and a coordinate in the wide-angle image corresponding to a criterial coordinate in the perspective projection image; and

outputting the generated perspective projection image to a display device, wherein the perspective projection image includes region information indicating an image region corresponding to the predetermined viewing angle in the wide-angle image,

wherein the region information includes a frame indicating the image region corresponding to the predetermined viewing angle and the region information includes a character string indicating the viewing angle, and

the generating generates the perspective projection image from the wide-angle image based on the first parameter, the second parameter, and the third parameter.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 6, 2023
From: KOBAYASHI, MASAAKI
To: CANON KABUSHIKI KAISHA
Reel/Frame 062593/0573 →
Priority Claims (1)
JP 2021-214448 · Dec 28, 2021 · national
Continuity (1)
Related Publication 20230206386A1 · Jun 29, 2023
References Cited (16)
US 20180341811A1 · Bendale · 2018 [cited by examiner]
US 20200409482A1 · Yin · 2020 [cited by examiner]
US 20220165021A1 · Kawaguchi · 2022 [cited by examiner]
JP 2008131405A · 2008 [cited by applicant]
JP 2014085897A · 2014 [cited by applicant]
JP 2021140676A · 2021 [cited by applicant]
KR 20200075249A · 2020 [cited by examiner]
WO 2020162218A1 · 2020 [cited by applicant]
Ogldev “Tutorial 12: Perspective Projection”, ogldev.org/www/tutorial12/tutorial12.html, published Nov. 8, 2015. [cited by examiner]
Realmax Qian youtube channel, “Realmax Qian is an AR headset with an ultra-wide field of view.6DOF tracking”, https://www.youtube.com/watch?v=dKxsdPO43Q4, published Aug. 18, 2020 (Year: 2020). [cited by examiner]
Realmax AR youtube channel, “Realmax Qian is an AR headset with an ultra-wide field of view.6DOF tracking”, https://www.youtube.com/watch?v=dKxsdPO43Q4 (Year: 2020). [cited by examiner]
C. Cruz-Neira, et al., “Surround-screen projection-based virtual reality”, Aug. 1-6, 1993, SIGGRAPH 93: 20th Annual Conference on Computer Graphics and Interactive Techniques; Anaheim, CA, USA (8 pages). [cited by applicant]
N. Kishishita, et al., “Poster: Investigation on the peripheral visual field for information display with real and virtual wide field-of-view see-through HMDs”, Mar. 16, 2013, 2013 IEEE Symposium on 3D User Interfaces (… [cited by applicant]
Extended European Search report issued on May 22, 2023, in corresponding European Patent Application No. 22214843.9 (9 pages). [cited by applicant]
Makoto Shohara, et al., “Special Feature a New Visual Audio Experience Chapter 2: Omnidirectional Imaging”, 2015, The journal of the Institute of Image Information and Television Engineers, vol. 69, No. 7, pp. 652 to 65… [cited by applicant]
Notice of Reasons for Refusal issued Jul. 1, 2025, in corresponding Japanese Patent Application No. 2021-214448, with English translation (12 pages). [cited by applicant]