IP Library Granted Patent US 11,825,213
Granted Patent B2
US 11,825,213 · App. 17/614,566 · Granted Nov 21, 2023

Removal of image capture device from omnidirectional image created by stitching partial images

Inventors: Kazuhiro Yoshida (Kanagawa, JP); Takeshi Watanabe (Kanagawa, JP); Masato Senshu (Tokyo, JP); Hiroshi Kano (Tokyo, JP); Daisuke Hohjoh (Chiba, JP)
Assignee: RICOH COMPANY, LTD.
H04N23/951H04N23/62H04N23/667H04N23/67H04N23/698
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,825,213
App. No.
17/614,566
Granted
Nov 21, 2023
Kind
B2
Abstract

An image processing system includes a joining processing unit configured to perform a joining process to join input images captured by an image capturing device and generate an output image the image capturing device being reflected in each of the input images; and an acceptance unit configured to receive selection of one of a plurality of modes for the joining process. The plurality of modes has a first mode to generate an output image in which at least a part of the image capturing device is reflected, through the joining process; and a second mode to, through the joining process, generate an output image whose area where the image capturing device is reflected is smaller than an area where the image capturing device is reflected in the output image in the first mode or generate an output image in which the image capturing device is not reflected.

Claims (57)

1. An image processing system, comprising:

joining processing circuitry configured to perform a joining process to join a plurality of input images captured by a camera and generate an output image, the camera being reflected in each of the plurality of input images;

acceptance circuitry configured to receive selection of one of a plurality of modes for the joining process,

correction circuitry configured to correct distortion of the plurality of input images based on respective parameters to obtain a plurality of corrected input images; and

detection circuitry configured to detect a joining position between two of the plurality of corrected input images;

the plurality of modes having:

a first mode to generate an output image in which at least a part of the camera is reflected, through the joining process; and

a second mode to, through the joining process, generate an output image whose area where the camera is reflected is smaller than an area where the camera is reflected in the output image in the first mode or generate an output image in which the camera is not reflected; and

the respective parameters for the first mode and the second mode are different so that a focal length at the joining position for joining the plurality of input images in the second mode is at least partly longer than a focal length at the joining position for joining the plurality of images in the first mode, the focal length at the joining position in the first mode being a certain distance.

2. The image processing system according to claim 1 ,

wherein the output image is stored in association with at least one of the first mode or the second mode used in the joining process and a parameter corresponding to the mode, and

wherein the parameter includes at least one of a transformation table and optical data for the joining process.

3. The image processing system according to claim 1 ,

further comprising an output circuitry configured to output, as intermediate image data, the plurality of input images that has not been subjected to the joining process, together with a parameter corresponding to the first mode and another parameter corresponding to the second mode,

wherein the joining processing circuitry is configured to read the intermediate image data and obtain the plurality of input images and obtain the parameter corresponding to the first mode or the second mode received by the acceptance circuitry so as to perform the joining process.

4. The image processing system according to claim 1 ,

wherein the acceptance circuitry is configured to select a mode based on user's operation.

5. The image processing system according to claim 4 ,

wherein the user's operation is made through a user interface of the camera, a user interface communicably connected with the camera, or a user interface of a terminal communicably connected with the camera.

6. The image processing system according to claim 1 ,

wherein the acceptance circuitry is configured to receive a mode selected based on information of a subject in an area where the camera is reflected and a surrounding area of the area in the plurality of input images.

7. The image processing system according to claim 1 ,

wherein the selected mode is kept unchanged under prescribed conditions.

8. The image processing system according to claim 1 , further comprising a detection processing circuitry configured to detect a joining position for joining the plurality of input images,

wherein for an area other than the area where the camera is reflected at least in the plurality of input images, the joining processing circuitry performs the joining process according to the detected joining position.

9. The image processing system according to claim 1 ,

wherein the plurality of input images is a partial-view image in the planar coordinate system, and the input image is a spherical image in the spherical coordinate system.

10. The image processing system according to claim 1 ,

wherein the plurality of input images and the output image are a still image or a moving image.

11. An image processing system comprising:

joining processing circuitry configured to perform a joining process to join a plurality of input images and generate an output image; and

acceptance circuitry configured to receive selection of one of a plurality of modes for the joining process,

correction circuitry configured to correct distortion of the plurality of input images based on respective parameters to obtain a plurality of corrected input images; and

detection circuitry configured to detect a joining position between two of the plurality of corrected input images;

the plurality of modes having a first mode and a second mode, wherein

the respective parameters for the first mode and the second mode are different so that a focal length at the joining position for joining the plurality of input images in the second mode is at least partly longer than a focal length at the joining position for joining the plurality of images in the first mode, the focal length at the joining position in the first mode being a certain distance.

12. An image capturing system comprising:

the image processing system according to claim 1 ;

a plurality of optical systems and image sensors,

the plurality of optical systems and the plurality of image sensors configured to capture the plurality of input images.

13. An image processing device comprising:

joining processing circuitry configured to perform a joining process to join a plurality of input images captured by the camera and generate an output image, in each of the plurality of input images, the camera being reflected;

identifying circuitry configured to identify a mode selected from a plurality of modes to be applied to the joining process,

correction circuitry configured to correct distortion of the plurality of input images based on respective parameters to obtain a plurality of corrected input images; and

detection circuitry configured to detect a joining position between two of the plurality of corrected input images;

the plurality of modes having:

a first mode to generate an output image in which at least a part of the camera is reflected, through the joining process; and

a second mode to, through the joining process, generate an output image whose area where the camera is reflected is smaller than an area where the camera is reflected in the first mode or generate an output image in which the camera is not reflected; and

the respective parameters for the first mode and the second mode are different so that a focal length at the joining position for joining the plurality of input images in the second mode is at least partly longer than a focal length at the joining position for joining the plurality of images in the first mode, the focal length at the joining position in the first mode being a certain distance.

14. The image processing device according to claim 13 ,

wherein, for an area where at least the camera is reflected in the input images, the joining process changes between the first mode and the second mode.

15. The image processing device according to claim 14 ,

wherein when the joining process changes, the focal length at a joining position is changed such that a focal length at a joining position in the second mode is longer than a focal length at a joining position in the first mode.

16. An image capturing device, comprising:

the image processing device according to claim 13 ; and

a plurality of optical systems and image sensors to capture the plurality of input images to be processed by the image processing device; and

wherein in each of the plurality of input images, the camera is reflected.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 29, 2021
From: YOSHIDA, KAZUHIRO; WATANABE, TAKESHI; SENSHU, MASATO; KANO, HIROSHI; HOHJOH, DAISUKE
To: RICOH COMPANY, LTD.
Reel/Frame 058220/0983 →
Priority Claims (1)
JP 2019-111951 · Jun 17, 2019 · national
Continuity (1)
Related Publication 20220224831A1 · Jul 14, 2022