IP Library › Granted Patent US 10,750,087
Granted Patent B2
US 10,750,087 · App. 16/135,397 · Granted Aug 18, 2020

Image processing system, image processing method, and computer-readable medium

Inventors: Masato Takada (Kanagawa, JP); Makoto Shohara (Tokyo, JP); Hidekazu Suzuki (Saitama, JP); Koui Sagawa (Saitama, JP)
Assignee: Ricoh Company, Ltd.
H04N5/23238G06T3/00G06T3/0018G06T3/4038H04N5/225H04N5/23232H04N5/265
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,750,087
App. No.
16/135,397
Granted
Aug 18, 2020
Kind
B2
Abstract

An image processing system is provided that includes an image capturing apparatus configured to generate a plurality of captured images and at least one information processing apparatus connected to the image capturing apparatus. The information processing apparatus includes processing circuitry configured to input at least a first captured image and a second captured image from among the plurality of captured images, acquire first conversion data to be used for converting the first captured image and second conversion data to be used for converting the second captured image, and generate an output image by stitching converted images generated by converting the first captured image based on the first conversion data and the second captured image based on the second conversion data.

Claims (34)

1. An image processing system comprising:

an image capturing apparatus configured to generate a plurality of captured images; and

at least one information processing apparatus connected to the image capturing apparatus;

wherein the information processing apparatus includes processing circuitry configured to

input at least a first captured image and a second captured image from among the plurality of captured images;

acquire first conversion data to be used for converting the first captured image and second conversion data to be used for converting the second captured image; and

generate an output image by stitching a first converted image generated by converting the first captured image based on the first conversion data and a second converted image generated by converting the second captured image based on the second conversion data,

wherein a coordinate value of each pixel included in the first captured image, the first captured image, and the output image is specified by an angle with respect to a predetermined axis as a vertical angle and an angle orthogonal to the vertical angle as a horizontal angle,

with respect to a movement amount when moving at least one of the first converted image and the second converted image, a movement amount in the vertical angle direction is defined as a first movement amount, and a movement amount in the horizontal angle direction is defined as a second movement amount, and

a user is allowed to input one of the first movement amount and the second movement amount, and the information processing apparatus adjusts a stitching position for stitching the first converted image and the second converted image by setting another movement amount of the first movement amount and the second movement amount based on the one movement amount.

2. The image processing system according to claim 1 , wherein the processing circuitry acquires the first conversion data and the second conversion data for each image capturing apparatus of a plurality of image capturing apparatuses.

3. The image processing system according to claim 1 , wherein the first conversion data and the second conversion data include identification data capable of identifying the image capturing apparatus; and

the first captured image and the second captured image are converted using the first conversion data and the second conversion data that include the identification data corresponding to the image capturing apparatus.

4. The image processing system according to claim 1 , wherein the processing circuitry is further configured to adjust an amount of overlap between the first converted image and the second converted image based on the input moving amount for moving at least one of the first converted image and the second converted image.

5. The image processing system according to claim 1 , wherein the image capturing apparatus includes a fish-eye lens or a wide-angle lens.

6. The image processing system according to claim 1 , wherein

the first conversion data and the second conversion data include data for arranging the first captured image and the second captured image in a part of the output image and implementing distortion correction on the first captured image and the second captured image.

7. The image processing system according to claim 1 , wherein the processing circuitry allows the user to input the second movement amount, and adjusts the position for stitching the first converted image and the second converted image by setting the first movement amount.

8. An image processing method implemented by an image processing system that includes an image capturing apparatus configured to generate a plurality of captured images and at least one information processing apparatus connected to the image capturing apparatus, the image processing method comprising:

inputting a first captured image and a second captured image from among the plurality of captured images from the image capturing apparatus;

acquiring first conversion data to be used for converting the first captured image and second conversion data to be used for converting the second captured image; and

generating an output image by stitching a first converted image generated by converting the first captured image based on the first conversion data and a second converted image generated by converting the second captured image based on the second conversion data,

wherein a coordinate value of each pixel included in the first captured image, the first captured image, and the output image is specified by an angle with respect to a predetermined axis as a vertical angle and an angle orthogonal to the vertical angle as a horizontal angle,

with respect to a movement amount when moving at least one of the first converted image and the second converted image, a movement amount in the vertical angle direction is defined as a first movement amount, and a movement amount in the horizontal angle direction is defined as a second movement amount, and

a user is allowed to input one of the first movement amount and the second movement amount, and the information processing apparatus adjusts a stitching position for stitching the first converted image and the second converted image by setting another movement amount of the first movement amount and the second movement amount based on the one movement amount.

9. The image processing method according to claim 8 , wherein the image processing system allows the user to input the second movement amount, and adjusts the position for stitching the first converted image and the second converted image by setting the first movement amount.

10. A non-transitory computer-readable medium storing a program to be executed by a computer including an image capturing apparatus configured to generate a plurality of captured images and at least one information processing apparatus connected to the image capturing apparatus, the program when executed causing the computer to implement an image processing method comprising:

inputting a first captured image and a second captured image from among the plurality of captured images from the image capturing apparatus;

acquiring first conversion data to be used for converting the first captured image and second conversion data to be used for converting the second captured image; and

generating an output image by stitching a first converted image generated by converting the first captured image based on the first conversion data and a second converted image generated by converting the second captured image based on the second conversion data,

wherein a coordinate value of each pixel included in the first captured image, the first captured image, and the output image is specified by an angle with respect to a predetermined axis as a vertical angle and an angle orthogonal to the vertical angle as a horizontal angle,

with respect to a movement amount when moving at least one of the first converted image and the second converted image, a movement amount in the vertical angle direction is defined as a first movement amount, and a movement amount in the horizontal angle direction is defined as a second movement amount, and

a user is allowed to input one of the first movement amount and the second movement amount, and the information processing apparatus adjusts a stitching position for stitching the first converted image and the second converted image by setting another movement amount of the first movement amount and the second movement amount based on the one movement amount.

11. The non-transitory computer-readable medium according to claim 10 , wherein the program causes the computer to allow the user to input the second movement amount, and adjusts the position for stitching the first converted image and the second converted image by setting the first movement amount.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 19, 2018
From: TAKADA, MASATO; SHOHARA, MAKOTO; SUZUKI, HIDEKAZU; SAGAWA, KOUI
To: RICOH COMPANY, LTD.
Reel/Frame 046911/0649 →
Priority Claims (1)
JP 2016-057354 · Mar 22, 2016 · national
Continuity (2)
Continuation PCTJP2016088958 · Dec 27, 2016
Related Publication 20190020818A1 · Jan 17, 2019