IP Library Granted Patent US 9,396,529
Granted Patent B2
US 9,396,529 · App. 14/444,275 · Granted Jul 19, 2016

Image processing apparatus and image processing method

Inventors: Kazuhiro Tsubota (Fukuoka, JP); Ryoji Ogino (Fukuoka, JP); Kojiro Iwasaki (Kanagawa, JP); Mikio Morioka (Fukuoka, JP)
Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
G06T5/20G06T3/00G06T5/001H04N1/3872H04N5/23238H04N5/2628H04N7/18H04N1/387
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,396,529
App. No.
14/444,275
Granted
Jul 19, 2016
Kind
B2
Abstract

An example image processor provides a distortion-corrected image including a masking area having improved appearance. The image processor includes: a masking area retaining section that retains a masking area set for an image having distortion; a masking execution section that performs masking processing for the image having distortion using the masking area retained in the masking area retaining section; a distortion correction section that corrects the image having distortion that is subjected to the masking processing using a correction parameter for correcting distortion of the image having distortion; and a masking area shaping section that shapes the masking area of the corrected image into a predetermined shape.

Claims (60)

1. An image processing apparatus comprising:

a masking area retainer that retains a masking area specified by a user for an image, the image having distortion;

a masking processor that performs masking processing for the image having distortion using the masking area of the masking area retainer;

a distortion corrector that corrects the image that is subjected to the masking processing using a correction parameter for correcting distortion of the image; and

a masking area shaper that shapes the masking area of the corrected image into a predetermined shape; wherein

the corrected image is displayed together with the image when the user specifies the masking area, the corrected image is the image corrected by the distortion corrector, the image displayed is the image having distortion that is subject to the masking processing by the masking processor.

2. The image processing apparatus according to claim 1 , further comprising a masking area detector that detects the masking area of the corrected image corrected by the distortion corrector, wherein

the masking area shaper shapes the masking area detected by the masking area detector into the predetermined shape.

3. The image processing apparatus according to claim 1 , wherein

the masking area shaper shapes the masking area into a rectangle surrounded by lines perpendicular and parallel to the image.

4. The image processing apparatus according to claim 1 , wherein

the masking area shaper shapes the masking area such that a line that is transformed into a curve by distortion correction processing, by the distortion corrector, is transformed into a straight line.

5. The image processing apparatus according to claim 1 , wherein

the image is an image cut out from an omnidirectional image, and

the masking area shaper shapes the masking area according to a direction in which the image is cut out from the omnidirectional image.

6. The image processing apparatus according to claim 1 , wherein

the distortion corrector linearly interpolates source coordinates for each square formed by a plurality of pixels to fill in pixels of corresponding coordinates, and

the masking area shaper sets the square as the predetermined shape, the square including the masking area of the corrected image.

7. The image processing apparatus according to claim 6 , wherein

the masking area shaper sets a plurality of squares including the squares that include the corrected masking area and combined into a rectangular shape, as a masking area after shaping.

8. The image processing apparatus according to claim 1 , further comprising an imager that inputs the image having distortion.

9. The image processing apparatus according to claim 8 , wherein

the imager includes a fish-eye lens.

10. The image processing apparatus according to claim 1 , further comprising:

a specifier that the user uses to specify, on the image having distortion, a masking area to be retained in the masking area retainer; and

a masking area corrector that corrects, by the correction parameter, the masking area specified by the specifier, wherein

the masking area of the corrected image is displayed, in a superimposed manner, on the image having distortion when user specifies the masking area.

11. An image processing apparatus comprising:

a masking area retainer that retains a masking area set for an image, the image having distortion;

a masking area corrector that corrects the masking area of the masking area retainer using a correction parameter for correcting the image;

a masking area shaper that shapes the masking area corrected by the masking area corrector into a predetermined shape;

an inverse transformer that performs inverse transform using the correction parameter for the masking area shaped by the masking area shaper;

a masking processor that performs masking processing for the image using the masking area that is subjected to the inverse transform by the inverse transformer; and

a distortion corrector that corrects the image that is subjected to the masking processing using the correction parameter.

12. An image processing method comprising:

acquiring an image, the acquired image having distortion;

receiving a masking area, specified by user for the acquired image;

performing masking processing for the image using the masking area;

correcting the image that is subjected to the masking processing using a correction parameter for correcting distortion of the image;

shaping the masking area of the corrected image into a predetermined shape, and

displaying the corrected image together with the image when the user specifies the masking area, the corrected image being corrected by the correction parameter, displayed the image is the image having distortion that is subject to the masking processing.

13. An image processing apparatus comprising:

a masking area receiver that receives a masking area corresponding to a partial area of an image, the image having distortion, the masking area being specified in response to user input;

a masking processor that generates, based upon the masking area received by the masking area receiver, a masked image by performing masking processing for the masking area of the image; and

a distortion corrector that generates a corrected image by correcting at least distortion of another partial area, including the masking area, of the masked image generated by the masking processor, wherein

the corrected image is displayed, on a display together with the image having distortion, when user designates the masking area.

14. The image processing apparatus according to claim 13 , wherein

the corrected image is displayed on the display such that the corrected image is superimposed on the image having distortion.

15. The image processing apparatus according to claim 13 , further comprising:

a masking area indicator that indicates the masking area, received by the masking area receiver, on the image having distortion, wherein

the corrected image is displayed, on the display, together with the image having distortion that is indicated by the masking area indicator.

16. The image processing apparatus according to claim 13 , wherein when the corrected image is displayed together with the image having distortion, and upon receiving a predetermined user input,

a display switch removes the corrected image from being displayed.

17. The image processing apparatus according to claim 13 , further comprising:

a display switch that changes a displayed image on the display from combination of images, the combination of images being a combination of the image having distortion with the corrected image, to the image having distortion, upon receiving a predetermined user input.

18. The image processing apparatus according to claim 13 , wherein

the corrected image comprises a clipped image having a rectangular shape and a smaller area than an area of the image having distortion.

19. The image processing apparatus according to claim 13 , wherein

a frame displayed on the image is moved in response to user input,

when a position of the frame is determined by the user input, the corrected image, showing at least an area corresponding to the determined position, is displayed on the display together with the image having distortion.

Assignments (3)
CORRECTIVE ASSIGNMENT TO CORRECT THE ERRONEOUSLY FILED APPLICATION NUMBERS 13/384239, 13/498734, 14/116681 AND 14/301144 PREVIOUSLY RECORDED ON REEL 034194 FRAME 0143. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Dec 24, 2020
From: PANASONIC CORPORATION
To: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
Reel/Frame 056788/0362 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 10, 2014
From: PANASONIC CORPORATION
To: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
Reel/Frame 034194/0143 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 9, 2014
From: TSUBOTA, KAZUHIRO; OGINO, RYOJI; IWASAKI, KOJIRO; MORIOKA, MIKIO
To: PANASONIC CORPORATION
Reel/Frame 033694/0127 →
Priority Claims (4)
JP 2012-017576 · Jan 31, 2012 · national
JP 2012-027160 · Feb 10, 2012 · national
JP 2012-047166 · Mar 2, 2012 · national
JP 2012-075741 · Mar 29, 2012 · national
Continuity (2)
Continuation In Part PCTJP2013000423 · Jan 28, 2013
Related Publication 20150016746A1 · Jan 15, 2015