IP Library › Granted Patent US 8,781,252
Granted Patent B2
US 8,781,252 · App. 13/064,921 · Granted Jul 15, 2014

Image processing apparatus and method

Inventors: Seok Lee (Yongin-si, KR); Jae Joon Lee (Seoul, KR); Ho Cheon Wey (Seongnam-si, KR); Seung Sin Lee (Yongin-si, KR)
Assignee: Samsung Electronics Co., Ltd.
H04N19/00769G06T9/00H04N13/0048H04N13/00H04N13/0007
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,781,252
App. No.
13/064,921
Granted
Jul 15, 2014
Kind
B2
Abstract

Provided is an image processing apparatus. In the case of a multi-view image, the image processing apparatus may warp a color image and/or a depth image of a reference view to correspond to a target view. An occlusion region may be extracted by comparing the warped color image and/or depth image of the reference view with a color image and/or a depth image of the target view. The image processing apparatus may encode the extracted occlusion region information without loss, and decrease an amount of data in the multi-view image.

Claims (48)

1. An image processing apparatus, comprising:

a processor to control one or more processor-executable units;

an extraction unit to extract an occlusion region of a color image of a reference view using a difference between a warped color image of the reference view corresponding to a target view and a color image of the target view;

a backward warping unit to backward warp the occlusion region of the color image of the reference view to correspond to the reference view; and

a processing unit to generate an occlusion region image to be stored by applying a side offset to the backward warped occlusion region of the color image of the reference view.

2. The image processing apparatus of claim 1 , wherein the processing unit duplicates a color value from a corresponding pixel of the color image of the reference view with respect to a pixel where a color value within the occlusion region image is absent.

3. The image processing apparatus of claim 2 , wherein the processing unit performs post-processing with respect to the occlusion region image, and the post-processing comprises hole filling.

4. The image processing apparatus of claim 1 , further comprising: a warping unit to warp the color image, of the reference view to correspond to the target view, using at least one of a depth image of the reference view and a depth image of the target view.

5. The image processing apparatus of claim 1 , further comprising: an encoding unit to encode the occlusion region image in association with the color image of the reference view.

6. An image processing apparatus, comprising:

a processor to control one or more processor-executable units;

an extraction unit to extract an occlusion region of a depth image of a reference view using a difference between a warped depth image of the reference view corresponding to a target view and a depth image of the target view;

a backward warping unit to backward warp the occlusion region of the depth image of the reference view to correspond to the reference view; and

a processing unit to generate an occlusion region image to be stored by applying a side offset to the backward warped occlusion region of the depth image of the reference view.

7. The image processing apparatus of claim 6 , wherein the processing unit duplicates a depth value from a corresponding pixel of the depth image of the reference view with respect to a pixel where a depth value within the occlusion region image is absent.

8. The image processing apparatus of claim 6 , further comprising: an encoding unit to encode the occlusion region image in association with the depth image of the reference view.

9. An image processing method, comprising:

extracting an occlusion region of a color image of a reference view using a difference between a warped color image of the reference view corresponding to a target view and a color image of the target view;

backward warping the occlusion region of the color image of the reference view to correspond to the reference view; and

generating, by way of a processor, an occlusion region image by applying a side offset to the backward warped occlusion region of the color image of the reference view.

10. The image processing method of claim 9 , wherein the generating comprises: applying the side offset to the backward warped occlusion region of the color image of the reference view; and duplicating a color value from a corresponding pixel of the color image of the reference view with respect to a pixel where a color value within the occlusion region image is absent.

11. The image processing method of claim 10 , wherein the generating further comprises: performing post-processing with respect to the occlusion region image, the post-processing comprising hole filling.

12. The image processing method of claim 9 , further comprising: prior to the extracting, warping the color image of the reference view to correspond to the target view, using at least one of a depth image of the reference view and a depth image of the target view.

13. The image processing method of claim 9 , further comprising:

encoding the occlusion region image in association with the color image of the reference view.

14. An image processing method, comprising:

extracting an occlusion region of a depth image of a reference view using a difference between a warped depth image of the reference view corresponding to a target view and a depth image of the target view;

backward warping the occlusion region of the depth image of the reference view to correspond to the reference view; and

generating, by way of a processor, an occlusion region image by applying a side offset to the backward warped occlusion region of the depth image of the reference view.

15. The image processing method of claim 14 , wherein the generating comprises: applying the side offset to the backward warped occlusion region of the depth image of the reference view; and duplicating a depth value from a corresponding pixel of the depth image of the reference view with respect to a pixel where a depth value within the occlusion region image is absent.

16. The image processing method of claim 14 , further comprising:

encoding the occlusion region image in association with the depth image of the reference view.

17. A non-transitory computer-readable medium comprising a program for instructing a computer to perform an image processing method, comprising:

extracting an occlusion region of a color image of a reference view using a difference between a warped color image of the reference view corresponding to a target view and a color image of the target view;

backward warping the occlusion region of the color image of the reference view to correspond to the reference view; and

generating an occlusion region image by applying a side offset to the backward warped occlusion region of the color image of the reference view.

18. An image processing method, comprising:

extracting an occlusion region of a color image of a reference view using a difference between a color image of a target view and a warped color image of the reference view corresponding to the target view;

backward warping the occlusion region of the color image of the reference view to correspond to the reference view;

generating an occlusion region image by applying a side offset to the backward warped occlusion region of the color image of the reference view; and

encoding, by way of a processor, data including the occlusion region image.

19. An image processing apparatus, comprising:

a processor to control one or more processor-executable units;

an extraction unit to extract an occlusion region of a color image of a reference view using a difference between a color image of a target view and a warped color image of the reference view corresponding to the target view;

a backward warping unit to backward warp the occlusion region of the color image of the reference view to correspond to the reference view;

a processing unit to generate an occlusion region image by applying a side offset to the backward warped occlusion region of the color image of the reference view; and

an encoding unit to encode data including the occlusion region image.

20. The image processing apparatus of claim 19 , wherein the encoding of the data by the encoding unit includes encoding the extracted occlusion region information and the color image of the reference view without encoding the color image of the target view.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 26, 2011
From: LEE, SEOK; LEE, JAE JOON; WEY, HO CHEON; LEE, SEUNG SIN
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 026325/0844 →
Priority Claims (1)
KR 10-2010-0078802 · Aug 16, 2010 · national
Continuity (1)
Related Publication 20120039528A1 · Feb 16, 2012