IP Library Granted Patent US 8,416,993
Granted Patent B2
US 8,416,993 · App. 12/267,986 · Granted Apr 9, 2013

Object boundary accurate motion detection using hierarchical block splitting and motion segmentation

Inventors: Paul Springer (Stuttgart, DE); Oliver Erdler (Ostfildern-Ruit, DE)
Assignee: Sony Corporation
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,416,993
App. No.
12/267,986
Granted
Apr 9, 2013
Kind
B2
Abstract

The present invention is directed to an apparatus for motion segmentation in the field of motion detection, whereby an initial motion map is processed to a more accurate final motion map which identifies the non- and the movement of pixels between at least two successive images, said apparatus comprising a processing-segmentation device and a combination-logic device. In this apparatus the initial motion map is processed to three different feature maps, describing static edges, moving edges and moving flat areas between at least two successive images, respectively. The present invention is further directed to a corresponding method adapted for motion segmentation in the field of motion detection.

Claims (85)

1. An accurate motion map generating apparatus operable to receive and process input data comprising a motion map and to output a final motion map,

wherein said motion map identifies the non-movement and the movement of pixels between at least two successive images, comprising

a processing-segmentation device operable to receive and process said input data and output a first signal M 1 , a second signal M 2 and a third signal M 3 ,

wherein said signals M 1 , M 2 and M 3 are feature maps, respectively, which base on said input data and describe characteristics between the at least two successive images,

said first signal M 1 describing static edges,

said second signal M 2 describing moving edges, and

said third signal M 3 describing moving flat areas; and

a combination-logic device operable to receive and process said first signal M 1 , said second signal M 2 and said third signal M 3 and to output said final motion map,

wherein said final motion map is based on said signals M 1 , M 2 and M 3 .

2. An accurate motion map generating apparatus according to claim 1 , wherein combination-logic device is operable to process signal M 2 to signal A based on a morphological closing operation Closing A.

3. An accurate motion map generating apparatus according to claim 2 ,

wherein the operation Closing A comprises a morphological dilatation operation followed by a morphological erosion operation.

4. An accurate motion map generating apparatus according to one of the above-mentioned claims,

wherein the combination-logic device is operable to process signal M 3 to signal B based on a morphological closing operation Closing B followed by a post-processing operation.

5. An accurate motion map generating apparatus according to claim 4 ,

wherein the operation Closing B comprises a morphological dilatation operation followed by a morphological erosion operation.

6. An accurate motion map generating apparatus according to claim 4 ,

wherein said post-processing operation comprises a two-dimensional edge-preserving filter.

7. An accurate motion map generating apparatus according to claim 6 ,

wherein said post-processing operation comprises a two-dimensional median filter.

8. An accurate motion map generating apparatus according to claim 1 ,

wherein said combination-logic device is operable to invert signal M 1 to signal C.

9. An accurate motion map generating apparatus according to claim 2 ,

wherein the combination-logic device is operable to process signal M 3 to signal B based on a morphological closing operation Closing B followed by a post-processing operation, wherein said combination-logic device is operable to invert signal M 1 to signal C, and

wherein said combination-logic device is operable to combine the signals A, B and C together to the final motion map.

10. An accurate motion map generating apparatus according to one of the above-mentioned claim 1 ,

wherein said input data comprises an edge map, said edge map identifying the edges of an image,

wherein said processing-segmentation device comprises a

pre-processing device operable to receive and process the motion map and to output a pre-processed motion map; and

a segmentation device operable to receive and process the pre-processed motion map and the edge map and to output the signals M 1 , M 2 and M 3 .

11. An accurate motion map generating apparatus according to claim 1 , further comprising

an image analysing device operable to receive and process image data and to output said input data comprising the motion map.

12. An accurate motion map generating apparatus according to claim 10 ,

further comprising an image analysing device operable to receive and process image data and to output said input data comprising the motion map,

wherein said image analysing device comprises

a motion detection device operable to receive and process said image data and to output said motion map; and

an edge detection device operable to receive and process said image data and to output said edge map;

said image analysing device being operable to output said input data comprising said motion map and said edge map.

13. An accurate motion map generating apparatus according to claim 12 ,

wherein said motion detection device is operable to process based on accurate motion detection with hierarchical block splitting.

14. An accurate motion map generating apparatus according to claim 12 ,

wherein said edge detection device is operable to process based on a 3×3 Sobel operator.

15. An accurate motion map generating method for receiving and processing input data comprising a motion map and for outputting a final motion map,

wherein said motion map identifies the non-movement and the movement of pixels between at least two successive images, comprising

a processing-segmentation step for receiving and processing said input data and for outputting a first signal M 1 , a second signal M 2 and a third signal M 3 ,

wherein said signals M 1 , M 2 and M 3 are feature maps, respectively, which base on said input data and describe characteristics between the at least two successive images,

said first signal M 1 describing static edges,

said second signal M 2 describing moving edges, and

said third signal M 3 describing moving flat areas; and

a combination-logic step for receiving and processing said first signal M 1 , said second signal M 2 and said third signal M 3 and for outputting said final motion map, wherein said final motion map is based on said signals M 1 , M 2 and M 3 .

16. An accurate motion map generating method according to claim 15 ,

wherein during the combination-logic step signal M 2 is processed to signal A based on a morphological closing operation Closing A.

17. An accurate motion map generating method according to claim 16 ,

wherein the operation Closing A comprises a morphological dilatation operation followed by a morphological erosion operation.

18. An accurate motion map generating method according to claim 15 ,

wherein during the combination-logic step the signal M 3 is processed to signal B based on a morphological closing operation Closing B followed by a post-processing operation.

19. An accurate motion map generating method according to claim 18 ,

wherein the operation Closing B comprises a morphological dilatation operation followed by a morphological erosion operation.

20. An accurate motion map generating method according to claim 18 ,

wherein said post-processing operation comprises a two-dimensional edge-preserving filter.

21. An accurate motion map generating method according to claim 20 ,

wherein said post-processing operation comprises a two-dimensional median filter.

22. An accurate motion map generating method according to claim 15 ,

wherein during said combination-logic step the signal M 1 is inverted to signal C.

23. An accurate motion map generating method according to claim 16 ,

wherein during the combination-logic step the signal M 3 is processed to signal B based on a morphological closing operation Closing B followed by a post-processing operation,

wherein during said combination-logic step the signal M 1 is inverted to signal C, and

wherein during said combination-logic step the signals A, B and C are combined together to the final motion map.

24. An accurate motion map generating method according to claim 15 ,

wherein said input data comprises an edge map, said edge map identifying the edges of an image,

wherein said processing-segmentation step comprises

a pre-processing step for receiving and processing the motion map and for outputting a pre-processed motion map; and

a segmentation step for receiving and processing the pre-processed motion map and the edge map and for outputting the signals M 1 , M 2 and M 3 .

25. An accurate motion map generating method according to claim 15 , further comprising

an image analysing step for receiving and processing image data and for outputting said input data comprising the motion map.

26. An accurate motion map generating method according to claim 24 ,

further comprising an image analysing step for receiving and processing image data and for outputting said input data comprising the motion map,

wherein said image analysing step comprises

a motion detection step for receiving and processing said image data and for outputting said motion map; and

an edge detection step for receiving and processing said image data and for outputting said edge map;

said image analysing step for outputting said input data comprising said motion map and said edge map.

27. An accurate motion map generating method according to claim 26 ,

wherein said motion detection step processes based on accurate motion detection with hierarchical block splitting.

28. An accurate motion map generating method according to claim 26 ,

wherein said edge detection step processes based on a 3×3 Sobel operator.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 6, 2009
From: SPRINGER, PAUL; ERDLER, OLIVER
To: SONY CORPORATION
Reel/Frame 022218/0832 →
Priority Claims (1)
EP 07120706 · Nov 14, 2007 · regional
Continuity (1)
Related Publication 20090136092A1 · May 28, 2009