IP Library Granted Patent US 9,367,747
Granted Patent B2
US 9,367,747 · App. 14/255,464 · Granted Jun 14, 2016

Image processing apparatus, image processing method, and program

Inventor: Hironaga Sano (Kanagawa, JP)
Assignee: SONY CORPORATION
G06K9/00771G06T7/0042G06T2207/30196G06T2207/30232
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,367,747
App. No.
14/255,464
Granted
Jun 14, 2016
Kind
B2
Abstract

An image processing apparatus includes a detection unit which detects an object which is included in an image; and a determination unit which determines a positional relationship between a detected object and a protective barrier region in a depth direction of the image based on a feature amount relating to at least one of the detected object and the protective barrier region, when the detected object and the protective barrier region overlap with each other in the image.

Claims (51)

1. An image processing apparatus comprising:

a processor; and

a memory, the memory storing program code executable by the processor to perform operations comprising:

detecting an object which is included in an image;

determining a positional relationship by calculating a difference value between a feature amount of a detected object and a feature amount of a protective barrier region in a depth direction of the image relating to at least one of the detected object and the protective barrier region, when the detected object and the protective barrier region overlap with each other in the image; and

calculating a total value of the difference value of each pixel of the overlap, wherein

the detected object is present in the protective barrier region when the total value is greater than a threshold value and the detected object is not present in the protective barrier region when the total value is less than the threshold value.

2. The image processing apparatus according to claim 1 , wherein operations further comprise:

comparing a feature amount which is included in an overlapped region of the detected object in the image, and a feature amount which is included in the overlapped region in the protective barrier region which is stored in a storage unit with each other, with respect to the overlapped region of the detected object and the protective barrier region in the image, and determining the positional relationship based on the comparison result.

3. The image processing apparatus according to claim 2 , wherein operations further comprise:

comparing a pixel which is included in the overlapped region of the detected object, and a pixel which is included in the overlapped region in the protective barrier region with each other, and determining the positional relationship based on a degree of similarity of the pixels in the overlapped region.

4. The image processing apparatus according to claim 1 , wherein operations further comprise:

determining a positional relationship when the detected object and the registered region overlap with each other in the image, and the detected object and the protective barrier region overlap with each other in the image, and determining whether or not the detected object has intruded into the registered region based on the determination result, wherein

the protective barrier region is a region of a protective barrier which is an object provided at a boundary of a registered region which is registered in the image, or in a vicinity of the boundary, and blocks the detected object.

5. The image processing apparatus according to claim 1 , wherein operations further comprise:

detecting a moving object which is included in the image, and

determining whether or not there is occlusion relating to the detected moving object.

6. The image processing apparatus according to claim 5 , wherein operations further comprise:

determining whether or not there is the occlusion based on a comparison result produced by comparing size information relating to the detected moving object to size information relating to a moving object which is detected immediately before the moving object in the image.

7. The image processing apparatus according to claim 5 , wherein operations further comprise:

determining a plurality of moving objects which are close to both sides of the protective barrier region to be one moving object, when it is determined that there is the occlusion.

8. An image processing method for controlling an image processing apparatus the method comprising:

detecting an object included in an image; and

determining a positional relationship by calculating a difference value between a feature amount of a detected object and a feature amount of a protective barrier region in a depth direction of the image relating to at least one of the detected object and the protective barrier region, when the detected object and the protective barrier region overlap with each other in the image; and

calculating a total value of the difference value of each pixel of the overlap, wherein

the detected object is present in the protective barrier region when the total value is greater than a threshold value and the detected object is not present in the protective barrier region when the total value is less than the threshold value.

9. The image processing method according to claim 8 , wherein operations further comprise comparing a feature amount which is included in an overlapped region of the detected object in the image, and a feature amount which is included in the overlapped region in the protective barrier region which is stored in a storage unit with each other, with respect to the overlapped region of the detected object and the protective barrier region in the image, and determining the positional relationship based on the comparison result.

10. The image processing method according to claim 9 , wherein operations further comprise

comparing a pixel which is included in the overlapped region of the detected object, and a pixel which is included in the overlapped region in the protective barrier region with each other, and determining the positional relationship based on a degree of similarity of the pixels in the overlapped region.

11. The image processing method according to claim 8 , wherein operations further comprise:

determining a positional relationship when the detected object and the registered region overlap with each other in the image, and the detected object and the protective barrier region overlap with each other in the image, and determining whether or not the detected object has intruded into the registered region based on the determination result, wherein

the protective barrier region is a region of a protective barrier which is an object provided at boundary of a registered region which is registered in the image, or in a vicinity of the boundary, and blocks the detected object.

12. The image processing method according to claim 8 , wherein operations further comprise:

detecting a moving object which is included in the image, and

determining whether or not there is occlusion relating to the detected moving object.

13. The image processing method according to claim 12 , wherein operations further comprise determining whether or not there is the occlusion based on a comparison result produced by comparing size information relating to the detected moving object to size information relating to a moving object which is detected immediately before the moving object in the image.

14. The image processing method according to claim 12 , wherein operations further comprise determining a plurality of moving objects which are close to both sides of the protective barrier region to be one moving object, when it is determined that there is the occlusion.

15. A non-transitory computer readable medium storing program code for image processing, the program code being executable by a processor to perform operations comprising:

detecting an object included in an image; and

determining a positional relationship by calculating a difference value between a feature amount of a detected object and a feature amount of a protective barrier region in a depth direction of the image relating to at least one of the detected object and the protective barrier region, when the detected object and the protective barrier region overlap with each other in the image; and

calculating a total value of the difference value of each pixel of the overlap, wherein

the detected object is present in the protective barrier region when the total value is greater than a threshold value and the detected object is not present in the protective barrier region when the total value is less than the threshold value.

16. The non-transitory computer-readable medium according to claim 15 , wherein operations further comprise comparing a feature amount which is included in an overlapped region of the detected object in the image, and a feature amount which is included in the overlapped region in the protective barrier region which is stored in a storage unit with each other, with respect to the overlapped region of the detected object and the protective barrier region in the image, and determining the positional relationship based on the comparison result.

17. The non-transitory computer-readable medium according to claim 16 , wherein operations further comprise comparing a pixel which is included in the overlapped region of the detected object, and a pixel which is included in the overlapped region in the protective barrier region with each other, and determines the positional relationship based on a degree of similarity of the pixels in the overlapped region.

18. The non-transitory computer-readable medium according to claim 15 , wherein operations further comprise:

determining a positional relationship when the detected object and the registered region overlap with each other in the image, and the detected object and the protective barrier region overlap with each other in the image, and determining whether or not the detected object has intruded into the registered region based on the determination result, wherein

the protective barrier region is a region of a protective barrier which is an object provided at a boundary of a registered region which is registered in the image, or in a vicinity of the boundary, and blocks the detected object.

19. The non-transitory computer-readable medium according to claim 15 , wherein operations further comprise:

detecting a moving object which is included in the image, and

determining whether or not there is occlusion relating to the detected moving object.

20. The non-transitory computer-readable medium according to claim 19 , wherein operations further comprise determining whether or not there is the occlusion based on a comparison result produced by comparing size information relating to the detected moving object to size information relating to a moving object which is detected immediately before the moving object in the image.

Assignments (3)
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE ZIP CODE FROM 246-0014 TO 243-0014 PREVIOUSLY RECORDED AT REEL: 039645 FRAME: 0019. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Dec 13, 2016
From: SONY CORPORATION
To: SONY SEMICONDUCTOR SOLUTIONS CORPORATION
Reel/Frame 040894/0926 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 10, 2016
From: SONY CORPORATION
To: SONY SEMICONDUCTOR SOLUTIONS CORPORATION
Reel/Frame 039645/0019 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 17, 2014
From: SANO, HIRONAGA
To: SONY CORPORATION
Reel/Frame 032712/0380 →
Priority Claims (1)
JP 2013-110264 · May 24, 2013 · national
Continuity (1)
Related Publication 20140348381A1 · Nov 27, 2014