IP Library › Granted Patent US 10,607,088
Granted Patent B2
US 10,607,088 · App. 15/559,506 · Granted Mar 31, 2020

Image processing device, image processing method, and image processing system

Inventor: Nobuhiro Tsunashima (Kanagawa, JP)
Assignee: SONY CORPORATION
G06K9/00765G06K9/00771G06K9/2054G06K9/78H04N5/225H04N5/232H04N7/18G06K2209/21
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,607,088
App. No.
15/559,506
Granted
Mar 31, 2020
Kind
B2
Abstract

The present disclosure provides an image processing device, image processing method, and image processing system that are capable of deciding a cutout region in accordance with change in the detection position of the same object between frame images captured at different times. The image processing device includes: a first region setting unit configured to set a first region including a detection position of an object in a cutout region in a first frame image; and a cutout region deciding unit configured to decide a cutout region in a second frame image subsequent to the first frame image, on the basis of a positional relation between the first region and a detection position of the object in the second frame image.

Claims (50)

1. An image processing device comprising:

processing circuitry configured to:

set a first region including a first detection position of a moving object in a first frame image, the first detection position initially being at the center of the first region;

when the first region in the first frame image does not include a second detection position of the moving object in a second frame image that is subsequent to the first frame image, move the first region in the first frame image in a direction of the second detection position of the moving object by the minimum distance between an outline of the first region and the second detection position such that the second detection position is on the outline of the first region, the second detection position being the middle of the moving object;

set a cutout region in the second frame image based on the first region that is moved; and

generate a cutout image by cutting out the cutout region in the second frame image.

2. The image processing device according to claim 1 ,

wherein the processing circuitry is further configured to determine whether to set a position of the cutout region in the second frame image the same as the cutout region in the first frame image based on a positional relation between the first region and the second detection position of the moving object in the second frame image.

3. The image processing device according to claim 2 ,

wherein when the first region includes the second detection position of the moving object in the second frame image, the processing circuitry is further configured to set the position of the cutout region in the second frame image the same as the cutout region in the first frame image.

4. The image processing device according to claim 1 ,

wherein a first shape and a first size of the cutout region in the first frame image are the same as a second shape and a second size of the cutout region in the second frame image.

5. The image processing device according to claim 4 ,

wherein a first position of the center of the cutout region in the first frame image and a second position of the center of the first region are the same as the first detection position of the moving object in the first frame image.

6. The image processing device according to claim 2 , wherein

the processing circuitry is configured to set the first region including a detection position of each of a plurality of moving objects in the cutout region in the first frame image,

set one of the plurality of moving objects as a tracking target, and

determine whether to set the position of the cutout region in the second frame image the same as the cutout region in the first frame image, based on a positional relation between a detection position of the tracking target and the first region.

7. The image processing device according to claim 2 ,

wherein the moving object is a human or an automobile.

8. An image processing method comprising:

setting a first region including a first detection position of a moving object in a first frame image, the first detection position initially being at the center of the first region;

when the first region in the first frame image does not include a second detection position of the moving object in a second frame image that is subsequent to the first frame image, moving the first region in the first frame image in a direction of the second detection position of the moving object by the minimum distance between an outline of the first region and the second detection position such that the second detection position is on the outline of the first region, the second detection position being the middle of the moving object;

setting a cutout region in the second frame image based on the first region that is moved; and

generating a cutout image by cutting out the cutout region in the second frame image.

9. An image processing system comprising:

processing circuitry configured to:

set a first region including a first detection position of a moving object in a first frame image, the first detection position initially being at the center of the first region,

when the first region in the first frame image does not include a second detection position of the moving object in a second frame image that is subsequent to the first frame image, move the first region in the first frame image in a direction of the second detection position of the moving object by the minimum distance between an outline of the first region and the second detection position such that the second detection position is on the outline of the first region, the second detection position being the middle of the moving object,

set a cutout region in the second frame image based on the first region that is moved,

generate a cutout image by cutting out the cutout region in the second frame image; and

a storage configured to store the generated cutout image.

10. The image processing method according to claim 8 , further comprising:

determining whether to set a position of the cutout region in the second frame image the same as the cutout region in the first frame image based on a positional relation between the first region and the second detection position of the moving object in the second frame image.

11. The image processing method according to claim 8 , further comprising:

when the first region includes the second detection position of the moving object in the second frame image, setting a position of the cutout region in the second frame image the same as the cutout region in the first frame image.

12. The image processing method according to claim 8 ,

wherein a first shape and a first size of the cutout region in the first frame image are the same as a second shape and a second size of the cutout region in the second frame image.

13. The image processing method according to claim 8 ,

wherein a first position of the center of the cutout region in the first frame image and a second position of the center of the first region are the same as the first detection position of the moving object in the first frame image.

14. The image processing system according to claim 9 ,

wherein the processing circuitry is further configured to determine whether to set a position of the cutout region in the second frame image the same as the cutout region in the first frame image based on a positional relation between the first region and the second detection position of the moving object in the second frame image.

15. The image processing system according to claim 9 ,

wherein when the first region includes the second detection position of the moving object in the second frame image, the processing circuitry is further configured to set the position of the cutout region in the second frame image the same as the cutout region in the first frame image.

16. The image processing system according to claim 9 ,

wherein a first shape and a first size of the cutout region in the first frame image are the same as a second shape and a second size of the cutout region in the second frame image.

17. The image processing system according to claim 9 ,

wherein a first position of the center of the cutout region in the first frame image and a second position of the center of the first region are the same as the first detection position of the moving object in the first frame image.

18. The image processing system according to claim 9 ,

wherein the moving object is a human or an automobile.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 19, 2017
From: TSUNASHIMA, NOBUHIRO
To: SONY CORPORATION
Reel/Frame 043899/0924 →
Priority Claims (1)
JP 2015-082274 · Apr 14, 2015 · national
Continuity (1)
Related Publication 20180121736A1 · May 3, 2018