Image processing device and method for moving gesture recognition using difference images
An image processing device includes a difference image generation unit which generates a difference image by obtaining a difference between frames of a cutout image which is obtained by cutting out a predetermined region on a photographed image; a feature amount extracting unit which extracts a feature amount from the difference image; and a recognition unit which recognizes a specific movement of an object on the photographed image based on the feature amount which is obtained from the plurality of difference images which are aligned in time sequence.
1. An image processing device, comprising:
a central processing unit (CPU) configured to:
detect a first part of a body to be recognized from a photographed image, wherein the photographed image is aligned in time sequence;
set a first region on the photographed image based on the detected first part;
control to overlay a first graphic based on the first region set on the photographed image;
track the first region in the photographed image;
extract a first feature amount from the tracked first region in the photographed image;
determine movement of the first part in the first region based on a magnitude of change of the first feature amount; and
execute a first process based on the movement of the first part.
2. The image processing device according to claim 1 , wherein the CPU is further configured to:
detect a second part of the body to be recognized from the photographed image, wherein the second part is different from the first part; and
set a second region on the photographed image based on the second part.
3. The image processing device according to claim 2 , wherein the CPU is further configured to:
generate a second graphic based on the second region; and
control display of the second graphic.
4. The image processing device according to claim 2 , wherein the CPU is further configured to:
track the second region in the photographed image; and
extract a second feature amount from the tracked second region in the photographed image.
5. The image processing device according to claim 4 , wherein the CPU is further configured to:
determine movement of the second part in the second region based on the second feature amount; and
execute a second process based on the movement of the second part.
6. The image processing device according to claim 1 ,
wherein the first part of the body is a user's face.
7. The image processing device according to claim 1 ,
wherein the first graphic includes a frame of an icon.
8. The image processing device according to claim 1 ,
wherein the first process comprises display of at least one image on the first part.
9. The image processing device according to claim 1 ,
wherein the CPU is further configured to extract the first feature amount based on a plurality of difference images.
10. The image processing device according to claim 1 , wherein
the CPU is further configured to skip the movement of the first part of the body in a third region, and
the third region is different from the first region.
11. An image processing method, comprising:
in an image processing device:
detecting a first part of a body to be recognized from a photographed image, wherein the photographed image is aligned in time sequence;
setting a first region on the photographed image based on the detected first part;
controlling to overlay a first graphic based on the first region set on the photographed image;
tracking the first region in the photographed image;
extracting a first feature amount from the tracked first region in the photographed image;
determining movement of the first part in the first region based on a magnitude of change of the first feature amount; and
executing a first process based on the movement of the first part.
12. The method according to claim 11 , further comprising:
detecting a second part of the body to be recognized from the photographed image, wherein the second part is different from the first part; and
setting a second region on the photographed image based on the second part.
13. The method according to claim 12 , further comprising:
generating a second graphic based on the second region; and
controlling display of the second graphic.
14. The method according to claim 12 , further comprising:
tracking the second region in the photographed image; and
extracting a second feature amount from the tracked second region in the photographed image.
15. The method according to claim 14 , further comprising:
determining movement of the second part in the second region based on the second feature amount; and
executing a second process based on the movement of the second part.
16. The method according to claim 11 , wherein the first process comprises displaying at least one image on the first part.
17. The method according to claim 11 , wherein the first part of the body is a user's face.
18. The method according to claim 11 , wherein the first graphic includes a frame of an icon.
19. The method according to claim 11 , further comprising extracting the first feature amount based on a plurality of difference images.
20. The method according to claim 11 , further comprising
skipping the movement of the first part of the body in a third region, wherein the third region is different from the first region.
21. A non-transitory computer-readable medium having stored thereon computer-readable instructions which, when executed by a computer, cause the computer to execute operations, the operations comprising:
detecting a first part of a body to be recognized from a photographed image, wherein the photographed image is aligned in time sequence;
setting a first region on the photographed image based on the detected first part;
controlling to overlay a first graphic based on the first region set on the photographed image;
tracking the first region in the photographed image;
extracting a first feature amount from the tracked first region in the photographed image;
determining movement of the first part in the first region based on a magnitude of change of the first feature amount; and
executing a first process based on the movement of the first part.
22. The non-transitory computer-readable medium according to claim 21 , wherein the operations further comprise:
detecting a second part of the body to be recognized from the photographed image, wherein the second part is different from the first part; and
setting a second region on the photographed image based on the second part.
23. The non-transitory computer-readable medium according to claim 22 , wherein the operations further comprise:
generating a second graphic based on the second region; and
controlling display of the second graphic.
24. The non-transitory computer-readable medium according to claim 22 , wherein the operations further comprise:
tracking the second region in the photographed image; and
extracting a second feature amount from the tracked second region in the photographed image.
25. The non-transitory computer-readable medium according to claim 24 , wherein the operations further comprise:
determining movement of the second part in the second region based on the second feature amount; and
executing a second process based on the movement of the second part.
26. The non-transitory computer-readable medium according to claim 21 , wherein the first process comprises displaying at least one image on the first part.
27. The non-transitory computer-readable medium according to claim 21 , wherein the first part of the body is a user's face.
28. The non-transitory computer-readable medium according to claim 21 , wherein the first graphic includes a frame of an icon.
29. The non-transitory computer-readable medium according to claim 21 , wherein the operations further comprise extracting the first feature amount based on a plurality of difference images.
30. The non-transitory computer-readable medium according to claim 21 , wherein the operations further comprise
skipping the movement of the first part of the body in a third region, wherein the third region is different from the first region.