Image processing method and input interface apparatus
View Patent ↗For an input interface apparatus for recognizing the motion of an object, there may be cases where the brightness of the object to be captured is insufficient, and thus, a camera takes an image of the object operated by the object, a depth position detector detects the position of the object based on captured frames, an action identifying unit identifies an action of the player based on a result on the detection of the object, an input receiving unit receives the action as an instruction to an input-receiving image displayed on a display, and in response to the action, an illumination control unit raises the brightness of the image projected on the display higher than that before the action is detected.
1. An image processing method, comprising:
capturing an image of an object operated by a player,
detecting a three-dimensional position of the object based on a captured frame,
identifying an action of the player based on a result of detecting the object,
receiving the action as an instruction to an input-receiving image displayed on a display,
determining whether or not a brightness measured in the playing environment for a user is under a predetermined reference value, and
in case that the brightness measured in the playing environment of the user is under the predetermined reference value, raising, in response to the action, the brightness of the image projected on the display higher than that before the action is detected.
2. An input interface apparatus, comprising:
a camera which captures an image of an object operated by a player;
a position detector which detects the three-dimensional position of an object based on a captured frame;
an action identifying unit which identifies an action of the player based on a result of detecting the object;
an input receiving unit which receives the action as an instruction to an input-receiving image displayed on a display;
a determining unit which determines whether or not a brightness measured in the playing environment for a user is under a predetermined reference value;
an illumination control unit which, in case that the brightness measured in the playing environment of the user is under the predetermined reference value, raises, in response to the action, the brightness of the image projected on the display higher than that before the action is detected; and
a reflector which is positioned such that a reflected image of the object is projected to the camera and which causes the camera to capture the reflected image of the object together with a direct image thereof, wherein a plurality of entry regions are provided by the reflector and the brightness of the image is changed in accordance with which of the entry regions the object is positioned.
3. An input interface apparatus according to claim 2 , wherein the illumination control unit raises the brightness of the image by displaying a lighting region with a higher lightness or brightness than that of the captured frame on the display.
4. An input interface apparatus according to claim 3 , wherein the illumination control unit uses a part of the whole image excluding an input image for receiving an input instruction in accordance with the motion of the object, as the lighting region.
5. An input interface apparatus according to claim 3 , wherein the illumination control unit uses a part of the whole image excluding the image of player captured together with the object, as the lighting region.
6. An input interface apparatus according to claim 3 , further comprising an image analyzing unit which estimates the brightness of a space to be captured,
wherein when the brightness of the object is determined to be insufficient, the illumination control unit raises the brightness of the lighting region to accurately detect the object.
7. An input interface apparatus according to claim 6 , wherein a parameter of the lighting region is adjusted based on the brightness of a space to be captured.
8. An input interface apparatus according to claim 3 , wherein the illumination control unit causes a lighting region contained in a right half of the display and that contained in a left half thereof to be displayed alternately on the display,
the apparatus further comprising a distance estimating unit which estimates a distance of the object in the space to be captured from the display, by acquiring frames captured when either the right lighting region or left lighting region is displayed on the display by the illumination control unit and by detecting the difference between the acquired frames.
9. An input interface apparatus according to claim 3 , wherein the illumination control unit causes a plurality of lighting regions of different colors to be sequentially displayed on the display,
the apparatus further comprising a color analyzing unit which acquires frames captured respectively when lighting regions of different colors are displayed on the display by the illumination control unit and, based on the variation of colors among the acquired frames, acquires color information on the object in the space to be captured.
10. An input interface apparatus according to claim 2 , wherein the illumination control unit raises the brightness of the image by displaying a lighting region with a higher lightness than that of the captured frame on the display.
11. An input interface apparatus according to claim 4 , wherein the illumination control unit uses a part of the whole image excluding the image of player captured together with the object, as the lighting region.
12. An input interface apparatus according to claim 4 , further comprising an image analyzing unit which estimates the brightness of a space to be captured,
wherein when the brightness of the object is determined to be insufficient, the illumination control unit raises the brightness of the lighting region to accurately detect the object.
13. An input interface apparatus according to claim 5 , further comprising an image analyzing unit which estimates the brightness of a space to be captured,
wherein when the brightness of the object is determined to be insufficient, the illumination control unit raises the brightness of the lighting region to accurately detect the object.
14. An input interface apparatus according to claim 4 , wherein the illumination control unit causes a lighting region contained in a right half of the display and that contained in a left half thereof to be displayed alternately on the display,
the apparatus further comprising a distance estimating unit which estimates a distance of the object in the space to be captured from the display, by acquiring frames captured when either the right lighting region or left lighting region is displayed on the display by the illumination control unit and by detecting the difference between the acquired frames.
15. An input interface apparatus according to claim 5 , wherein the illumination control unit causes a lighting region contained in a right half of the display and that contained in a left half thereof to be displayed alternately on the display,
the apparatus further comprising a distance estimating unit which estimates a distance of the object in the space to be captured from the display, by acquiring frames captured when either the right lighting region or left lighting region is displayed on the display by the illumination control unit and by detecting the difference between the acquired frames.
16. An input interface apparatus according to claim 4 , wherein the illumination control unit causes a plurality of lighting regions of different colors to be sequentially displayed on the display,
the apparatus further comprising a color analyzing unit which acquires frames captured respectively when lighting regions of different colors are displayed on the display by the illumination control unit and, based on the variation of colors among the acquired frames, acquires color information on the object in the space to be captured.
17. An input interface apparatus according to claim 5 , wherein the illumination control unit causes a plurality of lighting regions of different colors to be sequentially displayed on the display,
the apparatus further comprising a color analyzing unit which acquires frames captured respectively when lighting regions of different colors are displayed on the display by the illumination control unit and, based on the variation of colors among the acquired frames, acquires color information on the object in the space to be captured.
18. An input interface apparatus according to claim 12 , wherein a parameter of the lighting region is adjusted based on the brightness of a space to be captured.
19. An input interface apparatus according to claim 13 , wherein a parameter of the lighting region is adjusted based on the brightness of a space to be captured.