Display-and-image-pickup apparatus, object detection program and method of detecting an object

1. A display-and-image-pickup apparatus comprising:

a display-and-image-pickup panel having an image display function and an image pickup function;

an image producing means for producing a predetermined processed image on the basis of a picked-up image of a proximity object obtained through the use of the display-and-image-pickup panel;

an image processing means for obtaining information about at least one of position, shape and size of the proximity object through selectively using one of two obtaining modes on the basis of at least one of the picked-up image and the processed image; and

a switching means for performing a switching process between the two obtaining modes in the image processing means on the basis of the magnitude of a predetermined parameter so that, in the case where the parameter is increasing, one of the two obtaining modes is switched to the other obtaining mode when the parameter reaches a first threshold value, and in the case where the parameter is decreasing, the other obtaining mode is switched to the one obtaining mode when the parameter reaches a second threshold value smaller than the first threshold value.

2. The display-and-image-pickup apparatus according to claim 1 , wherein

the picked-up image is a shadow image obtained by picking up an image of a shadow of the proximity object with the display-and-image-pickup panel, and

the processed image is a differential image obtained by performing a differential process between a display-light-utilized image and the shadow image, the display-light-utilized image being obtained by picking up an image of the proximity object with the display-and-image-pickup panel through the use of display light from the display-and-image-pickup panel.

3. The display-and-image-pickup apparatus according to claim 2 , wherein

the one of the two obtaining modes is a differential obtaining mode performed on the basis of the differential image, and the other is a shadow obtaining mode performed on the basis of the shadow image.

4. The display-and-image-pickup apparatus according to claim 3 , wherein

the predetermined parameter is illuminance of environment light.

5. The display-and-image-pickup apparatus according to claim 4 , wherein

the switching means detects the illuminance of the environment light through the use of a moving average image of the shadow image.

6. The display-and-image-pickup apparatus according to claim 3 , wherein

the predetermined parameter is display luminance of the display-and-image-pickup panel.

7. The display-and-image-pickup apparatus according to claim 2 , wherein

the image producing means has a function of producing a synthesized image from the differential image and the shadow image through the use of a plurality of combinations of weighting coefficients,

one of the two obtaining modes is a first synthesization obtaining mode performed on the basis of a synthesized image through the use of a combination of the weighting coefficient of the shadow image and the weighting coefficient of the differential image where the latter is larger than the former, and the other is a second synthesization obtaining mode performed on the basis of a synthesized image through the use of a combination of the weighting coefficient of the shadow image and the weighting coefficient of the differential image where the latter is smaller than the former.

8. The display-and-image-pickup apparatus according to claim 7 , wherein

the predetermined parameter is illuminance of environment light, and

the switching means performs the switching process so that, in the case where the illuminance of the environment light is increasing, the first synthesization obtaining mode is switched to the second synthesization obtaining mode when the illuminance of the environment light reaches a first illuminance threshold value, and in the case where the illuminance of the environment light is decreasing, the second synthesization obtaining mode is switched to the first synthesization obtaining mode when the illuminance of the environment light reaches a second illuminance threshold value smaller than the first illuminance threshold value.

9. The display-and-image-pickup apparatus according to claim 7 , wherein

the predetermined parameter is illuminance of environment light, and

the switching means performs the switching process so that, in the case where the illuminance of the environment light is increasing, the second synthesization obtaining mode is switched to the first synthesization obtaining mode when the illuminance of the environment light reaches a first illuminance threshold value, and in the case where the illuminance of the environment light is decreasing, the first synthesization obtaining mode is switched to the second synthesization obtaining mode when the illuminance of the environment light reaches a second illuminance threshold value smaller than the first illuminance threshold value.

10. The display-and-image-pickup apparatus according to claim 7 , wherein

the predetermined parameter is illuminance of environment light, and

the switching means detects the illuminance of the environment light through the use of a moving average image of the shadow image.

11. The display-and-image-pickup apparatus according to claim 1 , wherein

the first and second threshold values are arbitrarily adjustable by a user.

12. The display-and-image-pickup apparatus according to claim 1 , wherein

the image processing means obtains information about at least one of the position, the shape and the size of each of a plurality of proximity objects placed on the display-and-image-pickup panel at the same time.

13. The display-and-image-pickup apparatus according to claim 1 , wherein

obtained information about at least one of the position, the shape and the size of the proximity object is displayed on the display-and-image-pickup panel.

14. The display-and-image-pickup apparatus according to claim 1 , wherein

the display-and-image-pickup panel includes a plurality of liquid crystal devices and a plurality of image pickup devices.

15. The display-and-image-pickup apparatus according to claim 1 , wherein

the display-and-image-pickup panel includes a plurality of display-and-image-pickup devices being allowed to perform a light-emitting operation and a light-receiving operation by time division.

16. The display-and-image-pickup apparatus according to claim 15 , wherein

the display-and-image-pickup devices are organic EL devices.

17. An object detection program, stored on a non-transitory computer readable medium, causing a computer to execute:

an image pickup step of obtaining a picked-up image of a proximity object through the use of a display-and-image-pickup panel having an image display function and an image pickup function;

an image producing step of producing a predetermined processed image on the basis of the picked-up image obtained in the image pickup step;

a detecting step of detecting information about at least one of position, shape and size of the proximity object through selectively using one of two obtaining modes on the basis of at least one of the picked-up image obtained in the image pickup step and the processed image obtained in the image producing step; and

a switching step of performing a switching process between the two obtaining modes used in the detecting step on the basis of the magnitude of a predetermined parameter so that, in the case where the parameter is increasing, one of the two obtaining modes is switched to the other obtaining mode when the parameter reaches a first threshold value, and in the case where the parameter is decreasing, the other obtaining mode is switched to the one obtaining mode when the parameter reaches a second threshold value smaller than the first threshold value.

18. A method of detecting an object comprising the steps of:

obtaining a picked-up image of a proximity object through the use of a display-and-image-pickup panel having an image display function and an image pickup function;

producing a predetermined processed image on the basis of the picked-up image;

detecting information about at least one of position, shape and size of the proximity object through selectively using one of two obtaining modes on the basis of at least one of the picked-up image and the processed image; and

performing a switching process between the two obtaining modes on the basis of the magnitude of a predetermined parameter so that, in the case where the parameter is increasing, one of the two obtaining modes is switched to the other obtaining mode when the parameter reaches a first threshold value, and in the case where the parameter is decreasing, the other obtaining mode is switched to the one obtaining mode when the parameter reaches a second threshold value smaller than the first threshold value.

19. A display-and-image-pickup apparatus comprising:

a display-and-image-pickup panel having an image display function and an image pickup function;

an image producing section producing a predetermined processed image on the basis of a picked-up image of a proximity object obtained through the use of the display-and-image-pickup panel;

an image processing section obtaining information about at least one of position, shape and size of the proximity object through selectively using one of two obtaining modes on the basis of at least one of the picked-up image and the processed image;

a switching section performing a switching process between the two obtaining modes in the image processing section on the basis of the magnitude of a predetermined parameter so that, in the case where the parameter is increasing, one of the two obtaining modes is switched to the other obtaining mode when the parameter reaches a first threshold value, and in the case where the parameter is decreasing, the other obtaining mode is switched to the one obtaining mode when the parameter reaches a second threshold value smaller than the first threshold value.