Spatial coordinate identification device
View Patent ↗A spatial coordinate identification device includes a detection light source that emits a detection light that scans a detection boundary plane defined in space, an optical sensor that detects a reflected light of the detection light reflected by an indicator when the indicator enters a detection region extending from the detection boundary plane to the detection light source, and a controller. The controller stores virtual touch surface defining information that defines a position of a virtual touch surface based on the detection boundary plane, and identifies, in response to the detection of the reflected light, a position of a boundary point that is an intersecting point of the indicator and the detection boundary plane, and an approach amount by which the indicator has entered the detection region.
1. A spatial coordinate identification device, comprising:
an image display panel that displays an image;
a reflective element assembled substrate that projects the displayed image in a detection region as an aerial image;
a light source that emits a detection light that scans the detection region;
an optical sensor that detects a reflected light of the detection light reflected by an indicator;
a controller that
stores virtual touch surface defining information that defines a position of a virtual touch surface to be touched by the indicator, with respect to a detection boundary plane, and
identifies a position touched on the virtual touch surface by comparing an approach amount by which the indicator has entered the detection region based on the detection of the reflected light
with a distance from a boundary point that is an intersecting point of the indicator and the detection boundary plane to the virtual touch surface defined by the virtual touch surface defining information; and
a rotating mechanism that rotates the image display panel and the optical sensor with respect to a rotational axis on a flat surface comprising the reflective element assembled substrate.
2. The spatial coordinate identification device according to claim 1 , wherein
the light source scans the detection boundary plane at a given timing using the detection light, and
when the optical sensor detects one or more detection pulses during a single scan of the detection boundary plane by the detection light, the controller identifies a position of the boundary point from the timing of a first or a last detection pulse of the detection pulses, and identifies the approach amount according to a number of detection pulses.
3. The spatial coordinate identification device according to claim 1 , wherein
the virtual touch surface defining information comprises a numerical table indicating a position for each of a plurality of points on the virtual touch surface corresponding to each of a plurality of points on the detection boundary plane, respectively.
4. The spatial coordinate identification device according to claim 1 , wherein
the virtual touch surface defining information comprises a numerical expression showing a position of a point on the virtual touch surface corresponding to any point on the detection boundary plane.
5. The spatial coordinate identification device according to claim 2 , wherein
the virtual touch surface defining information comprises a numerical table indicating a position for each of a plurality of points on the virtual touch surface corresponding to each of a plurality of points on the detection boundary plane, respectively.
6. The spatial coordinate identification device according to claim 2 , wherein
the virtual touch surface defining information comprises a numerical expression showing a position of a point on the virtual touch surface corresponding to any point on the detection boundary plane.
7. An aerial image interaction system, comprising:
an aerial image projection device comprising:
an image display panel that displays an image; and
a reflective element assembled substrate that projects the image displayed on the image display panel in a detection region as an aerial image;
a spatial coordinate identification device comprising:
a detection light source that emits a detection light that scans the detection region;
an optical sensor that detects a reflected light of the detection light reflected by an indicator; and
a controller that
stores virtual touch surface defining information that defines a position of a virtual touch surface to be touched by the indicator, with respect to a detection boundary plane, and
identifies a position touched on the virtual touch surface by comparing an approach amount by which the indicator has entered the detection region based on the detection of the reflected light
with a distance from a boundary point to the virtual touch surface defined by the virtual touch surface defining information; and
a rotating mechanism that rotates the image display panel and the optical sensor with respect to a rotational axis on a flat surface comprising the reflective element assembled substrate;
wherein the controller holds information that represents a surface shape of the aerial image as the virtual touch surface defining information.
8. An aerial image interaction system according to claim 7 , wherein
when the surface shape of the aerial image changes, the controller changes the virtual touch surface defining information to represent the surface shape of the aerial image after the change.
9. An aerial image interaction system according to claim 7 , wherein
the controller
displays a calibration icon at a given calibration point using the aerial image projection device;
identifies, when the indicator virtually touches the calibration icon, a position of a calibration boundary point defined as an intersecting point of the indicator and the detection boundary plane and a calibration amount defined as an amount by which the indicator has entered the detection region; and
corrects the virtual touch surface defining information based on the position of the calibration boundary point and the calibration amount.
10. The aerial image interaction system according to claim 9 , wherein
the rotating mechanism rotates the image display panel and the optical sensor in mutually opposing directions around the rotational axis so that the detection boundary plane comes to a position symmetrical with the image display panel in relation to the reflective element assembled substrate, and
wherein the controller
detects an approach direction of the indicator into the detection region using a difference in the position of the calibration boundary point and a position of the calibration point, and
rotates the image display panel and the optical sensor according to the detected approach direction.
11. A method for spatial coordinate identification executed in a spatial coordinate identification device, the method comprising:
displaying an image on an image display panel;
projecting, with a reflective element assembled substrate, the displayed image in a detection region as an aerial image;
emitting, with a light source, a detection light that scans the detection region;
detecting, with an optical sensor, a reflected light of the detection light reflected by an indicator;
storing virtual touch surface defining information that defines a position of a virtual touch surface to be touched by the indicator, with respect to a detection boundary plane;
identifying a position touched on the virtual touch surface by comparing an approach amount by which the indicator has entered the detection region based on the detection of the reflected light,
with a distance from a boundary point that is an intersecting point of the indicator and the detection boundary plane to the virtual touch surface defined by the virtual touch surface defining information; and
rotating, with a rotating mechanism, the image display panel and the optical sensor with respect to a rotational axis on a flat surface comprising the reflective element assembled substrate.
12. The method according to claim 11 , further comprising:
scanning, with the light source, the detection boundary plane at a given timing using the detection light, and
when the detecting detects one or more detection pulses during a single scan of the detection boundary plane by the detection light, identifying a position of the boundary point from the timing of a first or a last detection pulse of the detection pulses, and identifying the approach amount according to a number of detection pulses.
13. The method according to claim 11 , wherein
the virtual touch surface defining information comprises a numerical table indicating a position for each of a plurality of points on the virtual touch surface corresponding to each of a plurality of points on the detection boundary plane, respectively.
14. The method according to claim 11 , wherein
the virtual touch surface defining information comprises a numerical expression showing a position of a point on the virtual touch surface corresponding to any point on the detection boundary plane.
15. The method according to claim 12 , wherein
the virtual touch surface defining information comprises a numerical table indicating a position for each of a plurality of points on the virtual touch surface corresponding to each of a plurality of points on the detection boundary plane, respectively.
16. The method according to claim 12 , wherein
the virtual touch surface defining information comprises a numerical expression showing a position of a point on the virtual touch surface corresponding to any point on the detection boundary plane.