Image display system, method for controlling image display system, image distribution system and head-mounted display
A game system 100 to which an image display system is applied contains a head-mounted display 300 having a camera for capturing a real world and a display for displaying video information obtained by integrating real-world video information captured by the capturing part with virtual-world video information, a motion sensor 400 for detecting movement of a body of a wearer wearing the head-mounted display 300 as movement information and a marker 200 used for detecting position information of the wearer. The game system 100 controls the virtual-world video information based on the movement information and the position information. According to this configuration, it is possible to control the video information displayed on the head-mounted display according to the position and the movement of the wearer. Further, the present invention provides a method for controlling the image display system, an image distribution system and a head-mounted display.
1. An image display system, comprising:
a head-mounted display having a capturing part for obtaining first real-world video information by capturing a real world and an image display part for displaying first video obtained by integrating the first real-world video information captured by the capturing part with first virtual-world video information;
a movement information detecting part for detecting movement of a body of a wearer wearing the head-mounted display as movement information;
a position information detecting part for detecting position information of the wearer;
a capturing device which is fixedly arranged outside a predetermined field in which the wearer can experience an augmented reality provided by the image display system and configured to capture the predetermined field in which the wearer exists to obtain second real-world video information; and
an image display device for displaying second video obtained by integrating the second real-world video information obtained by the capturing device with second virtual-world video information obtained by viewing the first virtual-world video information from a viewpoint of the capturing device which is different from a viewpoint of the wearer,
wherein the image display system is configured to control the first virtual-world video information and the second virtual-world video information based on the movement information and the position information, and
wherein the position information detecting part obtains the position information of the wearer by performing image recognition of a marker arranged in a space using the capturing part of the head-mounted display, allows a virtual object corresponding to the wearer to follow the wearer based on the obtained position information and uses the virtual object to perform determination for collision with the wearer, and
the second video displayed on the image display device is different from the first video displayed on the image display part of the head-mounted display.
2. The image display system as claimed in claim 1 , wherein the position information detecting part can obtain three-dimensional position information of the wearer.
3. The image display system as claimed in claim 1 , wherein the movement information detecting part has a motion sensor to be worn by the wearer.
4. The image display system as claimed in claim 3 , wherein the motion sensor is worn on an arm of the wearer.
5. The image display system as claimed in claim 1 , wherein the head-mounted display has a mobile terminal including the capturing part and the image display part and a frame which is worn on a head of the wearer and to which the mobile terminal is detachably attached.
6. A method for controlling an image display system, the image display system containing a head-mounted display having a capturing part for obtaining first real-world video information by capturing a real world and an image display part for displaying first video obtained by integrating the first real-world video information captured by the capturing part with first virtual-world video information, a movement information detecting part for detecting movement of a body of a wearer wearing the head-mounted display as movement information, a position information detecting part for detecting position information of the wearer, a capturing device which is fixedly arranged outside a predetermined field in which the wearer can experience an augmented reality provided by the image display system and configured to capture the predetermined field in which the wearer exists to obtain second real-world video information and an image display device for displaying second video, wherein
the image display system allows the image display device to display the second video obtained by integrating second real-world video information obtained by the capturing device with second virtual-world video information obtained by viewing the first virtual-world video information from a viewpoint of the capturing device which is different from a viewpoint of the wearer,
the image display system configured to control the first virtual-world video information and the second virtual-world video information based on the movement information,
the position information detecting part obtains the position information of the wearer by performing image recognition of a marker arranged in a space using the capturing part of the head-mounted display, allows a virtual object corresponding to the wearer to follow the wearer based on the obtained position information and uses the virtual object to perform determination for collision with the wearer, and
the second video displayed on the image display device is different from the first video displayed on the image display part of the head-mounted display.
7. An image distribution system using an image display system, the image display system containing:
a head-mounted display having a capturing part for obtaining first real-world video information by capturing a real world and an image display part for displaying first video obtained by integrating the first real-world video information captured by the capturing part with first virtual-world video information;
a movement information detecting part for detecting movement of a body of a wearer wearing the head-mounted display as movement information;
a position information detecting part for detecting position information of the wearer; and
a capturing device which is fixedly arranged outside a predetermined field in which the wearer can experience an augmented reality provided by the image display system and configured to capture the predetermined field in which the wearer exists to obtain second real-world video information, and
wherein the image distribution system distributes second video obtained by integrating the second real-world video information obtained by the capturing device with second virtual-world video information obtained by viewing the first virtual-world video information from a viewpoint of the capturing device which is different from a viewpoint of the wearer,
the image display system is configured to control the first virtual-world video information and the second virtual-world video information based on the movement information and the position information,
the position information detecting part obtains the position information of the wearer by performing image recognition of a marker arranged in a space using the capturing part of the head-mounted display, allows a virtual object corresponding to the wearer to follow the wearer based on the obtained position information and uses the virtual object to perform determination for collision with the wearer, and
the distributed second video is different from the first video displayed on the image display part of the head-mounted display.