Television communication system, terminal, and method
View Patent ↗When a material sharing mode using a projector at a first point and the projector at a second point is active, the projector at the first point causes a projection unit to project a video image from a first personal computer onto a projection screen, causes an image taking unit to take an image of the projected video image on the projection screen, causes a control unit of the projector or the first personal computer to compare the taken video image with a supply video image supplied from the first personal computer to the projector, and supplies a difference video image generated based on the comparison to the projector at the second point so as to be superimposed on the supply video image.
1. A television communication terminal participating in a video conference at a first site with a device at a second site, the television communication terminal comprising:
an imaging device;
a mode selector that switches a mode between a conference mode and a material sharing mode;
a receiver that receives a video image from a device at the second site;
a material data inputter through which material data used in the material sharing mode is input;
a projector that is positioned at the first site and is spaced from a projection screen;
a detector that detects a pointing object; and
a transmitter,
wherein, in the material sharing mode,
the projector projects the material data input through the material data inputter onto the projection screen;
the imaging device takes an image of an area including the projection screen;
the detector detects the pointing object that is located in the space between the projection screen and the imaging device, from a modified image generated by modifying the image of the area including the projection screen taken by the imaging device; and
the transmitter transmits the material data input through the material data inputter and a detection result of the detector, to the device at the second site, but does not transmit the image of the area including the projection screen taken by the imaging device;
wherein, in the conference mode,
the projector projects the video image received from the device at the second site through the receiver onto the projection screen;
the imaging device takes a video image of at least one participant in the video conference; and
the transmitter transmits the video image taken by the imaging device to the device at the second site, but does not transmit the detection result of the detector, wherein the detector generates the modified image by clipping a part of the image of the area including the projection screen taken by the imaging device.
2. The television communication terminal according to claim 1 , wherein
the detector compares the modified image generated by modifying the image of the area including the projection screen taken by the imaging device with the material data input through the material data inputter, to detect the pointing object located in the space between the projection screen and the imaging device.
3. The television communication terminal according to claim 2 , wherein
the detector obtains location information of the pointing object with respect to the projection screen, and
the transmitter transmits the location information of the pointing object detected by the detector.
4. The television communication terminal according to claim 2 , wherein
the detector obtains location information of the pointing object with respect to the projection screen, and
the transmitter combines the material data with a graphic symbol at a location corresponding to the location information detected by the detector and transmits the combined material data and graphic symbol.
5. The television communication terminal according to claim 2 , wherein
the transmitter combines the material data with an object image extracted from the modified image generated by modifying the image of the area including the projection screen taken by the imaging device, the object image including an area corresponding to the pointing object detected by the detector, and transmits the combined material data and object image.
6. The television communication terminal according to claim 2 , wherein the detector detects a difference between the modified image generated by modifying the image of the area including the projection screen taken by the imaging device and the material data input through the material data inputter, to detect the pointing object located in the space between the projection screen and the imaging device.
7. The television communication terminal according to claim 1 , wherein
the detector detects the pointing object by detecting a shape of the pointing object learned beforehand, from the modified image generated by modifying the image of the area including the projection screen taken by the imaging device.
8. The television communication terminal according to claim 1 , wherein
the imaging device is a ranging-enabled stereo camera capable of measuring a distance to a target, and generating ranging data, and
the detector detects the pointing object by using the ranging data obtained by taking the image of the area including the projection screen by the imaging device.
9. A television communication system using the television communication terminal according to claim 1 .
10. The television communication terminal according to claim 1 , wherein, the projector and the imaging device are integrated in the television communication terminal, and the projection screen is provided separately from the television communication terminal.
11. The television communication terminal according to claim 1 , wherein the detector extracts the pointing object from the modified image generated by modifying the image of the area including the projection screen taken by the imaging device.
12. The television communication terminal according to claim 1 , further comprising a first memory and a second memory, wherein, in the material sharing mode,
the first memory stores one frame of the material data projected on the screen, from the material data input through the material data inputter,
the second memory stores the image of the area including the projection screen taken by the imaging device, when the one frame of the material data stored in the first memory is projected on the projection screen, and
the detector compares the one frame of the material data stored in the first memory and the modified image generated by modifying the image of the area including the projection screen stored in the second memory.
13. The television communication terminal according to claim 1 , wherein the detector generates the modified image by changing an orientation of the image of the area including the projection screen taken by the imaging device.
14. The television communication terminal according to claim 1 , wherein the detector clips the part of the image having a brightness more than a predetermined value.
15. The television communication terminal according to claim 1 , wherein the detector generates the modified image by correcting a distortion of the image of the area including the projection screen taken by the imaging device.
16. The television communication terminal according to claim 1 , wherein the mode selector switches the mode between the conference mode, in which the imaging device is directed toward the at least one participant in the video conference, and the material sharing mode, in which the imaging device is directed to the projection screen.