Immersive telepresence anywhere
View Patent ↗A portable immersive telepresence conferencing system which can capture audio data and video data and communicate at least some of the captured data to at least one remote endpoint via a network interface, receive image data and audio data from at least one remote source via the network interface and render a depiction of at least one object, which is substantially the same size of the actual object being shown.
1. A non-transitory computer readable storage medium storing instructions executable by at least one processor, the instructions comprising instructions to:
receive, at a first device at a communication endpoint, audio data and image data from a conferencing peripheral device at the communication endpoint, the audio data and the image data associated with a remote communication endpoint; and
control communication of one or more signals, from the first device to the conferencing peripheral device, to control:
emission of audio output based on the received audio data using a speaker of the conferencing peripheral device; and
display, using a display unit of the conferencing peripheral device, of a depiction of an object represented by the imaging data, such that the size of the depiction substantially corresponds to the true size of the depicted object.
2. The non-transitory computer readable storage medium of claim 1 , wherein the display unit corresponds to a projector.
3. The non-transitory computer readable storage medium of claim 2 , wherein the projector corresponds to a pico-projector.
4. The non-transitory computer readable storage medium of claim 2 , wherein displaying the depiction of the object, such that size of the depiction substantially corresponds to the true size of the depicted object includes displaying the depiction, such that the size of the depiction corresponds to at least 50% of the true size of the depicted object.
5. The non-transitory computer readable storage medium of claim 4 , wherein the one or more signals cause the projector to:
display the depiction on a surface five to ten feet distant from the projector.
6. The non-transitory computer readable storage medium of claim 2 , wherein the instructions further comprise instructions to:
receive, at the first device, sensor data from the conferencing peripheral device, the sensor data indicating a distance from the projector to a projection surface; and
automatically scale the displayed depiction of the depicted object based on the distance.
7. The non-transitory computer readable storage medium of claim 6 , wherein the depicted object comprises a far-end conference participant at the remote communication endpoint, and wherein the depiction of the far-end conference participant forms an angle with the projector, and the size of the angle is less than or equal to ten degrees.
8. The non-transitory computer readable storage medium of claim 7 , wherein the size of the angle is less than or equal to five degrees.
9. The non-transitory computer readable storage medium of claim 1 , wherein the first device includes a mobile communication device.
10. The non-transitory computer readable storage medium of claim 1 , wherein the first device includes a first camera and the conferencing peripheral device includes a second camera, wherein the instructions further comprise instructions to communicate instructions, from the first device to the conferencing peripheral device, to control transmission of local image data to a remote device at the remote communication endpoint, wherein the local image data is based on input from the first camera and input from the second camera.
11. A method of conducting an immersive teleconference over a network, the method comprising:
receiving, at a first device at a communication endpoint, audio data and image data from a conferencing peripheral device at the communication endpoint, the audio data and the image data associated with a remote communication endpoint; and
control communication of one or more signals, from the first device to the conferencing peripheral device, to control:
emission of audio output based on the received audio data using a speaker of the conferencing peripheral device; and
display, using a display unit of the conferencing peripheral device, of a depiction of an object represented by the imaging data, such that the size of the depiction substantially corresponds to the true size of the depicted object.
12. The method of claim 11 , wherein the display unit corresponds to a projector.
13. The method of claim 12 , wherein the projector corresponds to a pico-projector.
14. The method of claim 12 , wherein displaying, the depiction of the object, such that the size of the depiction substantially corresponds to the true size of the depicted object, comprises:
displaying the depiction of the object, such that the size of the depiction corresponds to at least 50% of the true size of the depicted object.
15. The method of claim 14 , wherein the one or more signals cause the projector to display the depiction on a surface five to ten feet distant from the projector.
16. The method of claim 12 , further comprising:
receiving, at the first device, sensor data from the conferencing peripheral device, the sensor data indicating a distance from the projector to a projection surface; and
automatically scaling the displayed depiction of the depicted object based on the distance.
17. The method of claim 16 , wherein the depicted object comprises a far-end conference participant at the remote communication endpoint, and wherein the depiction of the far-end conference participant forms an angle with the projector, and the size of the angle is less than or equal to ten degrees.
18. The method of claim 17 , wherein the size of the angle is less than or equal to five degrees.