Immersive telepresence anywhere
A conferencing peripheral for use with a mobile device or laptop or desktop computer can include one or more of projectors, cameras, microphones, and speakers. Such a device can work with the mobile device to provide a higher quality conferencing experience than has been provided to date by projecting a substantially full size, high resolution, image of conference participants onto a screen or wall and by providing microphones, speakers, and sufficient audio processing to provide high fidelity audio as part of the conferencing experience. The peripheral may be configured to use the voice and/or data network of the mobile device or may include its own internal network interface.
1. A portable immersive telepresence conferencing peripheral comprising:
a frame incorporating one or more cameras, pico projectors, speakers, and microphones, a power interface, and at least one conferencing device interface configured to operatively couple the conferencing peripheral to a portable device running conferencing software;
wherein the conferencing peripheral is controllable by the conferencing software to:
operate the one or more cameras and microphones to capture audio and video of one or more near end conference participants for communication to one or more far end conference participants via a media conference established by the conferencing software on the portable device;
operate the one or more speakers to deliver audio of one or more far end conference participants received via the media conference; and
operate the one or more pico projectors to display images of the one or more far end conference participants received via the media conference such that the one or more far end conference participants are rendered at substantially true size on a display surface located at a reasonable social distance from the one or more near end conference participants.
2. The portable immersive telepresence conferencing peripheral of claim 1 wherein the frame is a hollow, molded plastic frame, and the one or more cameras, pico projectors, speakers, and microphones are disposed within the frame.
3. The portable immersive telepresence conferencing peripheral of claim 2 wherein the frame is substantially triangular and wherein the one or more pico projectors are disposed at one or more vertices of the substantially triangular frame on one side of the frame and wherein the one or more cameras are disposed at one or more vertices of the substantially triangular frame on an opposite side of the frame.
4. The portable immersive telepresence conferencing peripheral of claim 1 wherein substantially true size is at least 50% of true size and wherein the reasonable social distance is between 5 and 10 feet.
5. The portable immersive telepresence conferencing peripheral of claim 1 further comprising one or more infra red or ultrasonic sensors operable to determine a distance from the one or more pico projectors to the display surface whereby the conferencing software can automatically scale the display of the one or more far end conference participants.
6. The portable immersive telepresence conferencing peripheral of claim 1 wherein the one or more microphones comprise a plurality of microphones operable to provide one or more functions selected from the group consisting of: beam forming, positional audio, camera framing, echo cancellation, and noise cancellation.
7. The portable immersive telepresence conferencing peripheral of claim 1 wherein the one or more speakers comprise a plurality of speakers operable to provide stereo audio corresponding to a projected location of one or more far end conference participants.
8. The portable immersive telepresence conferencing peripheral of claim 1 wherein the one or more cameras comprise a plurality of cameras and wherein the plurality of cameras are operable to image one or more items selected from the group consisting of: conference participants, documents, and exhibits.
9. The portable immersive telepresence conferencing peripheral of claim 1 wherein the one or more cameras are electronic pan-tilt-zoom cameras.
10. The portable immersive telepresence conferencing peripheral of claim 1 wherein the at least one conferencing device interface is a docking cradle for a mobile device.
11. The portable immersive telepresence conferencing peripheral of claim 1 further comprising a network interface, wherein the media conference may be established using either the network interface of the conferencing peripheral or a network interface of the portable device.
12. The portable immersive telepresence conferencing peripheral of claim 1 further comprising an adjustable stand.
13. A portable immersive telepresence conferencing peripheral comprising:
at least one pico projector;
a power interface; and
a conferencing device interface configured to operatively couple the conferencing peripheral to a portable device running conferencing software;
wherein the conferencing peripheral is controllable by the conferencing software to operate the at least one pico projector to display an image of at least one far end conference participant received via a media conference established by the portable device such that the at least one far end conference participant is rendered at least 50% of true size on a display surface.
14. The portable immersive telepresence conferencing peripheral of claim 13 wherein the conferencing peripheral includes at least one camera disposed on an opposite side of the conferencing peripheral from the at least one pico projector and wherein the conferencing peripheral is adapted to stand on a table at substantially eye level.
15. The portable immersive telepresence conferencing peripheral of claim 14 wherein the conferencing peripheral is adapted to stand on the table at substantially eye level via an adjustable folding tripod.
16. The portable immersive telepresence conferencing peripheral of claim 15 wherein legs of the adjustable folding tripod are configured to be folded against a body of the conferencing peripheral for storage.
17. The portable immersive telepresence conferencing peripheral of claim 16 wherein legs of the tripod incorporate at least one microphone or at least one speaker.
18. The portable immersive telepresence conferencing peripheral of claim 15 wherein the conferencing peripheral is configured to display the image of the at least one far end conference participant such that eyes of the at least one far end conference participant are approximately collinear with eyes of a local participant and a camera used to capture the image of the local participant.
19. The portable immersive telepresence conferencing peripheral of claim 18 wherein eye position of both the participants is determined by a face recognition algorithm applied to a local and a remote video stream.
20. The portable immersive telepresence conferencing peripheral of claim 15 further comprising at least one microphone and at least one speaker.
21. The portable immersive telepresence conferencing peripheral of claim 13 wherein the conferencing device interface is a wireless interface.
22. A portable immersive telepresence conferencing peripheral comprising:
a conferencing device interface configured to operatively couple the conferencing peripheral to a portable device running conferencing software;
a processor operatively coupled to the conferencing device interface for controlling operation of the conferencing peripheral; and
at least one pico projector operatively coupled to the processor;
wherein the pico projector is controlled by the processor to display an image of at least one far end conference participant received via a media conference established by the portable device such that the at least one far end conference participant is displayed at substantially true size on a display surface.
23. The portable immersive telepresence conferencing peripheral of claim 22 wherein the at least one pico projector comprises a plurality of projectors, each configured to display an image of at least one far end conference participant.
24. The portable immersive telepresence conferencing peripheral of claim 22 further comprising at least one camera operatively coupled to the processor to facilitate capture of images of one or more near end conference participants for communication to the at least one far end conference participant via the media conference.
25. The portable immersive telepresence conferencing peripheral of claim 24 wherein the at least one camera comprises a plurality of cameras, wherein at least one of the cameras is positioned to capture images of another near end conference participant, a document, or an exhibit.
26. The portable immersive telepresence conferencing peripheral of claim 22 further comprising at least one microphone operatively coupled to the processor to facilitate capture of audio of one or more near end conference participants for communication to the at least one far end conference participant via the media conference.
27. The portable immersive telepresence conferencing peripheral of claim 26 wherein the at least one microphone comprises a plurality of microphones operable to provide one or more functions selected from the group consisting of: beam forming, positional audio, camera framing, echo cancellation, and noise cancellation.
28. The portable immersive telepresence conferencing peripheral of claim 22 further comprising one or more speakers operatively coupled to the processor to facilitate delivery of audio of one or more far end conference participants received via the media conference.
29. The portable immersive telepresence conferencing peripheral of claim 28 wherein the one or more speakers are operable to provide stereo audio corresponding to a projected location of one or more far end conferencing participants.
30. The portable immersive telepresence conferencing peripheral of claim 22 further comprising one or more infra red or ultrasonic sensors operatively coupled to the processor to facilitate determination of a distance from the at least one pico projectors to the display surface and automatic scaling of the displayed image of the one or more far end conference participants.
31. The portable immersive telepresence conferencing peripheral of claim 22 wherein the conferencing device interface and the processor are a single system on a chip.
32. The portable immersive telepresence conferencing peripheral of claim 22 wherein the conferencing device interface is a wireless interface.
33. The portable immersive telepresence conferencing peripheral of claim 22 wherein the conferencing device interface is a dock for a mobile device.
34. The portable immersive telepresence conferencing peripheral of claim 22 further comprising a network interface for establishing another media conference independently of the portable device.