Immersive collaboration of remote participants via media displays
An immersive digital experience for video conferencing simulates common presence of a virtual participant in a local environment. Such simulation may include (i) using a transparent media display having a portion of its pixels projecting the virtual participant's body image while keeping at least a portion of the background transparent (e.g., to visible light), (ii) disposing sensor(s) (e.g., camera) behind the transparent media display at the gaze of the participant, and/or (iii) using added virtual overlays (e.g., of plants, memorabilia, and/or furniture) to the virtual image (e.g., that are consistent with the local environment), e.g., to provide a sense of depth ranging from the overlays to the virtual participant projection and to the background showing through the transparent media display.
1 . An apparatus for digital collaboration, the apparatus comprising:
a digital collaboration unit having a media display disposed within a first location; and
one or more controllers comprising circuitry;
wherein:
the media display comprises an electrochromic display that is at least partially transparent to visible light;
the one or more controllers are configured to display, on the media display, a media stream received from a remote processor, the media stream including a depiction of a remotely located remote user, to redact a background portion of the media stream from being displayed on the media display, the redacted portion comprising a region around the depiction of the remote user, and to enable a local user to view, through the redacted portion, at least a portion of the first location behind the media display; and
the one or more controllers are further configured to display, within the redacted portion, a virtual overlay based on the first location, the virtual overlay comprising a depiction of an object, and wherein the depiction of the object appears continuous with a physical object at the first location.
2 . The apparatus for digital collaboration of claim 1 wherein the one or more controllers are further configured to adjust a transparency of the electrochromic display based, at least in part, on an element selected from the group consisting of: a position of a sun, a weather condition, images displayed on the media display, and a reading from one or more sensors.
3 . The apparatus for digital collaboration of claim 1 wherein the electrochromic display comprises a camera configured for capturing an image of the local user.
4 . The apparatus for digital collaboration of claim 3 wherein the camera is configured for a focus that is greater than the distance between the camera and the electrochromic display to avoid capturing images displayed on the media display.
5 . The apparatus for digital collaboration of claim 1 wherein the electrochromic display comprises a wireless charger.
6 . The apparatus of claim 1 , wherein a position of the depiction of the remotely located remote user is based on the depiction of the object.
7 . A method for digital collaboration, the method comprising:
receiving a media stream, the media stream including a depiction of a remote user;
redacting a background portion of the media stream, the redacted portion comprising a region around the depiction of the remote user;
rendering a portion of an electrochromic display transparent, the transparent portion corresponding to at least a portion of the redacted portion of the media stream;
displaying, on the electrochromic display, the redacted media stream;
enabling a local user to view, through the transparent portion of the electrochromic display, at least a portion of a first location behind the electrochromic display; and
displaying, within the redacted portion, a virtual overlay based on the first location, the virtual overlay comprising a depiction of an object, and wherein the depiction of the object appears continuous with a physical object at the first location.
8 . The method for digital collaboration of claim 7 further comprising displaying on the electrochromic display, within the redacted portion, a virtual overlay based on the first location.
9 . The method for digital collaboration of claim 7 further comprising adjusting a transparency of the electrochromic display based, at least in part, on an element selected from the group consisting of: a position of a sun, a weather condition, images displayed on the media display, and a reading from one or more sensors.
10 . The method for digital collaboration of claim 7 further comprising capturing an image of the local user with a camera built into the electrochromic display.
11 . The method for digital collaboration of claim 10 further comprising setting the camera with a focus that is greater than the distance between the camera and the electrochromic display to avoid capturing images displayed on the electrochromic display.