Client devices, server, and methods
A method of receiving a live videoconference stream from a server is provided. The live videoconference stream comprises a plurality of participants each receiving the live videoconference stream using a client device. The method comprises receiving, by a client device of a first participant of the plurality of participants via the server, a foreground image from the client devices of at least some of the other participants, and outputting for display, by the client device of the first participant, the foreground images from the at least some of the other participants overlaid on a common background image in accordance with a position mapping received from a client device of an organiser of the live videoconference stream via the server. The position mapping is for distribution via the server to the client devices of all of the plurality of participants.
1. A method of receiving a live videoconference stream from a server, the live videoconference stream involving a plurality of participants each receiving the live videoconference stream using a client device, the method comprising
receiving, by a client device of a first participant of the plurality of participants via the server, a foreground image from the client devices of at least some of the other participants, and
outputting for display, by the client device of the first participant, the foreground images from the at least some of the other participants overlaid on a common background image in accordance with a position mapping received from a client device of an organiser of the live videoconference stream via the server, wherein the position mapping is for distribution via the server to the client devices of all of the plurality of participants; and
wherein the position mapping is a tile mapping, the tile mapping defining an association between each of the foreground images and a different one of a plurality of tiles of the background image.
2. The method according to claim 1 , wherein the background image is selected by the videoconference organiser and is received by the client device of the first participant from the videoconference organiser via the server.
3. The method according to claim 1 , wherein one or more of the foreground images are live video streams.
4. The method according to claim 1 , comprising transmitting, by the client device of the first participant to the server for transmission by the server to the client devices of each of the plurality of other participants, a foreground image of the first participant.
5. The method according to claim 1 , comprising selecting, by the first participant, the first tile from among those of the plurality of tiles which have not already been selected by others of the plurality of participants.
6. The method according to claim 1 , wherein each tile of the background image is received from one of the other participants via the server as a composite image comprising each tile of the background image and the foreground image to which it is mapped.
7. The method according to claim 6 , comprising transmitting, by the client device of the first participant to the server for transmission by the server to each of the plurality of other participants, a first tile of the background image, the first tile of the background image being mapped to the foreground image of the first participant.
8. The method according to claim 7 , comprising transmitting, by the client device of the first participant to the server for transmission by the server to each of the plurality of other participants, the foreground image of the first participant and the first tile of the background image together as a composite image.
9. The method according to claim 6 , wherein the transmitting the foreground image of the first participant comprises
capturing, by the client device of the first participant, a still image or a live video stream of the first participant,
segmenting, by the client device of the first participant, a portion of the still image or the live video stream from a background of the still image or the live video stream, the portion being the foreground image of the first participant, and
transmitting, by the client device of the first participant to the server for transmission by the server to each of the plurality of other participants, the segmented portion of the still image or the live video stream as the foreground image of the first participant.
10. The method according to claim 6 , wherein the transmitting the foreground image of the first participant comprises
capturing, by the client device of the first participant, a still image or a live video stream of the first participant, and
transmitting, by the client device of the first participant to the server for segmentation of a portion of the still image or the live video stream from a background of the still image or the live video stream, the portion being the foreground image of the first participant and being for subsequent transmission by the server to each of the plurality of other participants.
11. The method according to claim 1 , wherein an indication of a number of the tiles and/or an indication of a position of each of the tiles into which the background image is segmented are received by the client device of the first participant from the organiser of the live videoconference stream via the server.
12. The method according to claim 11 , wherein the position of the tiles mapped to the foreground images of one or more of the plurality of participants who are designated as key speakers of the videoconference is substantially at the centre of the background image.
13. The method according to claim 11 , wherein the position of the tiles mapped to the foreground images of two or more of the plurality of participants who are designated as key speakers of the videoconference are positioned in a cluster on the background image.
14. The method according to claim 11 , wherein the plurality of participants comprises one or more groups of two or more of the plurality of participants, and wherein the tiles mapped to the foreground images of participants forming part of the same group are positioned in a cluster on the background image.
15. The method according to claim 11 , wherein one or both of the number of the tiles and the position of each of the tiles is dynamically changeable by the organiser of the live videoconference stream during the live videoconference stream.
16. The method according to claim 5 , wherein the tiles are non-uniformly sized.
17. A first client device configured to receive a live videoconference stream from a server, the live videoconference stream involving a plurality of participants each receiving the live videoconference stream using a client device, the first client device being a client device of a first of the plurality of participants and comprising
memory comprising computer-readable instructions,
an interface configured to output signals for display, and
a processor configured, in accordance with the instructions stored in the memory,
to receive a foreground image from at least some of the other participants via the server, and
to output for display the foreground images from the at least some of the other participants overlaid on a common background image in accordance with a position mapping received from a client device of an organiser of the live videoconference stream via the server, wherein the position mapping is for distribution via the server to the client devices all of the plurality of participants; and
wherein the position mapping is a tile mapping, the tile mapping defining an association between each of the foreground images and a different one of a plurality of tiles of the background image.
18. A non-transitory computer readable medium storing computer code that, when executed by a computer, cause the computer to perform the method according to claim 1 .
19. A method of operating a server for hosting a live videoconference stream involving a plurality of participants, the live videoconference stream being receivable by client devices of each of the plurality of participants from the server, the method comprising
receiving a foreground image from the client devices of at least some of the plurality of participants, and
receiving a position mapping of the live videoconference stream from a client device of an organiser of the live videoconference stream, the position mapping being for distribution to the client devices of all of the plurality of participants, defining an association between a foreground image of each of the at least some of the plurality of participants and a position on a common background image of the live videoconference stream and the position mapping being a tile mapping, the tile mapping defining an association between each of the foreground images and a different one of a plurality of tiles of the background image,
transmitting, to the client devices by circuitry each of the plurality of participants, the foreground image of the at least some of the plurality of participants for presentation by the client devices of each of the plurality of participants overlaid on the common background image in accordance with the position mapping.