Music collaboration using virtual conferencing

1 . A method comprising:

receiving, by a client device, audio streams from a plurality of musicians in a virtual conference hosted by a virtual conference provider, each musician assigned to a virtual position within a virtual space established by the virtual conference, each audio stream corresponding to an individual musician of the plurality of musicians, the client device associated with a participant in the virtual conference, the participant having a participant virtual position within the virtual space;

receiving, by the client device from the virtual conference provider, the respective assigned virtual position for each musician and the participant virtual position within the virtual space;

determining relative virtual positions of each musician of at least a subset of the plurality of musicians in the virtual conference with respect to the participant virtual position based on the received assigned virtual positions for the musicians;

generating a plurality of spatialized audio streams based on the relative virtual positions of the respective musicians and the respective audio streams; and

outputting the spatialized audio streams.

2 . The method of claim 1 , further comprising:

selecting head-related transfer functions (“HRTF”) from a set of HRTFs based on the relative virtual positions of the musicians and the participant virtual position; and

wherein generating the plurality of spatialized audio streams is further based on the selected HRTFs.

3 . The method of claim 1 , further comprising:

generating one or more groups of musicians based on the virtual positions of the musicians;

associating each group of the one or more groups with a respective group virtual position within the virtual space; and

wherein:

determining relative virtual positions of each musician in the virtual conference with respect to the participant's head comprises determining relative group virtual positions of each group of musicians in the virtual conference based on the respective group virtual position with respect to the participant virtual position, and

generating a plurality of spatialized audio streams is further based on the relative group virtual positions.

4 . The method of claim 3 , further comprising:

selecting head-related transfer functions (“HRTF”) from a set of HRTFs based on the virtual positions of the musicians or the one or more groups and the participant virtual position; and

wherein generating the plurality of spatialized audio streams is further based on the selected HRTFs.

5 . The method of claim 1 , further comprising:

determining one or more audio effects based on the virtual space; and

wherein generating the plurality of spatialized audio streams comprises applying the one or more audio effects to the received audio streams.

6 . The method of claim 5 , wherein the virtual space comprises a concert hall, and wherein the one or more audio effects comprises a reverberation based on virtual physical characteristics of the concert hall.

7 . The method of claim 1 , wherein the participant is a first musician of the plurality of musicians.

8 . The method of claim 3 , further comprising:

receiving, from a camera connected to the client device, a video stream;

determining a pose of the participant's head in the video stream;

selecting one or more head-related transfer functions (“HRTF”) from a set of HRTFs based on the virtual positions of the musicians or the one or more groups, the participant virtual position, and the pose of the participant's head; and

wherein generating the plurality of spatialized audio streams is further based on the selected one or more HRTFs.

9 . The method of claim 1 , wherein the participant is a member of an audience of the plurality of musicians.

10 . A system comprising:

a communications interface;

a non-transitory computer-readable medium; and

one or more processors communicatively coupled to the communications interface and the non-transitory computer-readable medium, the one or more processors configured to execute processor-executable instructions stored in the non-transitory computer-readable medium to:

receive, by a client device, audio streams from a plurality of musicians in a virtual conference hosted by a virtual conference provider, each musician assigned to a virtual position within a virtual space established by the virtual conference, each audio stream corresponding to an individual musician of the plurality of musicians, the client device associated with a participant in the virtual conference, the participant having a participant virtual position within the virtual space;

receive, by the client device from the virtual conference provider, the respective assigned virtual position for each musician and the participant virtual position within the virtual space;

determine relative virtual positions of each musician of at least a subset of the plurality of musicians in the virtual conference with respect to the participant virtual position based on the received assigned virtual positions for the musicians;

generate a plurality of spatialized audio streams based on the relative virtual positions of the respective musicians and the respective audio streams; and

output the spatialized audio streams.

11 . The system of claim 10 , wherein the one or more processors are configured to execute further processor-executable instructions stored in the non-transitory computer-readable medium to:

select head-related transfer functions (“HRTF”) from a set of HRTFs based on the relative virtual positions of the musicians and the participant virtual position; and

generate the plurality of spatialized audio streams further based on the selected HRTFs.

12 . The system of claim 10 , wherein the one or more processors are configured to execute further processor-executable instructions stored in the non-transitory computer-readable medium to:

generate one or more groups of musicians based on the virtual positions of the musicians;

associate each group of the one or more groups with a respective group virtual position within the virtual space;

determine relative group virtual positions of each group of musicians in the virtual conference based on the respective group virtual position with respect to the participant virtual position; and

generate the plurality of spatialized audio streams further based on the relative group virtual positions.

13 . The system of claim 12 , wherein the one or more processors are configured to execute further processor-executable instructions stored in the non-transitory computer-readable medium to:

select head-related transfer functions (“HRTF”) from a set of HRTFs based on the virtual positions of the musicians or the one or more groups and the participant virtual position; and

generate the plurality of spatialized audio streams further based on the selected HRTFs.

14 . The system of claim 10 , wherein the one or more processors are configured to execute further processor-executable instructions stored in the non-transitory computer-readable medium to:

determine one or more audio effects based on the virtual space; and

apply the one or more audio effects to the received audio streams.

15 . The system of claim 12 , wherein the one or more processors are configured to execute further processor-executable instructions stored in the non-transitory computer-readable medium to:

receive, from a camera, a video stream;

determine a pose of the participant's head in the video stream;

select one or more head-related transfer functions (“HRTF”) from a set of HRTFs based on the virtual positions of the musicians or the one or more groups, the participant virtual position, and the pose of the participant's head; and

generate the plurality of spatialized audio streams further based on the selected one or more HRTFs.

16 . A non-transitory computer-readable medium comprising processor-executable instructions configured to cause one or more processors to:

receive, by a client device, audio streams from a plurality of musicians in a virtual conference hosted by a virtual conference provider, each musician assigned to a virtual position within a virtual space established by the virtual conference, each audio stream corresponding to an individual musician of the plurality of musicians, the client device associated with a participant in the virtual conference, the participant having a participant virtual position within the virtual space;

receive, by the client device from the virtual conference provider, the respective assigned virtual position for each musician and the participant virtual position within the virtual space;

determine relative virtual positions of each musician of at least a subset of the plurality of musicians in the virtual conference with respect to the participant virtual position based on the received assigned virtual positions for the musicians;

generate a plurality of spatialized audio streams based on the relative virtual positions of the respective musicians and the respective audio streams; and

output the spatialized audio streams.

17 . The non-transitory computer-readable medium of claim 16 , further comprising processor-executable instructions configured to cause one or more processors to:

select head-related transfer functions (“HRTF”) from a set of HRTFs based on the relative virtual positions of the musicians and the participant virtual position; and

generate the plurality of spatialized audio streams based on the selected HRTFs.

18 . The non-transitory computer-readable medium of claim 16 , further comprising processor-executable instructions configured to cause one or more processors to:

generate one or more groups of musicians based on the virtual positions of the musicians;

associate each group of the one or more groups with a respective group virtual position within the virtual space;

determine relative group virtual positions of each group of musicians in the virtual conference based on the respective group virtual position with respect to the participant virtual position; and

generate the plurality of spatialized audio streams further based on the relative group virtual positions.

19 . The non-transitory computer-readable medium of claim 18 , further comprising processor-executable instructions configured to cause one or more processors to:

select head-related transfer functions (“HRTF”) from a set of HRTFs based on the virtual positions of the musicians or the one or more groups and the participant virtual position; and

generate the plurality of spatialized audio streams further based on the selected HRTFs.

20 . The non-transitory computer-readable medium of claim 16 , further comprising processor-executable instructions configured to cause one or more processors to:

determine one or more audio effects based on the virtual space; and

apply the one or more audio effects to the received audio streams.