Distributed audio control method, device system, and software product

1. A multipoint audio processing method for processing audio streams originating from a plurality of audio clients, said method comprising:

second processing nodes receiving control information from a first processing node, the control information identifying how to preselect audio streams for transmitting upstream toward the first processing node for upstream mixing, each of the second processing node comprising a processor and a non-transitory computer readable medium;

each of the second processing nodes generating evaluated audio streams by analyzing packets of audio streams received by the second processing node in terms of at least one audio communication characteristic and including analysis result information of said analysis with said packets in each audio stream;

each of the second processing nodes preselecting audio streams by deciding on whether or not any evaluated audio stream is to be transmitted upstream for mixing based on said received control information and said analysis result information;

each of the second processing nodes transmitting said audio streams decided to be transmitted upstream toward the first processing node while discarding evaluated audio streams decided not to be transmitted upstream based on the control information and the analysis result information.

2. The method of claim 1 , comprising:

the first processing node receiving audio streams from the second processing nodes and generating a mixed audio stream from said received audio streams for transmission to audio clients.

3. The method of claim 1 , comprising:

the second processing nodes sending the control information on how to preselect audio streams for upstream mixing from received audio streams to third processing nodes;

each of the third processing nodes receiving audio streams from audio clients connected to the third processing node;

each of the third processing nodes generating evaluated audio streams by analyzing packets of said audio streams received from said audio clients connected to the third processing node in terms of at least one audio communication characteristic and attaching an analysis result information of said analysis to said packets in each audio stream;

each of the third processing nodes preselecting audio streams by deciding on whether or not any evaluated audio stream is to be transmitted upstream for mixing, based on said control information received from the second processing node to which the third processing node is connected and said analysis result information contained in said evaluated audio streams of the audio streams received from the audio clients connected to the third processing node; and

each of the third processing nodes transmitting said audio streams received from the audio clients connected to the third processing node decided to be transmitted upstream while discarding evaluated audio streams received from the audio clients connected to the third processing node decided not to be transmitted upstream based on the control information received from the second processing node to which the third processing node is communicatively connected and the analysis result information from the analyzing of the said audio streams received from said audio clients connected to the third processing node.

4. The method of claim 3 , comprising:

the first processing node receiving audio streams from the third processing nodes via the second processing nodes for generating the mixed audio stream for transmission to the audio clients.

5. The method of claim 3 , comprising:

each of the second processing nodes relying on analysis result information already contained in audio streams received from at least one of the third processing nodes to which the second processing node is communicatively connected for preselecting the audio streams received from the at least one third processing node to which the second processing node is connected for transmitting upstream to the first processing node.

6. The method of claim 1 , wherein said control information identifies how to preselect input audio streams includes at least one of an algorithm, parameters, and number of required streams.

7. The method of claim 6 , wherein the at least one audio communication characteristic parameter is adapted to said control information.

8. A multipoint audio processing method for processing audio streams originating from a plurality of audio clients, said method comprising:

a first processing node determining control information identifying how to preselect audio streams for transmitting upstream toward the first processing node and transmitting that control information downstream to second processing nodes, the first processing node comprising a processor and a non-transitory computer readable medium;

the first processing node transmitting the control information to the second processing nodes to facilitate the second processing nodes generating evaluated audio streams by analyzing packets of audio streams in terms of at least one audio communication characteristic and including an analysis result information of said analysis with said packets in each audio stream, preselecting audio streams by deciding on whether or not any evaluated audio stream is to be transmitted upstream for mixing based on said received control information and transmitting said audio streams decided to be transmitted upstream toward the first processing node.

9. The method of claim 8 , comprising:

the second processing nodes receiving the control information from the first processing node.

10. The method of claim 8 , comprising:

the first processing node receiving audio streams from the second processing nodes and generating a mixed audio stream from said received audio streams for transmission to the audio clients.

11. The method of claim 8 , wherein said control information identifies how to preselect input audio streams includes at least one of an algorithm, parameters, and number of required streams.

12. The method of claim 11 , wherein the at least one audio communication characteristic comprises at least one parameter adapted to said control information.

13. The method of claim 8 , comprising:

the second processing nodes receiving control information from the first processing node;

each of the second processing nodes receiving audio streams from audio clients connected to the second processing node;

each of the second processing nodes generating evaluated audio streams by analyzing packets of said audio streams received from said audio clients in terms of at least one audio communication characteristic;

each of the second processing nodes preselecting audio streams by deciding on whether or not any evaluated audio stream is to be transmitted upstream for mixing based on said received control information and said analysis result information contained in said evaluated audio streams;

each of the second processing nodes transmitting said audio streams decided to be transmitted upstream toward the first processing node while discarding evaluated audio streams decided not to be transmitted upstream based on the control information.

14. The method of claim 13 , comprising:

the second processing nodes sending the control information to third processing nodes; each of the third processing nodes receiving audio streams from audio clients connected to the third processing node;

each of the third processing nodes generating evaluated audio streams by analyzing packets of said audio streams received from said audio clients connected to the third processing node in terms of at least one audio communication characteristic;

each of the third processing nodes preselecting audio streams by deciding on whether or not any evaluated audio stream is to be transmitted upstream for mixing, based on said control information received from the second processing node to which the third processing node is connected; and

each of the third processing nodes transmitting said audio streams received from the audio clients connected to the third processing node decided to be transmitted upstream while discarding evaluated audio streams received from the audio clients connected to the third processing node decided not to be transmitted upstream based on the control information received from the second processing node to which the third processing node is communicatively connected and the analysis result information from the analyzing of the said audio streams received from said audio clients connected to the third processing node.

15. The method of claim 8 , comprising:

the second processing nodes receiving control information from the first processing node;

the second processing nodes sending the control information to third processing nodes;

each of the third processing nodes receiving audio streams from audio clients connected to the third processing node;

each of the third processing nodes generating evaluated audio streams by analyzing packets of said audio streams received from said audio clients connected to the third processing node in terms of at least one audio communication characteristic and attaching an analysis result information of said analysis to said packets in each audio stream;

each of the third processing nodes preselecting audio streams by deciding on whether or not any evaluated audio stream is to be transmitted upstream for mixing, based on said control information received from the second processing node to which the third processing node is connected and said analysis result information contained in said evaluated audio streams of the audio streams received from the audio clients connected to the third processing node; and

each of the third processing nodes transmitting said audio streams received from the audio clients connected to the third processing node decided to be transmitted upstream while discarding evaluated audio streams received from the audio clients connected to the third processing node decided not to be transmitted upstream based on the control information received from the second processing node to which the third processing node is communicatively connected and the analysis result information from the analyzing of the said audio streams received from said audio clients connected to the third processing node.

16. A communication apparatus comprising:

a first processing node having a processor and a non-transitory computer readable medium;

said first processing node configured to generate a mixed audio stream from received audio streams;

said first processing node also configured to send control information on how to preselect input audio streams for transmitting upstream toward the first processing node to respective inferior nodes to which the first processing node is communicatively connectable and is also configured to receive audio streams from any of the respective inferior nodes to generate the mixed audio stream for transmission to audio clients; and

the respective inferior nodes, each of the respective inferior nodes configured to receive the audio streams, analyze packets of said received audio streams in terms of at least one audio communication characteristic, to include analysis result information of said analysis with said packets, and to utilize an analyzed audio stream containing said packets including said analysis result information to preselect audio streams received from the audio clients for transmitting toward the first processing node.

17. The communication apparatus of claim 16 , wherein the analysis result information is utilized to preselect the received audio streams for transmitting toward the first processing node such that some of the received audio streams are not sent toward the first processing node.

18. The communication apparatus of claim 16 ,

wherein each of the respective inferior nodes is configured to send said control information toward any further inferior nodes to which it is communicatively connected;

and wherein the communication apparatus is a network.

19. The communication apparatus of claim 16 , wherein said control information identifies how to preselect input audio streams and includes at least one of an algorithm, parameters, and a number of required streams.