Automatic audio priority designation during conference
View Patent ↗During a conference, a multipoint control unit (MCU) designates priority and non-priority endpoints. The MCU forms priority audio from the priority endpoint and sends that audio to the other endpoints at a normal level. However, the MCU forms non-priority audio from the non-priority endpoint and handles that audio based on whether the input audio from the priority endpoint is from speaking or not. If the priority endpoint's audio indicates a participant at that endpoint is speaking, then the MCU sends the non-priority audio to the other endpoints at a reduced level. Designation of which endpoint has priority can be based on which endpoint has a current duration of audio indicative of speech that is longer than other endpoints. Alternatively, the designation can be based on which endpoint is currently presenting content during the conference or based on a mix of speech audio and content presentation.
1. A conferencing method, comprising:
designating endpoints in a conference as at least one priority endpoint and as one or more non-priority endpoints at a control unit;
generating priority output audio at the control unit using priority input audio from the at least one priority endpoint;
sending the priority output audio for the conference from the control unit;
generating non-priority output audio at the control unit using non-priority input audio from the one or more non-priority endpoints;
determining at the control unit whether the priority input audio is indicative of speech; and
sending the non-priority output audio for the conference from the control unit, the non-priority output sent at a controlled level when the priority input audio is indicative of speech.
2. The method of claim 1 , wherein the conference is an audio conference, a video conference, or a mixed audio and video conference.
3. The method of claim 1 , wherein designating the priority and non-priority endpoints is initially performed when reserving the conference, starting the conference, or connecting one of the endpoints to the control unit.
4. The method of claim 1 , wherein designating the priority and non-priority endpoints is performed repeatedly during the conference.
5. The method of claim 1 , further comprising:
determining at the control unit when the priority input audio is not indicative of speech whether the non-priority input audio from one of the non-priority endpoints is indicative of speech; and
changing the priority designation based on the determination.
6. The method of claim 1 , wherein generating the priority input audio comprises reducing noise from the priority input audio.
7. The method of claim 1 , wherein determining whether the priority input audio is indicative of speech comprises processing the priority input audio and comparing the processed audio to parameters indicative of speech.
8. The method of claim 1 , wherein sending the priority output audio comprises combining the priority and non-priority output audio together as conference audio, wherein the priority output audio is at an unreduced level in the conference audio.
9. The method of claim 1 , wherein sending the non-priority output audio comprises combining the priority and non-priority output audio together as conference audio, wherein the non-priority output audio is at the controlled audio level in the conference audio.
10. The method of claim 1 , wherein designating the priority and non-priority endpoints comprises:
determining at the control unit whether at least one of the endpoints is presenting content during conference;
designating the at least one endpoint presenting content as the at least one priority endpoint.
11. The method of claim 10 , further comprising:
determining at the control unit whether the input audio from one of the other endpoints is indicative of speech; and
changing the priority designation from the endpoint presenting content to the endpoint having the input audio indicative of speech.
12. The method of claim 1 , further comprising sending the non-priority output audio for the conference from the control unit at an unreduced audio level when the priority input audio is not indicative of speech.
13. The method of claim 1 , wherein determining whether the priority input audio is indicative of speech comprises determining at the control unit whether the input audio from two or more of the endpoints is indicative of speech.
14. The method of claim 13 , further comprising sending the priority and non-priority output audio at controlled audio levels when the input audio from the two or more of the endpoints is indicative of speech.
15. The method of claim 13 , further comprising:
determining which of the two or more endpoints has a longer duration of the input audio indicative of speech; and
designating the endpoint with the longer duration as the priority endpoint.
16. The method of claim 15 , wherein determining the longer duration comprises:
comparing the input audio from the two or more endpoints relative to one another or to one or more threshold; and
maintaining or changing the priority designation based on the comparison.
17. A programmable storage device having programmed instructions stored thereon for causing a programmable control device to perform a conferencing method comprising:
designating endpoints in a conference as at least one priority endpoint and as one or more non-priority endpoints at a control unit;
generating priority output audio at the control unit using priority input audio from the at least one priority endpoint;
sending the priority output audio for the conference from the control unit;
generating non-priority output audio at the control unit using non-priority input audio from the one or more non-priority endpoints;
determining at the control unit whether the priority input audio is indicative of speech; and
sending the non-priority output audio for the conference from the control unit, the non-priority output sent at a controlled level when the priority input audio is indicative of speech.
18. A conferencing control unit, comprising:
at least one network interface in communication with a plurality of endpoints during a conference via at least one network;
an audio interface in communication with the at least one network interface and handling input and output audio for the conference; and
a processing unit in communication with the audio interface and determining at least one of the endpoints as having priority, the processing unit sending first audio of the at least one priority endpoint for the conference with the audio interface, the processing unit determining whether input audio from the priority endpoint is indicative of speech, the processing unit sending second audio of the one or more non-priority endpoints for the conference with the audio interface, the second audio being sent at a controlled level based on the determination.
19. The control unit of claim 18 , wherein the conference is an audio conference, a video conference, or a mixed audio and video conference.
20. The control unit of claim 18 , wherein the processing unit allocates resources of the audio interface based on the priority designation.
21. The control unit of claim 18 , wherein the processing unit initially determines the priority endpoint when the conference is reserved, when the conference is started, or when one of the endpoints connects to the control unit.
22. The control unit of claim 18 , wherein the processing unit determines the priority endpoint repeatedly during the conference.
23. The control unit of claim 21 , wherein the processing unit changes the priority designation if the input audio from the priority endpoint is not indicative of speech and input audio from one of the non-priority endpoints is indicative of speech.
24. The control unit of claim 18 , wherein to determine the priority endpoint, the processing unit determines whether at least one of the endpoints is presenting content during conference and designates that endpoint as having priority.
25. The device of claim 17 , wherein the conference is an audio conference, a video conference, or a mixed audio and video conference.
26. The device of claim 17 , wherein designating the priority and non-priority endpoints is initially performed when reserving the conference, starting the conference, or connecting one of the endpoints to the control unit.
27. The device of claim 17 , wherein designating the priority and non-priority endpoints is performed repeatedly during the conference.
28. The device of claim 17 , further comprising:
determining at the control unit when the priority input audio is not indicative of speech whether the non-priority input audio from one of the non-priority endpoints is indicative of speech; and
changing the priority designation based on the determination.
29. The device of claim 17 , wherein generating the priority input audio comprises reducing noise from the priority input audio.
30. The device of claim 17 , wherein determining whether the priority input audio is indicative of speech comprises processing the priority input audio and comparing the processed audio to parameters indicative of speech.
31. The device of claim 17 , wherein sending the priority output audio comprises combining the priority and non-priority output audio together as conference audio, wherein the priority output audio is at an unreduced level in the conference audio.
32. The device of claim 17 , wherein sending the non-priority output audio comprises combining the priority and non-priority output audio together as conference audio, wherein the non-priority output audio is at the controlled audio level in the conference audio.
33. The device of claim 17 , wherein designating the priority and non-priority endpoints comprises:
determining at the control unit whether at least one of the endpoints is presenting content during conference;
designating the at least one endpoint presenting content as the at least one priority endpoint.
34. The device of claim 33 , further comprising:
determining at the control unit whether the input audio from one of the other endpoints is indicative of speech; and
changing the priority designation from the endpoint presenting content to the endpoint having the input audio indicative of speech.
35. The device of claim 17 , further comprising sending the non-priority output audio for the conference from the control unit at an unreduced audio level when the priority input audio is not indicative of speech.
36. The device of claim 17 , wherein determining whether the priority input audio is indicative of speech comprises determining at the control unit whether the input audio from two or more of the endpoints is indicative of speech.
37. The device of claim 36 , further comprising sending the priority and non-priority output audio at controlled audio levels when the input audio from the two or more of the endpoints is indicative of speech.
38. The device of claim 36 , further comprising:
determining which of the two or more endpoints has a longer duration of the input audio indicative of speech; and
designating the endpoint with the longer duration as the priority endpoint.
39. The device of claim 38 , wherein determining the longer duration comprises:
comparing the input audio from the two or more endpoints relative to one another or to one or more threshold; and
maintaining or changing the priority designation based on the comparison.