IP Library › Granted Patent US 10,771,272
Granted Patent B1
US 10,771,272 · App. 16/672,265 · Granted Sep 8, 2020

Throttling and prioritization for multichannel audio and/or multiple data streams for conferencing

Inventors: Arash Ghanaie-Sichanie (Woodinville, WA); Sriram Srinivasan (Redmond, WA); Wei Xiong (Seattle, WA); Bin Wang (Seattle, WA)
Assignee: Microsoft Technology Licensing, LLC
H04L12/1827H04L12/1818H04L12/1831H04W28/16H04W28/18H04W28/20H04W28/24
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,771,272
App. No.
16/672,265
Granted
Sep 8, 2020
Kind
B1
Abstract

Techniques for conducting a communication session include receiving, from a first device and in connection with a communication session, an indication of a bandwidth limitation on transferring data associated with the communication session, the first device being configured to generate a plurality of data streams associated with the communication session and to transmit the plurality of data streams to a second device; dynamically determining one or more operating parameters of the first device to reduce the amount of bandwidth required to transmit the plurality of data streams by eliminating one or more data streams, reducing an amount of bandwidth required by one or more data streams, or both based on bandwidth reduction criteria determined by the first device, the second device, or both; and directing the first device to transmit the plurality of data streams to the second device according to the one or more operating parameters.

Claims (54)

1. A data processing system comprising:

a processor; and

a computer-readable medium storing executable instructions for causing the processor to perform operations comprising:

receiving, from a first device and in connection with a communication session, an indication of a bandwidth limitation on transferring data associated with the communication session, the first device being configured to generate a plurality of data streams associated with the communication session and to transmit the plurality of data streams to a second device;

dynamically determining one or more operating parameters of the first device to reduce the amount of bandwidth required to transmit the plurality of data streams by eliminating one or more data streams, reducing an amount of bandwidth required by one or more data streams, or both based on bandwidth reduction criteria determined by the first device, the second device, or both; and

directing the first device to transmit the plurality of data streams to the second device according to the one or more operating parameters.

2. The data processing system of claim 1 , wherein to dynamically determine one or more operating parameters of the first device, the computer-readable medium further stores executable instructions for causing the processor to perform operations comprising:

identifying a first subset of one or more one or more data streams of the plurality of data streams that can be generated at the second device based on a second subset of the one or more other data streams of the plurality of data streams; and

determining that transmission of the first subset of the one or more data streams to the at least one recipient device should be stopped.

3. The data processing system of claim 2 , wherein the first subset of data streams comprise a set of one or more dedicated video streams each associated with a participant or object of interest in an environment in which the communication session is being conducted; and wherein the second subset of the one or more data streams includes a data stream comprising a media stream of a panoramic view of the environment in which the communication session is being conducted.

4. The data processing system of claim 1 , wherein to dynamically determine one or more operating parameters of the first device, the computer-readable medium further stores executable instructions for causing the processor to perform operations comprising:

identifying a first subset of one or more one or more data streams of the plurality of data streams that can be obtained from at least one other first device located in an environment in which the communication session is being conducted; and

determining that transmission of the first subset of the one or more data streams to the at least one recipient device should be stopped.

5. The data processing system of claim 1 , wherein to dynamically determine one or more operating parameters of the first device, the computer-readable medium further stores executable instructions for causing the processor to perform operations comprising:

identifying a first subset of one or more one or more data streams of the plurality of data streams for which a reduction in a bit rate, a reduction in a sample rate, or a reduction in a frame rate of one or more of the plurality of data streams that would not result in a reduction in meeting audio quality; and

reducing the bit rate, the sample rate, or the frame rate of the first subset of one or more data streams.

6. The data processing system of claim 1 , wherein to dynamically determine one or more operating parameters of the first device, the computer-readable medium further stores executable instructions for causing the processor to perform operations comprising:

reducing a number of audio channels transmitted from the first device to reduce bandwidth requirements without reducing a meeting audio quality, wherein each audio channel comprises a separate one of the plurality of data streams.

7. The data processing system of claim 6 , wherein to reduce the number of audio channels transmitted, the computer-readable medium further stores executable instructions for causing the processor to perform operations comprising:

eliminating at least one data stream associated with a transcription service, at least one data stream associated with a virtual assistant, or both to reduce the bandwidth requirements without reducing meeting audio quality.

8. A method executed by a data processing system for conducting a communication session, the method comprising:

receiving, from a first device and in connection with a communication session, an indication of a bandwidth limitation on transferring data associated with the communication session, the first device being configured to generate a plurality of data streams associated with the communication session and to transmit the plurality of data streams to a second device;

dynamically determining via a processor one or more operating parameters of the first device to reduce the amount of bandwidth required to transmit the plurality of data streams by eliminating one or more data streams, reducing an amount of bandwidth required by one or more data streams, or both based on bandwidth reduction criteria determined by the first device, the second device, or both; and

directing via the processor the first device to transmit the plurality of data streams to the second device according to the one or more operating parameters.

9. The method of claim 8 , wherein dynamically determining one or more operating parameters of the first device further comprises:

identifying a first subset of one or more one or more data streams of the plurality of data streams that can be generated at the second device based on a second subset of the one or more other data streams of the plurality of data streams; and

determining that transmission of the first subset of the one or more data streams to the at least one recipient device should be stopped.

10. The method of claim 9 , wherein the first subset of data streams comprise a set of one or more dedicated video streams each associated with a participant or object of interest in an environment in which the communication session is being conducted; and wherein the second subset of the one or more data streams includes a data stream comprising a media stream of a panoramic view of the environment in which the communication session is being conducted.

11. The method of claim 8 , wherein dynamically determining one or more operating parameters of the first device further comprises:

identifying a first subset of one or more one or more data streams of the plurality of data streams that can be obtained from at least one other first device located in an environment in which the communication session is being conducted; and

determining that transmission of the first subset of the one or more data streams to the at least one recipient device should be stopped.

12. The method of claim 8 , wherein dynamically determining one or more operating parameters of the first device further comprises:

identifying a first subset of one or more one or more data streams of the plurality of data streams for which a reduction in a bit rate, a reduction in a sample rate, or a reduction in a frame rate of one or more of the plurality of data streams that would not result in a reduction in meeting audio quality; and

reducing the bit rate, the sample rate, or the frame rate of the first subset of one or more data streams.

13. The method of claim 8 , wherein dynamically determining one or more operating parameters of the first device further comprises:

reducing a number of audio channels transmitted from the first device to reduce bandwidth requirements without reducing a meeting audio quality, wherein each audio channel comprises a separate one of the plurality of data streams.

14. The method of claim 13 , wherein reducing the number of audio channels transmitted further comprises:

eliminating at least one data stream associated with a transcription service, at least one data stream associated with a virtual assistant, or both to reduce the bandwidth requirements without reducing meeting audio quality.

15. A memory device storing instructions that, when executed on a processor of a computing device, cause the computing device to conduct a communication session, by:

receiving, from a first device and in connection with a communication session, an indication of a bandwidth limitation on transferring data associated with the communication session, the first device being configured to generate a plurality of data streams associated with the communication session and to transmit the plurality of data streams to a second device;

dynamically determining one or more operating parameters of the first device to reduce the amount of bandwidth required to transmit the plurality of data streams by eliminating one or more data streams, reducing an amount of bandwidth required by one or more data streams, or both based on bandwidth reduction criteria determined by the first device, the second device, or both; and

directing the first device to transmit the plurality of data streams to the second device according to the one or more operating parameters.

16. The memory device of claim 15 , wherein to dynamically determine one or more operating parameters of the first device, the memory device further stores executable instructions for causing the processor to perform operations comprising:

identifying a first subset of one or more one or more data streams of the plurality of data streams that can be generated at the second device based on a second subset of the one or more other data streams of the plurality of data streams; and

determining that transmission of the first subset of the one or more data streams to the at least one recipient device should be stopped.

17. The memory device of claim 16 , wherein the first subset of data streams comprise a set of one or more dedicated video streams each associated with a participant or object of interest in an environment in which the communication session is being conducted; and wherein the second subset of the one or more data streams includes a data stream comprising a media stream of a panoramic view of the environment in which the communication session is being conducted.

18. The memory device of claim 15 , wherein to dynamically determine one or more operating parameters of the first device, the memory device further stores executable instructions for causing the processor to perform operations comprising:

identifying a first subset of one or more one or more data streams of the plurality of data streams that can be obtained from at least one other first device located in an environment in which the communication session is being conducted; and

determining that transmission of the first subset of the one or more data streams to the at least one recipient device should be stopped.

19. The memory device of claim 15 , wherein to dynamically determine one or more operating parameters of the first device, the memory further stores executable instructions for causing the processor to perform operations comprising:

identifying a first subset of one or more one or more data streams of the plurality of data streams for which a reduction in a bit rate, a reduction in a sample rate, or a reduction in a frame rate of one or more of the plurality of data streams that would not result in a reduction in meeting audio quality; and

reducing the bit rate, the sample rate, or the frame rate of the first subset of one or more data streams.

20. The memory device of claim 15 , wherein to dynamically determine one or more operating parameters of the first device, the memory device further stores executable instructions for causing the processor to perform operations comprising:

reducing a number of audio channels transmitted from the first device to reduce bandwidth requirements without reducing a meeting audio quality, wherein each audio channel comprises a separate one of the plurality of data streams.

Assignments (3)
CORRECTIVE ASSIGNMENT TO CORRECT THE EXECUTION DATE PREVIOUSLY RECORDED AT REEL: 051425 FRAME: 0624. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Mar 4, 2020
From: GHANAIE-SICHANIE, ARASH
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 052203/0302 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 6, 2020
From: GHANAIE-SICHANIE, ARASH
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 051425/0624 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 1, 2019
From: SRINIVASAN, SRIRAM; XIONG, WEI; WANG, BIN
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 050894/0690 →
Cited By (5)
US 12,361,702 US 12,470,671 US 12,519,846 US 12,580,785 US 12,683,823