IP Library › Granted Patent US 10,225,814
Granted Patent B2
US 10,225,814 · App. 15/083,974 · Granted Mar 5, 2019

Conference audio management

Inventors: Venkatraman S. Atti (San Diego, CA); Daniel J. Sinder (San Diego, CA); Nikolai Leung (San Diego, CA); Vivek Rajendran (San Diego, CA)
Assignee: Qualcomm Incorporated
H04W56/0045H04L43/087H04L65/608H04M3/562H04M3/568H04R29/007H04S7/00H04S2420/01H04W80/04H04W88/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,225,814
App. No.
15/083,974
Filed
Mar 29, 2016
Granted
Mar 5, 2019
Kind
B2
Art Unit
2411
USPC
370/263
Abstract

A method for managing audio during a conference includes receiving, at a first buffer of a mobile device, a first audio stream from a first device associated with a first participant of the conference. The method also includes receiving, at a second buffer of the mobile device, a second audio stream from a second device associated with a second participant of the conference. The method further includes generating a control signal at a delay controller of the mobile device. The control signal is provided to the first buffer and to the second buffer to synchronize first buffered audio that is output from the first buffer with second buffered audio that is output from the second buffer.

Claims (75)

1. A method for managing audio during a conference, the method comprising:

receiving, at a first buffer of a mobile device, a first audio stream from a first device associated with a first participant of the conference;

receiving, at a second buffer of the mobile device, a second audio stream from a second device associated with a second participant of the conference; and

generating a control signal at a delay controller of the mobile device, the control signal provided to the first buffer and to the second buffer to synchronize first buffered audio that is outputted from the first buffer with second buffered audio that is outputted from the second buffer, the first buffered audio synchronized with the second buffered audio prior to performing decoding operations to output a first signal associated with the first buffered audio and a second signal associated with the second buffered audio.

2. The method of claim 1 , further comprising:

comparing, at the mobile device, a first time stamp of the first audio stream with a second time stamp of the second audio stream, the first time stamp and the second time stamp based on a common clock source; and

determining, at the mobile device, a time difference between the first time stamp and the second time stamp.

3. The method of claim 2 , wherein the control signal indicates to the first buffer to delay outputting the first buffered audio by the time difference if the first time stamp indicates an earlier time than the second time stamp.

4. The method of claim 2 , wherein the control signal indicates to the second buffer to delay outputting the second buffered audio by the time difference if the second time stamp indicates an earlier time than the first time stamp.

5. The method of claim 1 , wherein the first buffer comprises a first de-jitter buffer, and wherein the second buffer comprises a second de-jitter buffer.

6. The method of claim 1 , further comprising:

decoding, at a first decoder of the mobile device, the first buffered audio to generate first decoded audio; and

decoding, at a second decoder of the mobile device, the second buffered audio to generate second decoded audio.

7. The method of claim 6 , further comprising:

performing, at the mobile device, a first spatial steering operation on the first decoded audio to project the first decoded audio from a speaker at a first angle; and

performing, at the mobile device, a second spatial steering operation on the second decoded audio to project the second decoded audio from the speaker at a second angle.

8. The method of claim 7 , wherein performing the first spatial steering operation comprises applying a first head-related transfer function (HRTF) to the first decoded audio, and wherein performing the second spatial steering operation comprises applying a second HRTF to the second decoded audio.

9. The method of claim 7 , wherein the first angle and the second angle are based on user-defined settings.

10. The method of claim 9 , further comprising shifting the first angle and the second angle by a shift amount in response to detecting head movement associated with a user of the mobile device.

11. The method of claim 6 , further comprising:

adjusting a first gain of the first decoded audio; and

adjusting a second gain of the second decoded audio.

12. The method of claim 11 , wherein the first gain and the second gain are adjusted based on user-defined settings.

13. The method of claim 1 , wherein the first audio stream is routed from the first device to the first buffer via a network device, and wherein the second audio stream is routed from the second device to the second buffer via the network device.

14. The method of claim 13 , further comprising:

providing a first particular signal to the network device to adjust a first bit rate of the first audio stream; and

providing a second particular signal to the network device to adjust a second bit rate of the second audio stream.

15. The method of claim 14 , wherein the first bit rate and the second bit rate are adjusted based on user-defined settings, hardware capabilities of the mobile device, or a combination thereof.

16. The method of claim 1 , wherein the mobile device, the first device, and the second device each comprise a user equipment (UE) that is compatible with a Third Generation Partnership Project (3GPP) standard.

17. The method of claim 1 , wherein the first audio stream is received via an antenna of the mobile device.

18. The method of claim 1 , wherein the first buffer, the second buffer, and delay controller are included in a modem of the mobile device.

19. A mobile device for managing audio during a conference, the mobile device comprising:

a first buffer configured to receive a first audio stream from a first device associated with a first participant of a conference;

a second buffer configured to receive a second audio stream from a second device associated with a second participant of the conference; and

a delay controller configured to generate a control signal, the control signal provided to the first buffer and to the second buffer to synchronize first buffered audio that is outputted from the first buffer with second buffered audio that is outputted from the second buffer, the first buffered audio synchronized with the second buffered audio prior to performing decoding operations to output a first signal associated with the first buffered audio and a second signal associated with the second buffered audio.

20. The mobile device of claim 19 , wherein the delay controller is configured to:

compare a first time stamp of the first audio stream with a second time stamp of the second audio stream, the first time stamp and the second time stamp based on a common clock source; and

determine a time difference between the first time stamp and the second time stamp.

21. The mobile device of claim 20 , wherein the control signal indicates to the first buffer to delay outputting the first buffered audio by the time difference if the first time stamp indicates an earlier time than the second time stamp.

22. The mobile device of claim 20 , wherein the control signal indicates to the second buffer to delay outputting the second buffered audio by the time difference if the second time stamp indicates an earlier time than the first time stamp.

23. The mobile device of claim 19 , wherein the first buffer comprises a first de-jitter buffer, and wherein the second buffer comprises a second de-jitter buffer.

24. The mobile device of claim 19 , further comprising:

a first decoder configured to decode the first buffered audio to generate first decoded audio; and

a second decoder configured to decode the second buffered audio to generate second decoded audio.

25. The mobile device of claim 24 , further comprising a spatial steering processor configured to:

perform a first spatial steering operation on the first decoded audio to project the first decoded audio from a speaker at a first angle; and

perform a second spatial steering operation on the second decoded audio to project the second decoded audio from the speaker at a second angle.

26. The mobile device of claim 25 , wherein performing the first spatial steering operation comprises applying a first head-related transfer function (HRTF) to the first decoded audio, and wherein performing the second spatial steering operation comprises applying a second HRTF to the second decoded audio.

27. The mobile device of claim 19 , further comprising:

a first decoder configured to:

receive the control signal from the delay controller; and

based on the control signal, decode a first data packet associated with the first audio stream or bypass decoding operations on the first data packet; and

a second decoder configured:

receive the control signal from the delay controller; and

based on the control signal, decode a second data packet associated with the first audio stream or bypass decoding operations on the second data packet.

28. The mobile device of claim 27 , wherein the first decoder and the second decoder are different decoders.

29. The mobile device of claim 19 , further comprising an antenna configured to:

receive the first audio stream; and

provide the first audio stream to the first buffer.

30. The mobile device of claim 19 , further comprising a modem that includes the first buffer, the second buffer, and the delay controller.

31. A non-transitory computer-readable medium comprising instructions for managing audio during a conference, the instructions, when executed by a processor in a mobile device, cause the processor to perform operations comprising:

receiving, at a first buffer, a first audio stream from a first device associated with a first participant of the conference;

receiving, at a second buffer, a second audio stream from a second device associated with a second participant of the conference; and

generating a control signal at a delay controller, the control signal provided to the first buffer and to the second buffer to synchronize first buffered audio that is outputted from the first buffer with second buffered audio that is outputted from the second buffer, the first buffered audio synchronized with the second buffered audio prior to performing decoding operations to output a first signal associated with the first buffered audio and a second signal associated with the second buffered audio.

32. The non-transitory computer-readable medium of claim 31 , wherein the operations further comprise:

comparing a first time stamp of the first audio stream with a second time stamp of the second audio stream, the first time stamp and the second time stamp based on a common clock source; and

determining a time difference between the first time stamp and the second time stamp.

33. An apparatus for managing audio during a conference, the apparatus comprising:

means for receiving a first audio stream from a first device associated with a first participant of a conference;

means for receiving a second audio stream from a second device associated with a second participant of the conference; and

means for generating a control signal, the control signal provided to the means for receiving the first audio stream and to the means for receiving the second audio stream to synchronize first buffered audio that is outputted from the means for receiving the first audio stream with second buffered audio that is outputted from the means for receiving the second audio stream, the first buffered audio synchronized with the second buffered audio prior to performing decoding operations to output a first signal associated with the first buffered audio and a second signal associated with the second buffered audio.

34. The apparatus of claim 33 , further comprising:

means for decoding the first buffered audio to generate first decoded audio; and

means decoding the second buffered audio to generate second decoded audio.

35. The apparatus of claim 33 , wherein the means for receiving the first audio stream, the means for receiving the second audio stream, and the means for generating the control signal are included in a mobile device.

Assignments (3)
CORRECTIVE ASSIGNMENT TO CORRECT THE SECOND INVENTOR'S NAME PREVIOUSLY RECORDED ON REEL 038321 FRAME 0590. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Oct 24, 2018
From: ATTI, VENKATRAMAN S.; SINDER, DANIEL J.; LEUNG, NIKOLAI; RAJENDRAN, VIVEK
To: QUALCOMM INCORPORATED
Reel/Frame 047960/0571 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 19, 2016
From: ATTI, VENKATRAMAN S.; SINDER, DANEIL J.; LEUNG, NIKOLAI; RAJENDRAN, VIVEK
To: QUALCOMM INCORPORATED
Reel/Frame 038321/0590 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 19, 2016
From: ATTI, VENKATRAMAN S.; SINDER, DANIEL J.; LEUNG, NIKOLAI; RAJENDRAN, VIVEK
To: QUALCOMM INCORPORATED
Reel/Frame 038322/0701 →
Continuity (3)
Provisional Application 62143154 · Apr 5, 2015
Provisional Application 62144033 · Apr 7, 2015
Related Publication 20160295539A1 · Oct 6, 2016
Cited By (1)
US 12,744,689