IP Library Granted Patent US 8,970,651
Granted Patent B2
US 8,970,651 · App. 13/715,130 · Granted Mar 3, 2015

Integrating audio and video conferencing capabilities

Inventor: Michael Vernick (Ocean, NJ)
Assignee: Avaya Inc.
H04N7/147H04N7/15
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,970,651
App. No.
13/715,130
Granted
Mar 3, 2015
Kind
B2
Abstract

Systems, methods, and computer-readable storage media for adding video to an audio only communication session. During a communication session between a first device and a second device, the first device receives an audio portion of the communication session from a user. The first device then receives, via a wireless connection, a video portion of the communication session from a third device. The first device synchronizes the audio portion of the communication session and the video portion of the communication session to yield a synchronized audio and video portion of the communication session. Next, the first device sends the synchronized audio and video portion of the communication session to the second device.

Claims (56)

1. A method comprising:

establishing, via a wireless connection, an audio only communication session between a first device and a second device;

adding video capabilities to the audio only communication session by sending a message to a third device having video capabilities, the message requesting initialization of video input and output to yield an audio video communication session;

receiving, via the wireless connection, a video portion and an audio portion of the audio video communication session;

synchronizing the audio portion of the audio video communication session and the video portion of the audio video communication session to yield a synchronization of the audio and video portion of the audio video communication session; and

based on the synchronization, sending the video portion of the audio video communication session to a video output component at the third device and the audio portion of the audio video communication session to an audio output at the first device so as to expand capabilities of the audio only communication session from audio only to both audio and video.

2. The method of claim 1 , further comprising:

receiving audio for the audio video communication session via the first device, the audio originating from a user.

3. The method of claim 1 , further comprising:

receiving video outputted from the third device for the audio video communication session, wherein the video comprises compressed video frames captured by a camera associated with the third device; and

synchronizing the video with audio received from a user at the first device to yield synchronized video and audio for the audio video communication session.

4. The method of claim 1 , wherein synchronizing the audio portion of the audio video communication session and the video portion of the audio video communication session comprises setting lip synchronization attributes on the video portion of the audio video communication session with audio from the audio portion of the audio video communication session.

5. The method of claim 1 , further comprising:

receiving video frames associated with the audio video communication session;

checking lip synchronization attributes on the video frames; and

at a time that is based at least in part on the lip synchronization attributes, sending the video frames to the third device to be decoded and display at the third device.

6. The method of claim 1 , wherein the third device comprises a video decoder and encoder, a camera, and a video output, and wherein the audio portion and the video portion of the audio video communication session are both transmitted via a same network associated with the wireless connection.

7. The method of claim 1 , further comprising:

receiving, from a fourth device, a second video portion of the audio video communication session when the first device is outside of a wireless range of the third device;

synchronizing the second video portion of the audio video communication session and a corresponding audio portion of the audio video communication session to yield a second synchronized audio and video portion of the audio video communication session, wherein the corresponding audio portion is associated with the first device; and

sending the second synchronized audio and video portion of the audio video communication session to the second device.

8. The method of claim 1 , wherein the first device is a WIFI direct enabled phone, and wherein the wireless connection is a WIFI direct connection.

9. A system comprising:

a processor; and

a computer-readable storage medium storing instructions which, when executed by the processor, cause the processor to perform operations comprising:

establishing, via a wireless connection, an audio only communication session between a first device and a second device;

adding video capabilities to the audio only communication session by sending a message to a third device having video capabilities, the message requesting initialization of video input and output to yield an audio video communication session;

receiving, via the wireless connection, a video portion and an audio portion of the audio video communication session;

synchronizing the audio portion of the audio video communication session and the video portion of the audio video communication session to yield a synchronization of the audio and video portion of the audio video communication session; and

based on the synchronization, sending the video portion of the audio video communication session to a video output component at the third device and the audio portion of the audio video communication session to an audio output at the first device so as to expand capabilities of the audio only communication session from audio only to both audio and video.

10. The system of claim 9 , wherein the first device is a WIFI direct enabled phone and the wireless connection is a WIFI direct connection, and wherein the audio portion and the video portion of the audio video communication session are both transmitted via a same network associated with the wireless connection.

11. The system of claim 9 , wherein the computer-readable storage medium stores additional instructions which result in operations further comprising:

receiving audio for the audio video communication session via the first device, the audio originating from a user.

12. The system of claim 9 , wherein the computer-readable storage medium stores additional instructions which result in operations further comprising:

receiving video frames associated with the audio video communication session;

checking lip synchronization attributes on the video frames;

at a time that is based at least in part on the lip synchronization attributes, sending the video frames to the third device to be decoded and displayed at the third device; and

at the time that is based at least in part on the lip synchronization attributes, sending audio frames received for the audio video communication session to an audio output component on the first device, the audio frames being associated with the video frames.

13. The system of claim 9 , wherein the video portion of the audio video communication session comprises compressed video frames captured by a camera associated with the third device.

14. The system of claim 9 , wherein the third device comprises a video decoder and encoder, a camera, and a video output.

15. The system of claim 9 , wherein synchronizing the audio portion of the audio video communication session and the video portion of the audio video communication session comprises setting lip synchronization attributes on the video portion of the audio video communication session with audio from the audio portion of the audio video communication session.

16. A non-transitory computer-readable storage medium storing instructions which, when executed by a processor, cause the processor to perform operations comprising:

establishing, via a wireless connection, an audio only communication session between a first device and a second device;

adding video capabilities to the audio only communication session by sending a message to a third device having video capabilities, the message requesting initialization of video input and output to yield a video audio communication session;

receiving, via the wireless connection, a video portion and an audio portion of the audio video communication session;

synchronizing the audio portion of the audio video communication session and the video portion of the audio video communication session to yield a synchronization of the audio and video portion of the audio video communication session; and

based on the synchronization, sending the video portion of the audio video communication session to a video output component at the third device and the audio portion of the audio video communication session to an audio output at the first device so as to expand capabilities of the audio only communication session from audio only to both audio and video.

17. The non-transitory computer-readable storage medium of claim 16 , wherein the first device is a WIFI direct enabled phone, and wherein the wireless connection is a WIFI direct connection.

18. The non-transitory computer-readable storage medium of claim 16 , storing additional instructions which result in the method further comprising:

receiving audio for the audio video communication session via the first device, the audio originating from a user.

19. The non-transitory computer-readable storage medium of claim 16 , storing additional instructions which result in operations further comprising:

receiving video frames associated with the audio video communication session;

checking lip synchronization attributes on the video frames

at a time that is based at least in part on the lip synchronization attributes, sending the video frames to the third device to be decoded and displayed at the third device; and

at the time that is based at least in part on the lip synchronization attributes, sending audio frames received for the audio video communication session to an audio output component on the first device, the audio frames being associated with the video frames.

20. The non-transitory computer-readable storage medium of claim 16 , wherein the third device comprises a video decoder and encoder, a camera, and a video output.

Assignments (16)
(SECURITY INTEREST) GRANTOR'S NAME CHANGE Recorded Sep 21, 2023
From: AVAYA INC.
To: AVAYA LLC
Reel/Frame 065019/0231 →
RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 53955/0436) Recorded May 18, 2023
From: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
To: AVAYA MANAGEMENT L.P.; AVAYA INC.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
Reel/Frame 063705/0023 →
RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 61087/0386) Recorded May 18, 2023
From: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
To: AVAYA MANAGEMENT L.P.; AVAYA INC.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
Reel/Frame 063690/0359 →
RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 045034/0001) Recorded May 18, 2023
From: GOLDMAN SACHS BANK USA., AS COLLATERAL AGENT
To: AVAYA INC.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC; OCTEL COMMUNICATIONS LLC; VPNET TECHNOLOGIES, INC.; ZANG, INC. (FORMER NAME OF AVAYA CLOUD INC.); HYPERQUALITY, INC.; HYPERQUALITY II, LLC; CAAS TECHNOLOGIES, LLC; AVAYA MANAGEMENT L.P.
Reel/Frame 063779/0622 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 4, 2023
From: AVAYA INC.; AVAYA MANAGEMENT L.P.; INTELLISIST, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 063542/0662 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 3, 2023
From: AVAYA MANAGEMENT L.P.; AVAYA INC.; INTELLISIST, INC.; KNOAHSOFT INC.
To: WILMINGTON SAVINGS FUND SOCIETY, FSB [COLLATERAL AGENT]
Reel/Frame 063742/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS AT REEL 45124/FRAME 0026 Recorded Apr 26, 2023
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: AVAYA HOLDINGS CORP.; AVAYA INC.; AVAYA MANAGEMENT L.P.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
Reel/Frame 063457/0001 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Aug 5, 2022
From: AVAYA INC.; INTELLISIST, INC.; AVAYA MANAGEMENT L.P.; AVAYA CABINET SOLUTIONS LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 061087/0386 →
SECURITY INTEREST Recorded Sep 25, 2020
From: AVAYA INC.; AVAYA MANAGEMENT L.P.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION
Reel/Frame 053955/0436 →
SECURITY INTEREST Recorded Jan 23, 2018
From: AVAYA INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC; OCTEL COMMUNICATIONS LLC; VPNET TECHNOLOGIES, INC.; ZANG, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 045124/0026 →
SECURITY INTEREST Recorded Jan 10, 2018
From: AVAYA INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC; OCTEL COMMUNICATIONS LLC; VPNET TECHNOLOGIES, INC.; ZANG, INC.
To: GOLDMAN SACHS BANK USA, AS COLLATERAL AGENT
Reel/Frame 045034/0001 →
BANKRUPTCY COURT ORDER RELEASING ALL LIENS INCLUDING THE SECURITY INTEREST RECORDED AT REEL/FRAME 041576/0001 Recorded Dec 15, 2017
From: CITIBANK, N.A.
To: AVAYA INC.; AVAYA INTEGRATED CABINET SOLUTIONS INC.; OCTEL COMMUNICATIONS LLC (FORMERLY KNOWN AS OCTEL COMMUNICATIONS CORPORATION); VPNET TECHNOLOGIES, INC.
Reel/Frame 044893/0531 →
BANKRUPTCY COURT ORDER RELEASING ALL LIENS INCLUDING THE SECURITY INTEREST RECORDED AT REEL/FRAME 030083/0639 Recorded Dec 15, 2017
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
To: AVAYA INC.
Reel/Frame 045012/0666 →
SECURITY INTEREST Recorded Jan 27, 2017
From: AVAYA INC.; AVAYA INTEGRATED CABINET SOLUTIONS INC.; OCTEL COMMUNICATIONS CORPORATION; VPNET TECHNOLOGIES, INC.
To: CITIBANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 041576/0001 →
SECURITY AGREEMENT Recorded Mar 13, 2013
From: AVAYA, INC.
To: BANK OF NEW YORK MELLON TRUST COMPANY, N.A., THE
Reel/Frame 030083/0639 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 14, 2012
From: VERNICK, MICHAEL
To: AVAYA INC.
Reel/Frame 029472/0710 →
Continuity (1)
Related Publication 20140168345A1 · Jun 19, 2014