IP Library Granted Patent US 11,854,551
Granted Patent B2
US 11,854,551 · App. 16/362,035 · Granted Dec 26, 2023

Hybrid architecture for transcription of real-time audio based on event data between on-premises system and cloud-based advanced audio processing system

Inventors: Matthew A. Peters (Redmond, WA); Robert E. Braudes (Erie, CO); Jeffrey L. Aigner (Seattle, WA)
Assignee: Avaya Inc.
G10L15/26G10L15/22G10L15/30H04L65/60H04L67/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,854,551
App. No.
16/362,035
Granted
Dec 26, 2023
Kind
B2
Abstract

Transcribing portions of a communication session between a user device and an on-premises device of an enterprise includes receiving, by a computer located remotely from the on-premises device, a media stream of the communication session from the on-premises device and receiving, by the computer, at least one event associated with the media stream from the on-premises device. Furthermore, the computer determines a portion of the media stream to transcribe based on the at least one event and transcribes the portion of the media stream.

Claims (30)

1. A method for transcribing portions of a communication session between a user device and an on-premises device of an enterprise, the method comprising:

receiving, by a computer located remotely from the on-premises device, a media stream of the communication session from the on-premises device;

receiving, by the computer, at least one event associated with the media stream from the on-premises device, wherein the at least one event comprises a media and state change event, wherein the at least one event is received via a first communication channel and the media stream is received via a second communication channel;

determining, by the computer, a portion of the media stream to transcribe based on the at least one event; and

transcribing, by the computer, the portion of the media stream.

2. The method of claim 1 , wherein the transcribing is performed in real-time.

3. The method of claim 1 , comprising:

providing, by the computer, access to the transcribed portion to an entity associated with the enterprise.

4. The method of claim 1 , wherein the on-premises device and the computer are coupled via a network-based communication channel.

5. The method of claim 4 , wherein the network-based communication channel comprises one of a HTTPS connection, a virtual private network (VPN), or a software-define WAN.

6. The method of claim 1 , wherein the at least one event comprises one of Participant Enter, Participant Exit, Subconference created, Meeting Extended, Bot/Program Enter, Bot/Program Exit, Language Changed, or Personal Data Start/Stop.

7. The method of claim 1 , wherein determining a portion of the media stream to transcribe based on the at least one event comprises determining to start transcribing.

8. The method of claim 1 , wherein determining a portion of the media stream to transcribe based on the at least one event comprises determining to stop transcribing.

9. The method of claim 1 , wherein determining a portion of the media stream to transcribe based on the at least one event comprises determining to resume transcribing.

10. A system for transcribing portions of a communication session between a user device and an on-premises device of an enterprise, the system remotely located from the on-premises device and comprising:

a memory device, storing executable instructions; and

a processor in communication with the memory device, the processor when executing the executable instructions:

receives a media stream of the communication session from the on-premises device;

receives at least one event associated with the media stream from the on-premises device, wherein the at least one event comprises a media and state change event, wherein the at least one event is received via a first communication channel and the media stream is received via a second communication channel;

determines a portion of the media stream to transcribe based on the at least one event; and

transcribes the portion of the media stream.

11. The system of claim 10 , wherein the transcribing is performed in real-time.

12. The system of claim 10 , the processor when executing the executable instructions:

provides access to the transcribed portion to an entity associated with the enterprise.

13. The system of claim 10 , wherein the on-premises device and the system are coupled via a network-based communication channel.

14. The system of claim 13 , wherein the network-based communication channel comprises one of a HTTPS connection, a virtual private network (VPN), or a software-define WAN.

15. The system of claim 10 , wherein the at least one event comprises one of Participant Enter, Participant Exit, Subconference created, Meeting Extended, Bot/Program Enter, Bot/Program Exit, Language Changed, or Personal Data Start/Stop.

16. The system of claim 10 , wherein determining a portion of the media stream to transcribe based on the at least one event comprises determining to start transcribing.

17. The system of claim 10 , wherein determining a portion of the media stream to transcribe based on the at least one event comprises determining to stop transcribing.

18. The system of claim 10 , wherein determining a portion of the media stream to transcribe based on the at least one event comprises determining to resume transcribing.

Assignments (12)
INTELLECTUAL PROPERTY SECURITY AGREEMENT – SUPPLEMENT NO. 5 Recorded Jun 3, 2024
From: AVAYA LLC; AVAYA MANAGEMENT L.P.
To: WILMINGTON SAVINGS FUND SOCIETY, FSB, AS COLLATERAL AGENT
Reel/Frame 067606/0438 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 4, 2024
From: AVAYA LLC
To: ARLINGTON TECHNOLOGIES, LLC
Reel/Frame 067022/0780 →
INTELLECTUAL PROPERTY RELEASE AND REASSIGNMENT Recorded Mar 25, 2024
From: CITIBANK, N.A.
To: AVAYA LLC; AVAYA MANAGEMENT L.P.
Reel/Frame 066894/0117 →
INTELLECTUAL PROPERTY RELEASE AND REASSIGNMENT Recorded Mar 25, 2024
From: WILMINGTON SAVINGS FUND SOCIETY, FSB
To: AVAYA LLC; AVAYA MANAGEMENT L.P.
Reel/Frame 066894/0227 →
(SECURITY INTEREST) GRANTOR'S NAME CHANGE Recorded Sep 21, 2023
From: AVAYA INC.
To: AVAYA LLC
Reel/Frame 065019/0231 →
RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 61087/0386) Recorded May 18, 2023
From: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
To: AVAYA MANAGEMENT L.P.; AVAYA INC.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
Reel/Frame 063690/0359 →
RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 53955/0436) Recorded May 18, 2023
From: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
To: AVAYA MANAGEMENT L.P.; AVAYA INC.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
Reel/Frame 063705/0023 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 4, 2023
From: AVAYA INC.; AVAYA MANAGEMENT L.P.; INTELLISIST, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 063542/0662 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 3, 2023
From: AVAYA MANAGEMENT L.P.; AVAYA INC.; INTELLISIST, INC.; KNOAHSOFT INC.
To: WILMINGTON SAVINGS FUND SOCIETY, FSB [COLLATERAL AGENT]
Reel/Frame 063742/0001 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Aug 5, 2022
From: AVAYA INC.; INTELLISIST, INC.; AVAYA MANAGEMENT L.P.; AVAYA CABINET SOLUTIONS LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 061087/0386 →
SECURITY INTEREST Recorded Sep 25, 2020
From: AVAYA INC.; AVAYA MANAGEMENT L.P.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION
Reel/Frame 053955/0436 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 9, 2019
From: PETERS, MATTHEW A.; BRAUDES, ROBERT E.; AIGNER, JEFFREY L.
To: AVAYA INC.
Reel/Frame 050315/0367 →
Continuity (1)
Related Publication 20200302934A1 · Sep 24, 2020