IP Library Granted Patent US 12,406,652
Granted Patent B2
US 12,406,652 · App. 17/713,941 · Granted Sep 2, 2025

Electronic collaboration and communication method and system to facilitate communication with hearing or speech impaired participants

Inventor: Harikrishna Vuppaladhadiam (Fremont, CA)
G10L13/00G10L15/26
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,406,652
App. No.
17/713,941
Granted
Sep 2, 2025
Kind
B2
Abstract

An electronic communication method and system are disclosed. Exemplary methods can be used by hearing or speech-impaired participants in a conference, e.g., collaboration, environment to facilitate communication between conference participants.

Claims (39)

1. An electronic communication system comprising:

a first participant device comprising an application configured to receive input from a user and store the input as text information;

a second participant device;

a text-to-speech engine configured to convert the text information from the first participant device into audio information;

a conferencing engine comprising a mixer configured to: (a) receive audio information from (i) the text-to-speech engine, and (ii) the second participant device, and (b) combine the audio information from the second participant device and the text-to-speech engine into an audio conference;

a sentiment analysis engine configured to generate sentiment information corresponding to the text information, wherein at least partially the sentiment analysis engine combines the text information and the sentiment information; and

wherein the first participant device is configured to send the text information to the text-to-speech engine, and prior to sending the text information, the first participant device is further configured to send an indication to the second participant device that a user has information to share with the conferencing engine.

2. The electronic communication system of claim 1 , wherein the first participant device comprises the text-to-speech engine.

3. The electronic communication system of claim 1 , wherein a conferencing device comprises the text-to-speech engine.

4. The electronic communication system of claim 1 , wherein the application comprises a client.

5. The electronic communication system of claim 1 , wherein the first participant device is configured to determine whether to convert the text information to audio information using the first participant device.

6. The electronic communication system of claim 1 , wherein the application is further configured to whether the first participant device comprises a text-to-speech engine.

7. The electronic communication system of claim 1 , wherein the sentiment analysis engine is further configured to receive transcribed information.

8. The electronic communication system of claim 1 , wherein the conferencing engine is configured to determine whether a predetermined period of audio silence is detected, and if the predetermined period of audio silence is detected, the conferencing engine causes the text information to be sent to the text-to-speech engine.

9. The electronic communication system of claim 1 , further comprising a database comprising one or more of images and animation.

10. The electronic communication system of claim 1 , wherein the conferencing engine comprises a media decoding engine.

11. The electronic communication system of claim 1 , wherein the conferencing engine sends an indication to the first participant device to initiate sending text information.

12. An electronic communication system comprising:

a first participant device comprising an application configured to receive input from a user and store the input as text information;

a second participant device;

a text-to-speech engine configured to convert the text information from the first participant device into audio information;

a conferencing engine comprising a mixer configured to: (a) receive audio information from (i) the text-to-speech engine, and (ii) the second participant device, and (b) combine the audio information from the second participant device and the text-to-speech engine into an audio conference;

a sentiment analysis engine configured to generate sentiment information corresponding to the text information wherein the information corresponding to the sentiment information comprises animated information; and

wherein the first participant device is configured to send the text information to the text-to-speech engine, and prior to sending the text information, the first participant device is further configured to send an indication to the second participant device that a user has information to share with the conferencing engine.

13. An electronic communication system comprising:

a first participant device comprising an application configured to receive input from a user and store the input as text information;

a second participant device;

a text-to-speech engine configured to convert the text information from the first participant device into audio information;

a conferencing engine comprising a mixer configured to: (a) receive audio information from (i) the text-to-speech engine, and (ii) the second participant device, and (b) combine the audio information from the second participant device and the text-to-speech engine into an audio conference;

a sentiment analysis engine configured to generate sentiment information corresponding to the text information wherein the information corresponding to the sentiment information comprises pictorial information; and

wherein the first participant device is configured to send the text information to the text-to-speech engine, and prior to sending the text information, the first participant device is further configured to send an indication to the second participant device that a user has information to share with the conferencing engine.

14. The electronic communication system of claim 13 , wherein the first participant device comprises the text-to-speech engine; or

wherein a conferencing device comprises the text-to-speech engine.

15. The electronic communication system of claim 13 , wherein the first participant device is configured to determine whether to convert the text information to audio information using the first participant device.

16. The electronic communication system of claim 13 , wherein the application is further configured to whether the first participant device comprises a text-to-speech engine.

17. The electronic communication system of claim 13 , wherein the sentiment analysis engine is further configured to receive transcribed information.

18. The electronic communication system of claim 13 , wherein the conferencing engine is configured to determine whether a predetermined period of audio silence is detected, and if the predetermined period of audio silence is detected, the conferencing engine causes the text information to be sent to the text-to-speech engine.

19. The electronic communication system of claim 12 , further comprising a database comprising one or more of images and animation.

20. The electronic communication system of claim 12 , further comprising, wherein the conferencing engine comprises a media decoding engine.

Assignments (12)
SECURITY INTEREST Recorded Jun 30, 2025
From: MLN US HOLDCO LLC; MITEL (DELAWARE), INC.; MITEL NETWORKS CORPORATION; MITEL NETWORKS, INC.
To: U.S. PCI SERVICES, LLC
Reel/Frame 071758/0843 →
RELEASE OF SECURITY INTEREST Recorded Jun 24, 2025
From: ACQUIOM AGENCY SERVICES LLC
To: MITEL (DELAWARE), INC.; MITEL NETWORKS, INC.; MITEL NETWORKS CORPORATION
Reel/Frame 071730/0632 →
RELEASE OF SECURITY INTEREST Recorded Jun 24, 2025
From: WILMINGTON SAVINGS FUND SOCIETY, FSB
To: MITEL (DELAWARE), INC.; MITEL COMMUNICATIONS, INC.; MITEL NETWORKS, INC.; MITEL NETWORKS CORPORATION
Reel/Frame 071712/0821 →
SECURITY INTEREST Recorded Jun 20, 2025
From: MITEL (DELAWARE), INC.; MITEL NETWORKS CORPORATION; MITEL NETWORKS, INC.
To: ACQUIOM AGENCY SERVICES LLC
Reel/Frame 071676/0815 →
SECURITY INTEREST Recorded Mar 12, 2025
From: MITEL (DELAWARE), INC.; MITEL NETWORKS CORPORATION; MITEL NETWORKS, INC.
To: ACQUIOM AGENCY SERVICES LLC
Reel/Frame 070689/0857 →
NOTICE OF SUCCCESSION OF AGENCY - 3L Recorded Jan 14, 2025
From: UBS AG, STAMFORD BRANCH, AS LEGAL SUCCESSOR TO CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: WILMINGTON SAVINGS FUND SOCIETY, FSB
Reel/Frame 070006/0268 →
NOTICE OF SUCCCESSION OF AGENCY - PL Recorded Jan 14, 2025
From: UBS AG, STAMFORD BRANCH, AS LEGAL SUCCESSOR TO CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: WILMINGTON SAVINGS FUND SOCIETY, FSB
Reel/Frame 069895/0755 →
NOTICE OF SUCCCESSION OF AGENCY - 2L Recorded Jan 14, 2025
From: UBS AG, STAMFORD BRANCH, AS LEGAL SUCCESSOR TO CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: WILMINGTON SAVINGS FUND SOCIETY, FSB
Reel/Frame 069896/0001 →
SECURITY INTEREST Recorded Nov 1, 2022
From: MITEL (DELAWARE), INC.; MITEL NETWORKS, INC.; MITEL COMMUNICATIONS, INC.
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
Reel/Frame 061830/0760 →
SECURITY INTEREST Recorded Nov 1, 2022
From: MITEL (DELAWARE), INC.; MITEL NETWORKS, INC.; MITEL COMMUNICATIONS, INC.
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
Reel/Frame 061830/0715 →
SECURITY INTEREST Recorded Nov 1, 2022
From: MITEL (DELAWARE), INC.; MITEL NETWORKS, INC.; MITEL COMMUNICATIONS, INC.
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
Reel/Frame 061830/0643 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 5, 2022
From: VUPPALADHADIAM, HARIKRISHNA
To: MITEL NETWORKS, INC.
Reel/Frame 059509/0170 →
Continuity (2)
Continuation 16424257 · May 28, 2019
Related Publication 20220230622A1 · Jul 21, 2022
References Cited (11)
US 9584758B1 · Chen · 2017 [cited by examiner]
US 10516778B2 · Kumar Selvaraj · 2019 [cited by examiner]
US 20030048353A1 · Kenoyer · 2003 [cited by examiner]
US 20080045184A1 · Randall · 2008 [cited by examiner]
US 20130124240A1 · Varadarajan · 2013 [cited by examiner]
US 20170185375A1 · Martel · 2017 [cited by examiner]
US 20180213284A1 · Shekhar · 2018 [cited by examiner]
US 20180288110A1 · Kawachi · 2018 [cited by examiner]
US 20190042561A1 · Kakirwar · 2019 [cited by examiner]
US 20200104369A1 · Bellegarda · 2020 [cited by examiner]
US 20200372915A1 · Ishii · 2020 [cited by examiner]