IP Library Granted Patent US 10,127,833
Granted Patent B1
US 10,127,833 · App. 15/809,503 · Granted Nov 13, 2018

Video relay service, communication system, and related methods for providing remote assistance to a sign language interpreter during a communication session

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,127,833
App. No.
15/809,503
Granted
Nov 13, 2018
Kind
B1
Abstract

Video relay services, communication systems, and methods are disclosed herein. The video relay service is for providing sign language translation services during a real-time communication session between a hearing-impaired user and a hearing-capable user. The video relay service is configured to create a video conference and an audio conference for a remote video interpreter at a remote video interpreter work station to provide teaming assistance request for a first video interpreter work station of the video relay service.

Claims (54)

1. A communication system for providing sign language translation services during a real-time communication session, the communication system comprising:

a video relay service configured to:

establish a first connection for transmitting a video stream between a first video interpreter workstation associated with a video interpreter and a video communication device associated with a hearing-impaired user;

establish a second connection for transmitting an audio stream between the first video interpreter workstation and a far-end communication device associated with a hearing-capable user; and

create a video conference and an audio conference for a second video interpreter at a second video interpreter work station to provide teaming assistance as an assisting video interpreter responsive to receiving a teaming request from the first video interpreter workstation, wherein the first video interpreter work station and the second video interpreter work station are located at different call centers remote from each other, and wherein the video relay service comprises a routing server configured to select the second video interpreter work station from among a plurality of video interpreter work stations located at different call centers of the video relay service.

2. The communication system of claim 1 , wherein the video relay service is configured to create the video conference to be hosted on a cloud-based server.

3. The communication system of claim 2 , wherein the cloud-based server is a third party cloud-based server that is not part of the video relay service.

4. The communication system of claim 1 , wherein the video relay service is configured to create the audio conference to be hosted on a cloud-based server.

5. The communication system of claim 1 , wherein the video relay service is configured to create the audio conference to be hosted on the first video interpreter workstation.

6. The communication system of claim 1 , wherein the video relay service is configured to host the video conference and the audio conference on a same server.

7. The communication system of claim 1 , wherein the routing server is configured to select the second video interpreter work station based, at least in part, on querying a status and determining an inactivity time of each of the video interpreter work stations.

8. The communication system of claim 1 , wherein the routing server is configured to select the second video interpreter work station based, at least in part, on a desired skill identified in the teaming request for the assisting video interpreter.

9. The communication system of claim 1 , wherein the routing server is configured to select the second video interpreter work station based, at least in part, on a seniority for the assisting video interpreter.

10. A video relay service comprising:

a plurality of call centers having one or more video interpreter work stations associated with video interpreters to provide sign language interpretation to assist hearing-impaired users in communicating with hearing-capable users during real-time communication sessions; and

a routing server operably coupled with the video interpreter work stations at the plurality of call centers, and configured to:

facilitate a teaming request from a requesting video communication workstation for assistance from an assisting video communication workstation at a remote call center during a real-time communication session; and

select the assisting video interpreter workstation from among a plurality of video interpreter workstations located at different call centers of the video relay service.

11. The video relay service of claim 10 , wherein the routing server includes a video interpreter database including status information about the video interpreter work stations.

12. A video relay service comprising:

a plurality of call centers having one or more video interpreter work stations associated with video interpreters to provide sign language interpretation to assist hearing-impaired users in communicating with hearing-capable users during real-time communication sessions; and

a routing server operably coupled with the video interpreter work stations at the plurality of call centers, including a video interpreter database including status information about the video interpreter work stations, and configured to:

facilitate a teaming request from a requesting video communication workstation for assistance from an assisting video communication workstation at a remote call center during a real-time communication; and

query the status information and select the assisting video communication workstation based on a length of inactivity since a prior call.

13. A video relay service comprising:

a plurality of call centers having one or more video interpreter work stations associated with video interpreters to provide sign language interpretation to assist hearing-impaired users in communicating with hearing-capable users during real-time communication sessions; and

a routing server operably coupled with the video interpreter work stations at the plurality of call centers, including a video interpreter database including status information about the video interpreter work stations, and configured to:

facilitate a teaming request from a requesting video communication workstation for assistance from an assisting video communication workstation at a remote call center during a real-time communication; and

routing server is configured to query the status information and select the assisting video communication workstation after first querying availability of a local video communication workstation within a same call station as the requesting video interpreter workstation.

14. A method of facilitating a remote teaming session during a real-time communication session with a hearing-capable user, a hearing-impaired user, and a video interpreter within a video relay service, the method comprising:

generating a teaming request for a requesting video interpreter workstation of the video relay service during a communication session with a video communication device associated with the hearing-impaired user and a far-end communication device associated with the hearing-impaired user;

selecting a remote video interpreter workstation from among a plurality of video interpreter workstations located at different call centers of the video relay service;

transmitting a teaming message to the remote video interpreter workstation at a different call center location than the requesting video interpreter workstation;

displaying the teaming message on an electronic display of the remote video interpreter workstation requesting acceptance or rejection of the teaming request; and

creating a video conference and an audio conference for the requesting video interpreter workstation and the remote video interpreter workstation to facilitate the remote teaming session during the communication session to provide sign language translation services between the video communication device and the far-end communication device.

15. The method of claim 14 , wherein creating the video conference and the audio conference includes hosting both on a same multipoint control unit.

16. The method of claim 14 , wherein:

creating the video conference includes the requesting video interpreter workstation, the video communication device, and the remote video interpreter workstation joining the video conference; and

creating the audio conference includes the requesting video interpreter workstation, the far-end communication device, and the remote video interpreter workstation joining the audio conference.

17. The method of claim 16 , further comprising each of the requesting video interpreter workstation and the remote video interpreter workstation receiving and displaying all video streams of the video conference.

18. A method of facilitating a remote teaming session during a real-time communication session with a hearing-capable user, a hearing-impaired user, and a video interpreter within a video relay service, the method comprising:

generating a teaming request for a requesting video interpreter workstation of the video relay service during a communication session with a video communication device associated with the hearing-impaired user and a far-end communication device associated with the hearing-impaired user;

transmitting a teaming message to a remote video interpreter workstation at a different call center location than the requesting video interpreter workstation;

displaying the teaming message on an electronic display of the remote video interpreter workstation requesting acceptance or rejection of the teaming request; and

creating a video conference and an audio conference to facilitate the remote teaming session,

wherein:

creating the video conference includes the requesting video interpreter workstation, the video communication device, and the remote video interpreter workstation joining the video conference;

creating the audio conference includes the requesting video interpreter workstation, the far-end communication device, and the remote video interpreter workstation joining the audio conference;

each of the requesting video interpreter workstation and the remote video interpreter workstation receive and display all video streams of the video conference; and

the video communication device only display video streams from the requesting video interpreter workstation and the video communication device from the video conference, but not the remote video interpreter workstation.

19. The method of claim 14 , wherein:

creating the video conference is initiated by the remote video interpreter workstation; and

creating the audio conference is initiated by the requesting video interpreter workstation.

20. The method of claim 14 , wherein generating the teaming request for the requesting video interpreter workstation of the video relay service occurs automatically during call setup.

Assignments (11)
CORRECTIVE ASSIGNMENT TO CORRECT THE RECEIVING PARTY DATA THE NAME OF THE LAST RECEIVING PARTY SHOULD BE CAPTIONCALL, LLC PREVIOUSLY RECORDED ON REEL 67190 FRAME 517. ASSIGNOR(S) HEREBY CONFIRMS THE RELEASE OF SECURITY INTEREST. Recorded May 31, 2024
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
To: SORENSON IP HOLDINGS, LLC; SORENSON COMMUNICATIONS, LLC; CAPTIONCALL, LLC
Reel/Frame 067591/0675 →
SECURITY INTEREST Recorded Apr 23, 2024
From: SORENSON COMMUNICATIONS, LLC; INTERACTIVECARE, LLC; CAPTIONCALL, LLC
To: OAKTREE FUND ADMINISTRATION, LLC, AS COLLATERAL AGENT
Reel/Frame 067573/0201 →
RELEASE OF SECURITY INTEREST Recorded Apr 23, 2024
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
To: SORENSON IP HOLDINGS, LLC; SORENSON COMMUNICATIONS, LLC; CAPTIONALCALL, LLC
Reel/Frame 067190/0517 →
RELEASE OF SECURITY INTEREST Recorded Dec 16, 2021
From: CORTLAND CAPITAL MARKET SERVICES LLC
To: SORENSON COMMUNICATIONS, LLC; CAPTIONCALL, LLC
Reel/Frame 058533/0467 →
JOINDER NO. 1 TO THE FIRST LIEN PATENT SECURITY AGREEMENT Recorded Apr 22, 2021
From: SORENSON IP HOLDINGS, LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 056019/0204 →
LIEN Recorded Feb 11, 2020
From: SORENSON COMMUNICATIONS, LLC; CAPTIONCALL, LLC
To: CORTLAND CAPITAL MARKET SERVICES LLC
Reel/Frame 051894/0665 →
RELEASE OF SECURITY INTEREST Recorded May 8, 2019
From: U.S. BANK NATIONAL ASSOCIATION
To: SORENSON COMMUNICATIONS, LLC; SORENSON IP HOLDINGS, LLC; CAPTIONCALL, LLC; INTERACTIVECARE, LLC
Reel/Frame 049115/0468 →
RELEASE OF SECURITY INTEREST Recorded May 7, 2019
From: JPMORGAN CHASE BANK, N.A.
To: SORENSON COMMUNICATIONS, LLC; SORENSON IP HOLDINGS, LLC; CAPTIONCALL, LLC; INTERACTIVECARE, LLC
Reel/Frame 049109/0752 →
PATENT SECURITY AGREEMENT Recorded Apr 29, 2019
From: SORENSEN COMMUNICATIONS, LLC; CAPTIONCALL, LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
Reel/Frame 050084/0793 →
SECURITY INTEREST Recorded Apr 30, 2018
From: SORENSON COMMUNICATIONS, LLC; INTERACTIVECARE, LLC; CAPTIONCALL, LLC
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 046416/0166 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 10, 2017
From: UTLEY, BARRY; WALTERS, LANE; PARENT, JESSE; ESPOSITO, JANET; PETERSON, TYSON
To: SORENSON IP HOLDINGS LLC
Reel/Frame 044094/0315 →