IP Library Granted Patent US 10,460,159
Granted Patent B1
US 10,460,159 · App. 14/929,191 · Granted Oct 29, 2019

Video endpoint, communication system, and related method for automatic framing a signing area of a sign language user

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,460,159
App. No.
14/929,191
Granted
Oct 29, 2019
Kind
B1
Abstract

Communication systems and methods are disclosed for enabling a first user at a video endpoint to communicate with a far-end user at a communication device via a relay service providing translation services for the first user. The video endpoint may include a camera and may be configured to frame a view of the camera to include a signing area of a user. The video endpoint may be configured to determine the signing area of the user by taking measurements of the user's body and framing a region around the user to include the signing area based on the measurements, by monitoring a range of motion for the signing area of the user, and other methods.

Claims (25)

1. A communication system, comprising:

a video endpoint having a camera, the video endpoint configured to:

determine dimensions of an initial signing area of an audibly-impaired user during a setup procedure prior to engaging in a communication session by analyzing a range of motion for the audibly-impaired user to sign a predetermined word or set of words, wherein the video endpoint is configured to determine the dimensions of the initial signing area of the audibly-impaired user by taking measurements of at least a portion of the audibly-impaired user's body and automatically framing the camera to include a region including the initial signing area based on the measurements; and

automatically frame a field of view of the camera to include the initial signing area or a determined adjusted signing area of the audibly-impaired user having updated dimensions based, at least in part, on a range of motion for the audibly-impaired user's signing motions during the communication session; and

a relay service configured to provide sign language translation services during a communication session with the audibly-impaired user at the video endpoint and a far-end user at a communication device.

2. The communication system of claim 1 , wherein the video endpoint is configured to perform facial recognition to identify a reference point for applying or determining the initial signing area of the audibly-impaired user.

3. The communication system of claim 1 , wherein the video endpoint is configured to perform motion sensing to determine the range of motion for the audibly-impaired user's signing motions to determine the dimensions of the initial signing area of the audibly-impaired user.

4. The communication system of claim 1 , wherein the video endpoint is configured to detect skin tones of the audibly-impaired user to identify a reference point for applying or determining the initial signing area of the audibly-impaired user.

5. The communication system of claim 1 , wherein the dimensions of the initial signing area are determined as on a proportional amount horizontally and vertically from the portion of the audibly-impaired user's body based on the measurements.

6. The communication system of claim 1 , wherein the video endpoint is configured to initiate framing the field of view of the camera automatically upon an occurrence of one or more of the video endpoint being powered on, the video endpoint detecting the presence of the audibly-impaired user, and the video endpoint establishing a new communication session.

7. The communication system of claim 1 , wherein the video endpoint is configured to initiate framing the field of view of the camera upon a user input.

8. The communication system of claim 1 , wherein the video endpoint is configured to continuously automatically frame the field of view of the camera throughout a communication session to include the initial signing area for the audibly-impaired user.

9. A video endpoint, comprising:

a camera configured to capture video data for a field of view; and

a processor operably coupled to the camera, wherein the processor is configured to:

determine dimensions of an initial signing area of a user during a setup procedure by analyzing a range of motion for the user to sign a predetermined word or set of words prompted by the setup procedure prior to engaging in a communication session, wherein the initial signing area of the user includes a region extending vertically from above a head of the user to about a navel of the user and extending horizontally beyond shoulders of the user; and

determine the field of view of the camera and adjust the camera to frame the field of view to include the initial signing area determined signing area or an adjusted determined signing area of a user having dimensions based, at least in part, on analyzing a range of motion for the user's signing motions dynamically in real-time during the communication session.

10. The video endpoint of claim 9 , wherein the processor is configured to determine the dimensions of the initial signing area and the adjusted signing area of the user dynamically in real-time during a communication session based on proportional measurements taken from a body part of the user.

11. The video endpoint of claim 9 , wherein the processor is configured to determine dimensions of a signing area for multiple users within the field of view at the same time and adjust the camera to frame the field of view to include a combined signing area of the multiple users.

12. The video endpoint of claim 9 , further comprising memory storing dimensions for a plurality of different defined signing areas for each of a plurality of different known users of the video endpoint, and wherein the processor is configured to apply the corresponding dimensions of the defined signing area stored in memory responsive to identifying a known user.

13. A video endpoint, comprising:

a camera configured to capture video data for a field of view; and

a processor operably coupled to the camera, wherein the processor is configured to:

determine dimensions of an initial signing area of a user during a setup procedure by analyzing a range of motion for the user to sign a predetermined word or set of words prompted by the setup procedure prior to engaging in a communication session; and

determine the field of view of the camera and adjust the camera to frame the field of view to include the initial signing area determined signing area or an adjusted determined signing area of a user having dimensions based, at least in part, on analyzing a range of motion for the user's signing motions dynamically in real-time during the communication session, wherein the processor is configured to determine the dimensions of the initial signing area and the adjusted signing area of the user dynamically in real-time during a communication session based on proportional measurements taken from a body part of the user.

Assignments (15)
CORRECTIVE ASSIGNMENT TO CORRECT THE RECEIVING PARTY DATA THE NAME OF THE LAST RECEIVING PARTY SHOULD BE CAPTIONCALL, LLC PREVIOUSLY RECORDED ON REEL 67190 FRAME 517. ASSIGNOR(S) HEREBY CONFIRMS THE RELEASE OF SECURITY INTEREST. Recorded May 31, 2024
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
To: SORENSON IP HOLDINGS, LLC; SORENSON COMMUNICATIONS, LLC; CAPTIONCALL, LLC
Reel/Frame 067591/0675 →
SECURITY INTEREST Recorded Apr 23, 2024
From: SORENSON COMMUNICATIONS, LLC; INTERACTIVECARE, LLC; CAPTIONCALL, LLC
To: OAKTREE FUND ADMINISTRATION, LLC, AS COLLATERAL AGENT
Reel/Frame 067573/0201 →
RELEASE OF SECURITY INTEREST Recorded Apr 23, 2024
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
To: SORENSON IP HOLDINGS, LLC; SORENSON COMMUNICATIONS, LLC; CAPTIONALCALL, LLC
Reel/Frame 067190/0517 →
RELEASE OF SECURITY INTEREST Recorded Dec 16, 2021
From: CORTLAND CAPITAL MARKET SERVICES LLC
To: SORENSON COMMUNICATIONS, LLC; CAPTIONCALL, LLC
Reel/Frame 058533/0467 →
JOINDER NO. 1 TO THE FIRST LIEN PATENT SECURITY AGREEMENT Recorded Apr 22, 2021
From: SORENSON IP HOLDINGS, LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 056019/0204 →
LIEN Recorded Feb 11, 2020
From: SORENSON COMMUNICATIONS, LLC; CAPTIONCALL, LLC
To: CORTLAND CAPITAL MARKET SERVICES LLC
Reel/Frame 051894/0665 →
RELEASE OF SECURITY INTEREST Recorded May 8, 2019
From: U.S. BANK NATIONAL ASSOCIATION
To: SORENSON COMMUNICATIONS, LLC; SORENSON IP HOLDINGS, LLC; CAPTIONCALL, LLC; INTERACTIVECARE, LLC
Reel/Frame 049115/0468 →
RELEASE OF SECURITY INTEREST Recorded May 7, 2019
From: JPMORGAN CHASE BANK, N.A.
To: SORENSON COMMUNICATIONS, LLC; SORENSON IP HOLDINGS, LLC; CAPTIONCALL, LLC; INTERACTIVECARE, LLC
Reel/Frame 049109/0752 →
PATENT SECURITY AGREEMENT Recorded Apr 29, 2019
From: SORENSEN COMMUNICATIONS, LLC; CAPTIONCALL, LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
Reel/Frame 050084/0793 →
SECURITY INTEREST Recorded Apr 12, 2017
From: SORENSON IP HOLDINGS, LLC; CAPTIONCALL, LLC
To: U.S. BANK NATIONAL ASSOCIATION
Reel/Frame 042242/0001 →
SECURITY INTEREST Recorded Apr 9, 2017
From: SORENSON IP HOLDINGS, LLC; CAPTIONCALL, LLC
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 042229/0120 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 27, 2017
From: SORENSON COMMUNICATIONS INC.
To: SORENSON IP HOLDINGS LLC
Reel/Frame 041521/0614 →
SENIOR FIRST LIEN PATENT SECURITY AGREEMENT Recorded Mar 28, 2016
From: SORENSON COMMUNICATIONS, INC.
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 038274/0606 →
SECOND LIEN PATENT SECURITY AGREEMENT Recorded Mar 28, 2016
From: SORENSON COMMUNICATIONS, INC.
To: U.S. BANK NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 038274/0654 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 2, 2015
From: SHIELDS, RICHARD HARDY
To: SORENSON COMMUNICATIONS, INC.
Reel/Frame 036940/0967 →