IP Library Granted Patent US 9,936,162
Granted Patent B1
US 9,936,162 · App. 15/285,277 · Granted Apr 3, 2018

System and method for processing digital images during videoconference

Inventors: Guy Gadnir (Herzlia, IL); Tamar Barzuza (Tel Aviv, IL)
Assignee: Avaya Inc.
H04N7/147H04N5/23203H04N5/23296
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,936,162
App. No.
15/285,277
Granted
Apr 3, 2018
Kind
B1
Abstract

A video communication system that includes a computer readable medium and a processor, coupled with a wide angle and high resolution digital camera and the computer readable medium. The processor causes the wide angle and high resolution digital camera to acquire a digital image of a local participant during a video communication session. The processor extracts a first image of a first set of objects and a second image of a second set of objects from the digital image and provides the extracted first and second images to a remote endpoint for display to another participant.

Claims (33)

1. A video communication system, comprising:

a wide angle and high resolution digital camera to acquire a digital image of a local participant during a video communication session;

a computer readable medium; and

a processor, coupled with the digital camera and the computer readable medium, wherein the computer readable medium comprises instructions that program the processor to extract a first image of a first set of objects and a second image of a second set of objects from the digital image and provide the extracted first and second images to a remote endpoint for display to another participant, wherein the first image is of the local participant, and wherein the first image of the local participant is extracted for display to the another participant based on a hierarchical ranking of the local participant in an enterprise management structure.

2. The system of claim 1 , wherein the first and second sets of objects are provided simultaneously, as separate images, to the remote endpoint for display and wherein a field of view of the digital camera is at least about 100 degrees.

3. The system of claim 1 , wherein the first and second sets of objects are provided simultaneously, as separate images, to the remote endpoint for display and wherein the resolution of the digital image is at least about 10 million pixels.

4. The system of claim 1 , wherein the digital image is captured by one digital camera and wherein the first and second sets of objects are contained in a common image.

5. The system of claim 1 , wherein the computer readable medium comprises:

an imaging controller that programs the processor to select the digital image to be captured by the digital camera for provision to the remote endpoint for display to the another participant, the image selection being based on information describing the local participant or a context of the video communication session, wherein the processor conditions a change from providing, to the remote endpoint for display, a first image of a first set of objects selected at a first time to a different second image of a second set of objects selected at a second time upon a difference between the first and second times having at least a threshold magnitude.

6. The system of claim 5 , wherein the processor controls a pan, tilt, or zoom of the digital camera based on the information describing the local participant or the context of the video communication session and wherein the information describing the local participant or the context of the video communication session comprises one or more of: local participant location based upon detection of a face of the local participant, an identity of the local participant, movement of the local participant from one location to another, use of a key word or phrase during the video communication session, an estimated meeting duration, or a meeting type or structure, wherein the information describing the local participant or the context of the video communication session is not based on active speaker detection or tracking, and wherein the context is determining a point of local participant focus based on one or more image processing or meeting content analysis.

7. A video communication system, comprising:

a computer readable medium; and

a processor, coupled with a high resolution digital camera and the computer readable medium, wherein the processor causes the high resolution digital camera to acquire a digital image of a local participant during a video communication session and wherein the computer readable medium comprises instructions that program the processor to extract a first image of a first set of objects and a second image of a second set of objects from the digital image and provide the extracted first and second images to a remote endpoint for display to another participant, wherein the first image is of the local participant, and wherein the first image of the local participant is extracted for display to the another participant based on a hierarchical ranking of the local participant in an enterprise management structure.

8. The system of claim 7 , wherein the digital camera is a wide angle digital camera and wherein a field of view of the digital camera is at least about 100 degrees.

9. The system of claim 7 , wherein the first and second sets of objects are provided simultaneously, as separate images, to the remote endpoint for display and wherein the resolution of the digital image is at least about 10 million pixels.

10. The system of claim 7 , wherein the digital image is captured by one digital camera and wherein the first and second sets of objects are contained in a common digital image.

11. The system of claim 7 , wherein the computer readable medium comprises:

an imaging controller that programs the processor to select the digital image to be captured by the digital camera for provision to the remote endpoint for display to the another participant, the image selection being based on information describing the local participant or a context of the video communication session, wherein the processor conditions a change from providing, to the remote endpoint for display, a first image of a first set of objects selected at a first time to a different second image of a second set of objects selected at a second time upon a difference between the first and second times having at least a threshold magnitude.

12. The system of claim 11 , wherein the processor controls a pan, tilt, or zoom of the digital camera based on the information describing the local participant or the context of the video communication session and wherein the information describing the local participant or the context of the video communication session comprises one or more of: local participant location based upon detection of a face of the local participant, an identity of the local participant, or movement of the local participant from one location to another, use of a key word or phrase during the video communication session, an estimated meeting duration, or a meeting type or structure, wherein the information describing the local participant or the context of the video communication session is not based on active speaker detection or tracking, and wherein the context is determining a point of local participant focus based on one or more image processing or meeting content analysis.

13. A method for controlling a camera during a video communication session, comprising:

receiving, by a processor from a high resolution digital camera, a digital image of a local participant during a video communication session;

extracting, by the processor, a first image of a first set of objects and a second image of a second set of objects from the digital image; and

providing the extracted first and second images to a remote endpoint for display to another participant, wherein the first image is of the local participant and wherein the first image of the local participant is extracted for display to the another participant based on a hierarchical ranking of the local participant in an enterprise management structure.

14. The method of claim 13 , wherein the digital camera is a wide angle digital camera, wherein the first and second sets of objects are provided as separate images simultaneously to the remote endpoint for display, wherein a field of view of the digital camera is at least about 100 degrees, and wherein the resolution of the digital image is at least about 10 million pixels.

15. The method of claim 13 , wherein the first and second sets of objects are provided simultaneously to the remote endpoint for display, wherein the common digital image is captured by one digital camera, wherein the first and second sets of objects are contained in a common digital image, and wherein the first and second images are not selected based on active speaker detection or tracking.

16. The method of claim 13 , further comprising:

selecting, by the processor, the digital image to be captured by the digital camera for provision to the remote endpoint for display to the another participant during the video communication session, the image selection being based, at least in part, on information describing the local participant or a context of the video communication session, wherein the information describing the local participant or the context of the video communication session is not based on active speaker detection or tracking.

17. The method of claim 16 , further comprising:

conditioning, by the processor, a change from providing, to the remote endpoint for display, a first image of a first set of objects selected at a first time to a different second image of a second set of objects selected at a second time upon a difference between the first and second times having at least a threshold magnitude.

18. The method of claim 16 , further comprising:

controlling, by the processor, a pan, tilt, or zoom of the digital camera based on the information describing the local participant or the context of the video communication session, wherein the information describing the local participant or the context of the video communication session comprises one or more of local participant location based upon detection of a face of the local participant, an identity of the local participant, movement of the local participant from one location to another, use of a key word or phrase during the video communication session, an estimated meeting duration, or a meeting type or structure, wherein the image selection is not based on active speaker detection or tracking, and wherein the context is determining a point of local participant focus based on one or more image processing or meeting content analysis.

19. The system of claim 1 , wherein the second image is extracted based on at least one of a participant leaving a room, a new participant entering the room, and a participant moving to a seat location outside a view of the digital camera.

20. The system of claim 1 , wherein the second image is of a second local participant wherein the first and second images are digitally cropped and/or digitally zoomed to normalize or resize the first and second images to appear equally sized or spaced equidistant from the digital camera.

Assignments (17)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 4, 2024
From: AVAYA LLC
To: ARLINGTON TECHNOLOGIES, LLC
Reel/Frame 067022/0780 →
INTELLECTUAL PROPERTY RELEASE AND REASSIGNMENT Recorded Mar 25, 2024
From: CITIBANK, N.A.
To: AVAYA LLC; AVAYA MANAGEMENT L.P.
Reel/Frame 066894/0117 →
INTELLECTUAL PROPERTY RELEASE AND REASSIGNMENT Recorded Mar 25, 2024
From: WILMINGTON SAVINGS FUND SOCIETY, FSB
To: AVAYA LLC; AVAYA MANAGEMENT L.P.
Reel/Frame 066894/0227 →
(SECURITY INTEREST) GRANTOR'S NAME CHANGE Recorded Sep 21, 2023
From: AVAYA INC.
To: AVAYA LLC
Reel/Frame 065019/0231 →
RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 045034/0001) Recorded May 18, 2023
From: GOLDMAN SACHS BANK USA., AS COLLATERAL AGENT
To: AVAYA INC.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC; OCTEL COMMUNICATIONS LLC; VPNET TECHNOLOGIES, INC.; ZANG, INC. (FORMER NAME OF AVAYA CLOUD INC.); HYPERQUALITY, INC.; HYPERQUALITY II, LLC; CAAS TECHNOLOGIES, LLC; AVAYA MANAGEMENT L.P.
Reel/Frame 063779/0622 →
RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 53955/0436) Recorded May 18, 2023
From: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
To: AVAYA MANAGEMENT L.P.; AVAYA INC.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
Reel/Frame 063705/0023 →
RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 61087/0386) Recorded May 18, 2023
From: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
To: AVAYA MANAGEMENT L.P.; AVAYA INC.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
Reel/Frame 063690/0359 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 4, 2023
From: AVAYA INC.; AVAYA MANAGEMENT L.P.; INTELLISIST, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 063542/0662 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 3, 2023
From: AVAYA MANAGEMENT L.P.; AVAYA INC.; INTELLISIST, INC.; KNOAHSOFT INC.
To: WILMINGTON SAVINGS FUND SOCIETY, FSB [COLLATERAL AGENT]
Reel/Frame 063742/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS AT REEL 45124/FRAME 0026 Recorded Apr 26, 2023
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: AVAYA HOLDINGS CORP.; AVAYA INC.; AVAYA MANAGEMENT L.P.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
Reel/Frame 063457/0001 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Aug 5, 2022
From: AVAYA INC.; INTELLISIST, INC.; AVAYA MANAGEMENT L.P.; AVAYA CABINET SOLUTIONS LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 061087/0386 →
SECURITY INTEREST Recorded Sep 25, 2020
From: AVAYA INC.; AVAYA MANAGEMENT L.P.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION
Reel/Frame 053955/0436 →
SECURITY INTEREST Recorded Jan 23, 2018
From: AVAYA INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC; OCTEL COMMUNICATIONS LLC; VPNET TECHNOLOGIES, INC.; ZANG, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 045124/0026 →
SECURITY INTEREST Recorded Jan 10, 2018
From: AVAYA INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC; OCTEL COMMUNICATIONS LLC; VPNET TECHNOLOGIES, INC.; ZANG, INC.
To: GOLDMAN SACHS BANK USA, AS COLLATERAL AGENT
Reel/Frame 045034/0001 →
BANKRUPTCY COURT ORDER RELEASING ALL LIENS INCLUDING THE SECURITY INTEREST RECORDED AT REEL/FRAME 041576/0001 Recorded Dec 15, 2017
From: CITIBANK, N.A.
To: AVAYA INC.; AVAYA INTEGRATED CABINET SOLUTIONS INC.; OCTEL COMMUNICATIONS LLC (FORMERLY KNOWN AS OCTEL COMMUNICATIONS CORPORATION); VPNET TECHNOLOGIES, INC.
Reel/Frame 044893/0531 →
SECURITY INTEREST Recorded Jan 27, 2017
From: AVAYA INC.; AVAYA INTEGRATED CABINET SOLUTIONS INC.; OCTEL COMMUNICATIONS CORPORATION; VPNET TECHNOLOGIES, INC.
To: CITIBANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 041576/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 4, 2016
From: GADNIR, GUY; BARZUZA, TAMAR
To: AVAYA INC.
Reel/Frame 039936/0353 →