IP Library Granted Patent US 11,792,353
Granted Patent B2
US 11,792,353 · App. 17/113,945 · Granted Oct 17, 2023

Systems and methods for displaying users participating in a communication session

Inventors: Fernanda Cristina Martinez Pupo de Oliveira (Santos, BR); Daniel Makoto Iguchi (Sao Paulo, BR); Ricardo Tavernaro Queiroz (Indaiatuba, BR); Bernardo Coelho (Sao Paulo, BR); Rosylene Gorski Damaceno Carbone (Lugano, CH)
Assignee: Avaya Management L.P.
H04N5/272G06V40/161H04N7/141
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,792,353
App. No.
17/113,945
Granted
Oct 17, 2023
Kind
B2
Abstract

Systems and methods of the present disclosure include receiving, with a processor of the first user device, a first image from a first camera, receiving, with the processor, a first live video stream from a network location, generating, with the processor, a live image in real time, by superimposing a portion of the first live video stream received from the network location on to the first image received from the first camera, and displaying, with the processor, the generated live image.

Claims (41)

1. A method of presenting a live video call, the method comprising performing operations as follows:

receiving, with a processor of a first user device, a first live video stream from a first camera of the first user device;

receiving, with the processor, a second live video stream from a network location;

extracting, with the processor, a portion of the second live video stream received from the network location, wherein extracting the portion of the second live video stream comprises processing, with the processor, the second live video stream to detect a face of a user and extracting, with the processor, pixels of the second live video stream associated with the detected face of the user, wherein the portion of the second live video stream comprises the pixels associated with the detected face of the user;

determining, with the processor, that the extracted portion of the second live video stream comprises a first portion of a body of a user;

determining, with the processor, that the extracted portion of the second live video stream does not comprise a second portion of the body of the user;

in response to determining that the extracted portion of the second live video stream comprises the first portion and does not comprise the second portion, generating, with the processor, a live superimposed video in real-time by superimposing at least a part of the extracted portion of the second live video stream onto an avatar superimposed on top of the first live video stream received from the first camera; and

displaying, with the processor, the generated live superimposed video.

2. The method of claim 1 , wherein the first user device comprises a second camera, the method further comprising receiving, with the processor, a third live video stream from the second camera and transmitting, with the processor, the third live video stream to the network location.

3. The method of claim 1 , wherein the first live video stream from the first camera is taken in a direction opposite a direction of a user of the first user device in relation to the first user device.

4. The method of claim 1 , wherein the live superimposed video is generated by superimposing a live video of a user of a second user device onto a live video of an environment containing the first user device.

5. The method of claim 1 , further comprising receiving, with the processor, a third live video stream from a second network location, wherein generating the live superimposed video in real-time comprises superimposing the portion of the second live video stream and a portion of the third live video stream on top of the first live video stream received from the first camera.

6. The method of claim 5 , wherein the second live video stream is received from a second user device associated with a second user and the third live video stream is received from a third user device associated with a third user.

7. The method of claim 6 , wherein the live superimposed video portrays the second user and the third user in front of the first camera.

8. A first user device comprising:

a processor; and

a computer-readable storage medium storing computer-readable instructions which, when executed by the processor, cause the processor to:

receive a first live video stream from a first camera of the first user device;

receive a second live video stream from a network location;

extract a portion of the second live video stream received from the network location, wherein extracting the portion of the second live video stream comprises processing, with the processor, the second live video stream to detect a face of a user and extracting, with the processor, pixels of the second live video stream associated with the detected face of the user, wherein the portion of the second live video stream comprises the pixels associated with the detected face of the user;

determine that the extracted portion of the second live video stream comprises a first portion of a body of a user;

determine, with the processor, that the extracted portion of the second live video stream does not comprise a second portion of the body of the user;

in response to determining that the extracted portion of the second live video stream comprises the first portion and does not comprise the second portion, generate a live superimposed video in real-time by superimposing at least a part of the extracted portion of the second live video stream onto an avatar superimposed on top of the first live video stream received from the first camera; and

display the generated live superimposed video.

9. The first user device of claim 8 , wherein the first user device comprises the first camera and a second camera, wherein the instructions further cause the processor to receive a third live video stream from the second camera and transmit the third live video stream to the network location.

10. The first user device of claim 8 , wherein the first live video stream from the first camera is taken in a direction opposite a direction of a user of the first user device in relation to the first user device.

11. The first user device of claim 8 , wherein the live superimposed video is generated by superimposing a live video of a user of a second user device onto a live video of an environment containing the first user device.

12. The first user device of claim 8 , wherein the instructions further cause the processor to receive a third live video stream from a second network location, wherein generating the live superimposed video in real-time comprises superimposing the portion of the second live video stream and a portion of the third live video stream on top of the first live video stream received from the first camera.

13. The first user device of claim 12 , wherein the second live video stream is received from a second user device associated with a second user and the third live video stream is received from a third user device associated with a third user.

14. The first user device of claim 13 , wherein the live superimposed video portrays the second user and the third user in front of the first camera.

15. A computer program product comprising:

a non-transitory computer-readable storage medium having computer-readable program code embodied therewith, the computer-readable program code configured, when executed by a processor of a first user device, to:

receive a first live video stream from a first camera of the first user device;

receive a second live video stream from a network location;

extract a portion of the second live video stream received from the network location, wherein extracting the portion of the second live video stream comprises processing, with the processor, the second live video stream to detect a face of a user and extracting, with the processor, pixels of the second live video stream associated with the detected face of the user, wherein the portion of the second live video stream comprises the pixels associated with the detected face of the user;

determine that the extracted portion of the second live video stream comprises a first portion of a body of a user;

determine, with the processor, that the extracted portion of the second live video stream does not comprise a second portion of the body of the user;

in response to determining that the extracted portion of the second live video stream comprises the first portion and does not comprise the second portion, generate a live superimposed video in real-time by superimposing at least a portion of the extracted portion of the second live video stream onto an avatar superimposed on top of the first live video stream received from the first camera; and

display the generated live superimposed video.

16. The computer program product of claim 15 , wherein the first user device comprises the first camera and a second camera, wherein the computer-readable program code is further configured, when executed by the processor, to receive a third live video stream from the second camera and transmit the third live video stream to the network location.

17. The computer program product of claim 15 , wherein the first live video stream from the first camera is taken in a direction opposite a direction of a user of the first user device in relation to the first user device.

Assignments (8)
INTELLECTUAL PROPERTY SECURITY AGREEMENT – SUPPLEMENT NO. 5 Recorded Jun 3, 2024
From: AVAYA LLC; AVAYA MANAGEMENT L.P.
To: WILMINGTON SAVINGS FUND SOCIETY, FSB, AS COLLATERAL AGENT
Reel/Frame 067606/0438 →
RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 61087/0386) Recorded May 18, 2023
From: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
To: AVAYA MANAGEMENT L.P.; AVAYA INC.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
Reel/Frame 063690/0359 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 4, 2023
From: AVAYA INC.; AVAYA MANAGEMENT L.P.; INTELLISIST, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 063542/0662 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 3, 2023
From: AVAYA MANAGEMENT L.P.; AVAYA INC.; INTELLISIST, INC.; KNOAHSOFT INC.
To: WILMINGTON SAVINGS FUND SOCIETY, FSB [COLLATERAL AGENT]
Reel/Frame 063742/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS AT REEL 57700/FRAME 0935 Recorded Apr 26, 2023
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: AVAYA HOLDINGS CORP.; AVAYA INC.; AVAYA MANAGEMENT L.P.
Reel/Frame 063458/0303 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Aug 5, 2022
From: AVAYA INC.; INTELLISIST, INC.; AVAYA MANAGEMENT L.P.; AVAYA CABINET SOLUTIONS LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 061087/0386 →
SECURITY INTEREST Recorded Oct 4, 2021
From: AVAYA MANAGEMENT LP
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 057700/0935 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 3, 2021
From: MARTINEZ PUPO DE OLIVEIRA, FERNANDA CRISTINA; IGUCHI, DANIEL MAKOTO; QUEIROZ, RICARDO TAVERNARO; COELHO, BERNARDO; DAMACENO CARBONE, ROSYLENE GORSKI
To: AVAYA MANAGEMENT L.P.
Reel/Frame 055472/0507 →
Continuity (1)
Related Publication 20220182557A1 · Jun 9, 2022