IP Library Granted Patent US 12,126,937
Granted Patent B2
US 12,126,937 · App. 17/304,376 · Granted Oct 22, 2024

Method and system for virtual 3D communications having multiple participants per camera

Inventors: Nery Strasman (Los Altos, CA); Yuval Gronau (Ramat Hasharon, IL); Ran Oz (Maccabim, IL)
Assignee: TrueMeeting, LTD.
H04N7/157G06F3/013G06N3/04G06N3/045G06T7/11G06T7/70G06T15/04G06T15/20G06T15/205G06T17/20G06T19/00G06T19/20H04N7/144H04N7/147H04N7/152G06T2200/08G06T2207/30201G06T2219/2004
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,126,937
App. No.
17/304,376
Granted
Oct 22, 2024
Kind
B2
Abstract

A method for conducting a three dimensional (3D) video conference between multiple participants, the method may include acquiring visual information, by a visual sensing unit related to a certain participant; identifying multiple persons that appear in the visual information; finding, out of the multiple persons, at least one relevant person; determining 3D entity representation information, for each of the at least one relevant person; and generating, for at least one participant, a representation of a virtual 3D video conference environment, based on the 3D entity representation information for each of the at least one relevant person.

Claims (38)

1. A method for conducting a three dimensional (3D) video conference between multiple participants, the method comprises:

acquiring visual information, by a visual sensing unit, the visual sensing unit is related to a certain participant;

identifying multiple persons that appear in the visual information;

finding, out of the multiple persons, at least one relevant person;

determining 3D entity representation information, for each of the at least one relevant person;

generating, for at least one participant, a representation of a virtual 3D video conference environment, based on the 3D entity representation information for each of the at least one relevant person; and

continuing to indicate that a relevant person of the at least one relevant person, is within the field of view of the visual sensing unit related to a certain participant, even during a predefined period in which the relevant person exits the field of view of the visual sensing unit; wherein a duration of the predefined period ranges between 5 and 30 seconds.

2. The method according to claim 1 wherein the at least one participant comprises a first participant and a second participant, wherein the at least one relevant person comprises a third participant that differs from the first participant and differs from the second participant;

wherein the method comprises:

(i) generating, for the first participant, a first representation of the virtual 3D video conference environment that comprises an avatar of the third participant;

(ii) generating, for the second participant, a second representation of the virtual 3D video conference environment that is not indicative of a participance of the third participant in the 3D video conference, following a request of the second participant, not to receive an indication regarding a participation of the third participant in the 3D video conference.

3. The method according to claim 1 wherein the finding comprises determining that a non-participant of the 3D video conference is a relevant person.

4. The method according to claim 1 wherein the identifying comprising applying a face recognition process.

5. The method according to claim 1 comprising storing identification information about the at least one relevant person for at least a certain period of time following an appearance of the certain participant and the person.

6. The method according to claim 5 comprising identifying any of the at least one relevant person after the at least one relevant person exited the field of view of the visual sensing unit and then re-entered the field of view of the visual sensing unit; wherein the identifying is based on the identification information.

7. The method according to claim 1 wherein at least one relevant person comprises relevant persons.

8. The method according to claim 7 comprising searching for a physical interaction between the relevant persons.

9. The method according to claim 8 wherein the generating of the updated representation of virtual 3D video conference environment reflects the physical interaction.

10. The method according to claim 7 comprising generating a same-visual-sensing-unit indication that is indicative that the relevant persons are captured by a single visual sensing unit.

11. The method according to claim 7 wherein the visual sensing unit comprises a first camera and a second camera, wherein one of the relevant persons is within a field of view of the first camera, and one other of the relevant persons is within a field of view of the second camera.

12. The method according to claim 7 comprising determining for each relevant person of relevant persons captured by a same visual sensing unit, whether the relevant person speaks or not, and preventing from representing within any representation of the virtual 3D video conference environment, any relevant person that are not speaking.

13. The method according to claim 1 wherein multiple participants participate in the virtual 3D conference; wherein the multiple participants are sensed by a plurality of visual sensing units.

14. The method according to claim 13 wherein the generating, for the at least one participant, the representation of the virtual 3D video conference environment, is also based on 3D entity representation information for participants not included in the at least one relevant person.

15. The method according to claim 13 wherein the receiving and determining are executed by a computerized system that differs from any of the multiple participant devices.

16. A method for conducting a three dimensional (3D) video conference between multiple participants, the method comprises:

acquiring visual information, by a visual sensing unit, the visual sensing unit is related to a certain participant;

identifying multiple persons that appear in the visual information;

finding, out of the multiple persons, at least one relevant person;

determining 3D entity representation information, for each of the at least one relevant person;

generating, for at least one participant, a representation of a virtual 3D video conference environment, based on the 3D entity representation information for each of the at least one relevant person; and

continuing to indicate that a relevant person of the at least one relevant person, is within the field of view of the visual sensing unit related to a certain participant, even during a predefined period in which the relevant person exits the field of view of the visual sensing unit; wherein a duration of the predefined period is a predefined percent of a scheduled duration of the 3D video conference.

17. A method for conducting a three dimensional (3D) video conference between multiple participants, the method comprises:

acquiring visual information, by a visual sensing unit, the visual sensing unit is related to a certain participant;

identifying multiple persons that appear in the visual information;

finding, out of the multiple persons, at least one relevant person;

determining 3D entity representation information, for each of the at least one relevant person;

generating, for at least one participant, a representation of a virtual 3D video conference environment, based on the 3D entity representation information for each of the at least one relevant person; and

continuing to indicate that a relevant person of the at least one relevant person, is within the field of view of the visual sensing unit related to a certain participant, even during a predefined period in which the relevant person exits the field of view of the visual sensing unit; wherein a duration of the predefined period is determined based on an availability of resources for updating the representation of a virtual 3D video conference environment to reflect the exit of the person and a re-entry of the person to the field of view of the visual sensing unit.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 27, 2025
From: TRUEMEETING LTD.
To: CAVENDISH CAPITAL LLC
Reel/Frame 070654/0473 →
CORRECTIVE ASSIGNMENT TO CORRECT THE THE TRUEMEETING, LTD IS THE ASSIGNEE PREVIOUSLY RECORDED AT REEL: 68245 FRAME: 37. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Sep 10, 2024
From: STRASMAN, NERY; GRONAU, YUVAL; OZ, RAN
To: TRUEMEETING, LTD
Reel/Frame 068924/0458 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 10, 2024
From: STRASMAN, NERY; GRONAU, YUVAL; OZ, RAN
To: TRUE MEETING INC.
Reel/Frame 068245/0037 →
Continuity (6)
Continuation 17249468 · Mar 2, 2021
Provisional Application 63201713 · May 10, 2021
Provisional Application 63199014 · Dec 1, 2020
Provisional Application 63081860 · Sep 22, 2020
Provisional Application 63023836 · May 12, 2020
Related Publication 20220053168A1 · Feb 17, 2022
Cited By (1)
US 12,307,590