IP Library Granted Patent US 11,818,506
Granted Patent B2
US 11,818,506 · App. 17/249,470 · Granted Nov 14, 2023

Circumstances based 3D representations of participants of virtual 3D communications

Inventors: Ran Oz (Maccabim, IL); Yuval Gronau (Ramat Hasharon, IL); Michael Rabinovich (Tel Aviv, IL); Osnat Goren-Peyser (Tel Aviv, IL); Tal Perl (Los Altos, CA)
Assignee: TRUE MEETING INC.
H04N7/157G06F3/013G06N3/04G06N3/045G06T7/11G06T7/70G06T15/04G06T15/20G06T15/205G06T17/20G06T19/20H04N7/144H04N7/147H04N7/152G06T19/00G06T2200/08G06T2207/30201G06T2219/2004
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,818,506
App. No.
17/249,470
Granted
Nov 14, 2023
Kind
B2
Abstract

A method for conducting a three dimensional (3D) video conference between multiple participants, the method may include receiving initial 3D participant representation information for generating the 3D representation of the participant under different circumstances; receiving, by a user device of a first participant and during the 3D video conference call, second participant circumstances metadata indicative of one or more current circumstances regarding a second participant; and updating, by the user device of the first participant, a 3D participant representation of the second participant, within a first representation of virtual 3D video conference environment.

Claims (27)

1. A method for conducting a three dimensional (3D) video conference between multiple participants, the method comprises:

receiving, by a user device of a first participant, initial 3D participant representation information of a second participant for generating 3D representation of the second participant under different second user circumstances; wherein the initial 3D participant representation information of the second participant comprises a 3D model of the second participant and one or more texture maps of the second participant;

receiving, by the user device of the first participant and during the 3D video conference call, second participant circumstances metadata indicative of one or more current circumstances regarding the second participant, wherein the second participant circumstances metadata is sent to the user device of the first participant instead of sending, during the 3D video conference call, an entire 3D model of the second participant; and

updating, by the user device of the first participant, a 3D participant representation of the second participant, within a first representation of virtual 3D video conference environment.

2. The method according to claim 1 wherein the different circumstances comprise different image acquisition conditions.

3. The method according to claim 1 wherein the different circumstances comprise different directions of gaze.

4. The method according to claim 1 wherein the different circumstances comprise different expressions.

5. The method according to claim 1 wherein the initial 3D participant representation information of the second participant comprises different 3D models of the second participant, wherein the different 3D models are associated with the different circumstances.

6. The method according to claim 1 wherein the updating of the 3D participant representation of the second participant comprising selecting a selected 3D model of the second participant one of the different 3D models of the second participant.

7. The method according to claim 6 comprising smoothing a transition between one selected model of the second participant to another selected model of the second participant.

8. A non-transitory computer readable medium for conducting a three dimensional (3D) video conference between multiple participants, the non-transitory computer readable medium stores instructions for:

receiving, by a user device of a first participant, initial 3D participant representation information of a second participant for generating 3D representation of the second participant under different second user circumstances; wherein the initial 3D participant representation information of the second participant comprises a 3D model of the second participant and one or more initial texture maps of the second participant;

receiving, by the user device of the first participant and during the 3D video conference call, second participant circumstances metadata indicative of one or more current circumstances regarding the second participant, wherein the second participant circumstances metadata is sent to the user device of the first participant instead of sending, during the 3D video conference call, an entire 3D model of the second participant;

and

updating, by the user device of the first participant, a 3D participant representation of the second participant, within a first representation of virtual 3D video conference environment.

9. The non-transitory computer readable medium according to claim 8 wherein the different circumstances comprise different image acquisition conditions.

10. The non-transitory computer readable medium according to claim 8 wherein the different circumstances comprise different directions of gaze.

11. The non-transitory computer readable medium according to claim 8 wherein the different circumstances comprise different expressions.

12. The non-transitory computer readable medium according to claim 8 wherein the initial 3D participant representation information of the second participant comprises different 3D models of the second participant, wherein the different 3D models are associated with the different circumstances.

13. The non-transitory computer readable medium according to claim 8 wherein the updating of the 3D participant representation of the second participant comprising selecting a selected 3D model of the second participant one of the different 3D models of the second participant.

14. The non-transitory computer readable medium according to claim 13 that stores instructions for smoothing a transition between one selected model of the second participant to another selected model of the second participant.

15. The method according to claim 1 wherein the updating comprises augmenting a texture map of the one or more texture maps based on a combination of shape, pose and expression.

16. The method according to claim 1 wherein the updating comprises augmenting a texture map of the one or more texture maps, wherein the augmenting comprises changing facial make-up effects.

17. The method according to claim 1 wherein the updating comprises augmenting a texture map of the one or more texture maps, wherein the augmenting comprises adding or removing facial hair features.

18. The method according to claim 1 wherein the updating comprises augmenting a texture map of the one or more texture maps, wherein the augmenting comprises adding or removing accessories.

19. The non-transitory computer readable medium according to claim 13 wherein the updating comprises augmenting a texture map of the one or more texture maps based on a combination of shape, pose and expression.

20. The non-transitory computer readable medium according to claim 13 wherein the updating comprises augmenting a texture map of the one or more texture maps, wherein the augmenting comprises adding or removing facial hair features.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 27, 2025
From: TRUEMEETING LTD.
To: CAVENDISH CAPITAL LLC
Reel/Frame 070654/0473 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE PREVIOUSLY RECORDED ON REEL 56192 FRAME 351. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Aug 18, 2024
From: OZ, RAN; GRONAU, YUVAL; RABINOVICH, MICHAEL; GOREN-PEYSER, OSNAT; PERL, TAL
To: TRUEMEETING, LTD
Reel/Frame 068685/0966 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 10, 2021
From: OZ, RAN; GRONAU, YUVAL; RABINOVICH, MICHAEL; GOREN-PEYSER, OSNAT; PERL, TAL
To: TRUE MEETING INC.
Reel/Frame 056192/0351 →
Continuity (4)
Provisional Application 63199014 · Dec 1, 2020
Provisional Application 63081860 · Sep 22, 2020
Provisional Application 63023836 · May 12, 2020
Related Publication 20210360197A1 · Nov 18, 2021