IP Library Granted Patent US 11,570,404
Granted Patent B2
US 11,570,404 · App. 17/304,382 · Granted Jan 31, 2023

Predicting behavior changes of a participant of a 3D video conference

Inventors: Michael Rabinovich (Tel Aviv, IL); Yuval Gronau (Ramat Hasharon, IL); Ran Oz (Maccabim, IL)
Assignee: TRUE MEETING INC.
H04N7/157G06F3/013G06N3/04G06N3/0454G06T7/11G06T7/70G06T15/04G06T15/20G06T15/205G06T17/20G06T19/00G06T19/20H04N7/144H04N7/147H04N7/152G06T2200/08G06T2207/30201G06T2219/2004
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,570,404
App. No.
17/304,382
Granted
Jan 31, 2023
Kind
B2
Abstract

A method for predicting behavior changes of a participant of a virtual three dimensional (3D) video conference, the method may include determining, for each part of multiple parts of the virtual 3D video conference, and by a first computerized unit, (a) a participant behavioral predictor to be applied by a second computerized unit during the part of the virtual 3D video conference, (b) one or more prediction inaccuracies related to the applying of the participant behavioral predictor during the part of the virtual 3D video conference, and (c) whether to generate and transmit to the second computerized unit prediction inaccuracy metadata that is indicative of at least one prediction inaccuracy that affects a representation of the participant within a virtual 3D video conference environment presented to another participant of the virtual 3D video conference during the part of the virtual 3D video conference; and generating and transmitting to the second computerized unit the prediction inaccuracy metadata, when determining to generate and transmit to the second computerized unit prediction inaccuracy metadata.

Claims (31)

1. A method for predicting behavior changes of a participant of a virtual three dimensional (3D) video conference, the method comprises:

determining, for each part of multiple parts of the virtual 3D video conference, and by a first computerized unit, (a) a participant behavioral predictor to be applied by a second computerized unit during the part of the virtual 3D video conference, (b) one or more prediction inaccuracies related to the applying of the participant behavioral predictor during the part of the virtual 3D video conference, and (c) whether to generate and transmit to the second computerized unit prediction inaccuracy metadata that is indicative of at least one prediction inaccuracy that affects a representation of the participant within a virtual 3D video conference environment presented to another participant of the virtual 3D video conference during the part of the virtual 3D video conference; and

generating and transmitting to the second computerized unit the prediction inaccuracy metadata, when determining to generate and transmit to the second computerized unit prediction inaccuracy metadata.

2. The method according to claim 1 wherein the first computerized entity has access to a video of the participant, the video is acquired during the virtual 3D video conference; and wherein the second computerized entity has no access to the video.

3. The method according to claim 1 wherein the first computerized entity is an image analyzer and wherein the second computerized entity of a rendering unit.

4. The method according to claim 1 wherein the determining of the participant behavioral predictor to be applied by the second computerized unit during the part of the virtual 3D video conference is based on a behavior of the participant during a previous part of the virtual 3D video conference.

5. The method according to claim 1 wherein the determining of whether to generate and transmit to the second computerized unit prediction inaccuracy metadata is based on the effect of the at least one prediction inaccuracy on the representation of the participant.

6. The method according to claim 1 wherein the determining is executed by a machine learning process.

7. The method according to claim 1 comprising determining when the part ends and a new part starts based on the one or more prediction inaccuracies related to the applying of the participant behavioral predictor during the part.

8. The method according to claim 1 comprising sending a part end indicator to the second computerized entity.

9. The method according to claim 1 comprising sending to the second computerized entity, information about the participant behavioral predictor to be applied by the second computerized unit.

10. The method according to claim 1 comprising determining, by the second computerized unit, at each part, the participant behavioral predictor to be applied by the second computerized unit.

11. A non-transitory computer readable medium for predicting behavior changes of a participant of a virtual three dimensional (3D) video conference, the non-transitory computer readable medium that stores instructions for:

determining, for each part of multiple parts of the virtual 3D video conference, and by a first computerized unit, (a) a participant behavioral predictor to be applied by a second computerized unit during the part of the virtual 3D video conference, (b) one or more prediction inaccuracies related to the applying of the participant behavioral predictor during the part of the virtual 3D video conference, and (c) whether to generate and transmit to the second computerized unit prediction inaccuracy metadata that is indicative of at least one prediction inaccuracy that affects a representation of the participant within a virtual 3D video conference environment presented to another participant of the virtual 3D video conference during the part of the virtual 3D video conference; and

generating and transmitting to the second computerized unit the prediction inaccuracy metadata, when determining to generate and transmit to the second computerized unit prediction inaccuracy metadata.

12. The non-transitory computer readable medium according to claim 11 wherein the first computerized entity has access to a video of the participant, the video is acquired during the virtual 3D video conference; and wherein the second computerized entity has no access to the video.

13. The non-transitory computer readable medium according to claim 11 wherein the first computerized entity is an image analyzer and wherein the second computerized entity of a rendering unit.

14. The non-transitory computer readable medium according to claim 11 wherein the determining of the participant behavioral predictor to be applied by the second computerized unit during the part of the virtual 3D video conference is based on a behavior of the participant during a previous part of the virtual 3D video conference.

15. The non-transitory computer readable medium according to claim 11 wherein the determining of whether to generate and transmit to the second computerized unit prediction inaccuracy metadata is based on the effect of the at least one prediction inaccuracy on the representation of the participant.

16. The non-transitory computer readable medium according to claim 11 wherein the determining is executed by a machine learning process.

17. The non-transitory computer readable medium according to claim 11 that stores instructions for determining when the part ends and a new part starts based on the one or more prediction inaccuracies related to the applying of the participant behavioral predictor during the part.

18. The non-transitory computer readable medium according to claim 11 that stores instructions for sending a part end indicator to the second computerized entity.

19. The non-transitory computer readable medium according to claim 11 that stores instructions for sending to the second computerized entity, information about the participant behavioral predictor to be applied by the second computerized unit.

20. The non-transitory computer readable medium according to claim 11 that stores instructions for determining, by the second computerized unit, at each part, the participant behavioral predictor to be applied by the second computerized unit.

21. A method for predicting behavior changes of a participant of a virtual three dimensional (3D) video conference, the method comprises:

(a) determining, by a first computerized unit, a current participant behavior predictor, wherein the determining is based on an analysis of a previous video segment that captured a previous behavior of participant;

(b) calculating a current predicted behavior of the participant by applying the current participant behavior predictor on a current video segment;

(c) comparing the current predicted behavior of the participant to a current actual behavior of the participant to provide a comparison result;

(d) determining whether to generate and transmit prediction inaccuracy metadata, when the comparison result is indicative of one or more prediction inaccuracies; wherein the prediction inaccuracy metadata is indicative of at least one prediction inaccuracy that affects a representation of the participant within a virtual 3D video conference environment presented to another participant of the virtual 3D video conference;

(e) generating the prediction inaccuracy metadata and transmitting, to a second computerized entity, the prediction inaccuracy metadata, when determining to generate and transmit the prediction inaccuracy metadata; and

wherein the method further comprises determining whether to jump to step (a), and jumping to step (a) when determining to jump to step (a).

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 3, 2025
From: TRUEMEETING, INC.
To: CAVENDISH CAPITAL LLC
Reel/Frame 070723/0760 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 28, 2022
From: RABINOVICH, MICHAEL; GRONAU, YUVAL; OZ, RAN
To: TRUE MEETING INC.
Reel/Frame 061892/0963 →
Continuity (6)
Continuation In Part 17249468 · Mar 2, 2021
Provisional Application 63201713 · May 10, 2021
Provisional Application 63199014 · Dec 1, 2020
Provisional Application 63081860 · Sep 22, 2020
Provisional Application 63023836 · May 12, 2020
Related Publication 20210392296A1 · Dec 16, 2021