IP Library Granted Patent US 11,956,571
Granted Patent B2
US 11,956,571 · App. 17/875,666 · Granted Apr 9, 2024

Scene freezing and unfreezing

Inventors: Gerard Cornelis Krol (Leiden, NL); Petr Polyakov (Tampa, FL)
Assignee: KATMAI TECH INC.
H04N7/157G06T3/00G06T7/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,956,571
App. No.
17/875,666
Granted
Apr 9, 2024
Kind
B2
Abstract

Disclosed herein is a web-based videoconference system that allows for video avatars to navigate within a virtual environment. Various methods for efficient modeling, rendering, and shading are disclosed herein.

Claims (40)

1. A computer-implemented method for efficient rendering in a three-dimensional virtual environment including a plurality of nodes in a tree hierarchy, the plurality of nodes each representing an object displayed in a scene of a video conferencing application, the method comprising:

repeatedly to traverse the tree hierarchy, for respective nodes of the tree hierarchy:

(a) evaluating whether a position, rotation or scale of an object of represented by the respective node in the tree hierarchy needs to be updated;

(b) when the position, rotation and scale of the object needs to be updated, transforming the object;

(c) determining whether the object is labeled as fixed by referencing the tree hierarchy and identifying a child of the respective node, wherein a fixed object is a static object that is stationary within the three-dimensional virtual environment and cannot move, transform, or rotate;

(d) when determining whether the object is not labeled as fixed, repeating (a) and (b) for the child of the respective node; and

(e) when determining whether the object is labeled as fixed and the position, rotation and scale of the object does not need to be updated, halting (a) and (b) for the child of the respective node.

2. The method of claim 1 , wherein the transforming comprises playing an animation.

3. The method of claim 1 , wherein the object is labeled as fixed, and wherein the object presents at least a portion of a three-dimensional arena.

4. The method of claim 1 , wherein the object is not labeled as fixed, and wherein the object represents a participant to a virtual conference.

5. The method of claim 4 , wherein a location of the object in the three-dimensional virtual environment is controlled by the participant.

6. The method of claim 5 , wherein texture mapped to the object is video captured of the participant.

7. The method of claim 6 , wherein the object is a polygon having a surface displaying the video captured of the participant.

8. A computer-readable non-transitory storage medium comprising instructions which, when executed by a computer, cause the computer to carry out operations for efficient rendering in a three-dimensional virtual environment including a plurality of nodes in a tree hierarchy, the plurality of nodes each representing an object displayed in a scene of a video conferencing application, the operations comprising:

repeatedly to traverse the tree hierarchy, for respective nodes of the tree hierarchy:

(a) evaluating whether a position, rotation or scale of an object of represented by the respective node in the tree hierarchy needs to be updated;

(b) when the position, rotation and scale of the object needs to be updated, transforming the object;

(c) determining whether the object is labeled as fixed by referencing the tree hierarchy and identifying a child of the respective node, wherein a fixed object is a static object that is stationary within the three-dimensional virtual environment and cannot move, transform, or rotate;

(d) when determining whether the object is not labeled as fixed, repeating (a) and (b) for the child of the respective node; and

(e) when determining whether the object is labeled as fixed and the position, rotation and scale of the object does not need to be updated, halting (a) and (b) for the child of the respective node.

9. The computer-readable non-transitory storage medium of claim 8 , wherein the transforming comprises playing an animation.

10. The computer-readable non-transitory storage medium of claim 8 , wherein the object is labeled as fixed, and wherein the object presents at least a portion of a three-dimensional arena.

11. The computer-readable non-transitory storage medium of claim 8 , wherein the object is not labeled as fixed, and wherein the object represents a participant to a virtual conference.

12. The computer-readable non-transitory storage medium of claim 11 , wherein a location of the object in the three-dimensional virtual environment is controlled by the participant.

13. The computer-readable non-transitory storage medium of claim 12 , wherein texture mapped to the object is video captured of the participant.

14. A system for efficient rendering in a three-dimensional virtual environment including a plurality of nodes in a tree hierarchy, the plurality of nodes each representing an object displayed in a scene of a video conferencing application, comprising:

a memory;

a processor coupled to the memory;

a model optimizer executable by the processor and configured to determine whether the object is labeled as fixed by referencing the tree hierarchy and identifying a child of the respective node; and

at least one function executable by the processor and configured to traverse the tree hierarchy, and for respective nodes of the tree hierarchy:

(i) evaluate whether a position, rotation or scale of an object of represented by the respective node in the tree hierarchy needs to be updated,

(ii) when the position, rotation and scale of the object needs to be updated, transform the object,

(iii) when determining whether the object is not labeled as fixed, repeat (i) and (ii) for the child of the respective node, wherein a fixed object is a static object that is stationary within the three-dimensional virtual environment and cannot move, transform, or rotate, and

(iv) when the object is labeled as fixed and the position, rotation and scale of the object does not need to be updated, halt (i) and (ii) for the child of the respective node.

15. The system of claim 14 , wherein the transforming (ii) comprises playing an animation.

16. The system of claim 14 , wherein the object is labeled as fixed, and wherein the object presents at least a portion of a three-dimensional arena.

17. The system of claim 16 , wherein the object is not labeled as fixed, and wherein the object represents a participant to a virtual conference.

18. The system of claim 14 , wherein a location of the object in the three-dimensional virtual environment is controlled by a participant.

19. The system of claim 14 , wherein texture mapped to the object is video captured of a participant.

20. The system of claim 19 , wherein the object is a polygon having a surface displaying the video captured of the participant.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 13, 2022
From: KROL, GERARD CORNELIS; POLYAKOV, PETR
To: KATMAI TECH INC.
Reel/Frame 061406/0108 →
Continuity (1)
Related Publication 20240040086A1 · Feb 1, 2024
Cited By (3)
US 12,186,663 US 12,280,312 US 12,368,821