IP Library Granted Patent US 11,652,959
Granted Patent B2
US 11,652,959 · App. 17/249,478 · Granted May 16, 2023

Generating a 3D visual representation of the 3D object using a neural network selected out of multiple neural networks

Inventors: Ran Oz (Maccabim, IL); Yuval Gronau (Ramat Hasharon, IL); Michael Rabinovich (Tel Aviv, IL); Osnat Goren-Peyser (Tel Aviv, IL); Tal Perl (Los Altos, CA)
Assignee: TRUE MEETING INC.
H04N7/157G06F3/013G06N3/04G06N3/0454G06T7/11G06T7/70G06T15/04G06T15/20G06T15/205G06T17/20G06T19/20H04N7/144H04N7/147H04N7/152G06T19/00G06T2200/08G06T2207/30201G06T2219/2004
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,652,959
App. No.
17/249,478
Granted
May 16, 2023
Kind
B2
Abstract

A method for generating a three dimensional (3D) visual representation of a sensed object that is three dimensional, the method comprises obtaining at least one 3D visual representation parameter, the visual representation parameters is selected out of a size parameter, a resolution parameter, and a resource consumption parameter; obtaining object information that represents the sensed object; selecting, based on the at least one parameter, a neural network for generating the visual representation of the sensed object; and generating the 3D visual representation of the 3D object by the selected neural network.

Claims (28)

1. A method for generating a three dimensional (3D) visual representation of a sensed object that is three dimensional, the method comprises:

obtaining a 3D visual representation parameter, the visual representation parameters is selected out of a size parameter, a resolution parameter, and a resource consumption parameter;

obtaining object information that represents the sensed object;

selecting, based on a value of the 3D visual representation parameter, a selected neural network for generating the visual representation of the sensed object; wherein the selected neural network is selected out of a group of neural networks, wherein different neural networks of the group are associated with different values of the 3D visual representation parameter

and

generating the 3D visual representation of the 3D object by the selected neural network, without using other neural networks of the group that are associated with other values of the 3D visual representation.

2. The method according to claim 1 wherein the generating of the visual representation comprising generating a 3D model of the 3D object and at least one 2D texture map of the 3D object.

3. The method according to claim 2 wherein the generating comprises further processing the 3D model and the 2D texture map during a rendering process of at least one rendered image.

4. The method according to claim 2 wherein the generating is executed by a first computerized unit, wherein the generating is followed by sending the 3D model and the at least one 2D texture map to a second computerized unit configured to render at least one rendered image based on the 3D model and the at least one 2D texture map.

5. The method according to claim 1 wherein the 3D object is a participant of a 3D video conference.

6. The method according to claim 1 comprising outputting the 3D visual representation from the selected set of neural network outputs.

7. The method according to claim 6 wherein the 3D object is a participant of a 3D video conference.

8. The method according to claim 1 , wherein the 3D object is a second participant of a 3D video conference, wherein the obtaining of the 3D visual representation parameter comprises (i) receiving a zoom level requested by a first participant of the 3D video conference; (ii) determining a size of an image of the second participant in a virtual environment displayed to the first participant during the 3D video conference, and (ii) determining, based on the size, the value of a resolution of the selected neural network.

9. The method according to claim 8 , wherein the value of resolution is lower than a highest resolution associated with a highest resolution neural network of the group;

and wherein the generating of the 3D visual representation of the 3D object by the selected neural network involves performing less calculation in relation to a generation of the 3D visual representation of the 3D object by the highest resolution neural network.

10. A non-transitory computer readable medium for generating a three dimensional (3D) visual representation of a sensed object that is three dimensional, the non-transitory computer readable medium that stores instructions for:

obtaining a 3D visual representation parameter, the 3D visual representation parameters is selected out of a size parameter, a resolution parameter, and a resource consumption parameter;

obtaining object information that represents the sensed object;

selecting, based on a value of the 3D visual representation parameter, a selected neural network for generating the visual representation of the sensed object; wherein the selected neural network is selected out of a group of neural networks, wherein different neural networks of the group are associated with different values of the 3D visual representation parameter; and

generating the 3D visual representation of the 3D object by the selected neural network, without using other neural networks of the group that are associated with other values of the 3D visual representation.

11. The non-transitory computer readable medium according to claim 10 wherein the generating of the visual representation comprising generating a 3D model of the 3D object and at least one 2D texture map of the 3D object.

12. The non-transitory computer readable medium according to claim 11 wherein the generating comprises further processing the 3D model and the 2D texture map during a rendering process of at least one rendered image.

13. The non-transitory computer readable medium according to claim 11 wherein the generating is executed by a first computerized unit, wherein the generating is followed by sending the 3D model and the at least one 2D texture map to a second computerized unit configured to render at least one rendered image based on the 3D model and the at least one 2D texture map.

14. The non-transitory computer readable medium according to claim 10 wherein the 3D object is a participant of a 3D video conference.

15. The non-transitory computer readable medium according to claim 10 that stores instructions for outputting the 3D visual representation from the selected set of neural network outputs.

16. The non-transitory computer readable medium according to claim 15 wherein the 3D object is a participant of a 3D video conference.

17. The non-transitory computer readable medium according to claim 10 , wherein the 3D object is a second participant of a 3D video conference, wherein the obtaining of the 3D visual representation parameter comprises (i) receiving a zoom level requested by a first participant of the 3D video conference; (ii) determining a size of an image of the second participant in a virtual environment displayed to the first participant during the 3D video conference, and (ii) determining, based on the size, the value of a resolution of the selected neural network.

18. The non-transitory computer readable medium according to claim 17 , wherein the value of resolution is lower than a highest resolution associated with a highest resolution neural network of the group; and wherein the generating of the 3D visual representation of the 3D object by the selected neural network involves performing less calculation in relation to a generation of the 3D visual representation of the 3D object by the highest resolution neural network.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 27, 2025
From: TRUEMEETING LTD.
To: CAVENDISH CAPITAL LLC
Reel/Frame 070654/0473 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE PREVIOUSLY RECORDED ON REEL 56208 FRAME 542. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Aug 18, 2024
From: OZ, RAN; GRONAU, YUVAL; RABINOVICH, MICHAEL; GOREN-PEYSER, OSNAT; PERL, TAL
To: TRUEMEETING, LTD.
Reel/Frame 068686/0403 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 11, 2021
From: OZ, RAN; GRONAU, YUVAL; RABINOVICH, MICHAEL; GOREN-PEYSER, OSNAT; PERL, TAL
To: TRUE MEETING INC.
Reel/Frame 056208/0542 →
Continuity (4)
Provisional Application 63199014 · Dec 1, 2020
Provisional Application 63081860 · Sep 22, 2020
Provisional Application 63023836 · May 12, 2020
Related Publication 20210358194A1 · Nov 18, 2021
Cited By (2)
US 12,299,773 US 12,695,616