IP Library Patent Application 15990877
Patent Application
App. No. 15/990,877

METHOD AND SYSTEM FOR CREATING AND SIMULATING A REALISTIC 3D VIRTUAL WORLD

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
15/990,877
Abstract

A computer implemented method of creating data for a host vehicle simulation, comprising: in each of a plurality of iterations of a host vehicle simulation using at least one processor for: obtaining from an environment simulation engine a semantic-data dataset representing a plurality of scene objects in a geographical area, each one of the plurality of scene objects comprises at least object location coordinates and a plurality of values of semantically described parameters; creating a 3D visual realistic scene emulating the geographical area according to the dataset; applying at least one noise pattern associated with at least one sensor of a vehicle simulated by the host vehicle simulation engine on the virtual 3D visual realistic scene to create sensory ranging data simulation of the geographical area; converting the sensory ranging data simulation to an enhanced dataset emulating the geographical area, the enhanced dataset comprises a plurality of enhanced scene objects.

Claims (31)

1 . A computer implemented method of creating data for a host vehicle simulation, comprising:

in each of a plurality of iterations of a host vehicle simulation engine, using at least one processor for:

obtaining from an environment simulation engine a semantic-data dataset representing a plurality of scene objects in a geographical area, each one of said plurality of scene objects comprises at least object location coordinates and a plurality of values of semantically described parameters;

creating a virtual three dimensional (3D) visual realistic scene emulating said geographical area according to said semantic-data dataset;

applying at least one noise pattern associated with at least one sensor of a vehicle simulated by said host vehicle simulation engine on said virtual 3D visual realistic scene to create sensory ranging data simulation of said geographical area;

converting said sensory ranging data simulation to an enhanced semantic-data dataset emulating said geographical area, said enhanced semantic-data dataset comprises a plurality of enhanced scene objects comprising adjusted object location coordinates and a plurality of adapted values of respective said semantically described parameters; and

providing said enhanced semantic-data dataset to said host vehicle simulation engine for updating a simulation of said vehicle in said geographical area.

2 . The method of claim 1 , wherein creating said virtual 3D visual realistic scene comprises executing a neural network;

wherein said neural network receives said semantic-data dataset; and

wherein said neural network generates said virtual 3D visual realistic scene according to said semantic-data dataset.

3 . The method of claim 2 , wherein said neural network is trained using a perceptual loss function.

4 . The method of claim 2 , wherein said neural network is a generator network of a Generative Adversarial Neural Network (GAN) or of a Conditional Generative Adversarial Neural Network (cGAN).

5 . The method of claim 1 , wherein said at least one sensor of said vehicle simulated by said host vehicle simulation engine is selected from a group of sensors consisting of: a camera, a video camera, an infrared camera, a night vision sensor, a Light Detection and Ranging (LIDAR) sensor, a radar, and an ultra-sonic sensor.

6 . The method of claim 1 , wherein providing said enhanced semantic-data dataset to said host vehicle simulation engine comprises sending a stream of data to at least one other processor via at least one digital communication network interface connected to said at least one processor.

7 . The method of claim 1 , wherein providing said enhanced semantic-data dataset to said host vehicle simulation engine comprises storing a file on a shared access memory accessible by said host vehicle simulation engine.

8 . The method of claim 1 , wherein providing said enhanced semantic-data dataset to said host vehicle simulation engine comprises storing a file on a digital data storage.

9 . The method of claim 2 , wherein said neural network is trained using optical flow estimation to reduce temporal inconsistency between consecutive frames of a created virtual 3D visual realistic scene.

10 . The method of claim 1 , further comprising using the at least one processor for:

generating report data comprising at least one of analysis report data and analytics report data; and

outputting said report data.

11 . A system for creating data for a host vehicle simulation, comprising:

an input interface for obtaining from an environment simulation engine in each of a plurality of iterations a semantic-data dataset representing a plurality of scene objects in a geographical area, each one of said plurality of scene objects comprises at least object location coordinates and a plurality of values of semantically described parameters;

at least one processor for:

creating a virtual three dimensional (3D) visual realistic scene emulating said geographical area according to said semantic-data dataset;

applying at least one noise pattern associated with at least one sensor of a vehicle simulated by a host vehicle simulation engine on said virtual 3D visual realistic scene to create sensory ranging data simulation of said geographical area;

converting said sensory ranging data simulation to an enhanced semantic-data dataset emulating said geographical area, said enhanced semantic-data dataset comprises a plurality of enhanced scene objects comprising adjusted object location coordinates and a plurality of adapted values of respective said semantically described parameters; and

an output interface for providing said enhanced semantic-data dataset to said host vehicle simulation engine for updating a simulation of said vehicle in said geographical area.

12 . The system of claim 11 , wherein said output interface is a digital communication network interface.

13 . The system of claim 11 , further comprising a digital memory for at least one of storing code and storing an enhanced semantic-data dataset.

14 . The system of claim 11 , further comprising a digital data storage connected to said at least one processor via said output interface.

15 . The system of claim 14 , wherein said digital data storage is selected from a group consisting of: a storage area network, a network attached storage, a hard disk drive, an optical disk, and a solid state storage.

Assignments (3)
RELEASE OF SECURITY INTEREST Recorded Mar 16, 2026
From: KREOS CAPITAL VII AGGREGATOR SCSP
To: COGNATA LTD.
Reel/Frame 074083/0680 →
SECURITY INTEREST Recorded Sep 22, 2022
From: COGNATA LTD
To: KREOS CAPITAL VII AGGREGATOR SCSP
Reel/Frame 061174/0485 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 12, 2018
From: ATSMON, DAN; TSAFRIR, GUY; ASA, ERAN
To: COGNATA LTD.
Reel/Frame 046051/0129 →