IP Library › Granted Patent US 11,783,515
Granted Patent B2
US 11,783,515 · App. 17/741,482 · Granted Oct 10, 2023

System and method for mixed reality

Inventors: Amir Sheffer (Haifa, IL); Ayelet Mashiah (Haifa, IL); Ofer Livneh (Haifa, IL); Yoav Ophir (Haifa, IL)
Assignee: ELBIT SYSTEMS LTD.
G06T11/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,783,515
App. No.
17/741,482
Granted
Oct 10, 2023
Kind
B2
Abstract

A mixed reality system, comprising: a data acquisition device configured to acquire real-world data; an output device for providing the real-world data to a user; and a processing circuitry configured to: obtain (a) data acquired by the data acquisition device, and (b) information of one or more virtual entities having properties enabling determination of simulated effects of the virtual entities on the data; determine the simulated effects of the virtual entities on the data utilizing the properties; and provide the user with output on the output device being a manipulation of the data reflecting the simulated effects.

Claims (32)

1. A mixed reality system, comprising:

a data acquisition device configured to acquire real-world data;

an output device for providing the real-world data to a user; and

a processing circuitry configured to:

obtain: (a) the real-world data acquired by the data acquisition device, and (b) information of one or more virtual entities having virtual entities properties enabling determination of simulated effects of the virtual entities on the real-world data;

determine the simulated effects of the virtual entities on the data utilizing the virtual entities properties and one or more data acquisition device parameters of the data acquisition device, wherein the data acquisition device parameters include a dynamic range of the data acquisition device; and

provide the user with output on the output device being a manipulation of the real-world data reflecting the simulated effects.

2. The mixed reality system of claim 1 , wherein the data acquisition device is a sensor or a radio receiver.

3. The mixed reality system of claim 2 , wherein the sensor is one of the following: a camera, a radar, Night Vision Goggles (NVG), a proximity sensor, temperature sensor, an infrared sensor, pressure sensor, light sensor, touch sensor, ultrasonic sensor, color sensor, humidity sensor, tilt sensor, accelerometer, or an acoustic sensor.

4. The mixed reality system of claim 1 , wherein the real-world data is acquired from a training environment, and wherein the virtual entities are designed to simulate training scenarios.

5. The mixed reality system of claim 1 , wherein the simulated effect is one or more of: virtual heat, virtual light, virtual touch, virtual shade, virtual sound, virtual topography, virtual smoke, virtual hit, or virtual ice.

6. The mixed reality system of claim 1 , wherein the data acquisition device parameters also include a noise model characterizing readings of the data acquisition device.

7. The mixed reality system of claim 1 , wherein the data acquisition device parameters also include a signal-to-noise ratio of the data acquisition device.

8. The mixed reality system of claim 1 , wherein the data acquisition device parameters also include a detection limit of the data acquisition device.

9. The mixed reality system of claim 1 , wherein the data acquisition device parameters also include a resolution map of the readings acquired by the data acquisition device.

10. The mixed reality system of claim 1 , wherein the data acquisition device parameters also include a bandwidth of the data acquisition device.

11. The mixed reality system of claim 1 , wherein the data acquisition device parameters also include delay times of the data acquisition device.

12. The mixed reality system of claim 1 , wherein the data acquisition device parameters also include compression rates of the data acquisition device.

13. The mixed reality system of claim 1 , wherein the data acquisition device parameters also include communication methods of the data acquisition device.

14. The mixed reality system of claim 1 , wherein the data acquisition device parameters also include algorithms employed by the data acquisition device.

15. A method comprising:

obtaining, by a processing resource, (a) real-world data acquired by a data acquisition device configured to acquire real-world data, and (b) information of one or more virtual entities having virtual entities properties enabling determination of simulated effects of the virtual entities on the real-world data;

determining, by the processing resource, the simulated effects of the virtual entities on the real-world data utilizing the virtual entities properties and one or more data acquisition device parameters of the data acquisition device, wherein the data acquisition device parameters include a dynamic range of the data acquisition device; and

providing, by the processing resource, a user of an output device, used for providing the real-world data to the user, with output on the output device being a manipulation of the real-world data reflecting the simulated effects.

16. The method of claim 15 , wherein the data acquisition device is a sensor or a radio receiver.

17. The method of claim 16 , wherein the sensor is one of the following: a camera, a radar, Night Vision Goggles (NVG), a proximity sensor, temperature sensor, an infrared sensor, pressure sensor, light sensor, touch sensor, ultrasonic sensor, color sensor, humidity sensor, tilt sensor, accelerometer, or an acoustic sensor.

18. The method of claim 15 , wherein the real-world data is acquired from a training environment, and wherein the virtual entities are designed to simulate training scenarios.

19. The method of claim 15 , wherein the simulated effect is one or more of: virtual heat, virtual light, virtual touch, virtual shade, virtual sound, virtual topography, virtual smoke, virtual hit, or virtual ice.

20. A non-transitory computer readable storage medium having computer readable program code embodied therewith, the computer readable program code, executable by at least one processor of a computer to perform a method comprising:

obtaining, by a processing resource, (a) real-world data acquired by a data acquisition device configured to acquire real-world data, and (b) information of one or more virtual entities having virtual entities properties enabling determination of simulated effects of the virtual entities on the real-world data;

determining, by the processing resource, the simulated effects of the virtual entities on the real-world data utilizing the virtual entities properties and one or more data acquisition device parameters of the data acquisition device, wherein the data acquisition device parameters include a dynamic range of the data acquisition device; and

providing, by the processing resource, a user of an output device, used for providing the real-world data to the user, with output on the output device being a manipulation of the real-world data reflecting the simulated effects.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 11, 2022
From: SHEFFER, AMIR; LIVNEH, OFER; OPHIR, YOAV; MASHIAH, AYELET
To: ELBIT SYSTEMS LTD.
Reel/Frame 059887/0551 →
Priority Claims (2)
IL 270754 · Nov 18, 2019 · national
IL 270755 · Nov 18, 2019 · national
Continuity (2)
Continuation PCTIL2020051179 · Nov 15, 2020
Related Publication 20220270303A1 · Aug 25, 2022
Cited By (6)
US 12,353,457 US 12,664,519 US 12,675,470 US 12,676,878 US 12,711,240 US 12,711,243