IP Library Granted Patent US 12,045,432
Granted Patent B2
US 12,045,432 · App. 17/497,704 · Granted Jul 23, 2024

Interactive virtual interface

Inventors: Palmer F. Luckey (Newport Beach, CA); Jason Levin (Costa Mesa, CA); Julian Hammerstein (Murrieta, CA); Joseph Chen (Irvine, CA); Maximillian Zheng Wang (Irvine, CA)
Assignee: Anduril Industries, Inc.
G06F3/04815G01S7/51G01S17/42G06F3/017G06F3/0482G06F3/167G06F9/451G06T15/20G06T17/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,045,432
App. No.
17/497,704
Granted
Jul 23, 2024
Kind
B2
Abstract

A system for display and interaction includes an interface and a processor. The interface is configured to receive data from one or more sensors. The processor is configured to convert the data to a common synthetic data space; provide the common synthetic data space for display; receive a command associated with an object represented in the common synthetic data space; and cause display of an icon indicating a command has been issued.

Claims (42)

1. A system for user display and interaction, comprising:

an interface configured to receive data from one or more sensors; and

a processor configured to:

convert the data to a common synthetic data space;

provide the common synthetic data space for display;

receive a command associated with an object represented in the common synthetic data space;

issue the command to a real-world moveable asset, wherein the asset is represented in the common synthetic data space, and wherein the command directs the asset to carry out an action associated with the object;

determine whether the real-world moveable asset has responded to the command; and

in response to a determination that the real-world moveable asset has not responded to the command, cause display in the synthetic data space of an issuance time of the command.

2. The system of claim 1 , wherein the processor is further configured to cause display of an icon in the synthetic data space indicating the command has been issued to the asset, wherein the icon is displayed adjacent to the object in the common synthetic data space.

3. The system of claim 2 , wherein the icon comprises a loading indicator.

4. The system of claim 1 , wherein the processor is further configured to receive an acknowledgement of the command from the asset.

5. The system of claim 4 , wherein the processor is further configured to cause removal of display of the icon in response to receiving the acknowledgement of the command from the asset.

6. The system of claim 1 , wherein the data received includes one or more of: LIDAR data, optical imaging data, thermal data, and/or data collected by a drone.

7. The system of claim 1 , wherein converting the data to a common synthetic data space comprises converting a lower dimensional data to a higher dimensional representation.

8. The system of claim 1 , wherein providing the common synthetic data space for display includes one or more of: providing a first-person point of view from the object represented in the common synthetic data space, a third-person point of view from the object represented in the common synthetic data space, and/or an overhead point of view of at least a portion of the common synthetic data space.

9. The system of claim 1 , wherein providing the common synthetic data space for display includes allowing for adjustments of scale associated with a point of view.

10. The system of claim 1 , wherein the display of the common synthetic data space combines a plurality of layers of sensor data.

11. The system of claim 1 , wherein the display of the common synthetic data space includes providing updated locations of one or more objects.

12. The system of claim 1 , wherein the command received includes one or more of a voice command, a hand gesture command, and/or a command initiated using a computer interface device.

13. The system of claim 1 , wherein the command issued to the asset is to monitor the object represented in the common synthetic data space and that object corresponds to a real-world object.

14. The system of claim 1 , wherein the command is received by the asset from one or more issuers.

15. The system of claim 1 , wherein the processor is further configured to display a menu indicating one or more possible commands associated with the object.

16. The system of claim 1 , wherein the processor is further configured to give an alert regarding an item of potential interest.

17. The system of claim 16 , wherein the item of potential interest includes a reappearance of a previously tagged object.

18. The system of claim 16 , wherein the item of potential interest includes an entry of a second object into a zone of interest.

19. A method of user display and interaction, comprising:

receive data from one or more sensors;

converting, using a processor, data to a common synthetic data space;

providing the common synthetic data space for display;

receiving a command associated with an object represented in the common synthetic data space;

issuing the command to a real-world moveable asset, wherein the asset is represented in the common synthetic data space, and wherein the command directs the asset to carry out an action associated with the object;

determining whether the real-world moveable asset has responded to the command; and

in response to a determination that the real-world moveable asset has not responded to the command, causing display in the synthetic data space of an issuance time of the command.

20. A computer program product for user display and interaction, the computer program product being embodied in a non-transitory computer readable storage medium and comprising computer instructions for:

receive data from one or more sensors;

converting, using a processor, data to a common synthetic data space;

providing the common synthetic data space for display;

receiving a command associated with an object represented in the common synthetic data space;

issuing the command to a real-world moveable asset, wherein the asset is represented in the common synthetic data space, and wherein the command directs the asset to carry out an action associated with the object;

determining whether the real-world moveable asset has responded to the command; and

in response to a determination that the real-world moveable asset has not responded to the command, causing display in the synthetic data space of an issuance time of the command.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 27, 2025
From: LUCKEY, PALMER F.; LEVIN, JASON; HAMMERSTEIN, JULIAN; CHEN, JOSEPH; WANG, MAXIMILLIAN ZHENG
To: ANDURIL INDUSTRIES, INC.
Reel/Frame 071548/0982 →
SECURITY INTEREST Recorded Aug 9, 2024
From: ANDURIL INDUSTRIES, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC., AS COLLATERAL AGENT
Reel/Frame 068526/0728 →
Continuity (2)
Continuation 16201882 · Nov 27, 2018
Related Publication 20220027038A1 · Jan 27, 2022