IP Library Granted Patent US 12,333,663
Granted Patent B2
US 12,333,663 · App. 18/406,741 · Granted Jun 17, 2025

Systems and methods for using artificial intelligence for improved creation of extended reality worlds, experiences, simulations and learning activities

Inventor: Ethan Fieldman (Gainesville, FL)
Assignee: CURIOXR, INC.
G06T19/006G06F3/017G06T19/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,333,663
App. No.
18/406,741
Granted
Jun 17, 2025
Kind
B2
Abstract

A user creates and changes appearance of a digital object in extended reality environments by voice commands in conjunction pointing input and retrieving a representation of the digital object for display at a location point pointed to by the user with an artificial intelligence process communicating with a database of images or with image-generating software.

Claims (24)

1. A method for generating a digital object in an extended reality environment comprising:

detecting a voice command from a user using an extended reality environment via an extended reality hardware device that requests creation of a digital object for display in the extended reality environment;

detecting a location point being pointed to by a pointing action of the user in the extended reality environment via the extended reality hardware, wherein the location point is a vector with coordinates determined by an intersection point of a ray cast from the pointing action of the user with a representation of a wall or floor in the extended reality environment;

retrieving a representation of the digital object with an artificial intelligence process that provides the representation for displaying the digital object at the location point, wherein the artificial intelligence process provides the representation from one of artificial intelligence image-generating software and a database of images; and

displaying the representation of the digital object at the location point in the extended reality environment via the extended reality hardware device in response to both the detecting of the voice command and the pointing action from the user.

2. A method for generating a digital object in an extended reality environment comprising:

detecting a voice command from a user using an extended reality environment via an extended reality hardware device that requests creation of a digital object for display in the extended reality environment;

detecting a location point being pointed to by a pointing action of the user in the extended reality environment via the extended reality hardware, wherein the location point is a vector with coordinates determined by an intersection point of a ray cast from the pointing action of the user with an existing extended reality object in the extended reality environment;

retrieving a representation of the digital object with an artificial intelligence process that provides the representation for displaying the digital object at the location point, wherein the artificial intelligence process provides the representation from one of artificial intelligence image-generating software and a database of images; and

displaying the representation of the digital object at the location point on or interacting with the existing extended reality object in the extended reality environment via the extended reality hardware device in response to both the detecting of the voice command and the pointing action from the user.

3. A method for generating a digital object in an extended reality environment comprising:

detecting a voice command from a user using an extended reality environment via an extended reality hardware device that requests creation of a digital object for display in the extended reality environment;

detecting a location point being pointed to by a pointing action of the user in the extended reality environment via the extended reality hardware;

retrieving a representation of the digital object with an artificial intelligence process that provides the representation for displaying the digital object at the location point, wherein the artificial intelligence process provides the representation from one of artificial intelligence image-generating software and a database of images;

displaying the representation of the digital object at the location point in the extended reality environment via the extended reality hardware device in response to both the detecting of the voice command and the pointing action from the user;

receiving a size gesture detected from one or more hands of the user via the extended reality hardware device that the digital object should be represented according to the size gesture; and

displaying the representation of the digital object via the extended reality hardware device in the extended reality environment as including a size in accordance with the size gesture.

4. The method of claim 3 , wherein the size gesture is received from detection of both hands of the user via the extended reality hardware device.

5. A method for generating a digital object in an extended reality environment comprising:

detecting a voice command from a user using an extended reality environment via an extended reality hardware device that requests creation of a digital object for display in the extended reality environment;

detecting a location point being pointed to by a pointing action of the user in the extended reality environment via the extended reality hardware, wherein the location point is a vector with coordinates determined by an intersection point of a ray cast from the pointing action of the user with a representation of a wall or floor in the extended reality environment;

retrieving a representation of the digital object with an artificial intelligence process that provides the representation for displaying the digital object at the location point, wherein the artificial intelligence process provides the representation from one of artificial intelligence image-generating software and a database of images;

retrieving multiple different representations of the digital object with the artificial intelligence process and receiving selection of the representation of the digital object to display at the location point from the user; and

displaying the representation of the digital object at the location point in the extended reality environment via the extended reality hardware device in response to both the detecting of the voice command and the pointing action from the user.

Assignments (2)
CHANGE OF NAME Recorded Dec 4, 2024
From: VR-EDU, INC.
To: CURIOXR, INC.
Reel/Frame 069510/0242 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 11, 2024
From: FIELDMAN, ETHAN
To: VR-EDU, INC.
Reel/Frame 066711/0926 →
Continuity (2)
Continuation 18306800 · Apr 25, 2023
Related Publication 20240362868A1 · Oct 31, 2024
References Cited (17)
US 20110036452A1 · Schnyder · 2011 [cited by applicant]
US 20130307875A1 · Anderson · 2013 [cited by examiner]
US 20160026242A1 · Burns et al. · 2016 [cited by applicant]
US 20160203640A1 · Breedvelt-Schouten et al. · 2016 [cited by applicant]
US 20160286163A1 · Edwards · 2016 [cited by applicant]
US 20170052595A1 · Poulos · 2017 [cited by examiner]
US 20170135519A1 · Deng et al. · 2017 [cited by applicant]
US 20180143693A1 · Calabrese et al. · 2018 [cited by applicant]
US 20180300952A1 · Evans · 2018 [cited by examiner]
US 20220202493A1 · Gibby et al. · 2022 [cited by applicant]
US 20220366659A1 · Blakeley · 2022 [cited by examiner]
US 20230410436A1 · Beauchamp · 2023 [cited by examiner]
Meta AI, “Builder Bot Demo,” Feb. 23, 2022, https://www.youtube.com/watch?v=62RJv514ijQ, accessed May 10, 2023. [cited by applicant]
Malik, Aisha, “Mark Zuckerberg demos a tool for building virtual worlds using voice commands,” Feb. 23, 2022, https://techcrunch.com/2022/02/23/mark-zuckerberg-demos-a-tool-for-building-virtual-worlds-using-voice-comman… [cited by applicant]
“Dall E 2,” https://openai.com/product/dall-e-2, accessed May 10, 2023. [cited by applicant]
G2.com, Inc., “Dall E 2 Alternatives,” https://www.g2.com/search?utf8=%E2%9C%98&query=Dall-E, accessed May 10, 2023. [cited by applicant]
G2.com, Inc., “Best Synthetic Media Software,” https://www.g2.com/categories/synthetic-media, accessed May 10, 2023. [cited by applicant]