IP Library Patent Application 18766626
Patent Application
App. No. 18/766,626

CHARACTER AND TEXT RECOGNITION IN EXTENDED REALITY ENVIRONMENTS

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
18/766,626
Abstract

Systems and methods for aligning and recognizing text in extended reality environments include determining a plane and aligning text on that plane in the extended reality environment to provide for text recognition and interactivity of the recognized text.

Claims (52)

1 . A system for performing three-dimensional optical character recognition, wherein the system comprises:

a display, memory, and input and output devices, each communicatively coupled to a processor, wherein the processor is configured to:

determine a plane in an extended reality environment;

upon determining the plane, modify a location of one or more pixels representing text such that the one or more pixels are located on the plane in the extended reality environment;

identify, via a three-dimensional optical character recognition algorithm, one or more characters of the text from the one or more pixels in the extended reality environment;

generate interactable text based on the identified one or more characters from the text; and

align the interactable text on the plane in the extended reality environment such that the interactable text is a modifiable representation of the text as presented by the one or more pixels.

2 . The system of claim 1 , wherein the processor is configured to:

determine if the one or more pixels representing the text when the text is already located on or next to a vertical plane of the determined plane in the extended reality environment, wherein the text is representative of one or more words, characters, numbers, symbols, or any combination thereof; and

refrain from adjusting the one or more pixels representing the text when the text is already located on or next to a vertical plane of the determined plane in the extended reality environment.

3 . The system of claim 1 , wherein the processor is configured to:

receive one or more commands via an input device, wherein the one or more commands are representative of one or more modifications to one or more characteristics of the interactable text;

identify the one or more modifications from the one or more commands; and

modify, based on the one or more modifications, one or more characteristics of the interactable text.

4 . The system of claim 3 , wherein the one or more characteristics comprise

size, pitch, yawl, roll, a relative position in the extended virtual reality environment based on the set of coordinates, or any combination thereof; and

the one or more commands include at least one of a hand movement, analog button input, voice command, and virtual selection via an interactable button in the extended reality environment.

5 . The system of claim 1 , wherein configuration of the processor to determine the plane is based at least upon a minimized standard deviation.

6 . The system of claim 1 , wherein the processor is configured to generate an accuracy rating based on a comparison of the text and the interactable text.

7 . A method, comprising:

identifying a set of text from three-dimensional writings in an extended reality environment;

determining a plane in the extended reality environment based on a set of locations of each text of the set of text, wherein the set of locations comprises a three-dimensional position of each text of the set of text in the extended reality environment;

upon determining the plane, automatically modify each respective location for each text of the set of text to the determined plane, such that the set of text is aligned with the plane in the extended reality environment and readable by three-dimensional optical character recognition;

identifying, by the three-dimensional optical character recognition, one or more characters of each text in the extended reality environment;

generating interactable text based on the identified one or more characters from each text of the set of text; and

placing the interactable text on the plane such that the interactable text is a modifiable representation of the set of text.

8 . The method of claim 7 , wherein the set of text comprises one or more words, characters, symbols, or any combination thereof.

9 . The method of claim 7 , further comprising:

receiving one or more commands, wherein the one or more commands are representative of one or more modifications to one or more characteristics of the interactable text; and

modifying, based on the one or more commands, the one or more characteristics of the interactable text, wherein the one or more characteristics comprise size, pitch, yawl, roll, a relative position in the extended virtual reality environment based on the set of coordinates, or any combination thereof.

10 . The method of claim 7 , further comprising:

determining misspelled text of the set of text;

automatically modifying the interactable text associated with misspelled text of the set of text such that the misspelled text is corrected.

11 . A method, comprising:

identifying text from a set of three-dimensional writings in an extended reality environment;

determining a plane in the extended reality environment based on a set of coordinates of the text, wherein the set of coordinates comprises one or more coordinates representative of a three-dimensional position of the text in the extended reality environment;

upon determining the plane, automatically modify each respective coordinate of the set of coordinates for the text, such that the text is aligned with the plane in the extended reality environment;

identifying, by three-dimensional optical character recognition, one or more characters of the text in the extended reality environment;

generating interactable text based on the identified one or more characters; and

modifying the one or more coordinates such that the interactable text is disposed on the plane.

12 . The method of claim 11 , further comprising:

receiving one or more commands from a user, wherein the one or more commands are representative of one or more modifications to one or more characteristics of the interactable text;

identifying the one or more modifications from the one or more commands; and

modifying, based on the one or more modifications, one or more characteristics of the interactable text.

13 . The method of claim 12 , wherein the one or more characteristics include at least one of size, pitch, yawl, roll, and relative position in the extended virtual reality environment based on the set of coordinates.

14 . The method of claim 13 , wherein the one or more commands include hand movements.

15 . The method of claim 13 , wherein the one or more commands include hand movements.

16 . The method of claim 13 , wherein the one or more commands include analog button inputs.

17 . The method of claim 13 , wherein the one or more commands include voice commands.

18 . The method of claim 13 , wherein the one or more commands include virtual selections via interactable buttons in the extended reality environment.

19 . The method of claim 12 , wherein the one or more commands include at least one of a hand movement, analog button input, voice command, and virtual selection via an interactable button in the extended reality environment.

20 . The method of claim 11 , further comprising receiving a command and modifying the interactable text based on the command.

Assignments (3)
CHANGE OF NAME Recorded Feb 3, 2025
From: VR-EDU, INC.
To: CURIOXR, INC.
Reel/Frame 070096/0087 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 30, 2025
From: FIELDMAN, ETHAN
To: VR-EDU, INC.
Reel/Frame 070065/0478 →
CHANGE OF NAME Recorded Dec 4, 2024
From: VR-EDU, INC.
To: CURIOXR, INC.
Reel/Frame 069510/0242 →