IP Library › Granted Patent US 12,322,301
Granted Patent B2
US 12,322,301 · App. 18/064,817 · Granted Jun 3, 2025

Virtual, augmented and extended reality system

Inventors: Raphael Freiwirth (San Diego, CA); Mark Claude Lewison (West Hollywood, CA); Michelle Chiang (San Diego, CA); Nelson Thor Brickman (San Diego, CA)
Assignee: THE COMMONS XR LLC
G09B5/065G06T19/006H04L67/131
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,322,301
App. No.
18/064,817
Granted
Jun 3, 2025
Kind
B2
Abstract

Systems, methods and apparatus for multi-realm, computer-generated reality systems are disclosed. A method for managing a multi-realm, computer-generated reality includes determining one or more variances between each activity of a first participant and a corresponding baseline activity for each of a plurality of activities associated with traversal of a managed reality system during a session, and quantifying the one or more variances to obtain a performance metric. The method includes combining at least one performance metric for each activity of the first participant to obtain a session performance measurement for the first participant.

Claims (55)

1. A method in a managed multi-realm reality system, comprising:

admitting a plurality of participants to a session conducted in the managed multi-realm reality system, wherein each of the plurality of participants is admitted through a virtual reality context, extended reality context or an augmented reality context, wherein each participant is represented by a generic avatar, wherein each avatar is indistinguishable from each other avatar;

collecting performance data for each of the plurality of participants within the managed multi-realm reality system, wherein each of the plurality of participants have performance measurements associated with one or more performance data groupings;

recording observational data within the managed multi-realm reality system related to the generic avatar of at least one participant of the plurality of participants;

determining one or more variances, based on at least one of the performance data or observational data, between a first participant and one or more of a corresponding baseline activity for each of the plurality of participants, a peer group, or a baseline of the first participant;

quantifying the one or more variances to obtain a performance metric for the first participant; and

generating an assessment of a level of communication or interaction between a leader and the first participant within the managed multi-realm reality system based on the performance data, wherein the first participant or the leader initiates the interaction or the communication.

2. The method of claim 1 , wherein at least one of the performance data or observational data is based on observed behavior, measured behavior, or a combination thereof of the plurality of participants in the managed multi-realm reality system.

3. The method of claim 1 , wherein the communication or interaction between the leader and the first participant may include at least one of:

an instruction,

a message,

a question,

a response, or

an action,

within the managed multi-realm reality system by the first participant.

4. The method of claim 3 , wherein the action includes a movement of the first participant.

5. The method of claim 4 , wherein the movement of the first participant includes at least one of a hand movement, motion towards an object, motion away from an object, a head movement, eye movement or change of posture.

6. The method of claim 1 , wherein admitting the plurality of participants is based on a participant configuration for each of the plurality of the plurality of participants.

7. The method of claim 6 , wherein the participant configuration for each of the plurality of the plurality of participants includes at least one of preferences, options, permissions, enrollments or requirements to enable each participant to communicate and/or interact with other participants and/or reality contexts.

8. The method of claim 7 , wherein the participant configuration for the first participant includes an indication of a disability.

9. The method of claim 8 , wherein an avatar of the first participant contains the indication of the disability that is visible to a leader in the managed multi-realm reality system.

10. The method of claim 7 , wherein the participant configuration for the first participant is provided at least in part by the first participant.

11. The method of claim 1 , wherein at least one of the performance data or observational data includes at least one of status, actions, activities, relationships, or postures.

12. The method of claim 11 , wherein a status of the first participant includes at least one of active, passive, or distracted.

13. The method of claim 12 , further comprising:

providing assistance, by a leader, to the first participant based on the status of the first participant.

14. The method of claim 1 , wherein recording the observational data comprises:

entering by a leader, at least one of notes, observations, or combinations thereof.

15. The method of claim 1 , wherein recording observational data comprises at least one of: activating a recorder; providing textual notes; selecting check boxes;

selecting predefined text scripts; or combinations thereof in the managed multi-realm reality system through a user interface.

16. The method of claim 1 , wherein determining the one or more variances comprises:

processing the performance data to detect performance issues of the first participant based on the one or more variances; and

providing assistance and prompts.

17. The method of claim 16 , wherein processing the performance data comprises:

processing the performance data by an artificially intelligent virtual assistant in real time.

18. The method of claim 1 , wherein the first participant initiates an interaction with an AI avatar.

19. A managed multi-realm reality system, comprising:

one or more memories;

one or more processors communicatively coupled to the one or more memories memory, the one or more processors, either individually or in combination, configured to:

admit a plurality of participants to a session conducted in the managed multi-realm reality system, wherein each of the plurality of participants is admitted through a virtual reality context, extended reality context or an augmented reality context, wherein each participant is represented by a generic avatar, wherein each avatar is indistinguishable from each other avatar;

collect performance data for each of the plurality of participants within the managed multi-realm reality system, wherein each of the plurality of participants have performance measurements associated with one or more performance data groupings;

recording observational data within the managed multi-realm reality system related to the generic avatar of at least one participant of the plurality of participants;

determine one or more variances, based on at least one of the performance data or observational data, between a first participant and one or more of a corresponding baseline activity for each of the plurality of participants, a peer group, or a baseline of the first participant;

quantify the one or more variances to obtain a performance metric for the first participant; and

generate an assessment of a level of communication or interaction between a leader and the first participant within the managed multi-realm reality system based on the performance data, wherein the first participant or the leader initiates the interaction or the communication.

20. A method in a managed multi-realm reality system, comprising:

admitting a plurality of participants to a session conducted in the managed multi-realm reality system, wherein each of the plurality of participants is admitted through a virtual reality context, extended reality context or an augmented reality context, wherein each participant is represented by a generic avatar, wherein each avatar is indistinguishable from each other avatar;

collecting performance data for each of the plurality of participants within the managed multi-realm reality system, wherein each of the plurality of participants have performance measurements associated with one or more performance data groupings;

recording observational data within the managed multi-realm reality system related to the generic avatar of at least one participant of the plurality of participants;

determining one or more variances, based on at least one of the performance data or observational data, between a first participant and one or more of a corresponding baseline activity for each of the plurality of participants, a peer group, or a baseline of the first participant; and

quantifying the one or more variances to obtain a performance metric for the first participant,

wherein admitting the plurality of participants is based on a participant configuration for each of the plurality of the plurality of participants,

wherein the participant configuration for each of the plurality of the plurality of participants includes at least one of preferences, options, permissions, enrollments or requirements to enable each participant to communicate and/or interact with other participants and/or reality contexts,

wherein the participant configuration for the first participant includes an indication of a disability, and

wherein an avatar of the first participant contains the indication of the disability that is visible to a leader in the managed multi-realm reality system.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 8, 2023
From: FREIWIRTH, RAPHAEL; LEWISON, MARK CLAUDE; CHIANG, MICHELLE; BRICKMAN, NELSON THOR
To: THE COMMONS XR LLC
Reel/Frame 063891/0639 →
Continuity (6)
Continuation 16854743 · Apr 21, 2020
Provisional Application 62986621 · Mar 6, 2020
Provisional Application 62903710 · Sep 20, 2019
Provisional Application 62867224 · Jun 26, 2019
Provisional Application 62837141 · Apr 22, 2019
Related Publication 20230290259A1 · Sep 14, 2023
References Cited (20)
US 9311742B1 · Glover · 2016 [cited by examiner]
US 20080263458A1 · Altberg · 2008 [cited by examiner]
US 20110296163A1 · Abernethy · 2011 [cited by examiner]
US 20130288777A1 · Short · 2013 [cited by examiner]
US 20150243288A1 · Katsuranis · 2015 [cited by examiner]
US 20150356788A1 · Abe · 2015 [cited by examiner]
US 20160027336A1 · Towers et al. · 2016 [cited by applicant]
US 20160180248A1 · Regan · 2016 [cited by examiner]
US 20170090589A1 · Sharma · 2017 [cited by examiner]
US 20170213473A1 · Ribeira · 2017 [cited by examiner]
US 20180314321A1 · Primus et al. · 2018 [cited by applicant]
US 20180364803A1 · Khalid · 2018 [cited by examiner]
US 20210409516A1 · Saraf · 2021 [cited by examiner]
CN 108027664A · 2018 [cited by applicant]
WO 2017058960A1 · 2017 [cited by applicant]
Partial European Search Report—EP20792923.0 EPO—Dec. 23, 2022. [cited by applicant]
Mcnamara, Ann et al: “Information Placement in Virtual Reality”, 2019 IEEE Conference On Virtual Reality and User Intervaces (VR), IEEE, Mar. 23, 2019 (Mar. 23, 2019), pp. 1078-1079, XP033597554, DOI: 10.119/VR.2019.879… [cited by applicant]
Extended European Search Report—EP20795923.0 EPO—Mar. 23, 2023. [cited by applicant]
PCT/US2020/029367, International Search Report & Written Opinion (Sep. 4, 2020). [cited by applicant]
U.S. Appl. No. 17/805,151, filed Jun. 2, 2022. [cited by applicant]
Cited By (1)
US 12,563,120