IP Library Granted Patent US 11,475,650
Granted Patent B2
US 11,475,650 · App. 17/711,299 · Granted Oct 18, 2022

Environmentally adaptive extended reality display system

Inventors: Tamir Berliner (Tel Aviv, IL); Tomer Kahan (Ramat Hasharon, IL); Orit Dolev (Tel Aviv, IL)
Assignee: MULTINARITY LTD
G06T19/006G06F3/011G06F3/165G06T3/40
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,475,650
App. No.
17/711,299
Filed
Apr 1, 2022
Granted
Oct 18, 2022
Kind
B2
Art Unit
2677
USPC
345/633
Abstract

A method for facilitating an environmentally adaptive extended reality display in a physical environment includes virtually displaying content via a wearable extended reality appliance operating in the physical environment, wherein displaying content via the wearable extended reality appliance is associated with at least one adjustable extended reality display parameter. Image data is obtained from the wearable extended reality appliance and a specific environmental change unrelated to the virtually displayed content is detected in the image data. A group of rules associating environmental changes with changes in the at least one adjustable extended reality display parameter is accessed and a specific rule of the group of rules is determined, the specific rule corresponding to the specific environmental change. The specific rule is implemented to adjust the at least one adjustable extended reality display parameter based on the specific environmental change.

Claims (50)

1. A non-transitory computer readable medium containing instructions for performing operations configured to facilitate an environmentally adaptive extended reality display in a physical environment, the operations comprising:

virtually displaying content via a wearable extended reality appliance operating in the physical environment, wherein displaying content via the wearable extended reality appliance is associated with at least one adjustable extended reality display parameter;

obtaining image data from the wearable extended reality appliance;

detecting in the image data a specific environmental change unrelated to the virtually displayed content;

accessing a group of rules associating environmental changes with changes in the at least one adjustable extended reality display parameter;

determining that the specific environmental change corresponds to a specific rule of the group of rules; and

implementing the specific rule to adjust the at least one adjustable extended reality display parameter based on the specific environmental change.

2. The non-transitory computer readable medium of claim 1 , wherein the at least one adjustable extended reality display parameter includes at least one of: a number of screens associated with the virtually displayed content, a size of at least one virtual screen associated with the virtually displayed content, a position of at least one virtual screen associated with the virtually displayed content, a shape of at least one virtual screen associated with the virtually displayed content, an angle of at least one virtual screen associated with the virtually displayed content, an opacity of the virtually displayed content, a virtual distance of the virtually displayed content from the wearable extended reality appliance, or a type of widgets included in the virtually displayed content.

3. The non-transitory computer readable medium of claim 1 , wherein adjusting the at least one adjustable extended reality display parameter includes changing a combination of extended reality display parameters associated with the virtually displayed content.

4. The non-transitory computer readable medium of claim 1 , wherein the operations further include:

obtaining data from an input device separated from the wearable extended reality appliance; and

determining the specific environmental change unrelated to the virtually displayed content is based on the obtained data from the input device and the image data from the wearable extended reality appliance.

5. The non-transitory computer readable medium of claim 1 , wherein adjusting the at least one adjustable extended reality display parameter is configured to cause an eye of a user of the wearable extended reality appliance to be visible to people in the physical environment.

6. The non-transitory computer readable medium of claim 1 , wherein the operations further include:

determining a type of human interaction of another individual with a user of the wearable extended reality appliance;

accessing an additional group of rules associating types of human interaction with changes in the at least one adjustable extended reality display parameter; and

implementing at least one rule of the additional group of rules to adjust the at least one adjustable extended reality display parameter based on the determined type of interaction.

7. The non-transitory computer readable medium of claim 1 , wherein the operations further include presenting via the wearable extended reality appliance an interactive element for enabling a user of the wearable extended reality appliance to abort the adjustment to the at least one adjustable extended reality display parameter.

8. The non-transitory computer readable medium of claim 1 , wherein the operations further include:

detecting a change in a content type associated with the virtual content displayed via the wearable extended reality appliance;

accessing an additional group of rules associating content type changes with changes in the at least one adjustable virtual reality display parameter;

determining that the detected content type change corresponds to a particular rule of the additional group of rules; and

implementing the particular rule to adjust the at least one adjustable extended reality display parameter based on the detected content type change.

9. The non-transitory computer readable medium of claim 1 , wherein the operations further include:

receiving a selection of a do-not-disturb mode; and

avoiding adjusting the at least one adjustable extended reality display parameter based on the detected specific environmental change.

10. The non-transitory computer readable medium of claim 9 , wherein the selection of the do-not-disturb mode is tunable, and a level of the do-not-disturb mode is selectable by a user of the wearable extended reality appliance.

11. The non-transitory computer readable medium of claim 1 , wherein the environmental changes include at least some of: movement of a user of the wearable extended reality appliance, change in a pose of a user of the wearable extended reality appliance, interaction of a user of the wearable extended reality appliance with another individual, interaction of a user of the wearable extended reality appliance with an object, change in an ambient light level in the physical environment, change in a noise in the physical environment, or change in temperature in the physical environment.

12. The non-transitory computer readable medium of claim 1 , wherein, when the detected specific environmental change includes movement of a user of the wearable extended reality appliance, adjusting the at least one adjustable extended reality display parameter includes shrinking the virtually displayed content.

13. The non-transitory computer readable medium of claim 1 , wherein, when the detected specific environmental change includes entrance of an individual to a field of view of the wearable extended reality appliance, adjusting the at least one adjustable extended reality display parameter includes moving the virtually displayed content.

14. The non-transitory computer readable medium of claim 1 , wherein, when the detected specific environmental change includes a change in a pose of a user of the wearable extended reality appliance, adjusting the at least one adjustable extended reality display parameter includes changing a virtual size of the virtually displayed content and changing a virtual distance from the virtually displayed content.

15. The non-transitory computer readable medium of claim 1 , wherein, when the detected specific environmental change includes an environmental movement, adjusting the at least one adjustable extended reality display parameter includes changing an opacity of the virtually displayed content.

16. The non-transitory computer readable medium of claim 1 , wherein, when the detected specific environmental change includes kinesis of a user of the wearable extended reality appliance, adjusting the at least one adjustable extended reality display parameter includes decreasing an opacity of the virtually displayed content.

17. The non-transitory computer readable medium of claim 1 , wherein, when the detected specific environmental change includes a cessation of kinesis by a user of the wearable extended reality appliance, adjusting the at least one adjustable extended reality display parameter includes increasing an opacity of the virtually displayed content.

18. The non-transitory computer readable medium of claim 1 , wherein the displayed content includes audio, virtually displaying the content includes causing the wearable extended reality appliance to output the audio, and implementing the specific rule includes adjusting at least one of a volume associated with the output of the audio or a virtual location of an audio source associated with the output of the audio.

19. A system for facilitating an environmentally adaptive extended reality display in a physical environment, the system comprising:

at least one processor configured to:

virtually display content via a wearable extended reality appliance operating in the physical environment, wherein displaying content via the wearable extended reality appliance is associated with at least one adjustable extended reality display parameter;

obtain image data from the wearable extended reality appliance;

detect in the image data a specific environmental change unrelated to the virtually displayed content;

access a group of rules associating environmental changes with changes in the at least one adjustable extended reality display parameter;

determine that the specific environmental change corresponds to a specific rule of the group of rules; and

implement the specific rule to adjust the at least one adjustable extended reality display parameter based on the specific environmental change.

20. A method for facilitating an environmentally adaptive extended reality display in a physical environment, the method comprising:

virtually displaying content via a wearable extended reality appliance operating in the physical environment, wherein displaying content via the wearable extended reality appliance is associated with at least one adjustable extended reality display parameter;

obtaining image data from the wearable extended reality appliance;

detecting in the image data a specific environmental change unrelated to the virtually displayed content;

accessing a group of rules associating environmental changes with changes in the at least one adjustable extended reality display parameter;

determining that the specific environmental change corresponds to a specific rule of the group of rules; and

implementing the specific rule to adjust the at least one adjustable extended reality display parameter based on the specific environmental change.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 1, 2022
From: BERLINER, TAMIR; KAHAN, TOMER; DOLEV, ORIT
To: MULTINARITY LTD
Reel/Frame 059471/0448 →
Continuity (13)
Continuation PCTUS2022015548 · Feb 8, 2022
Provisional Application 63307207 · Feb 7, 2022
Provisional Application 63307217 · Feb 7, 2022
Provisional Application 63307203 · Feb 7, 2022
Provisional Application 63300005 · Jan 16, 2022
Provisional Application 63226977 · Jul 29, 2021
Provisional Application 63216335 · Jun 29, 2021
Provisional Application 63215500 · Jun 27, 2021
Provisional Application 63213019 · Jun 21, 2021
Provisional Application 63173095 · Apr 9, 2021
Provisional Application 63157768 · Mar 7, 2021
Provisional Application 63147051 · Feb 8, 2021
Related Publication 20220254120A1 · Aug 11, 2022
Cited By (15)
US 12,189,422 US 12,210,160 US 12,236,008 US 12,265,655 US 12,360,557 US 12,360,558 US 12,380,238 US 12,474,816 US 12,530,102 US 12,530,103 US 12,537,877 US 12,619,774 US 12,669,848 US 12,671,893 US 12,718,492