IP Library Granted Patent US 11,592,872
Granted Patent B2
US 11,592,872 · App. 17/711,867 · Granted Feb 28, 2023

Systems and methods for configuring displays based on paired keyboard

Inventors: Tamir Berliner (Tel Aviv, IL); Tomer Kahan (Ramat Hasharon, IL); Orit Dolev (Tel Aviv, IL)
Assignee: MULTINARITY LTD
G06F1/163G02B27/017G06F1/1616G06F1/1632G06F1/1656G06F1/1662G06F3/011G06F3/014G06F3/017G06F3/023G06F3/0231G06F3/0481G06F3/0489G06F3/04815G06F3/04847G06F3/04886G06F3/14G06F3/1423G06Q10/0631G06T7/70G06T19/006G02B2027/014G02B2027/0138G02B2027/0141G02B2027/0178G06T2200/24G06T2207/30196
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,592,872
App. No.
17/711,867
Filed
Apr 1, 2022
Granted
Feb 28, 2023
Kind
B2
Art Unit
2624
USPC
345/168
Abstract

Systems, methods, and non-transitory computer readable media containing instructions for causing at least one processor to perform operations for determining a display configuration for presenting virtual content are provided. In one implementation, the processor is configured for receiving image data from an image sensor associated with a wearable extended reality appliance; analyzing the image data to detect a particular input device placed on a surface; determining a value of at least one use parameter for the particular input device; retrieving from memory default display settings associated with the particular input device; determining a display configuration for presenting virtual content based on the value of the at least one use parameter and the retrieved default display settings; and causing a presentation of the virtual content via the wearable extended reality appliance according to the determined display configuration.

Claims (49)

1. A non-transitory computer readable medium containing instructions that when executed by at least one processor cause the at least one processor to perform operations for determining a display configuration for presenting virtual content, the operations comprising:

receiving image data from an image sensor associated with a wearable extended reality appliance, wherein the wearable extended reality appliance is configured to be paired with multiple input devices and each input device is associated with default display settings;

analyzing the image data to detect a particular input device;

determining a value of at least one use parameter for the particular input device, wherein the at least one use parameter is reflective of battery-charge data associated with the particular input device;

retrieving from memory default display settings associated with the particular input device;

when the particular input device operates on batteries:

determining a first display configuration for presenting virtual content based on the value of the at least one use parameter and the retrieved default display settings;

when the particular input device is connected to an external power source:

determining a second display configuration for presenting virtual content, wherein the second display configuration differs from the first display configuration; and

causing a presentation of the virtual content via the wearable extended reality appliance according to the determined display configuration.

2. The non-transitory computer readable medium of claim 1 , wherein the operations further include determining whether the particular input device is a home keyboard or a workplace keyboard, in response to a determination that the particular input device is a home keyboard, retrieving from the memory first default display settings, and in response to a determination that the particular input device is a workplace keyboard, retrieving from the memory second default display settings, the second default display settings differing from the first default display settings.

3. The non-transitory computer readable medium of claim 1 , wherein the operations further include determining whether the particular input device is a private keyboard or a public keyboard, in response to a determination that the particular input device is a private keyboard, retrieving from the memory first default display settings, and in response to a determination that the particular input device is a public keyboard, retrieving from the memory second default display settings, the second default display settings differing from the first default display settings.

4. The non-transitory computer readable medium of claim 1 , wherein the operations further include determining whether the particular input device is a keys-based keyboard or a touch screen based keyboard, in response to a determination that the particular input device is a keys-based keyboard, retrieving from the memory first default display settings, and in response to a determination that the particular input device is a touch screen based keyboard, retrieving from the memory second default display settings, the second default display settings differ from the first default display settings.

5. The non-transitory computer readable medium of claim 1 , wherein the operations further include pairing the particular input device to the wearable extended reality appliance, accessing stored information associating the multiple input devices with different default display settings, and retrieving from the accessed stored information the default display settings associated with the paired particular input device.

6. The non-transitory computer readable medium of claim 5 , wherein the pairing of the particular input device to the wearable extended reality appliance is based on a detection of a visual code depicted in the image data.

7. The non-transitory computer readable medium of claim 5 , wherein the pairing of the particular input device to the wearable extended reality appliance is based on a detection of light emitted by a light emitter included in the particular input device and captured by a sensor included in the wearable extended reality appliance.

8. The non-transitory computer readable medium of claim 1 , wherein determining the display configuration includes modifying the retrieved default display settings based on the value of the at least one use parameter.

9. The non-transitory computer readable medium of claim 1 , wherein the default display settings retrieved from the memory includes a default distance from the wearable extended reality appliance for presenting the virtual content.

10. The non-transitory computer readable medium of claim 1 , wherein the virtual content presented via the wearable extended reality appliance includes one or more virtual screens, and the default display settings include at least one of a default number of virtual screens, a default size of a virtual screen, a default orientation of a virtual screen, or a default configuration of a border of a virtual screen.

11. The non-transitory computer readable medium of claim 1 , wherein the default display settings retrieved from the memory include at least one of a default opacity of the virtual content, a default color scheme of the virtual content, or a default brightness level of the virtual content.

12. The non-transitory computer readable medium of claim 1 , wherein the default display settings include at least one of a default selection of an operating system for the virtual content, a default selection of startup applications, a default selection of startup virtual objects, or a default placement of the selected startup virtual objects in an extended reality environment.

13. The non-transitory computer readable medium of claim 1 , wherein the operations further include determining the value of the at least one use parameter for the particular input device based on at least one of an analysis of the image data, data received from the particular input device, or data received from the wearable extended reality appliance.

14. The non-transitory computer readable medium of claim 1 , wherein the at least one use parameter is reflective of a distance of the particular input device from the wearable extended reality appliance, and the operations further include determining a first display configuration when the distance is greater than a threshold and a second display configuration when the distance is less than the threshold, the second display configuration differs from the first display configuration.

15. The non-transitory computer readable medium of claim 1 , wherein the at least one use parameter is reflective of a posture of a user of the wearable extended reality appliance, and the operations further include determining a first display configuration when a first posture is identified and a second display configuration when a second posture is identified, the second display configuration differing from the first display configuration.

16. The non-transitory computer readable medium of claim 1 , wherein the particular input device is placed on a surface, the at least one use parameter is reflective of a type of the surface on which the particular input device is placed, and the operations further include determining a first display configuration when a first type of the surface is identified and a second display configuration when a second type of the surface is identified, the second display configuration differing from the first display configuration.

17. The non-transitory computer readable medium of claim 1 , wherein the multiple input devices includes at least a first input device and a second input device, the first and second input devices are visually similar, the first and second input devices are associated with different default display settings, and the operations further include:

analyzing the image data to identify an object in a vicinity of the particular input device; and

determining that the particular input device is the first input device and not the second input device based on the identification of the object in the vicinity of the particular input device.

18. A method for determining a display configuration for presenting virtual content, the method comprising:

receiving image data from an image sensor associated with a wearable extended reality appliance, wherein the wearable extended reality appliance is configured to be paired with multiple input devices and each input device is associated with default display settings;

analyzing the image data to detect a particular input device;

determining a value of at least one use parameter for the particular input device, wherein the at least one use parameter is reflective of battery-charge data associated with the particular input device;

retrieving from memory default display settings associated with the particular input device;

when the particular input device operates on batteries:

determining a first display configuration for presenting virtual content based on the value of the at least one use parameter and the retrieved default display settings;

when the particular input device is connected to an external power source:

determining a second display configuration for presenting virtual content, wherein the second display configuration differs from the first display configuration; and

causing a presentation of the virtual content via the wearable extended reality appliance according to the determined display configuration.

19. A system for determining a display configuration for presenting virtual content, the system comprising:

at least one processor configured to:

receive image data from an image sensor associated with a wearable extended reality appliance, wherein the wearable extended reality appliance is configured to be paired with multiple input devices and each input device is associated with default display settings;

analyze the image data to detect a particular input device;

determine a value of at least one use parameter for the particular input device, wherein the at least one use parameter is reflective of battery-charge data associated with the particular input device;

retrieve from memory default display settings associated with the particular input device;

when the particular input device operates on batteries:

determine a first display configuration for presenting virtual content based on the value of the at least one use parameter and the retrieved default display settings;

when the particular input device is connected to an external power source:

determine a second display configuration for presenting virtual content, wherein the second display configuration differs from the first display configuration; and

cause a presentation of the virtual content via the wearable extended reality appliance according to the determined display configuration.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 1, 2022
From: BERLINER, TAMIR; KAHAN, TOMER; DOLEV, ORIT
To: MULTINARITY LTD
Reel/Frame 059477/0464 →
Continuity (13)
Continuation PCTUS2022015546 · Feb 8, 2022
Provisional Application 63307203 · Feb 7, 2022
Provisional Application 63307217 · Feb 7, 2022
Provisional Application 63307207 · Feb 7, 2022
Provisional Application 63300005 · Jan 16, 2022
Provisional Application 63226977 · Jul 29, 2021
Provisional Application 63216335 · Jun 29, 2021
Provisional Application 63215500 · Jun 27, 2021
Provisional Application 63213019 · Jun 21, 2021
Provisional Application 63173095 · Apr 9, 2021
Provisional Application 63157768 · Mar 7, 2021
Provisional Application 63147051 · Feb 8, 2021
Related Publication 20220261091A1 · Aug 18, 2022