IP Library Granted Patent US 11,829,524
Granted Patent B2
US 11,829,524 · App. 18/089,933 · Granted Nov 28, 2023

Moving content between a virtual display and an extended reality environment

Inventors: Eli Elhadad (Kidron, IL); Amit Knaani (Tel Aviv, IL); Tomer Kahan (Ramat Hasharon, IL); Tamir Berliner (Tel Aviv, IL); Orit Dolev (Tel Aviv, IL)
Assignee: MULTINARITY LTD.
G06F3/012G02B27/0172G06F1/163G06F3/011G06F3/017G06F3/0231G06F3/1423G06F3/1454G06F3/167G06F40/169G06T7/70G06T7/73G06T11/60G06T19/00G06T19/006G06T19/20G06V10/761G06V20/20G06V40/28G09G3/001G10L15/22G02B2027/014G02B2027/0143G02B2027/0178G06T2219/2004G06V40/10G06V40/20G08B7/00G09G2320/064G09G2320/0613G09G2320/0686G09G2330/021G09G2354/00G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,829,524
App. No.
18/089,933
Filed
Dec 28, 2022
Granted
Nov 28, 2023
Kind
B2
Art Unit
2613
USPC
345/419
Abstract

Systems, methods, and non-transitory computer readable media including instructions for extracting content from a virtual display are disclosed. Extracting content from a virtual display includes generating a virtual display via a wearable extended reality appliance, wherein the virtual display presents a group of virtual objects and is located at a first virtual distance from the wearable extended reality appliance; generating an extended reality environment via the wearable extended reality appliance including at least one additional virtual object at a second virtual distance from the wearable extended reality appliance; receiving input for causing a specific virtual object to move from the virtual display to the extended reality environment; and in response, generating a presentation of a version of the specific virtual object in the extended reality environment at a third virtual distance different from the first virtual distance and the second virtual distance.

Claims (41)

1. A non-transitory computer readable medium containing instructions that when executed by at least one processor cause the at least one processor to perform operations for extracting content from a virtual display, the operations comprising:

generating the virtual display via a wearable extended reality appliance, wherein the virtual display presents a group of virtual objects and is located at a first virtual distance from the wearable extended reality appliance;

generating an extended reality environment via the wearable extended reality appliance, wherein

the extended reality environment includes at least one additional virtual object presented at a second virtual distance from the wearable extended reality appliance;

receiving input for causing a specific virtual object from the group of virtual objects to move from the virtual display to the extended reality environment;

in response to receiving the input, generating a presentation of a version of the specific virtual object in the extended reality environment at a third virtual distance from the wearable extended reality appliance, wherein the third virtual distance differs from the first virtual distance and the second virtual distance;

identifying a trigger for halting the presentation of the version of the specific virtual object in the extended reality environment and for presenting the specific virtual object on the virtual display; and

causing an occurrence of a corresponding action in response to the trigger.

2. The non-transitory computer readable medium of claim 1 , wherein the specific virtual object is a window including a group of control buttons in a particular area of the window, the group of control buttons include at least a control button for minimizing the window, a control button for maximizing the window, a control button for closing the window, and a control button for moving the window outside the virtual display; and wherein the input includes an activation of the control button for moving the window outside the virtual display.

3. The non-transitory computer readable medium of claim 1 , wherein the operations further include causing, in response to receiving the input, a presentation of the specific virtual object to be removed from the virtual display.

4. The non-transitory computer readable medium of claim 1 , wherein the operations further include causing, in response to receiving the input, simultaneous presentations of the specific virtual object on the virtual display and the version of the specific virtual object at another location in the extended reality environment.

5. The non-transitory computer readable medium of claim 1 , wherein the operations further include determining the third virtual distance for presenting the version of the specific virtual object.

6. The non-transitory computer readable medium of claim 5 , wherein the determination of the third virtual distance is based on at least one of the first virtual distance or the second virtual distance.

7. The non-transitory computer readable medium of claim 5 , wherein the determination of the third virtual distance is based on a type of the specific virtual object.

8. The non-transitory computer readable medium of claim 5 , wherein the determination of the third virtual distance is based on a physical object in the extended reality environment.

9. The non-transitory computer readable medium of claim 1 , wherein the operations further include determining a position for presenting the version of the specific virtual object in the extended reality environment.

10. The non-transitory computer readable medium of claim 9 , wherein the determination of the position is based on a physical object in the extended reality environment.

11. The non-transitory computer readable medium of claim 1 , wherein generating the presentation of the version of the specific virtual object in the extended reality environment includes implementing a modification to the specific virtual object.

12. The non-transitory computer readable medium of claim 11 , wherein the modification to the specific virtual object is based on a type of the specific virtual object.

13. The non-transitory computer readable medium of claim 11 , wherein the modification to the specific virtual object includes changing a visual appearance of the specific virtual object.

14. The non-transitory computer readable medium of claim 11 , wherein the modification to the specific virtual object includes changing a behavior of the specific virtual object.

15. The non-transitory computer readable medium of claim 1 , wherein the operations further include receiving an additional input for causing another virtual object from the group of virtual objects to move from the virtual display to the extended reality environment; and in response to receiving the additional input, generating a presentation of a version of the another virtual object in the extended reality environment at a fourth virtual distance from the wearable extended reality appliance, wherein the fourth virtual distance differs from the first virtual distance, the second virtual distance, and the third virtual distance.

16. The non-transitory computer readable medium of claim 1 , wherein the operations further include, after generating the presentation of the version of the specific virtual object in the extended reality environment:

while a focus of an operating system controlling the group of virtual objects is a particular virtual object presented in the virtual display, receiving a first input for task switching from a keyboard; and in response to receiving the first input for task switching, causing the focus of the operating system to switch from the particular virtual object presented in the virtual display to the version of the specific virtual object presented in the extended reality environment;

while the focus of the operating system is the version of the specific virtual object presented in the extended reality environment, receiving a second input for task switching from the keyboard; and in response to receiving the second input for task switching from the keyboard, causing the focus of the operating system to switch from the version of the specific virtual object presented in the extended reality environment to another virtual object presented in the virtual display.

17. The non-transitory computer readable medium of claim 1 , wherein the operations further include, after generating the presentation of the version of the specific virtual object in the extended reality environment, receiving an input from a keyboard for a thumbnail view presentation of virtual objects associated with the virtual display, and including a thumbnail version of the specific virtual object presented in the extended reality environment in the thumbnail view presentation of the virtual objects associated with the virtual display.

18. A system for extracting content from a virtual display, the system comprising:

at least one processor and memory for storing a program for execution by the at least one processor to:

generate the virtual display via a wearable extended reality appliance, wherein the virtual display presents a group of virtual objects and is located at a first virtual distance from the wearable extended reality appliance;

generate an extended reality environment via the wearable extended reality appliance, wherein the extended reality environment includes at least one additional virtual object presented at a second virtual distance from the wearable extended reality appliance;

receive input for causing a specific virtual object from the group of virtual objects to move from the virtual display to the extended reality environment;

in response to receiving the input, generate a presentation of a version of the specific virtual object in the extended reality environment at a third virtual distance from the wearable extended reality appliance, wherein the third virtual distance differs from the first virtual distance and the second virtual distance;

identify a trigger for halting the presentation of the version of the specific virtual object in the extended reality environment and for presenting the specific virtual object on the virtual display; and

cause an occurrence of a corresponding action in response to the trigger.

19. A method for extracting content from a virtual display, the method comprising:

generating the virtual display via a wearable extended reality appliance, wherein the virtual display presents a group of virtual objects and is located at a first virtual distance from the wearable extended reality appliance;

generating an extended reality environment via the wearable extended reality appliance, wherein the extended reality environment includes at least one additional virtual object presented at a second virtual distance from the wearable extended reality appliance;

receiving input for causing a specific virtual object from the group of virtual objects to move from the virtual display to the extended reality environment;

in response to receiving the input, generating a presentation of a version of the specific virtual object in the extended reality environment at a third virtual distance from the wearable extended reality appliance, wherein the third virtual distance differs from the first virtual distance and the second virtual distance;

identifying a trigger for halting the presentation of the version of the specific virtual object in the extended reality environment and for presenting the specific virtual object on the virtual display; and

causing an occurrence of a corresponding action in response to the trigger.

Assignments (3)
CHANGE OF NAME Recorded Aug 28, 2024
From: MULTINARITY LTD
To: SIGHTFUL COMPUTERS LTD
Reel/Frame 068791/0826 →
CHANGE OF NAME Recorded Oct 24, 2023
From: MULTINARITY LTD
To: SIGHTFUL COMPUTERS LTD
Reel/Frame 065335/0857 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 28, 2022
From: ELHADAD, ELI; KNAANI, AMIT; KAHAN, TOMER; BERLINER, TAMIR; DOLEV, ORIT
To: MULTINARITY LTD.
Reel/Frame 062224/0602 →
Continuity (9)
Continuation PCTUS2022038450 · Jul 27, 2022
Provisional Application 63344727 · May 23, 2022
Provisional Application 63319423 · Mar 14, 2022
Provisional Application 63307203 · Feb 7, 2022
Provisional Application 63307207 · Feb 7, 2022
Provisional Application 63307217 · Feb 7, 2022
Provisional Application 63299188 · Jan 13, 2022
Provisional Application 63226180 · Jul 28, 2021
Related Publication 20230237752A1 · Jul 27, 2023
Cited By (1)
US 12,586,289