IP Library Granted Patent US 11,481,963
Granted Patent B2
US 11,481,963 · App. 17/713,906 · Granted Oct 25, 2022

Virtual display changes based on positions of viewers

Inventors: Tamir Berliner (Tel Aviv, IL); Tomer Kahan (Ramat Hasharon, IL); Orit Dolev (Tel Aviv, IL)
Assignee: MULTINARITY LTD
G06T15/20G06F3/1454
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,481,963
App. No.
17/713,906
Filed
Apr 5, 2022
Granted
Oct 25, 2022
Kind
B2
Art Unit
2611
USPC
345/419
Abstract

Systems, methods, and non-transitory computer readable media configured for enabling content sharing between users of wearable extended reality appliances are provided. In one implementation, the computer readable medium may be configured to contain instructions to cause at least one processor to establish a link between a first wearable extended reality appliance and a second wearable extended reality appliance. The first wearable extended reality appliance may display first virtual content. The second wearable extended reality appliance may obtain a command to display first virtual content via the second wearable extended reality appliance, and in response, this content may be transmitted and displayed via the second extended reality appliance. Additionally, the first wearable extended reality appliance may receive second virtual content from the second wearable extended reality appliance, and display said second virtual content via the first wearable extended reality appliance.

Claims (41)

1. A non-transitory computer readable medium containing instructions that when executed by at least one processor cause the at least one processor to perform operations for presenting virtual content to multiple viewers, the operations comprising:

receiving sensor data indicative of a plurality of wearable extended reality appliances located in a room;

receiving a command to share a virtual object with the plurality of wearable extended reality appliances;

analyzing the sensor data to determine a first location in the room of a first wearable extended reality appliance, a second location in the room of a second wearable extended reality appliance, and a third location in the room of a third wearable extended reality appliance;

determining a position for displaying the virtual object in the room based on the determined first location, the determined second location, and the determined third location;

causing a first display of the virtual object at the determined position through the first wearable extended reality appliance, the first display being rendered from a first perspective;

causing a second display of the virtual object at the determined position through the second wearable extended reality appliance, the second display being rendered from a second perspective different from the first perspective; and

causing a third display of the virtual object at the determined position through the third wearable extended reality appliance, the third display being rendered from a third perspective different from the first perspective and the second perspective.

2. The non-transitory computer readable medium of claim 1 , wherein the operations further include analyzing the sensor data to determine that at least one of the first wearable extended reality appliance, the second wearable extended reality appliance, or the third wearable extended reality appliance is virtually located in the room, wherein the determined location of the at least one wearable extended reality appliance virtually located in the room is reflective of a location of an avatar of at least one user.

3. The non-transitory computer readable medium of claim 1 , wherein the determined position for displaying the virtual object includes a determined orientation of the virtual object in the room, and the operations further include analyzing additional sensor data to determine that at least two of the first wearable extended reality appliance, the second wearable extended reality appliance, or the third wearable extended reality appliance changed orientation, and adjusting the determined orientation of the virtual object is based on the orientation change.

4. The non-transitory computer readable medium of claim 1 , wherein the determined position for displaying the virtual object includes a determined location of the virtual object, and the operations further include analyzing additional sensor data to determine that at least two of the first wearable extended reality appliance, the second wearable extended reality appliance, or the third wearable extended reality appliance changed location, and adjusting the determined location of the virtual object is based on the location change.

5. The non-transitory computer readable medium of claim 1 , wherein the operations further include determining an identity of at least one of a user of the first wearable extended reality appliance, a user of the second wearable extended reality appliance, or a user of the third wearable extended reality appliance; and wherein determining the position for displaying the virtual object is further based on the identity of the at least one user.

6. The non-transitory computer readable medium of claim 1 , wherein the operations further include determining a physical characteristic of at least one user of the first wearable extended reality appliance, the second wearable extended reality appliance, or the third wearable extended reality appliance; and wherein determining the position for displaying the virtual object is further based on the physical characteristic of the at least one user.

7. The non-transitory computer readable medium of claim 1 , wherein the operations further include determining a layout of the room that involves one or more physical locations of furniture in the room, and wherein the position for displaying the virtual object is further determined based on the layout of the room.

8. The non-transitory computer readable medium of claim 1 , wherein the operations further include determining illumination conditions in the room, and wherein the position for displaying the virtual object is further determined based on the illumination conditions.

9. The non-transitory computer readable medium of claim 1 , wherein the operations further include determining a type of the virtual object, and wherein the position for displaying the virtual object is further determined based on the type of the virtual object.

10. The non-transitory computer readable medium of claim 1 , wherein the operations further include analyzing the sensor data to identify a physical object in the room and wherein the position for displaying the virtual object is determined so that none of the first display, the second display, and the third display are occluded by the physical object.

11. The non-transitory computer readable medium of claim 1 , wherein the operations further include analyzing the sensor data to identify a physical object in the room and wherein the position for displaying the virtual object is determined so that none of the first display, the second display, and the third display occlude the physical object.

12. The non-transitory computer readable medium of claim 1 , wherein the first display of the virtual object, the second display of the virtual object, and the third display of the virtual object are associated with a single version of the virtual object, wherein the operations further include detecting a change to the virtual object introduced by a user of the first wearable extended reality appliance, and updating the second display and the third display to reflect the change to the virtual object introduced by the user of the first wearable extended reality appliance.

13. The non-transitory computer readable medium of claim 1 , wherein the first display of the virtual object, the second display of the virtual object, and the third display of the virtual object are associated with different versions of the virtual object, and the operations further include obtaining a profile associated with a user of the first wearable extended reality appliance, a profile associated with a user the second wearable extended reality appliance, and a profile associated with a user of the third wearable extended reality appliance, and determining a personalized version of the virtual object based on the profile associated with each user.

14. The non-transitory computer readable medium of claim 1 , wherein while the virtual object is displayed at the determined position through the first wearable extended reality appliance and through the second wearable extended reality appliance, the operations further include receiving additional sensor data indicating a change to a status of the third wearable extended reality appliance, and repositioning the virtual object based on the determined first location of the first wearable extended reality appliance and the determined second location of the second wearable extended reality appliance.

15. The non-transitory computer readable medium of claim 1 , wherein while the virtual object is displayed at the determined position, the operations further include receiving additional sensor data indicating that a fourth wearable extended reality appliance is in the room, determining a fourth location of the fourth wearable extended reality appliance, and repositioning the virtual object based on the determined first location, the determined second location, the determined third location, and the determined fourth location.

16. The non-transitory computer readable medium of claim 1 , wherein the operations are executed by the first wearable extended reality appliance, wherein causing the first display includes generating display signals, causing the second display includes transmitting data reflecting the virtual object to the second wearable extended reality appliance, and causing the third display includes transmitting data reflecting the virtual object to the third wearable extended reality appliance.

17. The non-transitory computer readable medium of claim 1 , wherein the virtual object is a virtual display configured to present text entered using an input device, and determining the position for displaying the virtual display is further based on at least one of a location of the input device or an orientation of the input device.

18. The non-transitory computer readable medium of claim 1 , wherein the virtual object is a virtual display configured to present text entered using a physical keyboard, the physical keyboard is positioned on a physical surface, and determining the position for displaying the virtual display is further based on a characteristic of the physical surface.

19. A method for presenting virtual content to multiple viewers, the method comprising:

receiving sensor data indicative of a plurality of wearable extended reality appliances located in a room;

receiving a command to share a virtual object with the plurality of wearable extended reality appliances;

analyzing the sensor data to determine a first location in the room of a first wearable extended reality appliance, a second location in the room of a second wearable extended reality appliance, and a third location in the room of a third wearable extended reality appliance;

determining a position for displaying the virtual object in the room based on the determined first location, the determined second location, and the determined third location;

causing a first display of the virtual object at the determined position through the first wearable extended reality appliance, the first display being rendered from a first perspective;

causing a second display of the virtual object at the determined position through the second wearable extended reality appliance, the second display being rendered from a second perspective different from the first perspective; and

causing a third display of the virtual object at the determined position through the third wearable extended reality appliance, the third display being rendered from a third perspective different from the first perspective and the second perspective.

20. A system for presenting virtual content to multiple viewers, the system comprising: at least one processor programmed to:

receive sensor data indicative of a plurality of wearable extended reality appliances located in a room;

receive a command to share a virtual object with the plurality of wearable extended reality appliances;

analyze the sensor data to determine a first location in the room of a first wearable extended reality appliance, a second location in the room of a second wearable extended reality appliance, and a third location in the room of a third wearable extended reality appliance;

determine a position for displaying the virtual object in the room based on the determined first location, the determined second location, and the determined third location;

cause a first display of the virtual object at the determined position through the first wearable extended reality appliance, the first display being rendered from a first perspective;

cause a second display of the virtual object at the determined position through the second wearable extended reality appliance, the second display being rendered from a second perspective different from the first perspective; and

cause a third display of the virtual object at the determined position through the third wearable extended reality appliance, the third display being rendered from a third perspective different from the first perspective and the second perspective.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 5, 2022
From: BERLINER, TAMIR; KAHAN, TOMER; DOLEV, ORIT
To: MULTINARITY LTD
Reel/Frame 059508/0588 →
Continuity (13)
Continuation PCTUS2022015547 · Feb 8, 2022
Provisional Application 63307217 · Feb 7, 2022
Provisional Application 63307203 · Feb 7, 2022
Provisional Application 63307207 · Feb 7, 2022
Provisional Application 63300005 · Jan 16, 2022
Provisional Application 63226977 · Jul 29, 2021
Provisional Application 63216335 · Jun 29, 2021
Provisional Application 63215500 · Jun 27, 2021
Provisional Application 63213019 · Jun 21, 2021
Provisional Application 63173095 · Apr 9, 2021
Provisional Application 63157768 · Mar 7, 2021
Provisional Application 63147051 · Feb 8, 2021
Related Publication 20220254096A1 · Aug 11, 2022
Cited By (14)
US 12,189,422 US 12,236,008 US 12,265,655 US 12,360,557 US 12,360,558 US 12,380,238 US 12,474,816 US 12,530,102 US 12,530,103 US 12,537,877 US 12,619,774 US 12,625,556 US 12,627,740 US 12,669,848