IP Library Granted Patent US 11,941,149
Granted Patent B2
US 11,941,149 · App. 18/185,540 · Granted Mar 26, 2024

Positioning participants of an extended reality conference

Inventors: Orit Dolev (Tel Aviv, IL); Tamir Berliner (Tel Aviv, IL); Tomer Kahan (Ramat Hasharon, IL)
Assignee: SIGHTFUL COMPUTERS LTD
G06F21/6245G01C21/00G02B27/0172G06F3/011G06F9/451G06Q30/0261G06T3/40G06T7/20G06T11/00G06T13/40G06T17/00G06T19/006G06V10/25G06V10/60G06V10/764G06V20/20G06V20/50H04N7/147H04N7/152H04N7/157H04W4/02G02B2027/014G02B2027/0141G02B2027/0178G06T2200/24G06V2201/07
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,941,149
App. No.
18/185,540
Filed
Mar 17, 2023
Granted
Mar 26, 2024
Kind
B2
Art Unit
2693
USPC
348/14.09
Abstract

Methods, systems, apparatuses, and computer-readable media are provided for managing extended reality video conferences. In one implementation, the computer-readable medium may include instructions to cause a processor to: receive a request to initiate a video conference between a plurality of participants; receive image data captured by at least one image sensor associated with a wearable extended reality appliance, the image data reflecting a layout of a physical environment in which the wearable extended reality appliance is located; analyze the image data to identify at least one interference region in the physical environment; receive visual representations of the plurality of participants; and cause the wearable extended reality appliance to display the visual representations of the plurality of participants at multiple distinct locations other than in the at least one interference region.

Claims (43)

1. A non-transitory computer readable medium containing instructions that when executed by at least one processor cause the at least one processor to perform operations for managing extended reality video conferences, the operations comprising:

receiving a request to initiate a video conference between a plurality of participants;

receiving image data captured by at least one image sensor associated with a wearable extended reality appliance, the image data reflecting a layout of a physical environment in which the wearable extended reality appliance is located;

analyzing the image data to identify at least one interference region in the physical environment;

receiving visual representations of the plurality of participants; and

causing the wearable extended reality appliance to display the visual representations of the plurality of participants at multiple distinct locations other than in the at least one interference region, such that the at least one interference region is devoid of any of the visual representations of the plurality of participants;

selecting a designated area based on a vision problem of a wearer of the wearable extended reality appliance; and

after causing the wearable extended reality appliance to display the visual representations, identifying a speaking participant and moving a particular visual representation associated with the speaking participant to the designated area.

2. The non-transitory computer readable medium of claim 1 , wherein analyzing the image data to identify at least one interference region includes performing image recognition analysis to identify in the physical environment at least one of a window, a display, or an egress.

3. The non-transitory computer readable medium of claim 1 , wherein analyzing the image data to identify at least one interference region includes performing image recognition analysis to identify in the physical environment an area with light brighter than light in other areas of the physical environment.

4. The non-transitory computer readable medium of claim 1 , wherein the identification of the at least one interference region includes analyzing the image data to identify an inanimate object in the physical environment.

5. The non-transitory computer readable medium of claim 1 , wherein the operations further include analyzing the image data to determine presentation characteristics for at least one of the visual representations.

6. The non-transitory computer readable medium of claim 5 , wherein the presentation characteristics include dimensions, and the dimensions of at least one of the visual representations are determined to account for an existence of one or more physical objects in the physical environment.

7. The non-transitory computer readable medium of claim 1 , wherein the operations further include receiving a location selection corresponding to a portion of the physical environment; confirming that the selected portion of the physical environment is devoid of any interference regions; and causing the wearable extended reality appliance to display the visual representation of at least one of the plurality of participants at the portion of the physical environment.

8. The non-transitory computer readable medium of claim 1 , wherein the plurality of participants is a selected part of a group of participants, and the operations further include receiving a selection of the plurality of participants; and causing the wearable extended reality appliance to display the visual representations of participants included in the selected part of the group of participants while omitting from the display the visual representations of participants excluded from the selected part of the group of participants.

9. The non-transitory computer readable medium of claim 1 , wherein the designated area includes a predetermined speaker location.

10. The non-transitory computer readable medium of claim 1 , wherein the operations further include determining a region of focus of the wearer of the wearable extended reality appliance, and moving the particular visual representation to a new location in the region of focus.

11. The non-transitory computer readable medium of claim 1 , wherein moving the particular visual representation associated with the speaking participant to the designated area includes moving a specific visual representation associated with a previously speaking participant different from the speaking participant from the designated area.

12. The non-transitory computer readable medium of claim 1 , wherein the operations further include changing visual characteristics of the particular visual representation associated with the speaking participant to designate the speaking participant.

13. The non-transitory computer readable medium of claim 12 , wherein changing the visual characteristics of the particular visual representation includes enlarging the particular visual representation.

14. The non-transitory computer readable medium of claim 12 , wherein changing the visual characteristics of the particular visual representation includes virtually illuminating the particular visual representation.

15. The non-transitory computer readable medium of claim 1 , wherein the operations further include accessing a group of placement rules associating possible locations with layout of physical spaces; determining that the layout of the physical environment corresponds to one or more of the placement rules; and implementing the corresponding one or more rules to cause the wearable extended reality appliance to display the visual representations at the multiple distinct locations.

16. The non-transitory computer readable medium of claim 1 , wherein the operations further include:

receiving additional image data captured after causing the wearable extended reality appliance to display the visual representations;

analyzing the additional image data to identify a change of the at least one interference region in the physical environment, wherein the change causes at least part of the multiple distinct locations to overlap with the changed at least one interference region; and

causing the wearable extended reality appliance to move at least one visual representation to a different location that has no overlap with the changed at least one interference region, such that the changed at least one interference region is devoid of any of the visual representations of the plurality of participants.

17. A method for managing extended reality video conferences, the method comprising:

receiving a request to initiate a video conference between a plurality of participants;

receiving image data captured by at least one image sensor associated with a wearable extended reality appliance, the image data reflecting a layout of a physical environment in which the wearable extended reality appliance is located;

analyzing the image data to identify at least one interference region in the physical environment;

receiving visual representations of the plurality of participants;

causing the wearable extended reality appliance to display the visual representations of the plurality of participants at multiple distinct locations other than in the at least one interference region, such that the at least one interference region is devoid of any of the visual representations of the plurality of participants;

selecting a designated area based on a vision problem of a wearer of the wearable extended reality appliance; and

after causing the wearable extended reality appliance to display the visual representations, identifying a speaking participant and moving a particular visual representation associated with the speaking participant to the designated area.

18. A system for managing extended reality video conferences, the system comprising:

at least one processing device configured to:

receive a request to initiate a video conference between a plurality of participants;

receive image data captured by at least one image sensor associated with a wearable extended reality appliance, the image data reflecting a layout of a physical environment in which the wearable extended reality appliance is located;

analyze the image data to identify at least one interference region in the physical environment;

receive visual representations of the plurality of participants;

cause the wearable extended reality appliance to display the visual representations of the plurality of participants at multiple distinct locations other than in the at least one interference region, such that the at least one interference region is devoid of any of the visual representations of the plurality of participants;

select a designated area based on a vision problem of a wearer of the wearable extended reality appliance; and

after causing the wearable extended reality appliance to display the visual representations, identify a speaking participant and move a particular visual representation associated with the speaking participant to the designated area.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE ERRONEOUS APPLICATION NO. 18/185,640 PREVIOUSLY RECORDED ON REEL 065335 FRAME 0857. ASSIGNOR(S) HEREBY CONFIRMS THE CHANGE OF NAME. Recorded Jan 24, 2024
From: MULTINARITY LTD
To: SIGHTFUL COMPUTERS LTD
Reel/Frame 066367/0936 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 17, 2023
From: DOLEV, ORIT; BERLINER, TAMIR; KAHAN, TOMER
To: MULTINARITY LTD
Reel/Frame 063017/0274 →
Continuity (10)
Continuation PCTUS2023011401 · Jan 24, 2023
Provisional Application 63406000 · Sep 13, 2022
Provisional Application 63357225 · Jun 30, 2022
Provisional Application 63344727 · May 23, 2022
Provisional Application 63319423 · Mar 14, 2022
Provisional Application 63307217 · Feb 7, 2022
Provisional Application 63307207 · Feb 7, 2022
Provisional Application 63307203 · Feb 7, 2022
Provisional Application 63302851 · Jan 25, 2022
Related Publication 20230308609A1 · Sep 28, 2023