IP Library Granted Patent US 11,496,571
Granted Patent B2
US 11,496,571 · App. 17/712,812 · Granted Nov 8, 2022

Systems and methods for moving content between virtual and physical displays

Inventors: Tamir Berliner (Tel Aviv, IL); Tomer Kahan (Ramat Hasharon, IL); Orit Dolev (Tel Aviv, IL)
Assignee: Multinarity Ltd
H04L67/131G02B27/0093G02B27/017G06F3/011G06F3/017G06F3/04815G06F3/1454G06K7/1417G06T7/20G06T7/70G06T11/00G06T15/20G06T19/006G06T19/20G06V30/14G06V30/228H04L65/403H04L65/4015H04W4/02H04W4/70H04W4/80G02B2027/014G02B2027/0138G02B2027/0178G06T2219/024H04W4/026
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,496,571
App. No.
17/712,812
Filed
Apr 4, 2022
Granted
Nov 8, 2022
Kind
B2
Art Unit
2451
USPC
709/204
Abstract

Systems, methods, and non-transitory computer readable media for transferring virtual content to a physical display device are disclosed. An extended reality environment may be presented in a room via a wearable extended reality appliance configured to be paired with multiple display devices located in the room. Each display device may be associated with a unique network identifier. Input to cause presentation of a specific virtual object in the extended reality environment on a target display device and image data depicting the target display device may be received. The image data may be analyzed to identify the target display device. A network identifier of the target display device may be determined. A communications link with the target display device may be established. Data representing the specific virtual object may be transmitted to the target display device, to enable the target display device to present the specific virtual object.

Claims (51)

1. A non-transitory computer readable medium containing instructions that when executed by at least one processor cause the at least one processor to perform operations for transferring virtual content to a physical display device, the operations comprising:

presenting an extended reality environment in a room via a wearable extended reality appliance, the wearable extended realty appliance being configured to be paired with multiple display devices located in the room, wherein each display device is associated with a unique network identifier;

receiving input associated with the wearable extended reality appliance to cause presentation of a specific virtual object in the extended reality environment on a target display device;

receiving image data from an image sensor associated with the wearable extended reality appliance, the image data depicting the target display device;

analyzing the image data to identify the target display device;

upon identifying the target display device, determining a network identifier of the target display device;

using the determined network identifier of the target display device to establish a communications link with the target display device;

transmitting data representing the specific virtual object to the target display device, wherein the transmitted data enables the target display device to present the specific virtual object; and

determining that the specific virtual object is classified as private, analyzing the image data to determine presence of individuals other than a user of the wearable extended reality appliance exposed to the target display device, in response to a determination of no individuals other than the user exposed to the target display device, transmitting the data representing the specific virtual object to the target display device, and in response to a determination of more than one individual is exposed to the target display device, avoiding transmission of the data representing the specific virtual object to the target display device.

2. The non-transitory computer readable medium of claim 1 , wherein the input is received from the image sensor associated with the wearable extended reality appliance.

3. The non-transitory computer readable medium of claim 2 , wherein the operations further include analyzing the image data to identify a gesture initiated by a user of the wearable extended reality appliance that triggers a virtual collision between the specific virtual object and the target display device.

4. The non-transitory computer readable medium of claim 1 , wherein the input is received from a pointing device associated with the wearable extended reality appliance.

5. The non-transitory computer readable medium of claim 1 , wherein the operations further include analyzing the image data to recognize content displayed by the target display device and to thereby determine an identity of the target display device.

6. The non-transitory computer readable medium of claim 1 , wherein the operations further include determining that the specific virtual object is classified as private, requesting a permission for displaying the specific virtual object through the target display device, and transmitting the data representing the specific virtual object to the target display device only after receiving the permission.

7. The non-transitory computer readable medium of claim 1 , wherein the operations further include determining that the specific virtual object is classified as private, determining that the target display device is authorized for presenting the private information, and in response to the determination that the target display device is authorized for presenting the private information, transmitting the data representing the specific virtual object to the target display device.

8. The non-transitory computer readable medium of claim 1 , wherein the operations further include, after transmitting the data representing the specific virtual object to the target display device: determining that an individual other than the user is likely to be exposed to the target display device; and in response to the determination that the individual other than the user is likely to be exposed to the target display device, causing the target display device to cease presentation of the specific virtual object.

9. The non-transitory computer readable medium of claim 1 , wherein the specific virtual object is a virtual screen playing media content, and the transmission of the data causes the media content to be presented through the target display device.

10. The non-transitory computer readable medium of claim 1 , wherein the operations further include causing the specific virtual object to disappear from the extended reality environment once the specific virtual object is presented through the target display device.

11. The non-transitory computer readable medium of claim 1 , wherein the operations further include displaying via the wearable extended reality appliance a virtual indicator indicating that the specific virtual object is presented through the target display device.

12. The non-transitory computer readable medium of claim 1 , wherein the operations further include generating a virtual controller associated with the target display device, the virtual controller enabling modification of display parameters of the target display device.

13. The non-transitory computer readable medium of claim 1 , wherein the operations further include, after the target display device begins presenting the specific virtual object, receiving additional input, and modifying the specific virtual object on the target display device based on the additional input.

14. The non-transitory computer readable medium of claim 1 , wherein the operations further include, after the target display device begins presenting the specific virtual object, receiving an additional input indicating a desire of a user of the wearable extended reality appliance to stop presenting the specific virtual object through the target display device; and in response to receiving the additional input, causing the target display device to cease presentation of the specific virtual object by the target display device.

15. The non-transitory computer readable medium of claim 14 , wherein the additional input indicating the desire of the user of the wearable extended reality appliance to stop presenting the specific virtual object through the target display device includes an indication that the wearable extended reality appliance left the room.

16. The non-transitory computer readable medium of claim 15 , wherein the operations further include, after ceasing the presentation of the specific virtual object, receiving an indication that the wearable extended reality appliance reentered the room, and causing a renewal of the presentation of the specific virtual object by the target display device in response to the reentrance.

17. The non-transitory computer readable medium of claim 1 , wherein the operations further include:

receiving additional input to cause presentation of content from a second display device through the wearable extended reality appliance;

receiving second image data from the image sensor, the second image data depicting the second display device;

analyzing the second image data to identify the second display device;

upon identifying the second display device, determining a network identifier of the second display device;

using the determined network identifier of the second display device to establish a communications link with the second display device;

receiving data representing the content from the second display device; and

displaying through the wearable extended reality appliance the content from the second display device.

18. A method for transferring virtual content to a physical display device, the method comprising:

presenting an extended reality environment in a room via a wearable extended reality appliance, the wearable extended reality appliance being configured to be paired with multiple display devices located in the room, wherein each display device is associated with a unique network identifier;

receiving input associated with the wearable extended reality appliance to cause presentation of a specific virtual object in the extended realty environment on a target display device;

receiving image data from an image sensor associated with the wearable extended realty appliance, the image data depicting the target display device;

analyzing the image data to identify the target display device;

upon identifying the target display device, determining a network identifier of the target display device;

using the determined network identifier of the target display device to establish a communications link with the target display device;

transmitting data representing the specific virtual object to the target display device, wherein the transmitted data enables the target display device to present the specific virtual object; and

determining that the specific virtual object is classified as private, analyzing the image data to determine presence of individuals other than a user of the wearable extended reality appliance exposed to the target display device, in response to a determination of no individuals other than the user exposed to the target display device, transmitting the data representing the specific virtual object to the target display device, and in response to a determination of more than one individual is exposed to the target display device, avoiding transmission of the data representing the specific virtual object to the target display device.

19. A system for transferring virtual content to a physical display device, the system comprising:

at least one processing device configured to:

present an extended reality environment in a room via a wearable extended reality appliance, the wearable extended reality appliance being configured to be paired with multiple display devices located in the room, wherein each display device is associated with a unique network identifier;

receive input associated with the wearable extended reality appliance to cause presentation of a specific virtual object in the extended reality environment on a target display device;

receive image data from an image sensor associated with the wearable extended reality appliance, the image data depicting the target display device;

analyze the image data to identify the target display device;

upon identifying the target display device, determine a network identifier of the target display device;

use the determined network identifier of the target display device to establish a communications link with the target display device;

transmit data representing the specific virtual object to the target display device, wherein the transmitted data enables the target display device to present the specific virtual object; and

determine that the specific virtual object is classified as private, analyze the image data to determine presence of individuals other than a user of the wearable extended reality appliance exposed to the target display device, in response to a determination of no individuals other than the user exposed to the target display device, transmit the data representing the specific virtual object to the target display device, and in response to a determination of more than one individual is exposed to the target display device, avoid transmission of the data representing the specific virtual object to the target display device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 4, 2022
From: BERLINER, TAMIR; KAHAN, TOMER; DOLEV, ORIT
To: MULTINARITY LTD
Reel/Frame 059492/0387 →
Continuity (13)
Continuation PCTUS2022015547 · Feb 8, 2022
Provisional Application 63307217 · Feb 7, 2022
Provisional Application 63307207 · Feb 7, 2022
Provisional Application 63307203 · Feb 7, 2022
Provisional Application 63300005 · Jan 16, 2022
Provisional Application 63226977 · Jul 29, 2021
Provisional Application 63216335 · Jun 29, 2021
Provisional Application 63215500 · Jun 27, 2021
Provisional Application 63213019 · Jun 21, 2021
Provisional Application 63173095 · Apr 9, 2021
Provisional Application 63157768 · Mar 7, 2021
Provisional Application 63147051 · Feb 8, 2021
Related Publication 20220286488A1 · Sep 8, 2022
Cited By (50)
US 12,189,422 US 12,236,008 US 12,265,655 US 12,272,005 US 12,299,251 US 12,315,091 US 12,321,563 US 12,321,666 US 12,353,672 US 12,360,557 US 12,360,558 US 12,380,238 US 12,394,167 US 12,443,273 US 12,456,271 US 12,461,641 US 12,474,816 US 12,475,635 US 12,505,625 US 12,511,009 US 12,511,847 US 12,524,142 US 12,524,956 US 12,524,977 US 12,530,102 US 12,530,103 US 12,535,931 US 12,537,877 US 12,541,280 US 12,566,532 US 12,596,472 US 12,608,115 US 12,608,877 US 12,608,890 US 12,619,774 US 12,620,187 US 12,625,556 US 12,625,608 US 12,627,740 US 12,632,170 US 12,633,044 US 12,657,958 US 12,663,853 US 12,663,875 US 12,663,907 US 12,669,848 US 12,675,958 US 12,681,587 US 12,687,922 US 12,688,660