IP Library Granted Patent US 10,846,939
Granted Patent B2
US 10,846,939 · App. 16/733,308 · Granted Nov 24, 2020

Augmented reality workspace system

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,846,939
App. No.
16/733,308
Granted
Nov 24, 2020
Kind
B2
Abstract

An augmented reality workspace system includes a physical display device, a user tracking subsystem, and an augmented reality display subsystem, all coupled to a computing system. The computing system uses the augmented reality display subsystem to display an augmented reality element that appears located in a three-dimensional volume immediately adjacent the physical display device as viewed through the augmented reality display subsystem, and uses the physical display device to display a two-dimensional element in a manner that is coordinated with the augmented reality element displayed using the augmented reality display subsystem. When the computing system receives user tracking information from the user tracking subsystem that indicates a user interaction with the augmented reality element, it provides for a coordinated modification of the display of each of the augmented reality element and the two-dimensional element by the augmented reality display subsystem and the physical display device, respectively.

Claims (59)

1. A physical display device integrated augmented reality workspace system, comprising:

a physical display device;

an augmented reality display subsystem; and

a computing system including a processor that is coupled to the physical display device and the augmented reality display subsystem, wherein the computing system is configured to:

define, based on physical display device information associated with the physical display device, a three-dimensional volume that is immediately adjacent the physical display device and that remains stationary relative to the physical display device when the augmented reality display subsystem moves relative to the physical display device;

provide, for display on the augmented reality display subsystem and in order to appear to be located in the three-dimensional volume immediately adjacent the physical display device as viewed through the augmented reality display subsystem, a first augmented reality element;

provide, for display on the physical display device, a two-dimensional element that is coordinated with the first augmented reality element displayed on the augmented reality display subsystem;

identify at least one first user interaction with the two-dimensional element displayed on the physical display device;

modify, in response to the at least one first user interaction, the display of the two-dimensional element displayed on the physical display device; and

modify, in response to the at least one first user interaction, the display of the first augmented reality element by the augmented reality display subsystem in a manner that is coordinated with the modification of the display of the two-dimensional element displayed on the physical display device.

2. The physical display device integrated augmented reality workspace system of claim 1 , wherein the first augmented reality element is displayed in order to appear as a three-dimensional object that is located adjacent the physical display device as viewed through the augmented reality display subsystem.

3. The physical display device integrated augmented reality workspace system of claim 1 , further comprising:

a user tracking subsystem coupled to the computing system, wherein the computing system is configured to:

receive, from the user tracking subsystem, first user tracking information;

analyze the first user tracking information to identify the at least one first user interaction with the two-dimensional element displayed on the physical display device.

4. The physical display device integrated augmented reality workspace system of claim 1 , wherein the two-dimensional element is coordinated with the first augmented reality element by displaying a cross section of the first augmented reality element.

5. The physical display device integrated augmented reality workspace system of claim 1 , wherein the computing system is configured to:

identify at least one second user interaction with the two-dimensional element displayed on the physical display device;

modify, in response to the at least one second user interaction, the display of the two-dimensional element displayed on the physical display device; and

modify, in response to the at least one second user interaction, the display of the first augmented reality element by the augmented reality display subsystem in a manner that is coordinated with the modification, in response to the at least one second user interaction, of the display of the two-dimensional element displayed on the physical display device.

6. The physical display device integrated augmented reality workspace system of claim 1 , wherein the modification of the display of the two-dimensional element includes modifying an area occupied by the two-dimensional element displayed on the physical display device, and wherein the modification of the display of the first augmented reality element includes modifying a display of a virtual volume of the first augmented reality element by the augmented reality display subsystem.

7. An Information Handling System (IHS), comprising:

a processing system including a processor; and

a memory system that includes system memory and that is coupled to the processing system and that includes instructions that, when executed by the processing system, cause the processing system to provide an augmented reality display engine that is configured to:

define, based on physical display device information associated with a physical display device, a three-dimensional volume that is immediately adjacent the physical display device and that remains stationary relative to the physical display device when an augmented reality display subsystem moves relative to the physical display device;

provide, for display on the augmented reality display subsystem and in order to appear to be located in the three-dimensional volume immediately adjacent the physical display device as viewed through the augmented reality display subsystem, a first augmented reality element;

provide, for display on the physical display device, a two-dimensional element that is coordinated with the first augmented reality element displayed on the augmented reality display subsystem;

identify at least one first user interaction with the two-dimensional element displayed on the physical display device;

modify, in response to the at least one first user interaction, the display of the two-dimensional element displayed on the physical display device; and

modify, in response to the at least one first user interaction, the display of the first augmented reality element by the augmented reality display subsystem in a manner that is coordinated with the modification of the display of the two-dimensional element displayed on the physical display device.

8. The IHS of claim 7 , wherein the first augmented reality element is displayed in order to appear as a three-dimensional object that is located adjacent the physical display device as viewed through the augmented reality display subsystem.

9. The IHS of claim 7 , wherein the augmented reality display engine is configured to:

receive, from a user tracking subsystem, first user tracking information;

analyze the first user tracking information to identify the at least one first user interaction with the two-dimensional element displayed on the physical display device.

10. The IHS of claim 9 , wherein the first user tracking information is received from a physical user interaction device that includes at least one of a totem device and a pen device.

11. The IHS of claim 7 , wherein the two-dimensional element is coordinated with the first augmented reality element by displaying a cross section of the first augmented reality element.

12. The IHS of claim 7 , wherein the augmented reality display engine is configured to:

identify at least one second user interaction with the two-dimensional element displayed on the physical display device;

modify, in response to the at least one second user interaction, the display of the two-dimensional element displayed on the physical display device; and

modify, in response to the at least one second user interaction, the display of the first augmented reality element by the augmented reality display subsystem in a manner that is coordinated with the modification, in response to the at least one second user interaction, of the display of the two-dimensional element displayed on the physical display device.

13. The IHS of claim 7 , wherein the modification of the display of the two-dimensional element includes modifying an area occupied by the two-dimensional element displayed on the physical display device, and wherein the modification of the display of the first augmented reality element includes modifying a display of a virtual volume of the first augmented reality element by the augmented reality display subsystem.

14. A method for providing an augmented reality workspace that is integrated with a physical display device, comprising:

defining, by a computing system based on physical display device information associated with the physical display device, a three-dimensional volume that is immediately adjacent the physical display device and that remains stationary relative to the physical display device when an augmented reality display subsystem moves relative to the physical display device;

providing, by the computing system for display on the augmented reality display subsystem and in order to appear to be located in the three-dimensional volume immediately adjacent the physical display device as viewed through the augmented reality display subsystem, a first augmented reality element;

providing, by the computing system for display on the physical display device, a two-dimensional element that is coordinated with the first augmented reality element displayed on the augmented reality display subsystem;

identifying, by the computing system, at least one first user interaction with the two-dimensional element displayed on the physical display device;

modifying, by the computing system in response to the at least one first user interaction, the display of the two-dimensional element displayed on the physical display device; and

modifying, by the computing system in response to the at least one first user interaction, the display of the first augmented reality element by the augmented reality display subsystem in a manner that is coordinated with the modification of the display of the two-dimensional element displayed on the physical display device.

15. The method of claim 14 , wherein the first augmented reality element is displayed in order to appear as a three-dimensional object that is located adjacent the physical display device as viewed through the augmented reality display subsystem.

16. The method of claim 14 , further comprising:

receiving, by the computing system from a user tracking subsystem, first user tracking information;

analyzing, by the computing system, the first user tracking information to identify the at least one first user interaction with the two-dimensional element displayed on the physical display device.

17. The method of claim 16 , wherein the first user tracking information is received from a physical user interaction device that includes at least one of a totem device and a pen device.

18. The method of claim 14 , wherein the two-dimensional element is coordinated with the first augmented reality element by displaying a cross section of the first augmented reality element.

19. The method of claim 14 , further comprising:

identifying, by the computing system, at least one second user interaction with the two-dimensional element displayed on the physical display device;

modifying, by the computing system in response to the at least one second user interaction, the display of the two-dimensional element displayed on the physical display device; and

modifying, by the computing system in response to the at least one second user interaction, the display of the first augmented reality element by the augmented reality display subsystem in a manner that is coordinated with the modification, in response to the at least one second user interaction, of the display of the two-dimensional element displayed on the physical display device.

20. The method of claim 14 , wherein the modification of the display of the two-dimensional element includes modifying an area occupied by the two-dimensional element displayed on the physical display device, and wherein the modification of the display of the first augmented reality element includes modifying a display of a virtual volume of the first augmented reality element by the augmented reality display subsystem.

Assignments (9)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053311/0169) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
Reel/Frame 060438/0742 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053546/0001) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC IP HOLDING COMPANY LLC
Reel/Frame 071642/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (052216/0758) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 060438/0680 →
RELEASE OF SECURITY INTEREST AF REEL 052243 FRAME 0773 Recorded Nov 2, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 058001/0152 →
SECURITY INTEREST Recorded Jun 5, 2020
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 053311/0169 →
SECURITY AGREEMENT Recorded Apr 22, 2020
From: CREDANT TECHNOLOGIES INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 053546/0001 →
SECURITY AGREEMENT Recorded Mar 26, 2020
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 052243/0773 →
PATENT SECURITY AGREEMENT (NOTES) Recorded Mar 24, 2020
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 052216/0758 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 3, 2020
From: AURONGZEB, DEEDER M.; KNOPPERT, MICHIEL SEBASTIAAN EMANUËL PETRUS
To: DELL PRODUCTS L.P.
Reel/Frame 051407/0062 →