IP Library Granted Patent US 10,964,110
Granted Patent B2
US 10,964,110 · App. 15/972,498 · Granted Mar 30, 2021

Managed actions using augmented reality

Inventors: Santhosh Chandrashekarappa (Bangalore, IN); Ashish Maan (Bangalore, IN); Adithya Ravi (Bangalore, IN); Lokeswar Akuthota (Bangalore, IN)
Assignee: VMWARE, INC.
G06T19/006G06F3/04842G06T7/70G06F8/61H04L63/08
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,964,110
App. No.
15/972,498
Granted
Mar 30, 2021
Kind
B2
Abstract

Disclosed are various examples for performing actions using augmented reality. In some examples, a user interface that includes a field of view is generated. The field of view is currently captured using a camera of a client device. Object data in the field of view is detected. Position data is determined. The position data includes a location of the client device and an orientation vector that indicates a direction the camera of the client device. A request for actions is transmitted to a management service. The request includes the object data and the position data. An action and an identity of a managed object are received from the management service. The user interface is updated to include an identity of a managed object, and a user interface element that when selected causes an action to be performed.

Claims (50)

1. A system for performing actions using augmented reality, the system comprising:

a client device; and

a data store comprising instructions executable by the client device, the instructions, when executed, causing the client device to:

generate a user interface comprising a field of view currently captured by a camera of the client device;

transmit, to a management service, a request for at least one group-role-specific action for a managed object within the field of view of the camera, the managed object being identified based on a machine-readable identifier in the field of view of the camera, the at least one group-role-specific action comprising an action that is specific to a group role corresponding to a user group specified in a user account with the management service, and wherein the user account associated with the client device is identified by the management service based on an HMAC token transmitted with the request;

receive, from the management service, a group-role-specific action for the managed object, the group-role-specific action being identified from a list of actions for the managed object in the field of view of the camera, based on the group role corresponding to the user group specified in the user account with the management service;

update the user interface to include a managed object overlay, the managed object overlay comprising a user interface element that causes the group-role-specific action to be performed; and

perform the group-role-specific action based on a selection of the group-role-specific action for the managed object.

2. The system of claim 1 , wherein the request for the at least one group-role-specific action further comprises authentication data associated with the client device.

3. The system of claim 2 , wherein the group role is associated with the authentication data for the user account with the management service.

4. The system of claim 1 , wherein the group-role-specific action is performed by a subset of the instructions, and wherein the subset of the instructions, when executed, cause the client device to:

transmit data identifying the group-role-specific action to the management service;

retrieve a command that is placed in a command queue by the management service; and

execute the command in the client device.

5. The system of claim 4 , wherein the command is a command to install at least one of: a driver for the managed object, an application associated with the managed object, or a profile associated with the managed object.

6. The system of claim 4 , wherein the group-role-specific action is performed by a subset of the instructions, wherein the subset of the instructions, when executed, cause the client device to transmit data identifying the group-role-specific action to the management service, and wherein the management service places a command to perform the group-role-specific action in a command queue of the managed object.

7. The system of claim 1 , wherein the instructions, when executed, further cause the client device to:

determine an area that includes the managed object within the field of view of the user interface; and

position the managed object overlay based on the area that includes the managed object.

8. A non-transitory computer-readable medium embodying instructions executable by a client device, wherein the instructions, when executed, cause the client device to:

generate a user interface comprising a field of view currently captured by a camera of the client device;

transmit, to a management service, a request for at least one group-role-specific action for a managed object within the field of view of the camera, the managed object being identified based on a machine-readable identifier in the field of view of the camera, the at least one group-role-specific action comprising an action that is specific to a group role specified in a user account with the management service, and wherein the user account associated with the client device is identified by the management service based on an HMAC token transmitted with the request;

receive, from the management service, a group-role-specific action for the managed object, the group-role-specific action being identified from a list of actions for the managed object in the field of view of the camera, based on the group role corresponding to a user group specified in the user account with the management service;

update the user interface to include a managed object overlay, the managed object overlay comprising a user interface element that causes the group-role-specific action to be performed; and

perform the group-role-specific action based on a selection of the group-role-specific action for the managed object.

9. The non-transitory computer-readable medium of claim 8 , wherein the request for the at least one group-role-specific action further comprises authentication data associated with the client device.

10. The non-transitory computer-readable medium of claim 9 , wherein the group role is associated with the authentication data within the management service.

11. The non-transitory computer-readable medium of claim 8 , wherein the group-role-specific action is performed by a subset of the instructions, and wherein the subset of the instructions, when executed, cause the client device to:

transmit data identifying the group-role-specific action to the management service;

retrieve a command that is placed in a command queue by the management service; and

execute the command in the client device.

12. The non-transitory computer-readable medium of claim 11 , wherein the command is a command to install at least one of: a driver for the managed object, an application associated with the managed object, or a profile associated with the managed object.

13. The non-transitory computer-readable medium of claim 8 , wherein the instructions, when executed, further cause the client device to:

determine an area that includes the managed object within the field of view of the user interface; and

position the managed object overlay based on the area that includes the managed object.

14. A computer-implemented method comprising:

generating a user interface comprising a field of view currently captured by a camera of a client device;

transmitting, to a management service, a request for at least one group-role-specific action for a managed object within the field of view of the camera, the managed object being identified based on a machine-readable identifier in the field of view of the camera, the at least one group-role-specific action comprising an action that is specific to a group role specified in a user account with the management service, and wherein the user account associated with the client device is identified by the management service based on an HMAC token transmitted with the request;

receiving, from the management service, a group-role-specific action for the managed object, the group-role-specific action being identified from a list of actions for the managed object in the field of view of the camera, based on the group role corresponding to a user group specified in the user account with the management service;

updating the user interface to include a managed object overlay, the managed object overlay comprising a user interface element that causes the group-role-specific action to be performed; and

performing the group-role-specific action based on a selection of the group-role-specific action for the managed object.

15. The computer-implemented method of claim 14 , wherein the request for the at least one group-role-specific action further comprises authentication data associated with the client device.

16. The computer-implemented method of claim 15 , wherein the group role is associated with the authentication data within the management service.

17. The computer-implemented method of claim 14 , wherein the group-role-specific action is performed by:

transmitting data identifying the group-role-specific action to the management service;

retrieving a command that is placed in a command queue by the management service; and

executing the command in the client device.

18. The computer-implemented method of claim 17 , wherein the command is a command to install at least one of: a driver for the managed object, an application associated with the managed object, or a profile associated with the managed object.

19. The computer-implemented method of claim 14 , wherein the group-role-specific action is performed by transmitting data identifying the group-role-specific action to the management service, and wherein the management service places a command to perform the group-role-specific action in a command queue of the managed object.

20. The computer-implemented method of claim 14 , wherein the group-role-specific action comprises an option or a setting for the managed object.

Assignments (4)
PATENT ASSIGNMENT Recorded Aug 5, 2024
From: VMWARE LLC
To: OMNISSA, LLC
Reel/Frame 068327/0365 →
SECURITY INTEREST Recorded Jul 3, 2024
From: OMNISSA, LLC
To: UBS AG, STAMFORD BRANCH
Reel/Frame 068118/0004 →
CHANGE OF NAME Recorded Apr 15, 2024
From: VMWARE, INC.
To: VMWARE LLC
Reel/Frame 067102/0314 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 7, 2018
From: CHANDRASHEKARAPPA, SANTHOSH; MAAN, ASHISH; RAVI, ADITHYA; AKUTHOTA, LOKESWAR
To: VMWARE, INC.
Reel/Frame 045732/0320 →
Continuity (1)
Related Publication 20190340819A1 · Nov 7, 2019