IP Library Granted Patent US 11,651,527
Granted Patent B2
US 11,651,527 · App. 17/469,931 · Granted May 16, 2023

Augmented reality based image protection in enterprise settings

Inventor: Rohit Pradeep Shetty (Bangalore, IN)
Assignee: VMWARE, INC.
G06T11/00G01C21/206G06F21/62G06V10/22G06V20/20H04N5/23218H04N5/232945H04N5/272G06T2200/24
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,651,527
App. No.
17/469,931
Granted
May 16, 2023
Kind
B2
Abstract

Disclosed are various examples for augmented reality based image protection in enterprise settings. In one example, a managed camera application can generate an artificial reality based camera user interface using image data from a field of view of a camera. An indoor position can be identified using global positioning system (GPS) and indoor positioning data. A sector of the field of view can be identified as a protected image area that depicts a protected or confidential object, and the user interface can be updated to include an AR user interface element that is generated relative to the protected image area that is identified.

Claims (46)

1. A system for performing actions using augmented reality, the system comprising:

a client device; and

a data store comprising instructions executable by the client device, wherein the instructions, when executed, cause the client device to at least:

generate, by a managed camera application executed by the client device, an augmented reality (AR) camera user interface based at least in part on image data comprising a field of view of a camera of the client device;

detect, by the managed camera application, an indoor position using at least one of a global positioning system (GPS) device, a visual positioning system (VPS) device, a Bluetooth device, a WiFi device, a visible light communication (VLC) device, and a LiFi device, the indoor position comprising a location and an orientation of the client device;

identify, by the managed camera application, a protected image area in the field of view of the camera, wherein the protected image area depicts a protected object defined within image protection rules for an enterprise; and

update, by the managed camera application, the AR camera user interface to include at least one AR user interface element comprising a repositioning indicator that is generated to indicate a direction to move the camera based on at least one of: identification that the direction minimizes a change of angle that eliminates the protected image area from the field of view of the camera, and identification that the direction maximizes a reduction of an amount of the protected image area in the field of view.

2. The system of claim 1 , wherein the instructions, when executed, further cause the client device to at least:

capture, by the managed camera application, an image that omits or obscures the protected image area, wherein the managed camera application enforces protected image areas to be omitted or obscured within unencrypted image data of the image.

3. The system of claim 1 , wherein the instructions, when executed, further cause the client device to at least:

transmit, by the managed camera application, the image data and the indoor position to a management service; and

receive, by the managed camera application, data comprising an identification of the protected image area in the field of view of the camera.

4. The system of claim 1 , wherein the instructions, when executed, further cause the client device to at least:

analyze, by the managed camera application, at least one of the image data and the indoor position to identify the protected image area in the field of view of the camera.

5. The system of claim 1 , wherein the at least one AR user interface element indicates or obscures the protected image area in the field of view of the camera.

6. The system of claim 1 , wherein the at least one AR user interface element comprises an indication of a protection level required to view and capture the protected image area.

7. The system of claim 1 , wherein the AR camera user interface disables image capture based on the protected image area being identified in the field of view of the camera.

8. A non-transitory computer-readable medium embodying instructions executable by a client device, wherein the instructions, when executed, cause the client device to:

generate, by a managed camera application executed by the client device, an augmented reality (AR) camera user interface based at least in part on image data comprising a field of view of a camera of the client device;

detect, by the managed camera application, an indoor position using at least one of a global positioning system (GPS) device, a visual positioning system (VPS) device, a Bluetooth device, a WiFi device, a visible light communication (VLC) device, and a LiFi device, the indoor position comprising a location and an orientation of the client device;

identify, by the managed camera application, a protected image area in the field of view of the camera, wherein the protected image area depicts a protected object defined within image protection rules for an enterprise; and

update, by the managed camera application, the AR camera user interface to include at least one AR user interface element comprising a repositioning indicator that is generated to indicate a direction to move the camera based on at least one of: identification that the direction minimizes a change of angle that eliminates the protected image area from the field of view of the camera, and identification that the direction maximizes a reduction of an amount of the protected image area in the field of view.

9. The non-transitory computer-readable medium of claim 8 , wherein the instructions, when executed, further cause the client device to at least:

capture, by the managed camera application, an image that omits the protected image area, wherein the managed camera application enforces protected image areas to be omitted within unencrypted image data of the image.

10. The non-transitory computer-readable medium of claim 8 , wherein the instructions, when executed, further cause the client device to at least:

transmit, by the managed camera application, the image data and the indoor position to a management service; and

receive, by the managed camera application, data comprising an identification of the protected image area in the field of view of the camera.

11. The non-transitory computer-readable medium of claim 8 , wherein the instructions, when executed, further cause the client device to at least:

analyze, by the managed camera application, at least one of the image data and the indoor position to identify the protected image area in the field of view of the camera.

12. The non-transitory computer-readable medium of claim 8 , wherein the at least one AR user interface element indicates or obscures the protected image area in the field of view of the camera.

13. The non-transitory computer-readable medium of claim 8 , wherein the at least one AR user interface element comprises an indication of a protection level associated with the protected image area.

14. The non-transitory computer-readable medium of claim 8 , wherein the AR camera user interface disables image capture based on the protected image area being identified in the field of view of the camera.

15. A computer-implemented method comprising:

generating, by a managed camera application executed by a client device, an augmented reality (AR) camera user interface based at least in part on image data comprising a field of view of a camera of the client device;

detecting, by the managed camera application, an indoor position using at least one of a global positioning system (GPS) device, a visual positioning system (VPS) device, a Bluetooth device, a WiFi device, a visible light communication (VLC) device, and a LiFi device, the indoor position comprising a location and an orientation of the client device;

identifying, by the managed camera application, a protected image area in the field of view of the camera, wherein the protected image area depicts a protected object defined within image protection rules for an enterprise; and

updating, by the managed camera application, the AR camera user interface to include at least one AR user interface element comprising a repositioning indicator that is generated to indicate a direction to move the camera based on at least one of: identification that the direction minimizes a change of angle that eliminates the protected image area from the field of view of the camera, and identification that the direction maximizes a reduction of an amount of the protected image area in the field of view.

16. The computer-implemented method of claim 15 , further comprising:

capturing, by the managed camera application, a protected image that obscures the protected image area, wherein the managed camera application enforces protected image areas to be obscured within unencrypted image data of the protected image.

17. The computer-implemented method of claim 15 , further comprising:

transmitting, by the managed camera application, the image data and the indoor position to a management service; and

receiving, by the managed camera application, data comprising an identification of the protected image area in the field of view of the camera.

18. The computer-implemented method of claim 15 , further comprising:

analyzing, by the managed camera application, at least one of the image data the indoor position to identify the protected image area in the field of view of the camera.

19. The computer-implemented method of claim 15 , wherein the at least one AR user interface element indicates or obscures the protected image area in the field of view of the camera.

20. The computer-implemented method of claim 15 , wherein the at least one AR user interface element comprises an indication of a protection level associated with the protected image area.

Assignments (4)
PATENT ASSIGNMENT Recorded Aug 5, 2024
From: VMWARE LLC
To: OMNISSA, LLC
Reel/Frame 068327/0365 →
SECURITY INTEREST Recorded Jul 3, 2024
From: OMNISSA, LLC
To: UBS AG, STAMFORD BRANCH
Reel/Frame 068118/0004 →
CHANGE OF NAME Recorded Apr 15, 2024
From: VMWARE, INC.
To: VMWARE LLC
Reel/Frame 067102/0395 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 9, 2021
From: SHETTY, ROHIT PRADEEP
To: VMWARE, INC.
Reel/Frame 057419/0668 →