IP Library Granted Patent US 12,189,812
Granted Patent B2
US 12,189,812 · App. 17/987,013 · Granted Jan 7, 2025

Privacy controls for extended reality (XR) applications

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,189,812
App. No.
17/987,013
Granted
Jan 7, 2025
Kind
B2
Abstract

Systems and methods are described for preserving the privacy of a user in connection with an extended reality (XR) application. The system and methods may receive, by an interposer application, image data from a video capture driver and determine, by the interposer application and based on privacy preferences of a user profile, whether a region of the image data comprises sensitive content. In response to determining that a region of the image data comprises sensitive content, the image data may be modified by applying, by the interposer application, a modification to the region of the image data. The modified image data may be provided by the interposer application to the XR application, wherein the wherein the XR application may be prohibited from directly accessing data from the video capture driver.

Claims (84)

1. A computer-implemented method, comprising:

receiving, by an interposer application, image data from a video capture driver;

determining, by the interposer application and based on privacy preferences of a user profile, whether a region of the image data comprises sensitive content;

in response to determining that the region of the image data comprises sensitive content, modifying the image data by applying, by the interposer application, a modification to the region of the image data; and

providing, by the interposer application and to an extended reality (XR) application, the modified image data, wherein the XR application is prohibited from directly accessing data from the video capture driver.

2. The method of claim 1 , wherein the XR application is a first XR application, and the method further comprises:

determining, based on the privacy preferences of the user profile, that the first XR application is prohibited from directly accessing data from the video capture driver; and

determining, based on the privacy preferences of the user profile, that a second XR application is permitted to directly access data from the video capture driver.

3. The method of claim 1 , wherein:

the XR application is a first XR application;

the interposer application is configured to manage access to image data from the video capture driver for a plurality of XR applications including the first XR application based on the privacy preferences of the user profile; and

the privacy preferences indicate first criteria for determining whether the region of image data comprises sensitive content for the first XR application and indicate second criteria for determining whether the region of image data comprises sensitive content for a second XR application of the plurality of XR applications, the first criteria being different from the second criteria.

4. The method of claim 1 , wherein:

the privacy preferences indicate that, with respect to the XR application, a particular user being at a particular location within a particular environment comprises sensitive content;

determining that the region of the image data comprises sensitive content comprises determining that the region of the image data corresponds to the particular user at the particular location within the particular environment; and

performing the modifying of the image data based on the privacy preferences and based on determining that the image data is to be transmitted to the XR application.

5. The method of claim 1 , wherein:

the privacy preferences indicate that, with respect to the XR application, a particular object comprises sensitive content;

determining that the region of the image data comprises sensitive content comprises determining that the region of the image data corresponds to the particular object; and

performing the modifying of the image data based on the privacy preferences and based on determining that the image data is to be transmitted to the XR application.

6. The method of claim 1 , wherein:

the privacy preferences indicate that, with respect to the XR application, image data that is captured at a particular time and/or a particular location comprises sensitive content;

determining that the region of the image data comprises sensitive content comprises determining that the image data was captured at the particular time and/or the particular location; and

performing the modifying of the image data based on the privacy preferences and based on determining that the image data is to be transmitted to the XR application.

7. The method of claim 1 , wherein modifying the image data comprises removing the region from the image data or obscuring the region or substituting other content for the region.

8. The method of claim 1 , further comprising:

receiving, by the interposer application, audio data;

determining, by the interposer application and based on the privacy preferences of the user profile, whether a portion of the audio data comprises sensitive content with respect to the XR application;

in response to determining that a portion of the audio data comprises sensitive content with respect to the XR application, modifying the audio data by applying, by the interposer application, a modification to the portion of the audio data; and

providing, by the interposer application and to the XR application, the modified audio data.

9. The method of claim 1 , further comprising:

generating for display, by the interposer application, a graphical user interface providing a plurality of options for specifying privacy preferences for a plurality of XR applications including the XR application;

receiving input associated with whether a region of image data should be considered sensitive content for the XR application; and

determining the privacy preferences of the user profile for the XR application based on the received input.

10. The method of claim 1 , further comprising:

detecting an object in the image data not associated with the privacy preferences;

prompting a user with a request to specify whether the detected object should be associated with the privacy preferences; and

updating the privacy preferences based on a response to the prompting.

11. The method of claim 1 , further comprising:

determining whether user gaze is directed to a particular region of a particular environment corresponding to the image data being captured by a user device associated with the user profile; and

determining to modify the particular region based on the privacy preferences.

12. A computer-implemented system, comprising:

memory;

control circuitry configured to:

receive, by an interposer application, image data from a video capture driver;

determine, by the interposer application and based on privacy preferences of a user profile, whether a region of the image data comprises sensitive content, wherein the user profile is stored in the memory;

in response to determining that the region of the image data comprises sensitive content, modify the image data by applying, by the interposer application, a modification to the region of the image data; and

provide, by the interposer application and to an extended reality (XR) application, the modified image data, wherein the XR application is prohibited from directly accessing data from the video capture driver.

13. The system of claim 12 , wherein the XR application is a first XR application, and the control circuitry is further configured to:

determine, based on the privacy preferences of the user profile, that the first XR application is prohibited from directly accessing data from the video capture driver; and

determine, based on the privacy preferences of the user profile, that a second XR application is permitted to directly access data from the video capture driver.

14. The system of claim 12 , wherein:

the XR application is a first XR application;

the interposer application is configured to manage access to image data from the video capture driver for a plurality of XR applications including the first XR application based on the privacy preferences of the user profile; and

the privacy preferences indicate first criteria for determining whether a region of image data comprises sensitive content for the first XR application and indicate second criteria for determining whether the region of image data comprises sensitive content for a second XR application of the plurality of XR applications, the first criteria being different from the second criteria.

15. The system of claim 12 , wherein:

the privacy preferences indicate that, with respect to the XR application, a particular user being at a particular location within a particular environment comprises sensitive content;

the control circuitry is further configured to determine that the region of the image data comprises sensitive content by determining that the region of the image data corresponds to the particular user at the particular location within the particular environment; and

the control circuitry is further configured to modify the image data based on the privacy preferences and based on determining that the image data is to be transmitted to the XR application.

16. The system of claim 12 , wherein:

the privacy preferences indicate that, with respect to the XR application, a particular object comprises sensitive content;

the control circuitry is further configured to determine that the region of the image data comprises sensitive content by determining that the region of the image data corresponds to the particular object; and

the control circuitry is further configured to modify the image data based on the privacy preferences and based on determining that the image data is to be transmitted to the XR application.

17. The system of claim 12 , wherein:

the privacy preferences indicate that, with respect to the XR application, image data that is captured at a particular time and/or a particular location comprises sensitive content;

the control circuitry is further configured to determine that the region of the image data comprises sensitive content by determining that the image data was captured at the particular time and/or the particular location; and

the control circuitry is further configured to modify the image data based on the privacy preferences and based on determining that the image data is to be transmitted to the XR application.

18. The system of claim 12 , wherein the control circuitry is further configured to modify the image data by obscuring the region or substituting other content for the region.

19. The system of claim 12 , wherein the control circuitry is further configured to:

receive, by the interposer application, audio data;

determine, by the interposer application and based on the privacy preferences of the user profile, whether a portion of the audio data comprises sensitive content with respect to the XR application;

in response to determining that a portion of the audio data comprises sensitive content with respect to the XR application, modify the audio data by applying, by the interposer application, a modification to the portion of the audio data; and

provide, by the interposer application and to the XR application, the modified audio data.

20. The system of claim 12 , wherein the control circuitry is further configured to:

generate for display, by the interposer application, a graphical user interface providing a plurality of options for specifying privacy preferences for a plurality of XR applications including the XR application;

receive input associated with whether a region of image data should be considered sensitive content for the XR application; and

determine the privacy preferences of the user profile for the XR application based on the received input.

21. The system of claim 12 , wherein the control circuitry is further configured to:

detect an object in the image data not associated with the privacy preferences;

prompt a user with a request to specify whether the detected object should be associated with the privacy preferences; and

update the privacy preferences based on a response to the prompting.

22. The system of claim 12 , wherein the control circuitry is further configured to:

determine whether user gaze is directed to a particular region of a particular environment corresponding to the image data being captured by a user device associated with the user profile; and

determine to modify the particular region based on the privacy preferences.

Assignments (3)
CHANGE OF NAME Recorded Oct 4, 2024
From: ROVI GUIDES, INC.
To: ADEIA GUIDES INC.
Reel/Frame 069113/0413 →
SECURITY INTEREST Recorded May 3, 2023
From: ADEIA GUIDES INC.; ADEIA IMAGING LLC; ADEIA MEDIA HOLDINGS LLC; ADEIA MEDIA SOLUTIONS INC.; ADEIA SEMICONDUCTOR ADVANCED TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR BONDING TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR INC.; ADEIA SEMICONDUCTOR SOLUTIONS LLC; ADEIA SEMICONDUCTOR TECHNOLOGIES LLC; ADEIA SOLUTIONS LLC
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 063529/0272 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 27, 2023
From: EDWARDS, WARREN KEITH
To: ROVI GUIDES, INC.
Reel/Frame 062516/0380 →