Key update using relationship between keys for extended reality privacy
Systems and methods are provided herein for providing privacy while allowing interactions with virtual representations of sensitive objects. This may be accomplished by an extended reality (XR) system receiving information associated with a real-world environment of a user. The XR system may transmit the received information to one or more devices (e.g., server, XR device, etc.) for processing. Before transmitting the received information, the XR system can use the received information to identify and categorize objects in the real-world environment to identify sensitive objects. To protect the privacy of the sensitive objects, the XR system transforms features of the sensitive objects using one or more transform keys prior to transmitting the information to the one or more devices. The XR system may also update the transform keys after a first time period to further protect the privacy of the sensitive objects.
1 . A method comprising:
generating a first transform key corresponding to a first feature transform algorithm using a master key;
transmitting the first transform key to a first device, wherein the first transform key is associated with a first object type;
receiving, by the first device, a plurality of features;
identifying, by the first device, that a first feature set of the plurality of features corresponds to a first object type;
transforming, by the first device, the first feature set into a first transformed feature set using the first transform key;
transmitting, by the first device, the first transformed feature set to a second device;
receiving an input indicating a transform key update;
generating a second transform key corresponding to a second feature transform algorithm using the master key, wherein the second transform key is associated with the first object type;
transmitting a first request to the second device, wherein the first request indicates the first object type;
transmitting, by the second device, the first transformed feature set in response to receiving the first request;
determining a relationship, wherein the relationship corresponds to a difference between the first transform key and the second transform key;
generating a first updated portion of the first transformed feature set using a first portion of the first transformed feature set and the second transform key;
transmitting a message including the relationship and the first updated portion of the first transformed feature set to the second device;
generating, by the second device, a second updated portion of the first transformed feature set using a second portion of the first transformed feature set and the relationship; and
replacing, by the second device, the first portion of the first transformed feature set with the first updated portion of the first transformed feature set.
2 . The method of claim 1 , wherein the first portion of the first transformed feature set corresponds to sensitive features.
3 . The method of claim 1 , wherein:
the first portion of the first transformed feature set relates to a first feature type; and
the second portion of the first transformed feature set relates to a second feature type.
4 . The method of claim 3 , wherein the first updated portion of the first transformed feature set is a transform vector generated using the first portion of the first transformed feature set and the second transform key.
5 . The method of claim 3 , wherein;
the first feature set of the plurality of features is associated with a virtual object;
the virtual object corresponds to the first object type;
the first feature type corresponds to permutation features of the virtual object; and
the second feature type corresponds to location features of the virtual object.
6 . The method of claim 1 , further comprising:
accessing, by the second device, a first entry in a database, wherein the first entry in the database comprises the first portion of the first transformed feature set and the second portion of the first transformed feature set;
replacing, by the second device, the first portion of the first transformed feature set with the first updated portion of the first transformed feature set; and
replacing, by the second device, the second portion of the first transformed feature set with the second updated portion of the first transformed feature set.
7 . The method of claim 6 , further comprising transmitting the second transform key to the first device.
8 . The method of claim 7 , further comprising:
receiving, by the first device, an additional plurality of features;
identifying, by the first device, that a second feature set of the additional plurality of features corresponds to the first object type;
transforming, by the first device, the second feature set into a second transformed feature set using the second transform key; and
transmitting, by the first device, the second transformed feature set to the second device.
9 . The method of claim 8 , further comprising:
receiving, by the second device, the second transformed feature set from the first device; and
determining that the second transformed feature set corresponds to the first entry in the database based, at least in part, on the first updated portion of the first transformed feature set or the second updated portion of the first transformed feature set.
10 . The method of claim 9 , wherein determining that the second transformed feature set corresponds to the first entry in the database comprises at least one of:
identifying that a first portion of the second transformed feature set matches the first updated portion of the first transformed feature set; and
identifying that a second portion of the second transformed feature set matches the second updated portion of the first transformed feature set.
11 . An apparatus comprising:
control circuitry; and
at least one memory including computer program code for one or more programs, the at least one memory and the computer program code configured to, with the control circuitry, cause the apparatus to perform at least the following:
generate a first transform key corresponding to a first feature transform algorithm using a master key;
transmit the first transform key to a first device, wherein;
the first transform key is associated with a first object type;
the first device transforms a first feature set corresponding to the first object type into a first transformed feature set using the first transform key; and
the first device transmits the first transformed feature set to a second device;
receive an input indicating a transform key update;
generate a second transform key corresponding to a second feature transform algorithm using the master key, wherein the second transform key is associated with the first object type;
transmit a first request to the second device, wherein the first request indicates the first object type;
receive the first transformed feature set, wherein the second device transmits the first transformed feature set in response to receiving the first request;
determine a relationship, wherein the relationship corresponds to a difference between the first transform key and the second transform key;
generate a first updated portion of the first transformed feature set using a first portion of the first transformed feature set and the second transform key;
transmit a message including the relationship and the first updated portion of the first transformed feature set to the second device, wherein:
the message causes the second device to generate a second updated portion of the first transformed feature set using a second portion of the first transformed feature set and the relationship; and
the message causes the second device to replace the first portion of the first transformed feature set with the first updated portion of the first transformed feature set.
12 . The apparatus of claim 11 , wherein the first portion of the first transformed feature set corresponds to sensitive features.
13 . The apparatus of claim 11 , wherein:
the first portion of the first transformed feature set relates to a first feature type; and
the second portion of the first transformed feature set relates to a second feature type.
14 . The apparatus of claim 13 , wherein the first updated portion of the first transformed feature set is a transform vector generated using the first portion of the first transformed feature set and the second transform key.
15 . The apparatus of claim 13 , wherein;
the first feature set is associated with a virtual object;
the virtual object corresponds to the first object type;
the first feature type corresponds to permutation features of the virtual object; and
the second feature type corresponds to location features of the virtual object.
16 . A non-transitory computer-readable medium having instructions encoded thereon that, when executed by control circuitry, cause the control circuitry to:
generate a first transform key corresponding to a first feature transform algorithm using a master key;
transmit the first transform key to a first device, wherein:
the first transform key is associated with a first object type;
the first device transforms a first feature set corresponding to the first object type into a first transformed feature set using the first transform key; and
the first device transmits the first transformed feature set to a second device;
receive an input indicating a transform key update;
generate a second transform key corresponding to a second feature transform algorithm using the master key, wherein the second transform key is associated with the first object type;
transmit a first request to the second device, wherein the first request indicates the first object type;
receive the first transformed feature set, wherein the second device transmits the first transformed feature set in response to receiving the first request;
determine a relationship, wherein the relationship corresponds to a difference between the first transform key and the second transform key;
generate a first updated portion of the first transformed feature set using a first portion of the first transformed feature set and the second transform key;
transmit a message including the relationship and the first updated portion of the first transformed feature set to the second device, wherein:
the message causes the second device to generate a second updated portion of the first transformed feature set using a second portion of the first transformed feature set and the relationship; and
the message causes the second device to replace the first portion of the first transformed feature set with the first updated portion of the first transformed feature set.
17 . The non-transitory computer-readable medium of claim 16 , wherein the first portion of the first transformed feature set corresponds to sensitive features.
18 . The non-transitory computer-readable medium of claim 16 , wherein:
the first portion of the first transformed feature set relates to a first feature type; and
the second portion of the first transformed feature set relates to a second feature type.
19 . The non-transitory computer-readable medium of claim 18 , wherein the first updated portion of the first transformed feature set is a transform vector generated using the first portion of the first transformed feature set and the second transform key.
20 . The non-transitory computer-readable medium of claim 18 , wherein:
the first feature set is associated with a virtual object;
the virtual object corresponds to the first object type;
the first feature type corresponds to permutation features of the virtual object; and
the second feature type corresponds to location features of the virtual object.