SYSTEMS AND METHODS FOR GENERATING SUPPLEMENTAL CONTENT IN AN EXTENDED REALITY ENVIRONMENT

1 . A method for presenting supplemental content in an extended reality environment, the method comprising:

receiving, by a device, a plurality of fields of view of the extended reality environment, wherein each field of view of the plurality of fields of view was captured at a different time position;

generating a data stream representing the plurality of fields of view, the data stream comprising a respective data structure for each of the fields of view, wherein each respective data structure comprises:

at least one object identifier corresponding to a visual item appearing in a respective field of view of the plurality of fields of view, and

field coordinates representing the position of the respective field of view in the extended reality environment;

calculating a number of data structures in the data stream in which a same object identifier, called a candidate object identifier, appears;

calculating a measure of variance of field coordinates for the data structures in which the candidate object identifier appears;

computing an importance score for the candidate object identifier, based on (a) the calculated number of data structures in the data stream in which the candidate object identifier appears, and (b) the calculated measure of variance of coordinates for the data structures in which the candidate object identifier appears,

wherein the importance score measure is positively correlated with the measure of variance of field coordinates; and

in response to the importance score exceeding an importance threshold, generating instructions for displaying in the extended reality environment supplemental content, related to the visual item corresponding to the candidate object identifier.

2 . The method of claim 1 , wherein generating the data stream comprises:

identifying a visual item in the respective field of view; and

attributing an object identifier to the identified visual item, wherein a same visual item appearing in different respective fields of view is attributed the same object identifier.

3 . The method of claim 1 , wherein the importance score is based on the number of data structures in the data stream in which the candidate object identifier appears being higher than an occurrence threshold.

4 . (canceled)

5 . The method of claim 1 , wherein:

each respective data structure of the data stream further comprises object coordinates representing the position of the visual item in the field of view, the visual item corresponding to the object identifier; and

the method further comprises:

calculating a measure of variance of object coordinates for the data structures in which the candidate object identifier appears,

wherein the importance score is further based on the calculated measure of variance of object coordinates.

6 . The method of claim 5 , wherein:

the importance score based on a measure of variance of field coordinates and a measure of variance of object coordinates is lower than the importance score based on a higher measure of variance of field coordinates and a lower measure of variance of object coordinates.

7 . The method of claim 1 , wherein the data stream further comprises, for each data structure:

an object feature, representing a feature of the visual item,

wherein the importance score is further based on the object feature.

8 . The method of claim 1 , wherein:

the candidate object identifier is a first candidate object identifier and the first candidate object identifier appears in a first plurality of data structures; and

an importance score has been computed for a second candidate object identifier appearing in a second plurality of data structures, wherein the importance score of the second candidate object identifier exceeds the importance threshold;

the method further comprising:

calculating a number of shared data structures between the first and the second pluralities;

in response to determining that the number is higher than a similarity threshold, selecting the candidate object identifier that has the higher importance score of the two; and

generating instructions for displaying in the extended reality environment supplemental content, related to the visual item corresponding to the selected candidate object identifier.

9 . The method of claim 1 , further comprising:

notifying a plurality of potential content providers for the supplemental content;

launching a bidding war amongst the plurality of content providers;

determining a winner to the bidding war, wherein the supplemental content is provided by the winner of the bidding war.

10 . The method of claim 1 , wherein the data stream further comprises, for each data structure:

object metadata associated with the object; and

wherein retrieving content related to the object comprises retrieving content that is associated with the object metadata.

11 . A system for presenting supplemental content in an extended reality environment, the system comprising:

control circuitry configured to: receive, by a device, a plurality of fields of view of the extended reality environment, wherein each field of view of the plurality of fields of view was captured at a different time position;

generate a data stream representing the plurality of fields of view, the data stream comprising a respective data structure for each of the fields of view, wherein each respective data structure comprises:

at least one object identifier corresponding to a visual item appearing in a respective field of view of the plurality of fields of view, and

field coordinates representing the position of the respective field of view in the extended reality environment;

calculate a number of data structures in the data stream in which a same object identifier, called a candidate object identifier, appears;

calculate a measure of variance of field coordinates for the data structures in which the candidate object identifier appears;

compute an importance score for the candidate object identifier, based on (a) the calculated number of data structures in the data stream in which the candidate object identifier appears, and (b) the calculated measure of variance of coordinates for the data structures in which the candidate object identifier appears,

wherein the importance score measure is positively correlated with the measure of variance of field coordinates; and

in response to the importance score exceeding an importance threshold, generate instructions for displaying in the extended reality environment supplemental content, related to the visual item corresponding to the candidate object identifier.

12 . The system of claim 11 , wherein control circuitry configured to generate the data stream comprises control circuitry configured to:

identify a visual item in the respective field of view; and

attribute an object identifier to the identified visual item, wherein a same visual item appearing in different respective fields of view is attributed the same object identifier.

13 . The system of claim 11 , wherein the importance score is based on the number of data structures in the data stream in which the candidate object identifier appears being higher than an occurrence threshold.

14 . (canceled)

15 . The system of claim 11 , wherein:

each respective data structure of the data stream further comprises object coordinates representing the position of the visual item in the field of view, the visual item corresponding to the object identifier; and,

the control circuitry being further configured to:

calculate a measure of variance of object coordinates for the data structures in which the candidate object identifier appears,

wherein the importance score is further based on the calculated measure of variance of object coordinates.

16 . The system of claim 15 , wherein the importance score based on a measure of variance of field coordinates and a measure of variance of object coordinates is lower than the importance score based on a higher measure of variance of field coordinates and a lower measure of variance of object coordinates.

17 . The system of claim 11 , wherein the data stream further comprises, for each data structure:

an object feature, representing a feature of the visual item,

wherein the importance score is further based on the object feature.

18 . The system of claim 11 , wherein:

the candidate object identifier is a first candidate object identifier and the first candidate object identifier appears in a first plurality of data structures; and

an importance score has been computed for a second candidate object identifier appearing in a second plurality of data structures, wherein the importance score of the second candidate object identifier exceeds the importance threshold;

the control circuitry being further configured to:

calculate a number of shared data structures between the first and the second pluralities;

in response to determining that the number is higher than a similarity threshold, select the candidate object identifier that has the higher importance score of the two; and

generate instructions for displaying in the extended reality environment supplemental content, related to the visual item corresponding to the selected candidate object identifier.

19 . The system of claim 11 , wherein the control circuitry is further configured to:

notify a plurality of potential content providers for the supplemental content;

launch a bidding war amongst the plurality of content providers;

determine a winner to the bidding war, wherein the supplemental content is provided by the winner of the bidding war.

20 . The system of claim 11 , wherein the data stream further comprises, for each data structure:

object metadata associated with the object; and

wherein retrieving content related to the object comprises retrieving content that is associated with the object metadata.

21 - 50 . (canceled)