Generating and determining additional content and products based on product-tokens
In some embodiments, a computer-implemented method comprises: using a client application executing on a user device, generating a user interface configured to display one or more search keywords that are associated with a product that a user is viewing on a screen of the user device; displaying the user interface on the user device to depict graphical representations of the one or more search keywords; determining, by the client application, whether a particular search keyword was selected from the one or more search keywords displayed on the user device; in response: determining whether an object GTIF product-token, associated with the particular search keyword, matches a particular pair of a set of GTIF product-token pairs; in response to determining that the object GTIF product-token matches the particular pair, determining particular additional content based on the particular pair, and displaying the particular additional content on the user device.
1 . A method comprising:
using a client application executing on a user device, generating a user interface configured to display one or more search keywords that are associated with a product that a user is viewing on a screen of the user device;
wherein the one or more search keywords have been associated with one or more corresponding graph of transform invariant features product-tokens (GTIF product-tokens);
displaying the user interface on the user device to depict graphical representations of the one or more search keywords;
determining, by the client application, whether a particular search keyword was selected from the one or more search keywords displayed on the user device;
in response to determining that the particular search keyword was selected from the one or more search keywords displayed on the user device: determining whether an object GTIF product-token, associated with the particular search keyword, matches a particular pair of a set of GTIF product-token pairs;
wherein the set of GTIF product-token pairs comprises one or more of:
a pair comprising a known GTIF product-token and a location data determined for a location of a user device,
a pair comprising known GTIF product-token associated with a user of the user device and one or more social relationships defined for the user,
a pair comprising known time based data associated with one or more events defined for the user and the one or more events,
a pair comprising a known GTIF product-token and a representation of a physical object detected by a camera or sensors and communicated to the user device, or
a pair comprising a known GTIF product-token and a representation of a digital object provided by the user device;
wherein generating the object GTIF product-token comprises: generating an extracted SIFT features by extracting a plurality of local features from an image of the product using a scale-invariant feature transform (SIFT) feature recognition method; generating a SIFT-hash by hashing the extracted SIFT features; and forming the GTIF product-token as a data structure comprising the SIFT-hash;
wherein determining whether the object GTIF product-token matches a particular pair comprises: performing a SIFT-hash comparison by comparing the SIFT-hash of the object GTIF product-token to an index of SIFT-hashes corresponding to known GTIF product-tokens, and identifying a match based on the SIFT-hash comparison;
in response to determining that the object GTIF product-token matches the particular pair, determining particular additional content based on the particular pair, and displaying the particular additional content on the user device.
2 . The method of claim 1 , wherein a GTIF product-token, of the one or more corresponding GTIF product-tokens, is a complex data structure that is generated using advanced computer-based techniques that include one or more: encoding spatial representations of certain features identified in the product or determining a set of invariant features that are specific to the product;
wherein the set of invariant features includes features that remain invariant of any 2D transformation performed on the features of the product.
3 . The method of claim 1 , wherein the one or more search keywords include one or more terms such as: product, venue name, guests name, directions, maps, hotels, events, individuals' names, things, or vegetation.
4 . The method of claim 1 , wherein a GTIF product-token for a product, of a pair of the set of GTIF product-token pairs, represents one or more of:
one or more of relationships between a plurality of transform-invariant features identified for the product, or
one or more relationships between the plurality of transform-invariant features identified for the product and other transform-invariant features identified for other products.
5 . The method of claim 1 , wherein the particular additional content is displayed as an overlay over a graphical representation of the product;
wherein the particular additional content is displayed by launching and causing executing a software application on the user device to generate a webpage that displays a graphical representation of the additional content.
6 . The method of claim 1 , wherein the product has a plurality transform invariant features and a corresponding plurality of GTIF product-tokens;
wherein a GTIF product-token is used to determine whether the GTIF product-token matches a particular pair of the set of GTIF product-token pairs;
wherein a GTIF product-token pair comprises additional context data that include one or more of:
location data determined based on GPS location data obtained from one or more of: the location of the user device, a photo, an address of an event, or an address of customers or users;
social relationship data of a creator or a recipient of the product; or
time based data determined based on one or more of: a time of an event, a time when a photo was taken, or a time when a message was sent.
7 . The method of claim 1 , wherein the determining of the particular additional content based on the particular pair is a search that requires comparisons between non-directed graphs having a plurality of nodes, wherein the nodes represent transform invariant features, wherein a time for comparison performed as a series of instructions on computing machinery increases based on a number of comparisons, and wherein a number of transform invariant features exceeds practical limits of user interaction time;
wherein a GTIF product-token is generated using one or more of:
a scale-invariant feature transform feature recognition method (SIFT),
a simultaneous localization and mapping feature recognition method (SLAM), or
a speed up robust features feature recognition method (SURF).
8 . One or more non-transitory computer readable storage media storing one or more instructions which, when executed by one or more processors, cause the one or more processors to perform:
using a client application executing on a user device, generating a user interface configured to display one or more search keywords that are associated with a product that a user is viewing on a screen of the user device;
wherein the one or more search keywords have been associated with one or more corresponding graph of transform invariant features product-tokens (GTIF product-tokens);
displaying the user interface on the user device to depict graphical representations of the one or more search keywords;
determining, by the client application, whether a particular search keyword was selected from the one or more search keywords displayed on the user device;
in response to determining that the particular search keyword was selected from the one or more search keywords displayed on the user device: determining whether an object GTIF product-token, associated with the particular search keyword, matches a particular pair of a set of GTIF product-token pairs;
wherein the set of GTIF product-token pairs comprises one or more of:
a pair comprising a known GTIF product-token and a location data determined for a location of a user device,
a pair comprising known GTIF product-token associated with a user of the user device and one or more social relationships defined for the user,
a pair comprising known time based data associated with one or more events defined for the user and the one or more events,
a pair comprising a known GTIF product-token and a representation of a physical object detected by a camera or sensors and communicated to the user device, or
a pair comprising a known GTIF product-token and a representation of a digital object provided by the user device;
wherein generating the object GTIF product-token comprises: generating an extracted SIFT features by extracting a plurality of local features from an image of the product using a scale-invariant feature transform (SIFT) feature recognition method; generating a SIFT-hash by hashing the extracted SIFT features; and forming the GTIF product-token as a data structure comprising the SIFT-hash;
wherein determining whether the object GTIF product-token matches a particular pair comprises: performing a SIFT-hash comparison by comparing the SIFT-hash of the object GTIF product-token to an index of SIFT-hashes corresponding to known GTIF product-tokens, and identifying a match based on the SIFT-hash comparison;
in response to determining that the object GTIF product-token matches the particular pair, determining particular additional content based on the particular pair, and displaying the particular additional content on the user device.
9 . The one or more non-transitory computer readable storage media of claim 8 , wherein a GTIF product-token, of the one or more corresponding GTIF product-tokens, is a complex data structure that is generated using advanced computer-based techniques that include one or more: encoding spatial representations of certain features identified in the product or determining a set of invariant features that are specific to the product;
wherein the set of invariant features includes features that remain invariant of any 2D transformation performed on the features of the product.
10 . The one or more non-transitory computer readable storage media of claim 8 , wherein the one or more search keywords include one or more terms such as: product, venue name, guests name, directions, maps, hotels, events, individuals' names, things, or vegetation.
11 . The one or more non-transitory computer readable storage media of claim 8 , wherein a GTIF product-token for a product, of a pair of the set of GTIF product-token pairs, represents one or more of:
one or more of relationships between a plurality of transform-invariant features identified for the product, or
one or more relationships between the plurality of transform-invariant features identified for the product and other transform-invariant features identified for other products.
12 . The one or more non-transitory computer readable storage media of claim 8 , wherein the particular additional content is displayed as an overlay over a graphical representation of the product;
wherein the particular additional content is displayed by launching and causing executing a software application on the user device to generate a webpage that displays a graphical representation of the additional content.
13 . The one or more non-transitory computer readable storage media of claim 8 , wherein the product has a plurality transform invariant features and a corresponding plurality of GTIF product-tokens;
wherein a GTIF product-token is used to determine whether the GTIF product-token matches a particular pair of the set of GTIF product-token pairs;
wherein a GTIF product-token pair comprises additional context data that include one or more of:
location data determined based on GPS location data obtained from one or more of: the location of the user device, a photo, an address of an event, or an address of customers or users;
social relationship data of a creator or a recipient of the product; or
time based data determined based on one or more of: a time of an event, a time when a photo was taken, or a time when a message was sent.
14 . The one or more non-transitory computer readable storage media of claim 8 , wherein the determining of the particular additional content based on the particular pair is a search that requires comparisons between non-directed graphs having a plurality of nodes, wherein the nodes represent transform invariant features, wherein a time for comparison performed as a series of instructions on computing machinery increases based on a number of comparisons, and wherein a number of transform invariant features exceeds practical limits of user interaction time;
wherein a GTIF product-token is generated using one or more of:
a scale-invariant feature transform feature recognition method (SIFT),
a simultaneous localization and mapping feature recognition method (SLAM), or
a speed up robust features feature recognition method (SURF).
15 . A custom product computer system generator comprising:
a memory unit;
one or more processors; and
a custom product computer storing one or more instructions, which, when executed by one or more processors, cause the one or more processors to perform:
using a client application executing on a user device, generating a user interface configured to display one or more search keywords that are associated with a product that a user is viewing on a screen of the user device;
wherein the one or more search keywords have been associated with one or more corresponding graph of transform invariant features product-tokens (GTIF product-tokens);
displaying the user interface on the user device to depict graphical representations of the one or more search keywords;
determining, by the client application, whether a particular search keyword was selected from the one or more search keywords displayed on the user device;
in response to determining that the particular search keyword was selected from the one or more search keywords displayed on the user device: determining whether an object GTIF product-token, associated with the particular search keyword, matches a particular pair of a set of GTIF product-token pairs;
wherein the set of GTIF product-token pairs comprises one or more of:
a pair comprising a known GTIF product-token and a location data determined for a location of a user device,
a pair comprising known GTIF product-token associated with a user of the user device and one or more social relationships defined for the user,
a pair comprising known time based data associated with one or more events defined for the user and the one or more events,
a pair comprising a known GTIF product-token and a representation of a physical object detected by a camera or sensors and communicated to the user device, or
a pair comprising a known GTIF product-token and a representation of a digital object provided by the user device;
wherein generating the object GTIF product-token comprises: generating an extracted SIFT features by extracting a plurality of local features from an image of the product using a scale-invariant feature transform (SIFT) feature recognition method; generating a SIFT-hash by hashing the extracted SIFT features; and forming the GTIF product-token as a data structure comprising the SIFT-hash;
wherein determining whether the object GTIF product-token matches a particular pair comprises: performing a SIFT-hash comparison by comparing the SIFT-hash of the object GTIF product-token to an index of SIFT-hashes corresponding to known GTIF product-tokens, and identifying a match based on the SIFT-hash comparison;
in response to determining that the object GTIF product-token matches the particular pair, determining particular additional content based on the particular pair, and displaying the particular additional content on the user device.
16 . The custom product computer system generator of claim 15 , wherein a GTIF product-token, of the one or more corresponding GTIF product-tokens, is a complex data structure that is generated using advanced computer-based techniques that include one or more: encoding spatial representations of certain features identified in the product or determining a set of invariant features that are specific to the product;
wherein the set of invariant features includes features that remain invariant of any 2D transformation performed on the features of the product.
17 . The custom product computer system generator of claim 15 , wherein the one or more search keywords include one or more terms such as: product, venue name, guests name, directions, maps, hotels, events, individuals' names, things, or vegetation.
18 . The custom product computer system generator of claim 15 , wherein a GTIF product-token for a product, of a pair of the set of GTIF product-token pairs, represents one or more of:
one or more of relationships between a plurality of transform-invariant features identified for the product, or
one or more relationships between the plurality of transform-invariant features identified for the product and other transform-invariant features identified for other products.
19 . The custom product computer system generator of claim 15 , wherein the particular additional content is displayed as an overlay over a graphical representation of the product;
wherein the particular additional content is displayed by launching and causing executing a software application on the user device to generate a webpage that displays a graphical representation of the additional content.
20 . The custom product computer system generator of claim 15 , wherein the product has a plurality transform invariant features and a corresponding plurality of GTIF product-tokens;
wherein a GTIF product-token is used to determine whether the GTIF product-token matches a particular pair of the set of GTIF product-token pairs;
wherein a GTIF product-token pair comprises additional context data that include one or more of:
location data determined based on GPS location data obtained from one or more of: the location of the user device, a photo, an address of an event, or an address of customers or users;
social relationship data of a creator or a recipient of the product; or
time based data determined based on one or more of: a time of an event, a time when a photo was taken, or a time when a message was sent;
wherein the determining of the particular additional content based on the particular pair is a search that requires comparisons between non-directed graphs having a plurality of nodes, wherein the nodes represent transform invariant features, wherein a time for comparison performed as a series of instructions on computing machinery increases based on a number of comparisons, and wherein a number of transform invariant features exceeds practical limits of user interaction time;
wherein a GTIF product-token is generated using one or more of:
a scale-invariant feature transform feature recognition method (SIFT),
a simultaneous localization and mapping feature recognition method (SLAM), or
a speed up robust features feature recognition method (SURF).