Codeless anchor detection for detectable features in an environment
A client device that includes a camera and an extended reality client application program is employed by a user in a physical space, such as an industrial or campus environment. The user aims the camera within the mobile device at a real-world asset, such as a computer system, classroom, or vehicle. The client device acquires a digital image via the camera and detects textual and/or pictorial content included in the acquired image that corresponds to one or more anchors. The client device queries a data intake and query system for asset content associated with the detected anchors. Upon receiving the asset content from the data intake and query system, the client device generates visualizations of the asset content and presents the visualizations via a display device.
1. A computer-implemented method, comprising:
receiving an image of a physical space that includes a real-world asset and an uncoded feature;
extracting a representation of the uncoded feature from the image;
comparing the representation with a plurality of anchors previously associated with the physical space;
determining, based on the comparison, that a first anchor included in the plurality of anchors corresponds to the representation of the uncoded feature;
generating the first anchor by decrypting an encrypted dataset received from an asset store server if the size of the first anchor exceeds a maximum message size that may be transmitted to a data intake and query system, otherwise generating the first anchor by retrieving the first anchor and the representation of the uncoded feature directly from the data intake and query system;
retrieving, from a data intake and query system and based on the first anchor, asset content associated with the real-world asset; and
causing, through a display device, a visual representation of the asset content to be presented in an extended reality (XR) environment, at a position that is based on a physical location of the uncoded feature within the XR environment.
2. The computer-implemented method of claim 1 , wherein the uncoded feature comprises at least one of a textual feature or a pictorial feature.
3. The computer-implemented method of claim 1 , wherein at least a portion of the real-world asset is present in the image.
4. The computer-implemented method of claim 1 , wherein determining that the representation of the uncoded feature corresponds to the first anchor comprises:
performing an optical character recognition (OCR) process on the representation to extract a text string; and
determining that the first anchor corresponds to the text string.
5. The computer-implemented method of claim 1 , wherein determining that the uncoded feature corresponds to the first anchor comprises:
performing a perspective correction on at least a portion of the image to project the representation onto a virtual surface that is parallel to the display device;
performing an optical character recognition (OCR) process on the representation to extract a text string; and
determining that the anchor corresponds to the text string.
6. The computer-implemented method of claim 1 , wherein determining that the representation of the uncoded feature corresponds to the first anchor comprises:
performing an image analysis process on the representation to extract a symbol; and
determining that the first anchor corresponds to the symbol.
7. The computer-implemented method of claim 1 , wherein determining that the representation of the uncoded feature corresponds to the first anchor comprises:
performing a perspective correction on at least a portion of the image to project the representation onto a virtual surface that is parallel to the display device;
performing an image analysis process on the representation to extract a symbol; and
determining that the first anchor corresponds to the symbol.
8. The computer-implemented method of claim 1 , wherein if the size of the first anchor exceeds a maximum message size that may be transmitted to a data intake and query system, the generating further comprises:
receiving, from the data intake and query system via a mobile device, a link to an encrypted anchor;
transmitting the link from the mobile device to the asset store server;
receiving the encrypted anchor from the asset store server; and
decrypting the encrypted anchor to generate the first anchor,
wherein the data intake and query system:
retrieves the first anchor from a key-value store;
encrypts the first anchor to generate an encrypted anchor;
transmits the encrypted anchor to the asset store server;
receives the link to the encrypted anchor from the asset store server; and
transmits the link to the mobile device.
9. The computer-implemented method of claim 1 , further comprising, prior to determining that the representation the uncoded feature corresponds to the first anchor:
identifying a set of anchors that is proximate to a beacon; and
determining that the first anchor is included in the set of anchors.
10. The computer-implemented method of claim 1 , further comprising, prior to determining that the representation of at least one of textual content or pictorial content corresponds to the first anchor:
identifying a set of anchors that is within a geofence; and
determining that the first anchor is included in the set of anchors.
11. One or more non-transitory computer-readable storage media including instructions that, when executed by one or more processors, cause the one or more processors to perform steps of:
receiving an image of a physical space that includes a real-world asset and an uncoded feature;
extracting a representation of the uncoded feature from the image;
comparing the representation with a plurality of anchors previously associated with the physical space;
determining, based on the comparison, that a first anchor included in the plurality of anchors corresponds to the representation of the uncoded feature;
generating the first anchor by decrypting an encrypted dataset received from an asset store server if the size of the first anchor exceeds a maximum message size that may be transmitted to a data intake and query system, otherwise generating the first anchor by retrievinq the first anchor and the representation of the uncoded feature directly from the data intake and query system;
retrieving, from a data intake and query system and based on the first anchor, asset content associated with the real-world asset; and
causing, through a display device, a visual representation of the asset content to be presented in an extended reality (XR) environment, at a position that is based on a physical location of the uncoded feature within the XR environment.
12. The one or more non-transitory computer-readable storage media of claim 11 , wherein the uncoded feature comprises at least one of a textual feature or a pictorial feature.
13. The one or more non-transitory computer-readable storage media of claim 11 , wherein at least a portion of the real-world asset is present in the image.
14. The one or more non-transitory computer-readable storage media of claim 11 , wherein determining that the representation of the uncoded feature corresponds to the first anchor comprises:
performing an optical character recognition (OCR) process on the representation to extract a text string; and
determining that the first anchor corresponds to the text string.
15. The one or more non-transitory computer-readable storage media of claim 11 , wherein determining that the uncoded feature corresponds to the first anchor comprises:
performing a perspective correction on at least a portion of the image to project the representation onto a virtual surface that is parallel to the display device;
performing an optical character recognition (OCR) process on the representation to extract a text string; and
determining that the anchor corresponds to the text string.
16. The one or more non-transitory computer-readable storage media of claim 11 , wherein determining that the representation of the uncoded feature corresponds to the first anchor comprises:
performing an image analysis process on the representation to extract a symbol; and
determining that the first anchor corresponds to the symbol.
17. The one or more non-transitory computer-readable storage media of claim 11 , wherein determining that the representation of the uncoded feature corresponds to the first anchor comprises:
performing a perspective correction on at least a portion of the image to project the representation onto a virtual surface that is parallel to the display device;
performing an image analysis process on the representation to extract a symbol; and
determining that the first anchor corresponds to the symbol.
18. The one or more non-transitory computer-readable storage media of claim 11 , wherein if the size of the first anchor exceeds a maximum message size that may be transmitted to a data intake and query system, the generating further comprises:
receiving, from the data intake and query system via a mobile device, a link to an encrypted anchor;
transmitting the link from the mobile device to the asset store server;
receiving the encrypted anchor from the asset store server; and
decrypting the encrypted anchor to generate the first anchor,
wherein the data intake and query system:
retrieves the first anchor from a key-value store;
encrypts the first anchor to generate an encrypted anchor;
transmits the encrypted anchor to the asset store server;
receives the link to the encrypted anchor from the asset store server; and
transmits the link to the mobile device.
19. A system, comprising:
a memory that includes instructions; and
a processor that is coupled to the memory and, when executing the instructions, is configured to:
receiving an image of a physical space that includes a real-world asset and an uncoded feature;
extracting a representation of the uncoded feature from the image;
comparing the representation with a plurality of anchors previously associated with the physical space;
determining, based on the comparison, that a first anchor included in the plurality of anchors corresponds to the representation of the uncoded feature;
generating the first anchor by decrypting an encrypted dataset received from an asset store server if the size of the first anchor exceeds a maximum message size that may be transmitted to a data intake and query system, otherwise generating the first anchor by retrieving the first anchor and the representation of the uncoded feature directly from the data intake and query system;
retrieving, from a data intake and query system and based on the first anchor, asset content associated with the real-world asset; and
causing, through a display device, a visual representation of the asset content to be presented in an extended reality (XR) environment, at a position that is based on a physical location of the uncoded feature within the XR environment.
20. The system of claim 19 , wherein the uncoded feature comprises at least one of a textual feature or a pictorial feature.