Object datastore in an augmented reality environment
An augmented reality environment allows interaction between virtual and real objects and enhances an unstructured real-world environment. An object datastore comprising attributes of an object within the environment may be built and/or maintained from sources including manufacturers, retailers, shippers, and users. This object datastore may be local, cloud based, or a combination thereof. Applications may interrogate the object datastore to provide user functionality.
1. One or more non-transitory computer-readable media storing computer-executable instructions that, when executed, cause one or more processors to perform acts comprising:
detecting an object in an environment from an image of the environment;
determining one or more attributes about the object via one or more sensors within the environment;
generating a preliminary identification of the object based at least in part on a comparison of the one or more attributes to attributes maintained in an object datastore;
calculating a confidence value for the preliminary identification;
comparing the confidence value for the preliminary identification to a confidence threshold;
in response to the confidence value for the preliminary identification reaching or exceeding the confidence threshold, identifying the object using the preliminary identification; and
in response to the confidence value for the preliminary identification being below the confidence threshold:
providing a visual indicator to identify the object, wherein the visual indicator is displayed proximate to the object or overlapping with the object;
querying a user for identification information associated with the object identified by the visual indicator; and
storing the identification information associated with the object in the object datastore.
2. The one or more non-transitory computer-readable storage media of claim 1 , wherein the object datastore comprises physical attributes, functional attributes, and location attributes associated with a variety of different objects in the environment, in other environments, or both.
3. The one or more non-transitory computer-readable storage media of claim 1 , the acts further comprising:
recognizing speech of the user at least partly in response to the querying; and
wherein the storing of the identification information in the object datastore occurs at least partly in response to the recognizing of the speech.
4. The one or more non-transitory computer-readable storage media of claim 1 , the acts further comprising:
recognizing a gesture made by the user at least partly in response to the querying; and
wherein the storing of the identification information in the object datastore occurs at least partly in response to the recognizing of the gesture.
5. The one or more non-transitory computer-readable storage media of claim 1 , wherein the object datastore is stored at least partially at a remote server accessible via a network interface.
6. A computer-implemented method comprising:
detecting an object in an environment from an image of the environment;
determining, via at least one computing device, one or more attributes about the object via one or more sensors within the environment;
generating, via the one or more computing devices, a preliminary identification of the object based at least in part on a comparison of the one or more attributes to attributes maintained in an object datastore;
calculating, via the at least one computing device, a confidence value for the preliminary identification;
comparing, via the at least one computing device, the confidence value for the preliminary identification to a confidence threshold;
in response to the confidence value for the preliminary identification reaching or exceeding the confidence threshold, identifying, via the at least one computing device, the object using the preliminary identification; and
in response to the confidence value for the preliminary identification being below the confidence threshold and via the at least one computing device:
providing a visual indicator to identify the object, wherein the visual indicator is displayed proximate to the object or overlapping with the object;
querying a user for identification information associated with the object identified by the visual indicator; and
storing the identification information associated with the object in the object datastore.
7. The computer-implemented method of claim 6 , wherein the object datastore comprises physical attributes, functional attributes, and location attributes associated with a variety of different objects in the environment, in other environments, or both.
8. The computer-implemented method of claim 6 , further comprising:
recognizing speech of the user at least partly in response to the querying; and
wherein the storing of the identification information in the object datastore occurs at least partly in response to the recognizing of the speech.
9. The computer-implemented method of claim 6 , further comprising:
recognizing a gesture made by the user at least partly in response to the querying; and
wherein the storing of the identification information in the object datastore occurs at least partly in response to the recognizing of the gesture.
10. The computer-implemented method of claim 6 , wherein the object datastore is stored at least partially at a remote server accessible via a network interface.
11. A system comprising:
one or more processors; and
memory storing computer-executable instructions that, when executed, cause the one or more processors to perform acts comprising:
detecting an object in an environment from an image of the environment;
determining one or more attributes about the object via one or more sensors within the environment;
generating a preliminary identification of the object based at least in part on a comparison of the one or more attributes to attributes maintained in an object datastore;
calculating a confidence value for the preliminary identification;
comparing the confidence value for the preliminary identification to a confidence threshold;
in response to the confidence value for the preliminary identification reaching or exceeding the confidence threshold, identifying the object using the preliminary identification; and
in response to the confidence value for the preliminary identification being below the confidence threshold:
providing a visual indicator to identify the object, wherein the visual indicator is displayed proximate to the object or overlapping with the object;
querying a user for identification information associated with the object identified by the visual indicator; and
storing the identification information associated with the object in the object datastore.
12. The system of claim 11 , wherein the object datastore comprises physical attributes, functional attributes, and location attributes associated with a variety of different objects in the environment, in other environments, or both.
13. The system of claim 11 , the acts further comprising:
recognizing speech of the user at least partly in response to the querying; and
wherein the storing of the identification information in the object datastore occurs at least partly in response to the recognizing of the speech.
14. The system of claim 11 , the acts further comprising:
recognizing a gesture made by the user at least partly in response to the querying; and
wherein the storing of the identification information in the object datastore occurs at least partly in response to the recognizing of the gesture.
15. The system of claim 11 , wherein the object datastore is stored at least partially at a remote server accessible via a network interface.