Methods and systems for generating detailed datasets of an environment via gameplay
An example method includes obtaining, obtaining, from one or more sensors of a computing device, data relating to a feature in an environment. Following, the method includes analyzing the data to identify one or more details of the feature in the environment and determining, based on a comparison of the data to a stored dataset in a database, that the details includes a detail that the stored dataset lacks. The method includes providing one or more game elements for gameplay on an interface of the computing device based on the details including the detail that the stored dataset lacks.
1. A computer-implemented method, comprising:
analyzing an image of an environment to detect an object in the environment;
responsive to detecting the object, obtaining, from one or more sensors of a computing device, data of one of a plurality of available data types describing a detail of the object in the environment;
determining, based on a comparison of the data to a stored dataset in a database, that the stored dataset lacks the detail of the object, the stored dataset including data describing other details of the object of at least some of the plurality of available data types; and
responsive to determining the data includes the detail that the stored dataset lacks, providing one or more game elements for use in gameplay on an interface of the computing device.
2. The computer-implemented method of claim 1 , wherein the environment comprises a house, and wherein the object in the environment is a specific room in the house, wherein providing the one or more game elements comprises:
providing information indicating a request to obtain additional data relating to the specific room in the house.
3. The computer-implemented method of claim 1 , wherein the one or more sensors of the computing device include a depth camera and wherein obtaining, from the one or more sensors of the computing device, the data describing the detail of the object in the environment comprises:
obtaining, using the depth camera, one or more depth images of the object in the environment.
4. The computer-implemented method of claim 1 , wherein the one or more sensors of the computing device include a microphone, and wherein obtaining, from the one or more sensors of the computing device, the data describing the detail of the object in the environment comprises:
obtaining, using the microphone, audio from the environment.
5. The computer-implemented method of claim 1 , wherein the one or more sensors of the computing device include an inertial measurement unit (IMU), and wherein obtaining, from the one or more sensors of the computing device, the data describing the detail of the object in the environment comprises:
obtaining, using the IMU, movement data of the computing device in the environment.
6. The computer-implemented method of claim 1 , wherein the one or more sensors of the computing device include a motion tracking camera, and wherein obtaining, from the one or more sensors of the computing device, the data describing the detail of the object in the environment comprises:
obtaining, using the motion tracking camera, movement data of the object in the environment.
7. The computer-implemented method of claim 1 , wherein the one or more sensors of the computing device include a proximity sensor, and wherein obtaining, from the one or more sensors of the computing device, the data describing the detail of the object in the environment comprises:
obtaining, using the proximity sensor, proximity data of the object in the environment within a range of the computing device.
8. The computer-implemented method of claim 1 , further comprising:
generating a floorplan of the environment based on the data describing the detail of the object in the environment.
9. The computer-implemented method of claim 1 , wherein determining that the stored dataset lacks the detail of the object comprises:
receiving, from a server, an identification of the object based on the data describing the detail of the object;
retrieving the stored dataset from the database, the stored dataset corresponding to the object; and
comparing the data describing the detail of the object to the stored dataset from the database to determine that the data describing the detail of the object is not included in the dataset from the database.
10. The computer-implemented method of claim 1 , wherein the one or more game elements for gameplay include at least one of:
one or more points;
one or more achievements;
one or more levels; or
one or more ranks on a leaderboard.
11. A non-transitory computer-readable storage medium with encoded instructions that, when executed by a computer system, cause the computer system to perform steps comprising:
analyzing an image of an environment to detect an object in the environment;
responsive to detecting the object, obtaining, from one or more sensors of a computing device, data of one of a plurality of available data types describing a detail of the object in the environment;
determining, based on a comparison of the data to a stored dataset in a database, that the stored dataset lacks the detail of the object, the stored dataset including data describing other details of the object of at least some of the plurality of available data types; and
responsive to determining the data includes the detail that the stored dataset lacks, providing one or more game elements for use in gameplay on an interface of the computing device.
12. The storage medium of claim 11 , wherein the environment comprises a house, and wherein the object in the environment is a specific room in the house, wherein providing the one or more game elements comprises:
providing information indicating a request to obtain additional data relating to the specific room in the house.
13. The storage medium of claim 11 , wherein the one or more sensors of the computing device include a depth camera and wherein obtaining, from the one or more sensors of the computing device, the data describing the detail of the object in the environment comprises:
obtaining, using the depth camera, one or more depth images of the object in the environment.
14. The storage medium of claim 11 , wherein the one or more sensors of the computing device include a microphone, and wherein obtaining, from the one or more sensors of the computing device, the data describing the detail of the object in the environment comprises:
obtaining, using the microphone, audio from the environment.
15. The storage medium of claim 11 , wherein the one or more sensors of the computing device include an inertial measurement unit (IMU), and wherein obtaining, from the one or more sensors of the computing device, the data describing the detail of the object in the environment comprises:
obtaining, using the IMU, movement data of the computing device in the environment.
16. The storage medium of claim 11 , wherein the one or more sensors of the computing device include a motion tracking camera, and wherein obtaining, from the one or more sensors of the computing device, the data describing the detail of the object in the environment comprises:
obtaining, using the motion tracking camera, movement data of the object in the environment.
17. The storage medium of claim 11 , wherein the one or more sensors of the computing device include a proximity sensor, and wherein obtaining, from the one or more sensors of the computing device, the data describing the detail of the object in the environment comprises:
obtaining, using the proximity sensor, proximity data of the object in the environment within a range of the computing device.
18. The storage medium of claim 11 , further comprising:
generating a floorplan of the environment based on the data describing the detail of the object in the environment.
19. The storage medium of claim 11 , wherein determining that the stored dataset lacks the detail of the object comprises:
receiving, from a server, an identification of the object based on the data describing the detail of the object;
retrieving the stored dataset from the database, the stored dataset corresponding to the object; and
comparing the data describing the detail of the object to the stored dataset from the database to determine that the data describing the detail of the object is not included in the dataset lacks from the database.
20. The storage medium of claim 11 , wherein the one or more game elements for gameplay include at least one of:
one or more points;
one or more achievements;
one or more levels; or
one or more ranks on a leaderboard.