Scanning of 3D objects with a second screen device for insertion into a virtual environment

1. A method for inserting a virtual object into a virtual environment, comprising:

generating a scan of a real world object;

processing the scan to identify a type of the real world object;

based on the identified type of the real world object, generating a virtual object that resembles the real world object;

using the identified type of the real world object to identify and assign a functionality to the virtual object, the functionality defining a utility of the virtual object in a virtual environment, wherein assigning the functionality enables an action capable of being performed by the virtual object in the virtual environment that provides said utility;

deploying the virtual object in the virtual environment.

2. The method of claim 1 , wherein generating the scan of the real world object includes capturing one or more images of the real world object.

3. The method of claim 2 , wherein the one or more images of the real world object include images from multiple angles surrounding the real world object.

4. The method of claim 2 , wherein the capturing one or more images is performed by a handheld device.

5. The method of claim 1 , wherein processing the scan to identify the type of the real world object includes applying a machine learning model to recognize the type of the real world object based on the scan.

6. The method of claim 1 , wherein generating the virtual object includes obtaining a 3D model for the identified type of the real world object.

7. The method of claim 6 , wherein generating the virtual object includes applying features of the real world object to the 3D model.

8. The method of claim 1 , wherein assigning the functionality to the virtual object includes defining a mapping of the functionality to a controller input to activate the functionality, such that triggering the controller input causes performance of the action by the virtual object.

9. The method of claim 1 , wherein deploying the virtual object in the virtual environment includes receiving user input to determine a location in the virtual environment where the virtual object is placed.

10. The method of claim 1 , wherein deploying the virtual object in the virtual environment includes receiving user input to determine a size of the virtual object in the virtual environment.

11. The method of claim 1 , wherein the virtual environment is of a video game or of a simulation.

12. A method for inserting a virtual object into a virtual environment, comprising:

receiving a 2D drawing of a real world object;

processing the 2D drawing to identify a type of the real world object;

based on the identified type of the real world object, generating a virtual object that resembles the real world object;

using the identified type of the real world object to identify and assign a functionality to the virtual object, the functionality defining a utility of the virtual object in a virtual environment, wherein assigning the functionality enables an action capable of being performed by the virtual object in the virtual environment that provides said utility;

deploying the virtual object in the virtual environment.

13. The method of claim 12 , wherein receiving the 2D drawing of the real world object includes receiving touchscreen input that creates the 2D drawing.

14. The method of claim 12 , wherein processing the 2D drawing to identify the type of the real world object includes applying a machine learning model to recognize the type of the real world object based on the 2D drawing.

15. The method of claim 12 , wherein generating the virtual object includes obtaining a 3D model for the identified type of the real world object.

16. The method of claim 12 , wherein assigning the functionality to the virtual object includes defining a mapping of the functionality to a controller input to activate the functionality, such that triggering the controller input causes performance of the action by the virtual object.

17. The method of claim 12 , wherein deploying the virtual object in the virtual environment includes receiving user input to determine a location in the virtual environment where the virtual object is placed.

18. The method of claim 12 , wherein deploying the virtual object in the virtual environment includes receiving user input to determine a size of the virtual object in the virtual environment.

19. The method of claim 12 , wherein the virtual environment is of a video game or of a simulation.