Drone based capture of a multi-view interactive digital media
Various embodiments of the present disclosure relate generally to systems and methods for drone-based systems and methods for capturing a multi-media representation of an entity. In some embodiments, the multi-media representation is digital, or multi-view, or interactive, and/or the combinations thereof. According to particular embodiments, a drone having a camera is controlled or operated to obtain a plurality of images having location information. The plurality of images, including at least a portion of overlapping subject matter, are fused to form multi-view interactive digital media representations.
1. A method comprising:
transmitting control instructions to a drone from a mobile computing device via a wireless communications interface, the control instructions causing the drone to obtain a plurality of images of an object via a camera at the drone, each of the images being associated with respective location information, wherein the plurality of images include at least a portion of overlapping subject matter;
fusing the plurality of images into content and context models based on the location information, wherein the content model includes the object and the context model includes scenery surrounding the object;
applying an enhancement algorithm to the content and context models; and
generating a multi-view interactive digital media representation (MIDMR) from the content and context models, the MIDMR comprising a plurality of two-dimensional views of the object that are positioned so as to provide a three-dimensional view of the content and context models without rendering or storing an actual three-dimensional model, the MIDMR being navigable in three dimensions via a user interface at the mobile computing device.
2. The method of claim 1 , wherein the drone comprises one or more sensors.
3. The method of claim 1 , wherein the drone is configured to provide stabilized hovering.
4. The method of claim 1 , wherein the drone automatically determines an arc path that is used to obtain the plurality of images.
5. The method of claim 1 , wherein the drone is automatically piloted.
6. The method of claim 1 , wherein the drone is adapted to track a moving object.
7. A system comprising:
a drone, the drone including a camera;
a processor; and
memory comprising instructions to execute a method, the method comprising:
transmitting control instructions to a drone from a mobile computing device via a wireless communications interface, the control instructions causing the drone to obtain a plurality of images, each of the images being associated with respective location information, wherein the plurality of images include at least a portion of overlapping subject matter;
fusing the plurality of images into content and context models based on the location information, wherein the content model includes the object and the context model includes scenery surrounding the object;
applying an enhancement algorithm to the content and context models; and
generating a multi-view interactive digital media representation (MIDMR) from the content and context models, the MIDMR comprising a plurality of two-dimensional views of the object that are positioned so as to provide a three-dimensional view of the content and context models without rendering or storing an actual three-dimensional model, the MIDMR being navigable in three dimensions via a user interface at the mobile computing device.
8. The system of claim 7 , wherein the drone comprises one or more sensors.
9. The system of claim 7 , wherein the drone is configured to provide stabilized hovering.
10. The system of claim 7 , wherein the drone automatically determines an arc path that is used to obtain the plurality of images.
11. The system of claim 7 , wherein the drone is automatically piloted.
12. The system of claim 7 , wherein the drone is adapted to track a moving object.
13. A non-transitory computer readable medium having instructions stored thereon, the instructions comprising:
first instructions causing a computing device to transmit control instructions to a drone from a mobile computing device via a wireless communications interface, the control instructions causing the drone to obtain a plurality of images of an object via a camera at the drone, each of the images being associated with respective location information, wherein the plurality of images include at least a portion of overlapping subject matter;
second instructions causing a processor at the computing device to fuse the plurality of images into content and context models based on the location information, wherein the content model includes the object and the context model includes scenery surrounding the object;
third instructions causing the processor to apply an enhancement algorithm to the content and context models;
fourth instructions causing the processor to generate a multi-view interactive digital media representation (MIDMR) from the content and context models, the MIDMR comprising a plurality of two-dimensional views of the object that are positioned so as to provide a three-dimensional view of the content and context models without rendering or storing an actual three-dimensional model, the MIDMR being navigable in three dimensions via a user interface at the mobile computing device; and
fifth instructions causing the processor to store the MIDMR in a memory module at the computing device.
14. The non-transitory computer readable medium of claim 13 , wherein the drone comprises one or more sensors.
15. The non-transitory computer readable medium of claim 13 , wherein the drone is configured to provide stabilized hovering.
16. The non-transitory computer readable medium of claim 13 , wherein the drone automatically determines an arc path that is used to obtain the plurality of images.
17. The non-transitory computer readable medium of claim 13 , wherein the drone is automatically piloted.