Snapshots at predefined intervals or angles
Various embodiments of the present invention relate generally to systems and methods for analyzing and manipulating images and video. In particular, a multi-view interactive digital media representation can be generated from live images captured from a camera. The live images can include an object. An angular view of the object captured in the live images can be estimated using sensor data from an inertial measurement unit. The determined angular views can be used to select from among the live images. The multi-view interactive digital media representation can include a plurality of images where each of the plurality of images includes the object from a different camera view. When the plurality of images is output to a display, the object can appear to undergo a 3-D rotation through the determined angular view where the 3-D rotation of the object is generated without a 3-D polygon model of the object.
1. A method comprising:
on a mobile device including a processor, a memory, a camera, an inertial measurement unit, a microphone and a touchscreen display, receiving via an input interface on the mobile device a request to generate a multi-view interactive digital media representation of an object;
receiving via the input interface an angle profile wherein the angle profile includes a a set of designated angle values;
receiving live images from the camera on the mobile device as the mobile device moves along a path and wherein an orientation of the camera varies along the path such that the object in the live images is captured from a plurality of camera views;
based upon sensor data from the inertial measurement unit:
determining of a first position of the camera along the path, and
determining a second position of the camera along the path;
determining a camera angle in relation to the object captured based on the determined first position of the camera and the determined second position of the camera;
determining that the camera angle corresponds to a first one the designated angle values of the angle profile;
selecting a first one of the live images, the first image being captured at the determined camera angle selected in correspondence with the designated angle values of the angle profile;
selecting additional images at additional camera angles corresponding with each designated angle value of the angle profile; and
generating, based on the selected first image and the selected additional images, the multi-view interactive digital media representation, wherein the multi-view interactive digital media representation is capable of being displayed on the touchscreen display in a manner that appears to undergo a 3-D rotation through an angular view amount, wherein the 3-D rotation of the object is generated without a 3-D polygon model of the object.
2. The method of claim 1 , further comprising receiving via the interface a selection of the object appearing in one of the live images.
3. The method of claim 1 , wherein one or more of a height of the camera above ground, a distance from the camera to the object, a pitch angle of the mobile device, a roll angle of the mobile device, a yaw angle of the mobile device or combinations thereof varies along the path.
4. The method of claim 1 , wherein the camera angle is within a range of the designated angle values.
5. The method of claim 1 , further comprising, in response to receiving the request generate the multi-view interactive digital media representation, selecting a first image from among the live images wherein the camera angle associated with the first image is zero.
6. The method of claim 1 , wherein the of designated angle values in the angle profile are each spaced equally.
7. The method of claim 6 , wherein the designated angle values indicate a constant angle spacing value to use between each of the angles.
8. The method of claim 6 , further comprising determining a final image selected is not equally spaced with a preceding image in and removing the final image prior to generating the multi-view interactive digital media representation.
9. The method of claim 1 , further comprising determining whether a third position of the camera is positive in magnitude or negative in magnitude and selecting only a live image associated with a positive magnitude.
10. The method of claim 1 , wherein an angular spacing between each of the designated angle values are variable.
11. The method of claim 1 , wherein a portion of the designated angle values are clustered around a particular camera angle in relation to the object such that a first angular spacing near the particular camera angle is smaller than a different camera angle away from the particular angular view.
12. The method of claim 1 , wherein the first position of the camera is determined about an axis.
13. The method of claim 12 , wherein the axis is aligned with Earth's gravity vector.
14. The method of claim 12 , further comprising based upon the orientation of the camera along the path, determining a first direction of rotation of the camera about the axis.
15. The method of claim 14 , wherein only camera positions in the first direction are used to determine the camera angle of the object captured in each of the live images.
16. The method of claim 15 , further comprising determining a third position of the camera in a second direction opposite the first direction, determining a fourth position of the camera in the first direction, wherein the fourth position of the camera is determined based upon the orientation of the camera prior to the third position of the camera.
17. The method of claim 14 , further comprising determining positions of the camera in the first direction of rotation and in a second direction opposite the first direction wherein the camera angle of the object captured in each of the live images is determined using both the positions of the camera in the first direction and the second direction.
18. The method of claim 1 , further comprising outputting to the display a current value of the camera angle in relation to the object.
19. The method of claim 1 , wherein the inertial measurement unit includes a 3-axis accelerometer and the orientation of the camera at a plurality of times along the path is determined from sensor data from the 3-axis accelerometer generated along the path.
20. The method of claim 19 , based upon the sensor data from the 3-axis accelerometer, determining a tilt orientation of the mobile device relative to an orthogonal coordinate system associated with Earth's gravity vector wherein the tilt orientation includes a pitch angle of the mobile device and a roll angle of the mobile device measured relative to the orthogonal coordinate system wherein the positions of the camera are determined based upon the tilt orientation.
21. The method of claim 1 , wherein the first position of the camera is determined based upon one or more of accelerometer data, gyroscopic data, magnetometer data or combinations thereof.
22. The method of claim 1 , wherein the inertial measurement unit includes one or more of an accelerometer, a gyroscope, a magnetometer or combinations thereof.