Methods, devices, and systems for determining field of view and producing augmented reality

1. A method for automated determination of field of view of a camera, comprising

determining, by one or more processors, a first value that describes a change in a camera's position or orientation by tracking features across a plurality of images or video frames, wherein the images or video frames originated from the camera, wherein the camera includes at least one lens with a focal length and an image sensor with a sensor size;

determining, by the one or more processors, a second value that describes a change in the camera's position or orientation using motion sensor data corresponding with the camera;

determining a field of view (FOV) of the camera from a comparison of the first and second values, wherein the FOV is expressed as a single angle measure which is constant for a given value of the focal length and a given value of the sensor size; and

initiating a signal for controlling one or more of auditory, visual, and tactile output by an output device based on the determined field of view,

wherein the field of view determination is performed in an absence of a priori knowledge of the FOV of the camera, the focal length, or the sensor size.

2. The method of claim 1 , further comprising a step of extracting the features tracked for the first determining step from the images or video frames by image processing with the one or more processors.

3. The method of claim 1 , further comprising a step of providing the one or more of auditory, visual, and tactile output with an output device.

4. The method of claim 1 , further comprising a step of providing instruction to a user to pan the camera to the side or up and down while the plurality of images or video frames are captured and the motion sensor data is collected.

5. A method for augmented reality, comprising

determining, by one or more processors, a first value that describes a change in a camera's position or orientation by tracking features across a plurality of images or video frames, wherein the images or video frames originated from the camera, wherein the camera includes at least one lens with a focal length and an image sensor with a sensor size;

determining, by the one or more processors, a second value that describes a change in the camera's position or orientation using motion sensor data corresponding with the camera;

determining a field of view (FOV) of the camera from a comparison of the first and second values, wherein the FOV is expressed as a single angle measure which is constant for a given value of the focal length and a given value of the sensor size;

selecting one or more virtual objects to represent as augmentations to the one or more images or videos, wherein the selection is based on the determined field of view; and

initiating a signal for controlling an augmented reality output by an output device using the one or more selected virtual objects,

wherein the field of view determination is performed in an absence of a priori knowledge of the FOV of the camera, the focal length, or the sensor size.

6. The method of claim 5 , further comprising a step of extracting the features tracked for the first determining step from the images or video frames by image processing with the one or more processors.

7. The method of claim 5 , further comprising

determining a real world frustum for the camera based on the determined field of view, the location of the camera, and an orientation of the camera, and

applying the real world frustum to a virtual world, wherein the virtual world contains virtual objects and a virtual landscape that corresponds with a real world landscape,

wherein the step of selecting selects from virtual object candidates which are inside the frustum applied to the virtual world.

8. The method of claim 5 , further comprising a step of providing instruction to a user to pan the camera to the side or up and down while the plurality of images or video frames are captured and the motion sensor data is collected.

9. A system for automated determination of field of view of a camera, comprising

one or more processors configured to execute instructions which cause the one or more processors to

determine a first value that describes a change in a camera's position or orientation by tracking features across a plurality of images or video frames, wherein the images or video frames originated from the camera, wherein the camera includes at least one lens with a focal length and an image sensor with a sensor size;

determine a second value that describes a change in the camera's position or orientation using motion sensor data corresponding with the camera;

determine a field of view (FOV) of the camera from a comparison of the first and second values, wherein the FOV is expressed as a single angle measure which is constant for a given value of the focal length and a given value of the sensor size; and

initiate a signal for controlling one or more of auditory, visual, and tactile output by an output device based on the determined field of view,

wherein the field of view determination is performed in an absence of a priori knowledge of the FOV of the camera, the focal length, or the sensor size.

10. The system of claim 9 , further comprising

a camera configured to capture images or videos which are transmitted to the one or more processors; and

an output device for providing the one or more of auditory, visual, or tactile output based on the determined field of view.

11. The system of claim 9 , wherein the one or more processors are further caused to perform a step of providing instruction to a user to pan the camera to the side or up and down while the plurality of images or video frames are captured and the motion sensor data is collected.

12. An augmented reality system, comprising

one or more processors configured to execute instructions which cause the one or more processors to

determine a first value that describes a change in a camera's position or orientation by tracking features across a plurality of images or video frames, wherein the images or video frames originated from the camera, wherein the camera includes at least one lens with a focal length and an image sensor with a sensor size;

determine a second value that describes a change in the camera's position or orientation using motion sensor data corresponding with the camera;

determine a field of view (FOV) of the camera from a comparison of the first and second values, wherein the FOV is expressed as a single angle measure which is constant for a given value of the focal length and a given value of the sensor size; and

select one or more virtual objects to represent as augmentations to the one or more images or videos, wherein the selection is based on the determined field of view, and

initiate a signal for controlling an augmented reality output by an output device using the one or more selected virtual objects,

wherein the field of view determination is performed in an absence of a priori knowledge of the FOV of the camera, the focal length, or the sensor size.

13. The system of claim 12 , further comprising

a camera configured to capture images or videos which are transmitted to the one or more processors; and

an output device for providing the augmented reality output using the one or more selected virtual objects.

14. The system of claim 12 , wherein the one or more processors are further caused to perform a step of providing instruction to a user to pan the camera to the side or up and down while the plurality of images or video frames are captured and the motion sensor data is collected.