Methods, devices and systems for automatic zoom when playing an augmented scene
The present disclosure relates to methods, apparatus and systems for automatically adapt the zoom coefficient of the camera of a system when running an augmented reality application. A pose estimation is performed for the camera which captures the real scene and the boundaries of the AR scene are calculated. According to the camera frustum and the boundaries, three-dimension rectangles are computes to determine a zoom coefficient that would optimize the seeing of the seen and the optimal position for the camera. The zoom is automatically optically or digitally adapted and the optimal position is indicated to the user by visual, audio or haptic means.
1. A method of rendering images on a display device when playing an augmented reality scene from the point of view of a camera in a real scene, the method comprising:
determining 3D boundaries of the augmented reality scene, said boundaries embracing every 3D element of the augmented reality scene, the augmented reality scene being a 3D model comprising 3D models of objects and non-rendered 3D elements corresponding to objects of the real scene;
determining a zoom coefficient according to an estimation of a pose of the camera and the 3D boundaries of the scene; and
rendering images on the display device from the camera according to the zoom coefficient.
2. The method of claim 1 , comprising indicating a position of the camera to the user using effects from group comprising visual, audio or haptics effects.
3. The method of claim 2 , wherein said position is determined according to a direction and a weight associated with at least one element of the augmented reality scene.
4. The method of one of claim 1 , comprising controlling the aiming direction of said camera according to the boundaries of the augmented reality scene and said zoom coefficient.
5. The method of one of claim 1 , wherein said camera comprises an optical zoom function, the method further comprising controlling said optical zoom function according to said zoom coefficient.
6. The method of one of claim 1 , comprising operating a digital zoom on said images according to said zoom coefficient.
7. A device having a display configured to render images when playing an augmented reality scene from a point of view of a camera in a real scene, the device comprising a memory associated with at least one processor configured to:
determine 3D boundaries of the augmented reality scene, said boundaries embracing every 3D element of the augmented reality scene, the augmented reality scene being a 3D model comprising 3D models of objects and non-rendered 3D elements corresponding to objects of the real scene;
determine a zoom coefficient according to an estimation of a pose of the camera and the 3D boundaries of the scene;
render images from the camera according to the zoom coefficient.
8. The device of claim 7 , further comprising a transmitter configured to transmit an indication of a position of the camera to the user using effects from group comprising visual, audio or haptics effects.
9. The device of claim 8 , wherein said position is determined according to a direction and a weight associated with at least one element of the augmented reality scene.
10. The device of one of claim 7 , wherein said processor is further configured to control the aiming direction of said camera according to the boundaries of the augmented reality scene and said zoom coefficient.
11. The device of one of claim 7 , wherein said camera comprises an optical zoom function, said processor being further configured to control said optical zoom function according to said zoom coefficient.
12. The device of one of claim 7 , wherein said processor is further configured to operate a digital zoom on said images according to said zoom coefficient.
13. A non-transitory medium readable by computer and/or executable by a processor having stored instructions for causing said computer or said processor to perform at least the steps of the method according to one of the claim 1 .