Device and method for position determination in a 3D model of an environment
An apparatus and method for position determination in a 3D model of an environment and a computer-executed iterative method for position determination in a 3D model of an environment. The method includes the steps of: a) acquisition of camera, gyroscope and accelerometer data, b) determination of visual features from the acquired camera sensor data, c) creation of a current key image of the pose (PK) from the visual features and the gyroscope and accelerometer sensor data, d) addition of the key image of the pose (PK) to a database, and e) position determination by comparing the current key image of the posture (PK) with those of the database.
1. Iterative method executed by a computer for position determination in a 3D model of an environment, comprising the steps of:
aquiring, by a mobile device, of camera, gyroscope and accelerometer data,
determining visual features from the acquired camera sensor data,
creating a current key image of the pose (PK) from the visual features and the gyroscope and accelerometer data,
adding of the key image of the pose (PK) to a pose database (PK database), and
determining position by comparing the current key image of the pose (PK) with those of the PK database,
wherein the key image of the pose (PK) is compared with the pose database (PK database) on a server and from this comparison, the key image position of the current key image of the pose (PK) is determined in a coordinate system,
wherein the current key image of the pose (PK) is compared with key images of the pose previously stored in the database, unnecessary key images of the pose (PK) are removed from the pose database, based on the comparison, a current position inaccuracy of the current key image of the pose (PK) relative to the coordinate system is determined, the position inaccuracy is transmitted from the server to the mobile device and the mobile device thus corrects its current position and orientation in the coordinate system, and
wherein the 3D model comprises a salient point map and an RGB map, wherein the salient point map includes a database unifying:
a plurality of salient points that include visual features of an image file of the environment, among other points, that have contrast differences that are detectable across multiple image files of the environment, and
relative position of the gyroscope data and the accelerometer data.
2. Device for position determination in a 3D model of an environment, comprising a mobile device comprising:
a camera,
a gyroscope and
an accelerometer, wherein
the mobile device is configured to perform the steps of the method of claim 1 .
3. The method of claim 1 , wherein an RGB map is iteratively created from the camera, gyroscope, and accelerometer data and includes a database of visual image data from the camera being unified with the relative position of the gyroscope and accelerometer.
4. Method according to claim 1 , wherein the visual features are determined using an Oriented FAST and Rotated BRIEF (ORB) algorithm.
5. Method according to claim 1 , wherein the camera, gyroscope and accelerometer data are transmitted to a server.
6. Method according to claim 5 , wherein a 3D reconstruction is performed on the server using the transmitted data to create the 3D model of the environment.
7. Method according to claim 6 , wherein the 3D reconstruction is performed using a ORB-SLAM library.
8. Apparatus for position determination in a 3D model of an environment, comprising a mobile device comprising:
a camera,
a gyroscope,
an accelerometer, and
a display device, wherein
the mobile device is configured to perform the steps of the method according to claim 1 , wherein
the display device is configured to,
visually displaying the 3D model of the environment.
9. Apparatus according to claim 8 , wherein the mobile device is configured to enable adding and displaying contents of the augmented reality on the display device.
10. Apparatus according to claim 9 , wherein the position information of the contents of the augmented reality displayed on the display device is unified with the database.
11. Apparatus according to claim 10 , wherein the contents of the augmented reality are continuously visually adjusted to the determined position of the mobile device.
12. Apparatus according to claim 11 , wherein upon movement of the mobile device during the time between an analysis of an image and a placement of the contents of the augmented reality, a directional and angular correction for the visual representation of the contents of the augmented reality is taken into account.