System with 3D user interface integration

1. A scanning system for scanning a 3D environment, the scanning system comprising:

a handheld device including an optical scanner, wherein the 3D environment to be scanned is selected by pointing the optical scanner at the 3D environment; and

at least one display remotely connected to the handheld device,

wherein the handheld device is adapted for performing at least one scanning action in a physical 3D environment, and the at least one display is adapted for visually representing the physical 3D environment; and

the handheld device includes a user interface for remotely controlling the display to adjust the view with which the 3D environment is represented on the display.

2. A system according to claim 1 , wherein the handheld device is adapted to record the 3D geometry of the 3D environment.

3. A system according to claim 1 , wherein the user interface includes means for manually switching between performing the at least one scanning action and remotely controlling the view.

4. The system according to claim 1 , wherein the handheld device comprises at least one motion sensor.

5. The system according to claim 4 , wherein the view of the 3D environment represented in the at least one display is at least partly determined by the at least one motion sensor.

6. The system according to claim 4 , wherein functionality of the user interface comprises a use of gestures.

7. The system according to claim 6 , wherein the gestures are detected by the at least one motion sensor.

8. The system according to claim 4 , wherein the user-interface is other than the at least one motion sensor.

9. The system according to claim 1 , wherein the handheld device is adapted to change a viewing angle with which the 3D environment is represented on the at least one display.

10. The system according to claim 1 , wherein the handheld device is adapted to change a magnification factor with which the 3D environment is represented on the at least one display.

11. The system according to claim 1 , wherein the handheld device is an intra-oral 3D scanner.

12. The system according to claim 1 , wherein the handheld device includes a surgical instrument.

13. The system according to claim 1 , wherein the handheld device includes a mechanical tool.

14. The system according to claim 1 , wherein the handheld device is an in-ear 3D scanner.

15. The system according to claim 1 , wherein the at least one display is defined as a first display, and where the system further comprises a second display.

16. The system according to claim 15 , wherein the second display indicates where the handheld device is positioned relative to the 3D environment.

17. The system according to claim 15 , wherein the first display and/or the second display provides instructions for the operator.

18. The system according to claim 1 , wherein audible information is provided to the operator.

19. A system comprising:

a handheld device and at least one display;

wherein the handheld device is adapted for switching between performing at least one action in a physical 3D environment, wherein the at least one display is adapted for visually representing the physical 3D environment; and remotely controlling the display to adjust the view with which the 3D environment is represented on the display;

wherein the handheld device is an intra-oral 3D scanner and the at least one action performed in the physical 3D environment is scanning and that the view is remotely controlled by at least one motion sensor arranged in the handheld device, and wherein an actuator provided on the handheld device switches between performing the at least one action and remotely controlling the view.