Augmented reality writing system and method thereof

1. An augmented reality writing system comprising:

a memory;

a display device including a transparent display;

a sensor arranged to provide position information identifying positions of a writing tool within a scene in a volumetric space behind the display device; and

a processing unit communicatively coupled to the memory, the sensor and the transparent display, said processing unit being programmed to execute instructions stored in the memory to render a digital image on the transparent display corresponding to motion of the writing tool within the scene based on the position information so that the digital image is visible in the context of the scene, wherein, in a first mode, the digital image corresponding to the motion of the writing tool remains stationary with respect to the transparent display when the display device is moved.

2. The system of claim 1 , wherein the digital image is rendered on a front surface of the transparent display, the front face facing a user operating the writing tool.

3. The system of claim 2 , wherein, in the second mode, the digital image corresponding to the motion of the writing tool is associated with the scene via a fiducial marker identified by the processing unit.

4. The system of claim 3 , wherein the digital image and the identified fiducial marker are saved in the memory for subsequent retrieval.

5. The system of claim 1 , wherein, in a second mode, the digital image corresponding to the motion of the writing tool is associated with the scene such that the digital image remains stationary with respect to the scene when the display device is moved.

6. The system of claim 1 further comprising the writing tool, wherein the writing tool is an active stylus configured to emit signals that are sensed by the sensor for locating a three-dimensional position of an end portion of the stylus.

7. The system of claim 1 , wherein the transparent display includes a transparent display panel, a glass projection surface, or a display panel having an in-line rear camera.

8. The system of claim 1 , wherein the digital image is displayed in a three-dimensional virtual environment.

9. A computer-implemented method comprising:

detecting, via a sensor, positions of a writing tool within a scene in a volumetric space behind a display device including the sensor and a transparent display; and

rendering, via a processing unit, virtual handwritten content on the transparent display corresponding to motion of the writing tool within the scene so that the virtual handwritten content is visible in the context of the scene, wherein, in a first mode, the virtual handwritten content corresponding to the motion of the writing tool remains stationary with respect to the transparent display as the display device is moved.

10. The method of claim 9 , wherein the steps of rendering the virtual handwritten content further comprises:

displaying the virtual handwritten content corresponding to the motion of the writing tool on a front surface of the transparent display facing an operating user.

11. The method of claim 9 , further comprising, in a second mode:

determining a reference marker; and

associating the virtual handwritten content corresponding to the motion of the writing tool with the reference marker so that the virtual handwritten content is displayed based on a position of the reference marker in the scene.

12. The method of claim 11 , further comprising:

displaying the virtual handwritten content only when the sensor is pointed in a direction of the scene and the reference marker is within a field of view of the sensor.

13. The method of claim 9 , further comprising:

emitting, via the writing tool, a signal; and

detecting, via the sensor, the signal emitting from the writing tool so as to locate and track movement of an end portion of the writing tool in the volumetric space.

14. The method of claim 9 , where the virtual handwritten content appears as three-dimensional objects within the volumetric space behind the display using stereoscopic rendering.

15. The method of claim 9 , wherein the transparent display includes a transparent display panel, a glass projection surface, or a display panel having an in-line rear camera.

16. A non-transitory computer-readable storage medium having stored executable instructions that, when executed by a processor, cause the system to:

track, using a display device including a sensor and a transparent display, positions of a writing tool within a scene in a volumetric space behind the transparent display; and

render digital ink on the transparent display, wherein the rendered digital ink corresponds to the positions of the writing tool within the scene so that the digital ink is visible in the context of the scene, wherein, in a first mode, the digital ink corresponding to the motion of the writing tool remains stationary with respect to the transparent display when the display device is moved.

17. The non-transitory computer-readable storage medium of claim 16 , wherein, in a second mode, the executable instructions, when executed by the processor, further cause the system to:

determine a fiducial marker in the scene; and

display the digital ink upon a detection of the fiducial marker.

18. The non-transitory computer-readable storage medium of claim 16 , wherein, in a second mode, the executable instructions, when executed by the processor, further cause the system to display the digital ink corresponding to the motion of the writing tool in association with the scene such that the digital ink remains stationary with respect to the scene when the display device is moved.

19. The non-transitory computer-readable storage medium of claim 16 , wherein the executable instructions when executed by the processor, further cause the system to:

detect a signal emitted from the handwriting tool;

track movement of the end portion of the handwriting tool in the volumetric space so as to create a three-dimensional image corresponding to said movement; and

display the three-dimensional image on the transparent display.