Integrating overlaid textual digital content into displayed data via graphics processing circuitry using a frame buffer

1. An apparatus, comprising:

processing circuitry, including a graphics processing unit (GPU), configured to access a frame buffer of the GPU,

analyze, in the frame buffer of the GPU, a frame representing a section of a stream of displayed data that is being displayed by a display device,

based on the analyzed frame, identify a reference patch in the frame buffer that includes an instruction to identify an object comprising original text on an original layer, the reference patch identifying an available area in which translated text is insertable in the displayed data that is being displayed by the apparatus and a screen position within the available area at which the translated text is insertable into the displayed data,

based on the instruction included in the reference patch, recognize the original text,

receive the translated text, the translated text being a translation of the original text,

generate an overlay positioned on top of the original layer, the overlay comprising an augmentation layer, the augmentation layer including the translated text, a position of the translated text on the augmentation layer determined, at least in part, by the reference patch, and

overlay the overlay onto the displayed data of the original layer such that the translated text is viewable while the original text is obscured from view.

2. The apparatus of claim 1 , wherein the overlay further comprises an overlay mask that includes non-transparent pixels, the overlay mask obscuring the original text from view and being in a different area of the augmentation layer than the translated text.

3. The apparatus of claim 1 , wherein

the overlay includes a plurality of augmentation layers, and

the processing circuitry is configured to, prior to overlaying the overlay

determine a size of the translated text,

determine an obscuring of elements present in the displayed data which are different from the original text, and

adjust the overlay, which includes the plurality of augmentation layers, such that the elements present in the displayed data which are different from the original text are not obscured.

4. The apparatus of claim 1 , wherein the instruction included in the reference patch includes an indication of a translation language target, which is an indication of a language in which the original text is to be translated into.

5. The apparatus of claim 1 , wherein the processing circuitry is configured to

receive the translated text from a translation apparatus.

6. The apparatus of claim 1 , wherein the processing circuitry is configured to modify the overlay to allow user interaction with an interactive element in the displayed data.

7. The apparatus of claim 1 , wherein the overlay comprises a plurality of augmentation layers, each of the plurality of augmentation layers including translated text.

8. A method, comprising:

accessing a frame buffer of a graphics processing unit (GPU);

analyzing, in the frame buffer of the GPU, a frame representing a section of a stream of displayed data that is being displayed by a display device;

based on the analyzed frame, identifying a reference patch in the frame buffer that includes an instruction to identify an object comprising original text on an original layer, the reference patch identifying an available area in which translated text is insertable in the displayed data that is being displayed and a screen position within the available area at which the translated text is insertable into the displayed data;

based on the instruction included in the reference patch, recognizing the original text;

receiving the translated text, the translated text being a translation of the original text;

generating an overlay positioned on top of the original layer, the overlay comprising an augmentation layer, the augmentation layer including the translated text, a position of the translated text on the augmentation layer determined, at least in part, by the reference patch; and

overlaying the overlay onto the displayed data of the original layer such that the translated text is viewable while the original text is obscured from view.

9. The method of claim 8 , wherein the overlay further comprises an overlay mask that includes non-transparent pixels, the overlay mask obscuring the original text from view and being in a different area of the augmentation layer than the translated text.

10. The method of claim 8 , further comprising, prior to overlaying the overlay:

determining a size of the translated text;

determining an obscuring of elements present in the displayed data which are different from the original text; and

adjusting the overlay such that the elements present in the displayed data which are different from the original text are not obscured.

11. The method of claim 8 , wherein the instruction in the reference patch includes an indication of a translation language target, which is an indication of a language in which the original text is to be translated into.

12. The method of claim 8 , wherein the

receiving of the translated text is from a translation apparatus.

13. The method of claim 8 , further comprising:

modifying the overlay to allow user interaction with an interactive element in the displayed data.

14. A non-transitory computer-readable storage medium for storing computer-readable instructions that, when executed by a computer, cause the computer to perform a method, the method comprising:

accessing a frame buffer of a graphics processing unit (GPU);

analyzing, in the frame buffer of the GPU, a frame representing a section of a stream of displayed data that is being displayed by a display device;

based on the analyzed frame, identifying a reference patch in the frame buffer that includes an instruction to identify an object comprising original text on an original layer, the reference patch identifying an available area in which translated text is insertable in the displayed data that is being displayed and a screen position within the available area at which the translated text is insertable into the displayed data;

based on the instruction included in the reference patch, recognizing the original text;

receiving the translated text, the translated text being a translation of the original text;

generating an overlay positioned on top of the original layer, the overlay comprising an augmentation layer, the augmentation layer including the translated text, a position of the translated text on the augmentation layer determined, at least in part, by the reference patch; and

overlaying the overlay onto the displayed data of the original layer such that the translated text is viewable while the original text is obscured from view.

15. The non-transitory computer-readable storage medium of claim 14 , wherein the overlay further comprises an overlay mask that includes non-transparent pixels, the overlay mask obscuring the original text from view and being in a different area of the augmentation layer than the translated text.

16. The non-transitory computer-readable storage medium of claim 14 , further comprising, prior to overlaying the overlay:

determining a size of the translated text;

determining an obscuring of elements present in the displayed data which are different from the original text; and

adjusting the overlay such that the elements present in the displayed data which are different from the original text are not obscured.

17. The non-transitory computer-readable storage medium of claim 14 , wherein the instruction included in the reference patch includes an indication of a translation language target, which is an indication of a language in which the original text is to be translated into.

18. The non-transitory computer-readable storage medium of claim 14 , wherein the

receiving of the translated text is from a translation apparatus.

19. The non-transitory computer-readable storage medium of claim 14 , further comprising:

modifying the overlay to allow user interaction with an interactive element in the displayed data.