IP Library Granted Patent US 10,885,689
Granted Patent B2
US 10,885,689 · App. 16/029,143 · Granted Jan 5, 2021

System and method for augmented reality overlay

Inventors: William Forrester Seely (Taylors, SC); Glen William Brooksby (Glenville, NY); Sandra Beverly Kolvick (Simpsonville, SC)
Assignee: General Electric Company
G06T11/60G06F40/169
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,885,689
App. No.
16/029,143
Granted
Jan 5, 2021
Kind
B2
Abstract

The present disclosure generally relates to a system that includes a processor configured to execute an augmented reality (AR) translator and visualizer system. The AR translator and visualizer system is configured to receive a language file that includes content, determine a background in the language file, remove the background, and retrieve the content from the language file. Moreover, the AR translator and visualizer system is configured to overlay the content onto a real world view via a display to form AR content that includes the content merged with the real world view. Furthermore the AR translator and visualizer system is configured to cause the system to display the real world view overlaid with the content via the display.

Claims (57)

1. A system, comprising a processor configured to execute an augmented reality (AR) translator and visualizer system, wherein the AR translator and visualizer system is configured to:

receive a language file comprising content;

determine a background in the language file;

remove the background;

retrieve the content from the language file;

overlay the content onto a real world view via a display to form AR content, wherein the AR content comprises the content merged with the real world view;

cause the system to display the real world view overlaid with the content via the display;

receive user input indicative of a request to enlarge, shrink, or move the content with respect to the real world view within the AR content after the AR content has been displayed; and

enlarge, shrink, or move the content with respect to the real world view based on the user input.

2. The system of claim 1 , wherein a language of the language file comprises a page description language.

3. The system of claim 2 , wherein the language file comprises a Portable Document Format (PDF) file.

4. The system of claim 1 , wherein the AR translator and visualizer system is configured to rotate the content, annotate the content, or a combination thereof within the AR content after the AR content has been displayed.

5. The system of claim 4 , wherein the AR translator and visualizer system is configured to rotate the content on the display or to add an annotation to the content based on a second user input received after the AR content has been displayed.

6. The system of claim 1 , wherein the AR translator and visualizer system is configured to reposition the content or change a size of the content based on a change to the real world view.

7. The system of claim 1 , wherein the content comprises text, at least one image, a set of objects representative of the real world, or a combination thereof.

8. The system of claim 7 , wherein the content comprises an engineering drawing.

9. A processor implemented method, comprising:

receiving a language file comprising content;

determining a background in the language file;

removing the background;

retrieving the content from the language file;

overlaying the content onto a real world view via a display to form augmented reality (AR) content, wherein the AR content comprises the content merged with the real world view;

displaying the AR content via the display;

receiving user input indicative of a request to enlarge, shrink, or move the content with respect to the real world view within the AR content after the AR content has been displayed; and

enlarging, shrinking, or moving the content with respect to the real world view based on the user input.

10. The method of claim 9 , wherein the background is defined as a layer within the language file or by one or more alpha channels within the language file.

11. The method of claim 9 , comprising capturing the real world view via a camera.

12. The method of claim 9 , comprising:

detecting via a camera or a sensor, a change in orientation associated with the real world view; and

modifying the content based on the change in orientation.

13. The method of claim 9 , wherein the content comprises at least one image, wherein the method comprises:

receiving a second user input to:

modify a thickness of one or more lines within the at least one image;

re-color the at least one image;

highlight a portion of the at least one image; or

a combination thereof; and

modifying the AR content based on the second user input.

14. A non-transitory, computer-readable medium, comprising processor-implementable instructions, wherein the instructions are configured to cause a processor to:

receive a language file comprising content;

determine a background associated with the content, wherein the background is defined as a layer within the language file or by one or more alpha channels within the language file;

remove the background;

retrieve the content;

receive a real world view;

overlay the content onto the real world view to form augmented reality (AR) content; and

display the AR content via a display operatively coupled to the processor.

15. The non-transitory, computer-readable medium of claim 14 , wherein the instructions are configured to retrieve the real world view from a camera of an electronic device that comprises the processor.

16. The non-transitory, computer-readable medium of claim 14 , wherein the instructions are configured to cause the processor to:

receive user input indicative of an annotation associated with the content; and

display the annotation in the AR content based on the user input.

17. The non-transitory, computer-readable medium of claim 16 , wherein the annotation comprises handwriting or a hand-drawn drawing.

18. The non-transitory, computer-readable medium of claim 14 , wherein the content comprises at least one image, wherein the instructions are configured to cause the processor to:

determine that a portion of the at least one image corresponds to a portion of the real world view; and

indicate, via the display, that the portion of the at least one image corresponds to the portion of the real world view.

19. The non-transitory, computer-readable medium of claim 14 , wherein the instructions are configured to cause the processor to:

receive user input indicative of a request to enlarge, shrink, or move the content after the AR content has been displayed; and

enlarge, shrink, or move the content based on the user input.

20. The non-transitory, computer-readable medium of claim 14 , wherein the instructions are configured to cause the processor to capture a screenshot of the AR content.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 17, 2023
From: GENERAL ELECTRIC COMPANY
To: GE INFRASTRUCTURE TECHNOLOGY LLC
Reel/Frame 065727/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 9, 2018
From: SEELY, WILLIAM FORRESTER; BROOKSBY, GLEN WILLIAM; KOLVICK, SANDRA BEVERLY
To: GENERAL ELECTRIC COMPANY
Reel/Frame 046292/0454 →
Continuity (1)
Related Publication 20200013206A1 · Jan 9, 2020