IP Library Granted Patent US 11,880,944
Granted Patent B2
US 11,880,944 · App. 16/883,448 · Granted Jan 23, 2024

Method and apparatus for displaying information

Inventors: Tigran Andjelic (Baden, CH); Oliver Sims (Baden, CH)
Assignee: General Electric Technologies GmBH
G06T19/006G02B27/0075G06T7/55
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,880,944
App. No.
16/883,448
Granted
Jan 23, 2024
Kind
B2
Abstract

A method and apparatus for displaying information. The method comprises: determining a field of view of a user viewing an environment via a display of a display device; using the field of view, determining a focal region of interest of the user in the environment; providing a database comprising a list of objects and, for each object, a location of that object in the environment; using the list of objects and a location of the focal region in the environment, identifying one or more of the objects that are at least partially located in the environment in or proximate to the focal region; acquiring information related to the identified one or more objects; generating an image element comprising the acquired information; and displaying the generated image element on the display of the display device through which the user is viewing the environment.

Claims (39)

1. A method for displaying information, the method comprising:

determining a field of view of a user viewing an environment via a display of a display device;

determining a focal region of interest of the user in the field of view;

providing a database comprising a list of objects and, for each object, a location of that object in the environment;

specifying a task to be performed by the user, the task specifying one or more objects in the environment;

using the list of objects and a location of the focal region of interest in the environment, identifying at least one of the objects specified by the task that are at least partially located in the environment in or proximate to the focal region of interest;

acquiring information related to the identified one or more objects, wherein the acquired information for the one or more objects specified in the task is dependent on the task;

generating an image element comprising the acquired information; and

displaying the generated image element on the display of the display device through which the user is viewing the environment.

2. The method of claim 1 , wherein determining the field of view and determining the focal region is performed by the display device.

3. The method of claim 1 , wherein providing the database, identifying the one or more of the objects, acquiring the information, and generating the image element is performed by one or more computing devices remote from the display device.

4. The method of claim 3 , further comprising sending the generated image element from the one or more computing devices to the display device.

5. The method of claim 1 , wherein:

the database further comprises, for each object, additional information relating to that object; and

acquiring the information comprises retrieving the information related to the identified one or more objects from the database.

6. The method of claim 1 , further comprising:

determining a distance in the environment between the user or the display device and the identified one or more objects; wherein

the acquired information is dependent on the determined distance.

7. The method of claim 6 , wherein:

if the determined distance is less than or equal to a threshold distance, a relatively large amount of information is included in the image element; and

if the determined distance is more than the threshold distance, a relatively small amount of information included in the image element.

8. The method of claim 1 , wherein

identifying the one or more of the objects comprises identifying one or more of the objects that are located in the environment in or proximate to the focal region and that are specified in the task.

9. The method of claim 1 , wherein the environment is a real-world environment and the objects are physical objects located in the environment.

10. The method of claim 1 , wherein the environment is a virtual or digital environment and the objects are virtual or digital objects.

11. The method of claim 1 , wherein the display device is a device selected from the group of devices consisting of: a tablet computer, a smartphone, smartglasses, a see-through display device, a heads-up display, and a virtual reality headset.

12. A system comprising:

one or more processors; and

a display device comprising a display, the display device operatively coupled to the one or more processors; wherein the one or more processors are configured to:

determine a field of view of a user viewing an environment via the display of the display device;

determine a focal region of interest of the user in the field of view;

provide a database comprising a list of objects and, for each object, a location of that object in the environment;

specify a task to be performed by the user, the task specifying one or more objects in the environment;

using the list of objects and a location of the focal region of interest in the environment, identify at least one of the objects specified by the task that are located in the environment in or proximate to the focal region of interest;

acquire information related to the identified one or more objects, wherein the acquired information for the one or more objects specified in the task is dependent on the task;

generate an image element comprising the acquired information; and

control the display to display the generated image element.

13. A program or plurality of programs arranged such that when executed by a computer system or one or more processors it/they cause the computer system or the one or more processors to operate in accordance with the method of claim 1 .

14. A machine-readable storage medium storing a program or at least one of the plurality of programs according to claim 13 .

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 1, 2020
From: ANDJELIC, TIGRAN; SIMS, OLIVER
To: GENERAL ELECTRIC TECHNOLOGIES GMBH
Reel/Frame 053657/0403 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 28, 2020
From: ANDJELIC, TIGRAN; SIMS, OLIVER
To: GENERAL ELECTRIC TECHNOLOGIES GMBH
Reel/Frame 053629/0190 →
Priority Claims (1)
EP 19176536 · May 24, 2019 · regional
Continuity (1)
Related Publication 20200372719A1 · Nov 26, 2020