IP Library Granted Patent US 10,996,924
Granted Patent B2
US 10,996,924 · App. 16/368,730 · Granted May 4, 2021

Drawing attention to a graphical element on a display

Inventors: John Weldon Nicholson (Cary, NC); Daryl Cromer (Raleigh, NC); Howard Locker (Cary, NC)
Assignee: Lenovo (Singapore) PTE. LTD.
G06F3/167G06F3/013G06F3/04845G06F3/1446G06F2203/04801G09G2354/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,996,924
App. No.
16/368,730
Granted
May 4, 2021
Kind
B2
Abstract

Apparatuses, methods, systems, and program products are disclosed for drawing attention to a graphical element on a display. An apparatus includes a display, a processor, and a memory that stores code executable by the processor. The memory stores code executable by the processor to detect a voice cue. The voice cue may include a predefined command associated with drawing a user's attention to a graphical element that is presented on the display. The memory stores code executable by the processor to determine a location of the graphical element that is presented on the display in response to the voice cue. The memory stores code executable by the processor to draw the user's attention to the graphical element on the display in response to determining the location of the graphical element on the display.

Claims (35)

1. An apparatus comprising:

a display;

a sound capture device;

a speaker;

a camera;

a processor; and

a memory that stores code executable by the processor to:

detect a voice cue using the sound capture device, the voice cue comprising a predefined command associated with drawing a user's attention to a graphical element that is presented on the display;

determine a location of the graphical element that is presented on the display in response to the voice cue; and

draw the user's attention to the graphical element on the display in response to determining the location of the graphical element on the display by providing a verbal indicator, via the speaker, of where the graphical element is located on the display, the verbal indicator comprising a direction to the location of the graphical element on the display relative to where the user is looking based on eye tracking information captured using the camera.

2. The apparatus of claim 1 , wherein the code is further executable by the processor to reset the brightness of the darkened region of the display in response to the graphical element being moved.

3. The apparatus of claim 1 , wherein the verbal indicator comprises a direction to the location of the graphical element on the display further relative to the user's position.

4. The apparatus of claim 1 , wherein the code is executable by the processor to draw the user's attention to the location of the graphical element on the display by presenting an indicator on the display that points to the location of the graphical element on the display.

5. The apparatus of claim 4 , wherein the code is executable by the processor to present the indicator on the display at a location where the user is currently looking.

6. The apparatus of claim 1 , wherein the code is further executable by the processor to draw the user's attention to the graphical element by moving the graphical element to a location where the user is looking at the display in response to the voice cue, the voice cue comprising a specific command to move the graphical element to the location on the display where the user is looking.

7. The apparatus of claim 1 , wherein the display is one of a plurality of displays that are operably interconnected such that the graphical element is moveable between each of the plurality of displays.

8. The apparatus of claim 7 , wherein each of the plurality of displays comprises a virtual display that is presented within one or more of a virtual reality environment and an augmented reality environment.

9. The apparatus of claim 3 , wherein the direction comprises a direction relative to the user's physical position within a three-dimensional virtual environment.

10. The apparatus of claim 9 , wherein the direction includes an identifier for a virtual display that the graphical element is presented on within the three-dimensional virtual environment.

11. The apparatus of claim 1 , wherein the code is further executable by the processor to change one or more properties of the graphical element in response to the voice cue, the one or more properties comprising a color of the graphical element, a blinking rate of the graphical element, and a movement of the graphical element.

12. The apparatus of claim 7 , wherein the indicator comprises one of multiple graphical arrows that are presented at different position on the display and that each point to the location where the graphical element is located, the graphical arrows moving around the display based on where the user's eye gaze is detected.

13. A method comprising:

detecting, by a processor and a sound capture device, a voice cue, the voice cue comprising a predefined command associated with drawing a user's attention to a graphical element that is presented on a display;

determining a location of the graphical element that is presented on the display in response to the voice cue; and

drawing the user's attention to the graphical element on the display in response to determining the location of the graphical element on the display by providing a verbal indicator, via a speaker, of where the graphical element is located on the display, the verbal indicator comprising a direction to the location of the graphical element on the display relative to where the user is looking based on eye tracking information captured using a camera.

14. The method of claim 13 , further comprising resetting the brightness of the darkened region of the display in response to the graphical element being moved.

15. The method of claim 13 , wherein drawing the user's attention to the location of the graphical element on the display comprises providing a verbal indicator of where the graphical element is located on the display, the verbal indicator comprising a direction to the location of the graphical element on the display relative to one or more of the user's position and where the user is looking.

16. The method of claim 13 , wherein drawing the user's attention to the location of the graphical element on the display comprises presenting an indicator on the display that points to the location of the graphical element on the display, the indicator presented on the display at a location where the user is currently looking.

17. The method of claim 13 , wherein drawing the user's attention to the graphical element comprises moving the graphical element to a location where the user is looking at the display in response to the voice cue, the voice cue comprising a specific command to move the graphical element to the location on the display where the user is looking.

18. The method of claim 13 , wherein the display is one of a plurality of virtual displays, each of the plurality of virtual displays presented within one or more of a virtual reality environment and an augmented reality environment.

19. A program product comprising a non-transitory computer readable storage medium that stores code executable by a processor, the executable code comprising code to perform:

detecting a voice cue using a sound capture device, the voice cue comprising a predefined command associated with drawing a user's attention to a graphical element that is presented on a display;

determining a location of the graphical element that is presented on the display in response to the voice cue;

drawing the user's attention to the graphical element on the display in response to determining the location of the graphical element on the display by gradually darkening a brightness of the display except for a region of the display where the graphical element is located and by providing a verbal indicator, via a speaker, of where the graphical element is located on the display, the verbal indicator comprising a direction to the location of the graphical element on the display relative to where the user is looking based on eye tracking information captured using the camera; and

resetting the brightness of the darkened region of the display in response to the user looking at the graphical element.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 10, 2025
From: LENOVO PC INTERNATIONAL LIMITED
To: LENOVO SWITZERLAND INTERNATIONAL GMBH
Reel/Frame 069870/0670 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 13, 2022
From: LENOVO (SINGAPORE) PTE LTD
To: LENOVO PC INTERNATIONAL LIMITED
Reel/Frame 060638/0160 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 29, 2019
From: NICHOLSON, JOHN WELDON; CROMER, DARYL; LOCKER, HOWARD
To: LENOVO (SINGAPORE) PTE. LTD.
Reel/Frame 048746/0233 →