IP Library › Granted Patent US 10,748,003
Granted Patent B2
US 10,748,003 · App. 16/130,127 · Granted Aug 18, 2020

Mitigation of augmented reality markup blindness

Inventors: Paul R. Bastide (Boxford, MA); Liam S. Harpur (Dublin, IE); Matthew E. Broomhall (Goffstown, NH); Lin Sun (Cary, NC)
Assignee: International Business Machines Corporation
G06K9/00671G06T5/002G06T7/70G06T13/20G06T19/006H04N21/812
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,748,003
App. No.
16/130,127
Granted
Aug 18, 2020
Kind
B2
Abstract

Embodiments of the present invention disclose a method, computer program product, and system for avoiding augmented reality blindness during an augmented reality session via an augmented reality device used by a user. In the method, computer program product, and system a set of visual representations within the augmented reality session is detected. A set of labeling objects is applied to the set of visual representations within the augmented reality session. A subset of labeling objects and associated visual representation within a display view of the augmented reality device are recorded in a history table. A blindness quotient based on the history table of recorded labeled objects and associated visual representation is calculated. In response to the calculated blindness quotient exceeding a threshold, the set of labeling objects within the display view of the augmented reality device are modified.

Claims (79)

1. A method for avoiding augmented reality blindness during an augmented reality session via an augmented reality device used by a user, the method comprising:

detecting a set of visual representations within the augmented reality session;

applying a set of labeling objects to the set of visual representations within the augmented reality session;

recording a subset of labeling objects and associated visual representation within a display view of the augmented reality device in a history table;

calculating a blindness quotient based on the history table of recorded labeled objects and associated visual representation; and

in response to the calculated blindness quotient exceeding a threshold, modifying the set of labeling objects within the display view of the augmented reality device, wherein modifying the labeling objects within the display view of the augmented reality device comprises:

modifying a shape of the labeling object;

animating the labeling object;

overlaying the labeling object with its inverse;

blurring an area around the labeling object, wherein a first size of the blurred area is below a threshold; and

blooming the area around the labeling object, wherein a second size of the bloomed area is below a threshold.

2. The method of claim 1 , further comprising:

calculating a modified blindness quotient based on the modified set of labeling objects within the display view of the augmented reality device; and

in response to determining the modified blindness quotient value is less than the calculated blindness quotient, displaying the modified labeling objects within the display view of the augmented reality device.

3. The method of claim 1 , wherein the labeling objects within the display view further comprises metadata, wherein the labeling objects metadata includes one or more of:

geographic location data;

computer vision object recognition data; and

user visual tags.

4. The method of claim 1 , wherein detecting the set of visual representations within the augmented reality session further comprises:

recording a set of position data within a view associated with the visual representation;

generating a labeling object frame associated with the visual representation; and

in response to datamining textual data associated with the visual representation, generating textual image details for display associated with the visual representation.

5. The method of claim 1 , wherein recording a subset of labeling objects and associated visual representation within the display view of the augmented reality device in the history table further comprises:

storing an identification associated with each of the labeling object; and

determining an occurrence count associated with each of the labeling object.

6. A computer program product for avoiding augmented reality blindness during an augmented reality session via an augmented reality device used by a user, the computer program product comprising:

one or more computer-readable storage media and program instructions stored on the one or more computer-readable storage media, the program instructions comprising:

instructions to detect a set of visual representations within the augmented reality session;

instructions to apply a set of labeling objects to the set of visual representations within the augmented reality session;

instructions to record a subset of labeling objects and associated visual representation within a display view of the augmented reality device in a history table;

instructions to calculate a blindness quotient based on the history table of recorded labeled objects and associated visual representation; and

in response to the calculated blindness quotient exceeding a threshold, instructions to modify the set of labeling objects within the display view of the augmented reality device, wherein instructions to modify the labeling objects within the display view of the augmented reality device comprises:

instructions to modify a shape of the labeling object;

instructions to animate the labeling object;

instructions to overlay the labeling object with its inverse;

instructions to blur an area around the labeling object, wherein a first size of the blurred area is below a threshold; and

instructions to bloom the area around the labeling object, wherein a second size of the bloomed area is below a threshold.

7. The computer program product of claim 6 , further comprising:

instructions to calculate a modified blindness quotient based on the modified set of labeling objects within the display view of the augmented reality device; and

in response to instructions to determine the modified blindness quotient value is less than the calculated blindness quotient, instructions to display the modified labeling objects within the display view of the augmented reality device.

8. The computer program product of claim 6 , wherein the labeling objects within the display view further comprises metadata, wherein the labeling objects metadata includes one or more of:

geographic location data;

computer vision object recognition data; and

user visual tags.

9. The computer program product of claim 6 , wherein instructions to detect the set of visual representations within the augmented reality session further comprises:

instructions to record a set of position data within a view associated with the visual representation;

instructions to generate a labeling object frame associated with the visual representation; and

in response to instructions to datamine textual data associated with the visual representation, instructions to generate textual image details for display associated with the visual representation.

10. The computer program product of claim 6 , wherein instructions to record a subset of labeling objects and associated visual representation within the display view of the augmented reality device in the history table further comprises:

instructions to store an identification associated with each of the labeling object; and

instructions to determine an occurrence count associated with each of the labeling object.

11. A computer system for avoiding augmented reality blindness during an augmented reality session via an augmented reality device used by a user, the computer system comprising:

one or more computer processors;

one or more computer-readable storage media;

program instructions stored on the computer-readable storage media for execution by at least one of the one or more processors, the program instructions comprising:

instructions to detect a set of visual representations within the augmented reality session;

instructions to apply a set of labeling objects to the set of visual representations within the augmented reality session;

instructions to record a subset of labeling objects and associated visual representation within a display view of the augmented reality device in a history table;

instructions to calculate a blindness quotient based on the history table of recorded labeled objects and associated visual representation; and

in response to the calculated blindness quotient exceeding a threshold, instructions to modify the set of labeling objects within the display view of the augmented reality device, wherein instructions to modify the labeling objects within the display view of the augmented reality device further comprises:

instructions to modify a shape of the labeling object;

instructions to animate the labeling object;

instructions to overlay the labeling object with its inverse;

instructions to blur an area around the labeling object, wherein a first size of the blurred area is below a threshold; and

instructions to bloom the area around the labeling object, wherein a second size of the bloomed area is below a threshold.

12. The computer system of claim 11 , further comprising:

instructions to calculate a modified blindness quotient based on the modified set of labeling objects within the display view of the augmented reality device; and

in response to instructions to determine the modified blindness quotient value is less than the calculated blindness quotient, instructions to display the modified labeling objects within the display view of the augmented reality device.

13. The computer system of claim 11 , wherein the labeling objects within the display view further comprises metadata, wherein the labeling objects metadata includes one or more of:

geographic location data;

computer vision object recognition data; and

user visual tags.

14. The computer system of claim 11 , wherein instructions to detect the set of visual representations within the augmented reality session further comprises:

instructions to record a set of position data within a view associated with the visual representation;

instructions to generate a labeling object frame associated with the visual representation; and

in response to instructions to datamine textual data associated with the visual representation, instructions to generate textual image details for display associated with the visual representation.

15. The computer system of claim 11 , wherein instructions to record a subset of labeling objects and associated visual representation within the display view of the augmented reality device in the history table further comprises:

instructions to store an identification associated with each of the labeling object; and

instructions to determine an occurrence count associated with each of the labeling object.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 13, 2018
From: BASTIDE, PAUL R.; HARPUR, LIAM S.; BROOMHALL, MATTHEW E.; SUN, LIN
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 046866/0001 →
Continuity (1)
Related Publication 20200089952A1 · Mar 19, 2020
Cited By (2)
US 12,314,626 US 12,463,859