IP Library Granted Patent US 10,176,396
Granted Patent B2
US 10,176,396 · App. 14/896,701 · Granted Jan 8, 2019

Systems and methods for computing and presenting results of visual attention modeling

Inventors: William K. Smyth (Stillwater, MN); Richard J. Moore (Maplewood, MN); Benjamin D. Zimmer (Maplewood, MN); Brian J. Stankiewicz (Mahtomedi, MN)
Assignee: 3M INNOVATIVE PROPERTIES COMPANY
G06K9/4652G06K9/3233G06K9/52G06T7/90G06K2009/4666
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,176,396
App. No.
14/896,701
Granted
Jan 8, 2019
Kind
B2
Abstract

At least some embodiments of the present disclosure feature systems and methods for assessing the impact of visual features within a region of a scene. With the input of a visual representation of a scene and at least one selected region within the scene, the system applies a visual attention model to the visual representation to determine visual conspicuity of the at least one selected region. The system computes feature-related data associated with a plurality of features of the at least one selected region. Based on the visual conspicuity and the feature-related data, the system assesses an impact that at least one of the features within the at least one selected region have on the visual conspicuity.

Claims (34)

1. A method for assessing the impact of visual features within a region of a scene with a computer having a processor and memory, comprising:

receiving a visual representation of a scene;

receiving region selection data indicative of at least one selected region within the scene;

applying, using the processor, a visual attention model to the visual representation to determine visual conspicuity of the at least one selected region;

computing, using the processor, feature-related data associated with a plurality of visual features associated with the at least one selected region, wherein a feature comprises at least one of color, edges, luminance, faces, intensity, font, orientation, motion, contrast, text, spatial frequency, shape and size;

based on the visual conspicuity and the feature-related data, determining a feature impact score that at least one of the visual features within the at least one selected region have on the visual conspicuity.

2. The method of claim 1 , further comprising:

rendering, by the processor, a visual indicia indicative of the feature impact score.

3. The method of claim 2 , wherein the visual indicia comprises at least one of a color, a number, and a letter.

4. The method of claim 2 , further comprising:

creating, by the processor, a report containing the visual indicia.

5. The method of claim 1 , wherein the contrast is red-green contrast or blue-yellow contrast.

6. The method of claim 1 , wherein the region selection data is based upon a user input.

7. The method of claim 1 , wherein the region selection data is based upon an algorithmic selection by the computer.

8. The method of claim 1 , wherein the visual representation comprises an image, a video, metadata of an image, or metadata of a video.

9. The method of claim 1 , wherein the feature impact score is represented by a numeric value.

10. The method of claim 1 , wherein the feature impact score is represented by a percentage.

11. The method of claim 1 , wherein the visual conspicuity is represented by a numeric value, an image, a percentage, or a combination thereof.

12. A system for presenting visual attention model (VAM) results comprising:

an input module configured to receive a visual representation of a scene and region selection data indicative of a selected region within the scene,

a VAM module configured to apply a visual attention model on the visual representation to determine visual conspicuity of the selected region, the VAM module further configured to compute feature-related data associated with a visual feature of the selected region, wherein a feature comprises at least one of color, edges, luminance, faces, intensity, font, orientation, motion, contrast, text, spatial frequency, shape and size; and

an output module configured to determine a contribution of the visual feature to the visual conspicuity of the selected region based on the visual conspicuity and the feature-related data.

13. The system of claim 12 , further comprising:

a presentation module configured to generate a visual indicia indicative the contribution of the visual feature.

14. The system of claim 13 , wherein the visual indicia comprises at least one of a color, a number, and a letter.

15. The system of claim 13 , further comprising:

creating, by a processing unit, a report containing the visual indicia.

16. The system of claim 12 , wherein the contrast is red-green contrast or blue-yellow contrast.

17. The system of claim 12 , wherein the region selection data is based upon a user input.

18. The system of claim 12 , wherein the region selection data is based upon an algorithmic selection by a computing device.

19. The system of claim 12 , wherein the visual representation comprises an image, a video, metadata of an image, or metadata of a video.

20. The system of claim 12 , wherein the contribution of the visual feature is represented by a numeric value.

21. The system of claim 12 , wherein the contribution of the visual feature is represented by a percentage.

22. The system of claim 12 , wherein the visual conspicuity is represented by a numeric value, an image, a percentage, or a combination thereof.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 8, 2015
From: SMYTH, WILLIAM K.; MOORE, RICHARD J.; ZIMMER, BENJAMIN D.; STANKIEWICZ, BRIAN J.
To: 3M INNOVATIVE PROPERTIES COMPANY
Reel/Frame 037233/0106 →
Continuity (2)
Provisional Application 61834271 · Jun 12, 2013
Related Publication 20160132749A1 · May 12, 2016
Cited By (3)
US 12,293,294 US 12,505,470 US 12,675,902