IP Library Granted Patent US 10,691,429
Granted Patent B2
US 10,691,429 · App. 15/646,597 · Granted Jun 23, 2020

Converting whiteboard images to personalized wireframes

Inventors: Vijay Kumar Ananthapur Bache (Bangalore, IN); Jhilam Bera (Bangalore, IN); Vijay Ekambaram (Chennai, IN); Saravanan Sadacharam (Chennai, IN)
Assignee: International Business Machines Corporation
G06F8/38G06F8/34G06K9/00422
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,691,429
App. No.
15/646,597
Granted
Jun 23, 2020
Kind
B2
Abstract

A method for creating a wireframe model for a user interface. A computer identifies an image on a user interface. The computer performs image recognition to identify objects and text within the image. The computer creates a digital widget model based on the step of performing image recognition. The computer delivers digital widget output to a user experience designer for editing, wherein the digital widget output is based on the step of creating. The computer stores edits made by the user experience designer in a historical records database and the wireframe model design is finalized.

Claims (48)

1. A method for creating a wireframe model for a user interface, comprising:

identifying, by a computer, an image created on a user interface;

capturing said image from a sketch created on a whiteboard;

performing, by the computer, image recognition to identify objects and text within said image;

creating, by the computer, a storyboard based on said step of performing image recognition, wherein said storyboard is converted into a digital widget model;

calibrating, by the computer, said digital widget model by comparing said digital widget model with a guideline, rejecting at least one feature of the digital widget model based on the guideline, and replacing the rejected feature with an available acceptable feature based on the guideline;

delivering, by the computer, a digital widget output to a user experience designer for editing, said digital widget output based on said steps of creating and calibrating;

storing, by the computer, edits made by said user experience designer in an historical record database, wherein said historical record database includes at least one previous edit made by said user experience designer to a previous digital widget output;

wherein said calibrating said digital widget model further includes comparing, by the computer, said digital widget model to said historical record database, and applying the at least one previous edit to said digital widget model; and

finalizing a final wireframe model design.

2. The method of claim 1 , wherein said guideline is a HMi guideline.

3. The method of claim 1 , wherein said guideline is specific to an industry for which said user interface is designed.

4. The method of claim 3 , further comprising: replacing said rejected feature with an available acceptable feature stored in said historical record database.

5. The method of claim 1 , wherein said identifying an image comprises receiving an image from at least one image of a photo image and a digital image and identifying controls and metadata that is defined for said controls.

6. The method of claim 1 , wherein said creating said digital widgets comprises accessing said historical record database to denote at least one digital widget.

7. The method of claim 1 , further comprising: analyzing said changes made by said user experience designer for use by a cognitive generator during said step of determining said digital widgets.

8. A computer program product comprising:

a non-transitory computer-readable storage device; and

a computer-readable program code stored in the computer-readable storage device, the computer readable program code containing instructions executable by a processor of a computer system to implement a method for creating a wireframe model for a user interface, the method comprising:

identifying an image created on a user interface;

capturing said image from a sketch created on a whiteboard;

performing image recognition to identify objects and text within said image;

creating a storyboard based on said step of performing image recognition, wherein said storyboard is converted into a digital widget model;

calibrating said digital widget model by comparing said digital widget model with a guideline, rejecting at least one feature of the digital widget model based on the guideline, and replacing the rejected feature with an available acceptable feature based on the guideline;

delivering a digital widget output to a user experience designer for editing, said digital widget output based on said steps of creating and calibrating;

storing edits made by said user experience designer in an historical record database, wherein said historical record database includes at least one previous edit made by said user experience designer to a previous digital widget output;

wherein said calibrating said digital widget model further includes comparing said digital widget model to said historical record database, and applying the at least one previous edit to said digital widget model; and

finalizing a final wireframe model design.

9. The computer program product of claim 8 , wherein said guideline is a HMI guideline.

10. The computer program product of claim 8 , wherein said guideline is specific to an industry for which said user interface is designed.

11. The computer program product of claim 10 , said method further comprising: replacing said rejected feature with an available acceptable feature in said historical record database.

12. The computer program product of claim 8 , wherein said identifying an image comprises receiving an image from at least one image of a photo image and a digital image and identifying controls and metadata that is defined for said controls.

13. A computer system, comprising:

a processor;

a memory coupled to said processor; and

a computer readable storage device coupled to the processor, the storage device containing instructions executable by the processor via the memory to implement a method for creating a wireframe model for a user interface, the method comprising the steps of:

identifying an image created on a user interface;

capturing said image from a sketch created on a whiteboard;

performing image recognition to identify objects and text within said image;

creating a storyboard based on said step of performing image recognition, wherein said storyboard is converted into a digital widget model;

calibrating said digital widget model by comparing said digital widget model with a guideline, rejecting at least one feature of the digital widget model based on the guideline, and replacing the rejected feature with an available acceptable feature based on the guideline;

delivering a digital widget output to a user experience designer for editing, said digital widget output based on said steps of creating and calibrating;

storing changes made by said user experience designer in an historical record database, wherein said historical record database includes at least one previous change made by said user experience designer to a previous digital widget output;

wherein said calibrating said digital widget model further includes comparing; said digital widget model to said historical record database, and applying the at least one previous change to said digital widget model; and

finalizing a final wireframe model design.

14. The computer system of claim 13 , wherein said guideline is a HMI guideline.

15. The computer system of claim 13 , wherein said guideline is specific to an industry for which said user interface is designed.

16. The computer system of claim 15 , said method further comprising: replacing said rejected feature with an available acceptable feature stored in said historical record database.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 11, 2017
From: ANANTHAPUR BACHE, VIJAY KUMAR; BERA, JHILAM; EKAMBARAM, VIJAY; SADACHARAM, SARAVANAN
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 042975/0886 →
Cited By (1)
US 12,450,802