IP Library Granted Patent US 11,966,758
Granted Patent B2
US 11,966,758 · App. 17/338,889 · Granted Apr 23, 2024

Method and system for accessing table content in a digital image of the table

Inventors: Alexander Vaindiner (Or-Akiva, IL); Vitaly Shelest (Holon, IL); Semyon Kleinerman (Netania, IL)
Assignee: Nice Ltd.
G06F9/451G06F8/10G06F8/38G06T5/003G06T5/20G06T7/13
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,966,758
App. No.
17/338,889
Granted
Apr 23, 2024
Kind
B2
Abstract

A system and method for accessing elements of a table in a digital image of the table, including: obtaining the digital image of the table; finding table elements in the digital image based on digital table properties, wherein the table elements define table cells; calculating coordinates of the table cells in the digital image based on the table elements; and accessing content of a selected table cell in the digital image using the coordinates of the selected table element.

Claims (34)

1. A method for enabling graphic-based interoperability with a computer executed application, the method comprising, on a computer system operating as a client and displaying a graphical user interface (GUI) generated by a third-party application, the GUI comprising control graphic items:

examining, using a computer processor executing a software program, changes in a captured screen image of the GUI, and based on the examination correspondingly taking an action, the action selected from:

updating properties of an object construct corresponding to the captured screen image; and

raising a software event corresponding to an object construct corresponding to a control graphic item.

2. The method as in claim 1 , wherein the event communicates information to the third-party application.

3. The method as in claim 1 , wherein the properties are object-oriented properties.

4. The method as in claim 1 , wherein the event comprises a function which sends a message to a listener or an event handler.

5. The method as in claim 1 , comprising examining the captured screen image upon an occurrence of the end of a time period, a detection of keyboard input, a detection of mouse input, or an indication that the GUI has changed.

6. The method as in claim 1 , wherein the control graphic item comprises one of a button, a link, a list box, a check box, a table, a drop-list, a combination box, a tab, and a slider.

7. The method as in claim 1 , comprising examining the captured screen image of the GUI to identify within the GUI a control graphic item.

8. The method of claim 1 , wherein the third-party application comprises server software modules executed on a computer remote from the computer system.

9. The method of claim 1 , wherein raising an event comprises determining that a state of the control graphic item has changed and notifying a process of the change.

10. A system for enabling graphic-based interoperability with a computer executed application, the system comprising:

a computer system operating as a client comprising a memory and a processor, the processor configured to:

display a graphical user interface (GUI) generated by a third-party application;

examine, by executing a software program, a captured screen image of the GUI to determine if there has been a change in the GUI, and based on the examination correspondingly take an action, the action selected from:

updating properties of an object construct corresponding to the captured screen image; and

raising a software event corresponding to an object construct corresponding to the captured screen image.

11. The system as in claim 10 , wherein the event communicates information to the third-party application.

12. The system as in claim 10 , wherein the properties are object-oriented properties.

13. The system as in claim 10 , wherein the event comprises a function which sends a message to a listener or an event handler.

14. The system as in claim 10 , the processor configured to execute the computer executed application and a second program on the computer system, the second program to perform the examining.

15. The system of claim 10 , wherein raising an event comprises determining that a state of the captured screen image has changed and notifying a process of the change.

16. A method for communication between a first executing software program and a second executing software program, the method comprising, using one or more computer processors:

the first executing software program executed by at least one of the one or more computer processors and obtaining a captured screen image generated by a third-party application executed by at least one of the one or more computer processors and displayed by the second executing software program;

the first executing software program determining if there has been a change in the obtained captured screen image; and

if there has been a change then performing one of:

notifying via a software message the third-party application of the change;

updating properties of an object construct corresponding to an item in image; and

raising a software event corresponding to an object corresponding to an item in the image.

17. The method as in claim 16 , comprising determining if there has been a change upon an occurrence of the end of a time period, a detection of keyboard input, a detection of mouse input, or an indication that the GUI has changed.

18. The method as in claim 16 , comprising simulating a functionality of a graphical control in the captured screen image based on the type of the graphical control.

19. The method as in claim 16 , comprising examining the obtained graphical image to identify within the obtained captured screen image a graphical control.

20. The method of claim 16 , comprising executing the first executing software program and the second executing software program on the same computer.

Assignments (2)
SECURITY INTEREST Recorded Feb 26, 2026
From: NICE LTD; NICE SYSTEMS INC.; NICE SYSTEMS TECHNOLOGIES INC.; INCONTACT, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 074986/0208 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 12, 2022
From: VAINDINER, ALEXANDER; SHELEST, VITALY; KLEINERMAN, SEMYON
To: NICE LTD.
Reel/Frame 059988/0633 →
Cited By (1)
US 12,555,396