IP Library › Granted Patent US 12,547,428
Granted Patent B2
US 12,547,428 · App. 17/550,766 · Granted Feb 10, 2026

Page transition detection using screen operation history

Inventors: Takahide Nogayama (Kawasaki, JP); Akihiko Tozawa (Minato-ku, JP)
Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
G06F9/451G06V10/762G06F9/45512
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,547,428
App. No.
17/550,766
Granted
Feb 10, 2026
Kind
B2
Abstract

Automation methods and systems include identifying common parts of consecutive pairs of consecutive screen outputs. The consecutive screen outputs are clustered responsive to a determination that a distance between the common parts of the consecutive pairs is lower than a threshold distance value. Interactions with a remote computer system are automated based on the clustered consecutive screen outputs.

Claims (37)

1 . A computer-implemented automation method, comprising:

identifying first common parts of a first consecutive pair of consecutive screen outputs by comparing the first consecutive pair of consecutive screen outputs;

identifying second common parts of a second consecutive pair of consecutive screen outputs by comparing the second pair of consecutive screen outputs;

comparing the first common parts with the second common parts to determine a distance;

clustering the screen outputs of the first consecutive pair and the second consecutive pair together responsive to a determination that the distance is lower than a threshold distance value; and

automating interactions with a remote computer system by generating a script based on the clustered consecutive screen outputs and executing the script.

2 . The method of claim 1 , wherein the consecutive screen outputs include three consecutive screen outputs.

3 . The method of claim 2 , wherein clustering includes clustering together a first and second screen output of the three consecutive screen outputs.

4 . The method of claim 3 , wherein clustering further includes clustering a third screen output of the three consecutive screen outputs with the first and second screen output.

5 . The method of claim 1 , wherein identifying common parts includes generating a respective screen difference for each of the consecutive pairs that includes text that is common to the pair of consecutive screen outputs and replaces all other text of the pair of consecutive screen outputs with a special character.

6 . The method of claim 5 , further comprising determining the distance between the common parts of the consecutive pairs by comparing text of the corresponding screen differences other than the special character.

7 . The method of claim 1 , further comprising iterating the identifying and clustering based on new screen outputs in a plurality of consecutive screen outputs until all of the plurality of consecutive screen outputs have been processed.

8 . The method of claim 1 , further comprising generating the consecutive screen outputs by issuing commands to a remote computer system that generates outputs one full screen at a time.

9 . The method of claim 1 , further comprising recording the screen outputs from communications between a client and the remote computer system.

10 . The method of claim 1 , wherein the screen outputs are transmitted with the IBM® 3270 terminal protocol.

11 . A computer program product for automation, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions being executable by a hardware processor to cause the hardware processor to:

identify first common parts of a first consecutive pair of consecutive screen outputs by comparing the first consecutive pair of consecutive screen outputs;

identify second common parts of a second consecutive pair of consecutive screen outputs by comparing the second pair of consecutive screen outputs;

compare the first common parts with the second common parts to determine a distance;

cluster the screen outputs of the first consecutive pair and the second consecutive pair together responsive to a, determination that the distance is lower than a threshold distance value; and

automate interactions with a remote computer system by generating a script based on the clustered consecutive screen outputs and executing the script.

12 . The computer program product of claim 11 , wherein the consecutive screen outputs include three consecutive screen outputs.

13 . The computer program product of claim 12 , wherein the computer program further causes the hardware processor to cluster together a first and second screen output of the three consecutive screen outputs.

14 . The computer program product of claim 13 , wherein the computer program further causes the hardware processor to cluster a third screen output of the three consecutive screen outputs with the first and second screen output.

15 . The computer program product of claim 11 , wherein the computer program further causes the hardware processor to generate a respective screen difference for each of the consecutive pairs that includes text that is common to the pair of consecutive screen outputs and replaces all other text of the pair of consecutive screen outputs with a special character.

16 . The computer program product of claim 15 , wherein the computer program further causes the hardware processor to determine the distance between the common parts of the consecutive pairs by comparing text of the corresponding screen differences other than the special character.

17 . The computer program product of claim 11 , wherein the computer program further causes the hardware processor to iterate the identification and clustering based on new screen outputs in a plurality of consecutive screen outputs until all of the plurality of consecutive screen outputs have been processed.

18 . The computer program product of claim 11 , wherein the computer program further causes the hardware processor to generate the consecutive screen outputs by issuing commands to a remote computer system that generates outputs one full screen at a time.

19 . The computer program product of claim 11 , wherein the computer program further causes the hardware processor to record the screen outputs from communications between a client and the remote computer system.

20 . An automation system, comprising:

a hardware processor; and

a memory that stores a computer program, which, when executed by the hardware processor, causes the hardware processor to:

identify first common parts of a first consecutive pair of consecutive screen outputs by comparing the first consecutive pair of consecutive screen outputs;

identify second common parts of a second consecutive pair of consecutive screen outputs by comparing the second pair of consecutive screen outputs;

compare the first common parts with the second common parts to determine a distance;

cluster the screen outputs of the first consecutive pair and the second consecutive pair together responsive to a determination that the distance is lower than a threshold distance value; and

automate interactions with a remote computer system by generating a script based on the clustered consecutive screen outputs and executing the script.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 14, 2021
From: NOGAYAMA, TAKAHIDE; TOZAWA, AKIHIKO
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 058388/0982 →
Continuity (1)
Related Publication 20230185582A1 · Jun 15, 2023
References Cited (14)
US 5996011A · Humes · 1999 [cited by examiner]
US 6836780B1 · Opitz · 2004 [cited by examiner]
US 8868993B1 · Yu et al. · 2014 [cited by applicant]
US 9311425B2 · Mahan et al. · 2016 [cited by applicant]
US 9767213B2 · Jeong · 2017 [cited by applicant]
US 10108695B1 · Yeturu et al. · 2018 [cited by applicant]
US 20070065040A1 · Ming · 2007 [cited by examiner]
US 20140111522A1 · Refstrup et al. · 2014 [cited by applicant]
CN 102693304A · 2012 [cited by applicant]
JP 2016038693A · 2016 [cited by applicant]
WO WO2017123203A1 · 2017 [cited by examiner]
WO 2023109359A1 · 2023 [cited by applicant]
Countwordsfree, Compare Text Online, Oct. 31, 2020, CountwordsFree from Internet Archive Wayback Machine (Year: 2020). [cited by examiner]
International Search Report issued in corresponding PCT Application Serial No. PCT/CN2022/130272 dated Jan. 20, 2023, 4 pgs. [cited by applicant]