IP Library Granted Patent US 12693764
Granted Patent B2
US 12693764 · App. 19/279,198 · Granted Jul 28, 2026

Systems and methods for automated interaction with a touch-screen device

Inventors: Eric Parker (Brooklyn, NY); Peter J. Sullivan (Santa Barbara, CA); Elias Bachaalany (Jbeil, LB); Imad Maalouf (Beirut, LB); James Mansour (Austin, TX); Redza Shah (Austin, TX)
Assignee: Jackpocket LLC
G06F3/0421
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12693764
App. No.
19/279,198
Granted
Jul 28, 2026
Kind
B2
Abstract

Systems and methods for automated interaction with a touch-screen device are described. A system for automated interaction with a touch-screen device may include at least one optical sensor configured to sense at least a first portion of a touch-screen of the touch-screen device; at least one solenoid including an end effector that is tactilely detectable by the touch-screen, wherein operation of the at least one solenoid causes the end effector to tactilely engage with a second portion of the touch-screen; and a controller that is operatively connected to the at least one optical sensor and the at least one solenoid, and that is configured to operate the at least one solenoid in response to detecting a predetermined characteristic of the touch-screen via the at least one sensor.

Claims (61)

1 . A computer-implemented method, comprising:

receiving, at a server instance of an electronic application and from at least one client instance of the electronic application operating on a user device, at least one request for a physical media element;

causing a physical request slip corresponding to each request to be conveyed to one or more terminal systems;

monitoring, via at least one sensor of a respective automated interaction device operatively engaged with a screen of each of the one or more terminal systems, an operating state of each of the one or more terminal systems;

detecting, by at least one of the respective automated interaction devices and via the monitoring, that at least one terminal system is awaiting an input to the screen of the at least one terminal system; and

in response to the detecting, causing the respective automated interaction device to operate a solenoid operationally engaged with the at least one terminal system to autonomously provide the input awaited to the screen of the at least one terminal system.

2 . The computer-implemented method of claim 1 , wherein providing the input causes the at least one terminal system to proceed with generating the physical media element based on a corresponding physical request slip.

3 . The computer-implemented method of claim 1 , further comprising:

obtaining media data scanned from each physical media element generated by the one or more terminal systems.

4 . The computer-implemented method of claim 3 , further comprising:

at the server instance, generating an association between each physical media element and corresponding media data with a corresponding request.

5 . The computer-implemented method of claim 4 , further comprising:

transmitting, by the server instance, the media data to a provider system; and

receiving a validated position of the physical media elements from the provider system.

6 . The computer-implemented method of claim 5 , further comprising:

based on the generated association, causing the client instance of the electronic application operating on the user device to output the validated position corresponding to the request.

7 . A computer-implemented method, comprising:

receiving, from an instance of an electronic application operating on a user device, a request for a physical media element;

causing a physical request element corresponding to the request to be conveyed to a terminal system;

detecting, via one or more optical sensors of an automated interaction device, that the terminal system is in a state awaiting input;

causing the automated interaction device to operate one or more actuators to mechanically interact with the terminal system and cause the terminal system to receive the awaited input;

obtaining physical media data scanned from a physical media element generated by the terminal system;

causing the instance of the electronic application operating on the user device to output a notification regarding the physical media data.

8 . The computer-implemented method of claim 7 , wherein causing the physical request element to be conveyed to the terminal system includes causing a printer to print the physical request element based on data included in the request.

9 . The computer-implemented method of claim 7 , wherein causing the physical request element to be conveyed to the terminal system includes operating an automatic feeder system that is operationally engaged with a physical input of the terminal system.

10 . The computer-implemented method of claim 7 , wherein obtaining the physical media data includes:

causing a scanner to generate a scan the physical media element generated by the terminal system; and

parsing the scan to determine the physical media data.

11 . The computer-implemented method of claim 7 , wherein:

the one or more actuators includes an end effector that is tactilely detectable by a touch screen of the terminal system; and

the mechanical interaction with the terminal system includes tactile engagement of the end effector with the touch screen.

12 . The computer-implemented method of claim 7 , further comprising:

generating an association between the physical media data and the request.

13 . The computer-implemented method of claim 7 , further comprising:

validating a position of the physical media element; and

causing the instance of the electronic application to output the validated position.

14 . A system, comprising:

an automated interaction device that includes:

at least one actuator with an end effector that is tactilely detectable by a touch screen; and

at least one sensor configured to monitor a display of at least a portion of the touch screen; and

a server that includes:

at least one memory storing instructions; and

at least one processor operatively connected to the at least one memory and configured to execute the instructions to perform operations, including:

hosting a server instance of an electronic application:

receiving from a client instance of the electronic application, a request for one or more physical media elements;

causing conveyance of a physical request element to a terminal system that includes the touch screen;

obtaining physical media data from a scan of the one or more physical media elements generated by the terminal system; and

transmitting at least a portion of the physical media data to the client instance of the electronic application;

wherein the automated interaction device is configured to operate the actuator so as to interact with the touch screen via the end effector in response to detecting, via the monitoring, that the terminal system is awaiting input.

15 . The system of claim 14 , further comprising:

a printer, wherein the operations further include causing the printer to generate the physical request element based on data included in the request.

16 . The system of claim 14 , further comprising:

a scanner, wherein the obtaining of the physical media data from a scan of the one or more physical media elements generated by the terminal system is performed via the scanner.

17 . The system of claim 14 , wherein the operations further include:

associating the physical media data with the request;

transmitting at least a portion of the physical media data to a provider system;

receiving validated position data associated with the request from the provider system; and

transmitting the validated position data to the client instance of the electronic application.

18 . The system of claim 14 , wherein the automated interaction device is removably affixed to the terminal system.

19 . The system of claim 14 , further comprising an automated feeder system operable to autonomously convey the physical request element to a mechanical input of the terminal system.

20 . The system of claim 19 , wherein the one or more sensors of the automated interaction device are activated in response to a signal from the automated feeder system.