Granted Patent B2

US 12,496,725 · App. 18/355,277 · Granted Dec 16, 2025

Inventor: David Ross Jenkinson (Auburn, WA)

Assignee: T-Mobile USA, Inc.

B25J11/00B25J9/02G06F3/0412G06F11/2221G01R1/06705Y10S901/47Y10T74/20305

Abstract

Claims (58)

1 . A system for testing a touch screen device, the system comprising:

a camera configured to record one or more images of a touch screen of the touch screen device;

a robot configured to move a tip to contact the touch screen; and

a controller configured to control movement of the tip by the robot by:

receiving, from the camera, a first image of the touch screen;

determining, based at least in part on the first image, a first coordinate location of a first target feature displayed on the touch screen;

causing the robot to provide a first input to the touch screen device by moving the tip to contact the touch screen at the first coordinate location to engage with the first target feature on the touch screen;

receiving, from the camera, a second image of the touch screen;

determining, based at least in part on the second image, a second coordinate location of a second target feature displayed on the touch screen; and

causing the robot to provide a second input to the touch screen device by moving the tip to contact the touch screen at the second coordinate location to engage with the second target feature on the touch screen.

2 . The system of claim 1 , wherein the controller causing the robot to provide the first input to the touch screen device comprises the controller providing an instruction to the robot to move the tip to contact the touch screen at the first coordinate location.

3 . The system of claim 1 , wherein the first input includes at least one of a tap movement to engage the tip to a single location on the touch screen or a slide movement to drag the tip across a portion of the touch screen.

4 . The system of claim 1 , wherein the first input causes the touch screen to display a touch screen image corresponding to the second image on the touch screen.

5 . The system of claim 1 , wherein the controller is further configured to control the movement of the tip by the robot by:

receiving, from the camera and after the second input to the touch screen device, a third image of the touch screen;

determining, based at least in part on the third image, an absence of a third target feature in the third image; and

in response to the determining the absence of the third target feature, executing an instruction to cause the robot to provide the touch screen device with a third input.

6 . The system of claim 1 , wherein the controller is further configured to control the movement of the tip by the robot by:

receiving, from the camera and after the second input to the touch screen device, a third image of the touch screen;

determining, based at least in part on the third image, a third coordinate location of a third target feature on the touch screen; and

causing, based at least in part on the determining the third coordinate location of the third target feature, the robot to provide a third input to the touch screen device by moving the tip to contact the touch screen at the third coordinate location to engage with the third target feature on the touch screen.

7 . The system of claim 1 , wherein the controller is configured to receive data logged by the touch screen device.

8 . The system of claim 1 , wherein the controller is further configured to determine the first coordinate location of the first target feature by:

receiving a data file corresponding to one or more visual characteristics of the first target feature; and

identifying the first target feature in the first image based at least in part on the one or more visual characteristics.

9 . The system of claim 1 , wherein the first input simulates user interactions with the touch screen device.

10 . A method for testing a touch screen device comprising:

receiving, by a controller and from a camera, a first image of a touch screen of a touch screen device;

determining, by the controller and based at least in part on the first image, a first coordinate location of a first target feature displayed on the touch screen;

causing, by the controller, a robot to provide a first input to the touch screen device by moving a tip to contact the touch screen at the first coordinate location to engage with the first target feature on the touch screen;

receiving, by the controller and from the camera, a second image of the touch screen;

determining, by the controller and based at least in part on the second image, a second coordinate location of a second target feature displayed on the touch screen; and

causing, by the controller, the robot to provide a second input to the touch screen device by moving the tip to contact the touch screen at the second coordinate location to engage with the second target feature on the touch screen.

11 . The method of claim 10 , further comprising:

receiving, by the controller and from the camera, a third image of the touch screen;

determining, by the controller and based at least in part on the third image, an absence of a third target feature on the touch screen; and

causing, by the controller and based at least in part on the determining the absence of the third target feature, the robot to provide a third input to the touch screen device by moving the tip.

12 . The method of claim 10 , further comprising:

receiving, by the controller and from the camera after the second input to the touch screen device, a third image of the touch screen;

determining, by the controller and based at least in part on the third image, an absence of a third target feature in the third image; and

in response to the determining the absence of the third target feature, executing, by the controller, an instruction to cause the robot to provide the touch screen device with a third input.

13 . The method of claim 10 , further comprising:

receiving, by the controller, a data file corresponding to one or more visual characteristics of the second target feature; and

identifying, by the controller, the second target feature in the first image based at least in part on the one or more visual characteristics.

14 . The method of claim 10 , further comprising receiving, by the controller, log data from the touch screen device.

15 . The method of claim 10 , wherein the second input causes the touch screen device to initiate, pause, resume, or terminate a logging task.

16 . The method of claim 10 , wherein the first input includes at least one of a tap movement to engage the tip to a single location on the touch screen or a slide movement to contact the tip across a portion of the touch screen.

17 . The method of claim 10 , wherein the first input prompts the touch screen device to display a command menu that includes the second target feature, and wherein a location of the second target feature depends at least partially on a state of the command menu.

18 . A method comprising:

receiving, by a controller and from a camera, a first image of a touch screen of a touch screen device;

causing, by the controller and based at least in part on the first image, a robot to provide a first input to the touch screen device by moving a tip to engage with a first target feature on the touch screen;

receiving, by the controller and from the camera, a second image of the touch screen; and

causing, by the controller and based at least in part on the second image, the robot to provide a second input to the touch screen device by moving the tip to engage with a second target feature on the touch screen.

19 . The method of claim 18 , wherein the first input includes at least one of a tap movement to engage the tip to a single location on the touch screen or a slide movement to contact the tip across a portion of the touch screen.

20 . The method of claim 18 , wherein the controller is further configured to control movement of the tip by the robot by:

receiving, by the controller and from the camera after the second input to the touch screen device, a third image of the touch screen;

determining, by the controller and based at least in part on the third image, a coordinate location of a third target feature on the touch screen; and

causing, by the controller and based at least in part on the determining the coordinate location of the third target feature, the robot to provide a third input to the touch screen device by moving the tip to contact the touch screen at the coordinate location to engage with the third target feature on the touch screen.

Assignments (1)

Continuity (6)

References Cited (120)