IP Library Granted Patent US 9,141,443
Granted Patent B2
US 9,141,443 · App. 13/735,794 · Granted Sep 22, 2015

Method and system for integrating visual controls with legacy applications

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,141,443
App. No.
13/735,794
Granted
Sep 22, 2015
Kind
B2
Abstract

A method is provided for controlling a legacy application. The method includes visually capturing a series of movements. The method also includes recording the series of movements at a first time as a recorded series of movements. Moreover, the recorded series of movements includes at least a command that is configured to control a legacy application. Furthermore, the method includes invoking the recorded series of movements at a second time.

Claims (33)

1. A method for controlling a legacy application, comprising:

visually capturing a series of movements;

recording the series of movements at a first time as a recorded series of movements, wherein the recorded series of movements comprises at least a command that is configured to control a legacy application;

editing the recorded series of movements, wherein the recorded series of movements comprise visually captured movements of a user comprising two or more recorded gesture types; and

invoking the recorded series of movements at a second time.

2. The method of claim 1 , wherein editing the recorded series of movements is performed at a third time.

3. The method of claim 2 , wherein editing of the recorded series of movements comprises using a mobile computing device.

4. The method of claim 1 , wherein recording the series of movements comprises receiving user input to record a name for the recorded series of movements.

5. The method of claim 1 , wherein recording the series of movements comprises using an image capturing device.

6. The method of claim 5 , wherein using the image capturing device comprises using a wand configured to assist the image capturing device in capturing the series of movements.

7. The method of claim 1 , wherein recording the series of movements comprises capturing voice commands and integrating the voice commands into the recorded series of movements.

8. The method of claim 1 , comprising controlling a legacy application by using the recorded series of movements and without using a legacy application programming interface configured to control the legacy application, wherein the legacy application is configured to manage an electrical network.

9. A system, comprising:

at least one processor;

a memory communicatively coupled to the at least one processor;

an image capturing device configured to record a series of movements in the memory at a first time as a recorded series of movements, wherein the recorded series of movements comprises at least a command that is configured to control a legacy application;

an editing interface configured to enable a user to edit the recorded series of movements, wherein the recorded series of movements comprise visually captured movements of a user comprising two or more recorded gesture types; and

an input interface configured to invoke the recorded series of movements at a second time.

10. The system of claim 9 , wherein the input interface comprises a mobile computing device remote from the at least one processor.

11. The system of claim 10 , wherein the mobile computing device comprises an editing interface configured to edit the recorded series of movements.

12. The system of claim 9 , comprising a microphone configured to capture voice commands associated with the series of movements.

13. The system of claim 9 , wherein the legacy application is configured to manage an electrical network.

14. The system of claim 9 , wherein the at least one processor derives a plurality of user interface commands configured to navigate through a user interface included in the legacy application based on the recorded series of movements.

15. The system of claim 14 , wherein an execution of the plurality of user interface commands by the at least one processor is faster than a playback of the recorded series of movements by the at least one processor.

16. The system of claim 9 , comprising a display, wherein the series of movements comprises movements where a user is not touching the display.

17. A visual control apparatus, comprising:

an image capture device configured to capture a series of movements;

a memory configured to record the series of movements as a recorded series of movements, wherein the recorded series of the movements comprises at least a command that is configured to control a legacy application;

an editing interface configured to enable a user to edit the recorded series of movements, wherein the recorded series of movements comprise visually captured movements of a user comprising two or more recorded gesture types; and

a user interface application configured to invoke or to edit the recorded series of movements.

18. The apparatus of claim 17 , wherein the legacy application is configured to manage an electrical network.

19. The apparatus of claim 17 , comprising a communication interface configured to transport the recorded series of movements to the legacy application through one or more pools as a protein.

20. The apparatus of claim 19 , wherein each pool is a queue implemented as a ring buffer, and wherein the protein is a self describing data structure unit.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 17, 2023
From: GENERAL ELECTRIC COMPANY
To: GE DIGITAL HOLDINGS LLC
Reel/Frame 065612/0085 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 7, 2013
From: IYER, GIRIDHAR; TADEPALLI, VENU
To: GENERAL ELECTRIC COMPANY
Reel/Frame 029580/0649 →