IP Library Granted Patent US 9,415,509
Granted Patent B2
US 9,415,509 · App. 13/667,348 · Granted Aug 16, 2016

Robot teach device with 3-D display

Inventors: Kenneth W. Krause (Rochester Hills, MI); Bradley O. Niederquell (Troy, MI); Gordon Geheb (Hartland, MI); Ganesh Kalbavi (Rochester, MI); Claude Dinsmoor (Rochester Hills, MI); Scott M. Dreslinski (Rochester Hills, MI); Charles R. Strybis (Rochester Hills, MI); H. Dean McGee (Rochester Hills, MI); Glenn Nowak (Rochester Hills, MI); Judy Evans (Oakland, MI); Rick E. Wunderlich (Canton, MI)
Assignee: Fanuc America Corporation
B25J9/1605G05B19/409G05B2219/35318G05B2219/39449
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,415,509
App. No.
13/667,348
Granted
Aug 16, 2016
Kind
B2
Abstract

A method and an apparatus for displaying three-dimensional workcell data includes a hand-held pendant that is provided with 3-D workcell data representing a model of a machine and associated components in a workcell. The hand-held pendant has a display that generates a 3-D visual representation of the workcell data. The pendant can be operated by a user to manipulate the visual representation to change a user viewpoint and to show motion of the machine with associated process information.

Claims (51)

1. A method for displaying three-dimensional workcell data comprising the steps of:

providing from a data source 3-D workcell data representing a model of a robot and associated components in a workcell;

providing a hand-held display device and placing the display device in data communication with the data source;

communicating the workcell data from the data source to the display device;

generating a 3-D visual representation of the workcell data on the display device, including displaying the visual representation of

a position of the robot based on a value of a program or a non-program representation of robot position within a software program for controlling the robot,

an aggregate space occupied by the robot through movement of an associated part of the robot about at least one axis of rotation of the robot throughout execution of at least a portion of the software program, and

an interference visualization image of the aggregate space that includes an image of a plane transverse to the axis of rotation; and

operating the display device to manipulate the visual representation.

2. The method according to claim 1 wherein the display device has jog keys and including displaying a direction the robot will take if moved in response to actuation of the jog keys.

3. The method according to claim 1 including plotting process information in conjunction with TCP trace of the software program.

4. The method according to claim 1 including storing data from a series of the robot positions and associated secondary information and replaying a progression of the robot positions with the associated secondary information as the visual representation.

5. The method according to claim 1 including using color and transparency to differentiate various elements in the visual representation.

6. The method according to claim 1 including incorporating in the visual representation an area not visible to a user of the hand-held display device for restricting or limiting travel of the robot during an operation of the robot.

7. The method according to claim 1 including incorporating in the visual representation video data from a view point of a camera in the workcell.

8. The method according to claim 1 including showing movement of elements of the robot in the visual representation.

9. The method according to claim 1 including selecting a 3-D element of the visual display and automatically indicating or displaying a corresponding 2-D item on the display device.

10. The method according to claim 1 including changing the visual representation to provide different user viewpoints.

11. The method according to claim 1 including operating the display device to display at least one of a menu and robot text data in a semi-transparent window with 3-D elements visible below and manipulating the transparency from invisible to opaque.

12. The method according to claim 1 including displaying multiple 3-D views in the visual representation as a split screen or a picture-in-picture.

13. The method according to claim 1 including presenting the visual representation as separate images for each eye of a user wherein the separate images are different for a 3-D movie effect or are the same.

14. A hand-held pendant for communicating with a robot controller comprising:

a display having a resolution high enough to show 3-D graphical images;

an input/output port for receiving from a data source 3-D workcell data representing a model of a robot and associated components in a workcell;

a data storage device for storing the 3-D workcell data and a pendant operating program; and

a processor connected to the display, the input/output port and the data storage device for running the operating program to generate a 3-D visual representation of the 3-D workcell data on the display and being responsive to user input to manipulate the visual representation, the visual representation including

a position of the robot based on a value of a program or a non-program representation of robot position within a software program for controlling the robot,

an aggregate space occupied by the robot through movement of an associated part of the robot about at least one axis of rotation of the robot throughout execution of at least the portion of the software program, and

an interference visualization image of the aggregate space that includes an image of a plane transverse to the axis of rotation.

15. The pendant according to claim 14 wherein the data source is the robot controller, the 3-D workcell data is related to a robot operating program being run by the controller and visual representation includes graphical images of the robot moving in response to instructions in the robot operating program.

16. A method for displaying three-dimensional workcell data comprising the steps of:

providing from a data source 3-D workcell data representing a model of a machine and associated components in a workcell;

providing a hand-held display device and placing the display device in data communication with the data source;

communicating the workcell data from the data source to the display device;

selecting a 2-D item on the display device and automatically indicating or displaying a corresponding 3-D element on the visual display of the display device;

generating a 3-D visual representation of the workcell data on the display device; and

operating the display device to manipulate the visual representation.

17. A method for displaying three-dimensional workcell data comprising the steps of:

providing from a data source 3-D workcell data representing a model of a machine and associated components in a workcell;

providing a hand-held display device and placing the display device in data communication with the data source;

communicating the workcell data from the data source to the display device;

generating a 3-D visual representation of the workcell data on the display device;

operating the display device to manipulate the visual representation; and

using the display device to create an adjusted view of the machine, associating the adjusted view with an original scene of the machine, and automatically recording the adjusted view with the original scene.

18. A method for displaying three-dimensional workcell data comprising the steps of:

providing from a data source 3-D workcell data representing a model of a machine and associated components in a workcell;

providing a hand-held display device and placing the display device in data communication with the data source;

communicating the workcell data from the data source to the display device;

generating a 3-D visual representation of the workcell data on the display device;

operating the display device to manipulate the visual representation; and

using the display device to preview a movement of the machine by engaging a movement key of the display device, wherein the display device displays the movement graphically prior to actual movement of the machine.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 27, 2012
From: KRAUSE, KENNETH W.; NIEDERQUELL, BRADLEY O.; GEHEB, GORDON; KALBAVI, GANESH; DINSMOOR, CLAUDE; DRESLINSKI, SCOTT M.; STRYBIS, CHARLES R.; MCGEE, H. DEAN; NOWAK, GLENN; EVANS, JUDY; WUNDERLICH, RICK E.
To: FANUC ROBOTICS AMERICA CORPORATION
Reel/Frame 029534/0033 →
Continuity (2)
Provisional Application 61555675 · Nov 4, 2011
Related Publication 20130116828A1 · May 9, 2013