IP Library Granted Patent US 10,620,778
Granted Patent B2
US 10,620,778 · App. 15/080,482 · Granted Apr 14, 2020

Augmentable and spatially manipulable 3D modeling

Inventors: Michael Capozella (Cleveland Heights, OH); Paul Griesmer (Broadview Heights, OH)
Assignee: Rockwell Automation Technologies, Inc.
G06F3/04815G06F3/04845G06F3/04883G06T7/564G06T15/20G06T17/00G06T19/006G06T19/20G06T2207/30108G06T2210/04
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,620,778
App. No.
15/080,482
Granted
Apr 14, 2020
Kind
B2
Abstract

Augmentable and manipulable modeling of equipment provides a three dimensional, manipulable base model image of an equipment specimen on a display system using optical base model data obtained using a computing system. Base model data collection can be user-controlled to permit changing spatial aspects of the base model image (size, perspective, orientation). User inputs concerning functions, conditions and the like can be transmitted from a model control unit to the computing system via a two-way communication link, generating augmenting data that is combined with the base model data to render augmented three dimensional models. User inputs also can be received directly by the computing system, for example using a display system touchscreen. Augmenting data received by the computing system and/or display system also can be transmitted via the communication link to the model control unit. Such implementations permit realistic simulation of the effects of a control system on a real world system, equipment, etc.

Claims (48)

1. A method for generating a spatially manipulable and augmentable model of an industrial automation equipment on a display system, the method comprising:

in a computing system comprising a data acquisition device, receiving base model data comprising spatial data defining a spatial relationship between the data acquisition device and an image of the industrial automation equipment;

in the computing system, generating a base model image by processing the base model data;

in the computing system, receiving augmenting data from a model control unit external to the computing system, wherein the augmenting data comprises updated spatial data defining an updated spatial relationship between the data acquisition device and the industrial automation equipment; and

in the computing system, generating an augmented model image by modifying the base model image according to the augmenting data.

2. The method of claim 1 wherein the data acquisition device is a camera integrated in at least one of a smartphone, a laptop, and a tablet.

3. The method of claim 1 further comprising displaying the augmented model image as a three dimensional image on the display system.

4. The method of claim 1 wherein receiving the augmenting data from the model control unit comprises receiving the augmenting data via a wireless link with the model control unit.

5. The method of claim 1 further comprising:

receiving additional augmenting data via a touch screen; and

communicating the additional augmenting data to the model control unit.

6. The method of claim 5 wherein the additional augmenting data comprises a user request to modify the augmented model image.

7. The method of claim 1 wherein the augmenting data comprises data changing one or more operational characteristics of the industrial automation equipment.

8. One or more computer-readable storage media having program instructions stored thereon to generate augmentable and spatially manipulable model images of industrial automation equipment, wherein the program instructions, when executed by a computing system, direct the computing system to at least:

receive base model data associated with an image of the industrial automation equipment;

generate a base model image by processing the base model data, wherein the base model image comprises an operational characteristic of the industrial automation equipment;

enable display of the base model image on a display system, wherein the computing system comprises the display system;

receive augmenting data from a model control unit external to the computing system;

generate an augmented model image by modifying the operational characteristic in accordance with the augmenting data; and

enable display of the augmented model image on the display system.

9. The one or more computer-readable storage media of claim 8 wherein the computing system receives the augmenting data from the model control unit via a communication bridge device.

10. The one or more computer-readable storage media of claim 9 wherein the communication bridge device comprises a microcontroller that communicates wirelessly with the computing system.

11. The one or more computer-readable storage media of claim 10 wherein the microcontroller receives the augmenting data from the model control unit.

12. The one or more computer-readable storage media of claim 8 wherein to receive the base model data, the program instructions direct the computing system to optically read, via a camera, the base model data from the image of the industrial automation equipment.

13. The one or more computer-readable storage media of claim 8 wherein the base model image and the augmented model image are each presented as a three dimensional image on a display system.

14. The one or more computer-readable storage media of claim 8 wherein the program instructions further direct the computing system to:

receive additional augmenting data via a touch screen; and

communicate the additional augmenting data to the model control unit.

15. The one or more computer-readable storage media of claim 14 wherein the additional augmenting data comprises a user request to modify the augmented model image.

16. A computing apparatus comprising:

a storage device;

a display system;

a data acquisition device;

a processor operatively coupled with the storage device; and

program instructions for generating a spatially manipulable and augmentable model of industrial automation equipment, wherein the program instructions, when executed by the processor, direct the computing apparatus to at least:

receive base model data comprising spatial data defining a spatial relationship between the data acquisition device and an equipment specimen;

generate a base model image of the equipment specimen on the display system based on the base model data;

receive augmenting data from a model control unit external to the computing system, wherein the augmenting data comprises updated spatial data defining an updated spatial relationship between the data acquisition device and the equipment specimen; and

generating an augmented model image by modifying the base model image according to the augmenting data.

17. The computing apparatus of claim 16

wherein the augmenting data further comprises

user-input data pertaining to changing operation of the equipment specimen.

18. The computing apparatus of claim 17 wherein the augmenting data is received via a wireless communication link.

19. The computing apparatus of claim 16 wherein the equipment specimen is an image of the industrial automation equipment, and wherein, to receive the base model data, the program instructions direct the computing apparatus to

acquire, via the data acquisition device, the base model data from the equipment specimen.

20. The computing apparatus of claim 16 wherein the program instructions further direct the computing apparatus to:

receive additional augmenting data via the display system; and

communicate the additional augmenting data to the model control unit.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 24, 2016
From: CAPOZELLA, MICHAEL; GRIESMER, PAUL
To: ROCKWELL AUTOMATION TECHNOLOGIES, INC.
Reel/Frame 038097/0356 →
Continuity (2)
Provisional Application 62212402 · Aug 31, 2015
Related Publication 20170060379A1 · Mar 2, 2017