IP Library Granted Patent US 12,300,273
Granted Patent B2
US 12,300,273 · App. 17/217,299 · Granted May 13, 2025

Apparatus and method for visualizing periodic motions in mechanical components

Inventors: Jeffrey R Hay (Prospect, KY); Mark William Slemp (Tellico Plains, TN)
Assignee: RDI TECHNOLOGIES, INC.
G11B27/022G06F3/005G06F3/04847G06F16/7335G06T7/0004G06T7/13G06T7/254G06T7/262G06V20/46G06V40/20H04N5/148G01N29/12G01N2291/0289G01N2291/2693G06F2218/10G06T2200/24G06T2207/10016G06T2207/20056G06T2207/20221G06T2207/30164
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,300,273
App. No.
17/217,299
Granted
May 13, 2025
Kind
B2
Abstract

A non-contacting system for visualizing and analyzing periodic movements in machinery includes at least one video acquisition device that acquires sampling data as a video comprising a plurality of video image frames and a data analysis system including processor and memory, and a computer program operating in the processor to filter movements depicted in the video to a specific frequency to normalize the phase in a plurality of objects in the video representing parts or components of the machinery, to compare the movements of such objects which in some embodiments provides for construction of a modified video to visually exaggerate the apparent movement of the at least one of the plurality of objects.

Claims (27)

1. A system for evaluating a moving object undergoing periodic motion, the system comprising:

at least one video acquisition device that acquires video image files of the moving object;

a processor configured to cause the video acquisition device to acquire sampling data, wherein the sampling data comprises a video recording of a scene having a plurality of image frames of the moving object, wherein an image frame is divisible into a plurality of pixels; and

a computer program operating in the processor to:

operate on pixel intensities at a selected frequency of motion present in the video recording, wherein the pixel intensities are characterized by changes in an intensity of light reflected or transmitted from the moving object, and wherein at least a subset of the changes in intensity of light reflected or transmitted from the moving object are imperceptible to the human eye when viewing an unmodified version of the video recording;

automatically calculate a phase value for one or more pixels at the selected frequency and implement a normalizing phase adjustment, wherein the normalizing phase adjustment is dependent on a direction of displacement of the moving object; and

display phase values in a modified video recording, wherein a plurality of the one or more pixels at the selected frequency represent the normalized phase adjustment by using a directional gradient operator to determine and show a direction of motion of at least one edge of the moving object relative to at least two axes.

2. The system of claim 1 , wherein a normalized phase map is applied to one or more frames of the video as it is replayed based on at least one of the plurality of image frames as selected by the user.

3. The system of claim 2 , wherein the moving object comprises a plurality of components, and the one or more normalized phase values is calculated for a subset of the pixels in the field of view as defined by the user using a graphical user interface.

4. The system of claim 2 , wherein the computer program further operates to provide a modified version of the video recording as it is replayed, wherein the modified version produces motion amplification of the displacement of the moving object, wherein the motion amplification is performed digitally to visually exaggerate apparent movement of the at least one object.

5. The system of claim 1 , wherein one or more normalized phase vectors is shown on at least one of the plurality of image frames for a position in the field of view identified by the user.

6. The system of claim 1 , wherein one or more normalized phase values is labeled on at least one of the plurality of image frames for a position in the field of view identified by the user.

7. The system of claim 1 , wherein the normalizing phase adjustment also is dependent on a direction of contrast between the moving object and at least one other structure in the scene.

8. The system of claim 1 , wherein the directional gradient operator is a Sobel operator, and wherein the computer program further operates to determine a position of the at least one edge by canny edge detection.

9. The system of claim 1 , wherein the normalized phase adjustment changes at least a subset of pixels on the image frames to appear black or transparent.

10. A method of visualizing and studying motion of a moving object, comprising:

using a video acquisition device to acquire a video recording of a scene that contains the moving object, wherein the video recording comprises a plurality of image frames of the moving object and wherein an image frame is divisible into a plurality of pixels;

selecting a frequency of motion present in the video recording, wherein the selected motion is characterized by changes in an intensity of light reflected or transmitted from the moving object, and wherein at least a subset of the changes in intensity of light reflected or transmitted from the moving object are imperceptible to the human eye when viewing an unmodified version of the video recording;

automatically performing a normalizing phase adjustment upon measured phase values of pixel intensity by using a directional gradient operator to determine and show in a modified video recording a direction of motion of at least one edge of the moving object relative to at least two axes, and wherein the normalizing phase adjustment is dependent on a direction of displacement of the moving object;

displaying a modified image frame containing the moving object; and

superimposing in the modified video recording at least one modified phase value in which a plurality of pixels represent the normalized phase adjustment associated with the selected frequency of motion.

11. The method of claim 10 , wherein the normalizing phase adjustment is dependent on a direction of contrast between the moving object and at least one other structure in the scene.

12. The method of claim 10 , wherein a normalized phase map is applied to one or more frames of the recorded video as it is replayed based on at least one of the plurality of image frames as selected by the user.

13. The method of claim 10 , wherein one or more normalized phase vectors is shown on at least one of the plurality of image frames for a position in the field of view identified by the user.

14. The method of claim 10 , wherein one or more normalized phase values is labeled on at least one of the plurality of image frames for a position in the field of view identified by the user.

15. The method of claim 10 , wherein the directional gradient operator is a Sobel operator, and wherein the computer program further operates to determine a position of the at least one edge by canny edge detection.

16. The method of claim 10 , wherein the normalized phase adjustment changes at least a subset of pixels on the image frames to appear black or transparent.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 13, 2021
From: HAY, JEFFREY R.; SLEMP, MARK WILLIAM
To: RDI TECHNOLOGIES, INC.
Reel/Frame 058367/0993 →
Continuity (13)
Continuation In Part 16840911 · Apr 6, 2020
Continuation 16106642 · Aug 21, 2018
Continuation In Part 14999660 · Jun 9, 2016
Continuation In Part 14757245 · Dec 9, 2015
Provisional Application 62209979 · Aug 26, 2015
Provisional Application 62161228 · May 13, 2015
Provisional Application 62154011 · Apr 28, 2015
Provisional Application 62139110 · Apr 14, 2015
Provisional Application 62146744 · Apr 13, 2015
Provisional Application 62141940 · Apr 2, 2015
Provisional Application 62139127 · Mar 27, 2015
Provisional Application 62090729 · Dec 11, 2014
Related Publication 20220122638A1 · Apr 21, 2022
References Cited (117)
US 5517251A · Rector et al. · 1996 [cited by applicant]
US 5666157A · Aviv · 1997 [cited by applicant]
US 6028626A · Aviv · 2000 [cited by applicant]
US 6295383B1 · Smitt et al. · 2001 [cited by applicant]
US 6422741B2 · Murphy et al. · 2002 [cited by applicant]
US 6456296B1 · Cataudella et al. · 2002 [cited by applicant]
US 6727725B2 · Devaney et al. · 2004 [cited by applicant]
US 6774601B2 · Swartz et al. · 2004 [cited by applicant]
US 6792811B2 · Argento et al. · 2004 [cited by applicant]
US 7622715B2 · Ignatowicz · 2009 [cited by applicant]
US 7627369B2 · Hunt et al. · 2009 [cited by applicant]
US 7672369B2 · Garakani et al. · 2010 [cited by applicant]
US 7710280B2 · Mclellan · 2010 [cited by applicant]
US 7862188B2 · Luty et al. · 2011 [cited by applicant]
US 7903156B2 · Nobori et al. · 2011 [cited by applicant]
US 8119986B1 · Garvey, III et al. · 2012 [cited by applicant]
US 8149273B2 · Liu et al. · 2012 [cited by applicant]
US 8170109B2 · Gaude et al. · 2012 [cited by applicant]
US 8242445B1 · Scanion et al. · 2012 [cited by applicant]
US 8351571B2 · Brinks et al. · 2013 [cited by applicant]
US 8374498B2 · Pastore · 2013 [cited by applicant]
US 8475390B2 · Heaton et al. · 2013 [cited by applicant]
US 8483456B2 · Nagatsuka et al. · 2013 [cited by applicant]
US 8502821B2 · Louise et al. · 2013 [cited by applicant]
US 8515711B2 · Mitchell et al. · 2013 [cited by applicant]
US 8523674B2 · Patti · 2013 [cited by applicant]
US 8537203B2 · Seibel et al. · 2013 [cited by applicant]
US 8693735B2 · Keilkopf et al. · 2014 [cited by applicant]
US 8720781B2 · Wang et al. · 2014 [cited by applicant]
US 8731241B2 · Johnson et al. · 2014 [cited by applicant]
US 8765121B2 · Maslowski et al. · 2014 [cited by applicant]
US 8774280B2 · Tourapis et al. · 2014 [cited by applicant]
US 8797439B1 · Coley et al. · 2014 [cited by applicant]
US 8803977B2 · Uchima et al. · 2014 [cited by applicant]
US 8811708B2 · Fischer et al. · 2014 [cited by applicant]
US 8823813B2 · Manzel et al. · 2014 [cited by applicant]
US 8831370B2 · Archer · 2014 [cited by applicant]
US 8874374B2 · Bogucki · 2014 [cited by applicant]
US 8879789B1 · Figov et al. · 2014 [cited by applicant]
US 8879894B2 · Neuman et al. · 2014 [cited by applicant]
US 8884741B2 · Cavallaro et al. · 2014 [cited by applicant]
US 8897491B2 · Ambrus et al. · 2014 [cited by applicant]
US 8924163B2 · Hudson et al. · 2014 [cited by applicant]
US 9006617B2 · Mullen · 2015 [cited by applicant]
US 9075136B1 · Joao · 2015 [cited by applicant]
US 9805475B2 · Rubinstein et al. · 2017 [cited by applicant]
US 11322182B1 · Hay · 2022 [cited by examiner]
US 11380363B1 · Hay · 2022 [cited by examiner]
US 11423551B1 · Hay · 2022 [cited by examiner]
US 11631185B1 · Piety · 2023 [cited by examiner]
US 20040032924A1 · Judge, Jr. · 2004 [cited by applicant]
US 20040081369A1 · Gindele et al. · 2004 [cited by applicant]
US 20040160336A1 · Hoch et al. · 2004 [cited by applicant]
US 20040184529A1 · Henocq et al. · 2004 [cited by applicant]
US 20060009700A1 · Brumfield et al. · 2006 [cited by applicant]
US 20060049707A1 · Vuyyuru · 2006 [cited by applicant]
US 20060147116A1 · Le Clerc · 2006 [cited by applicant]
US 20060251170A1 · Ali · 2006 [cited by applicant]
US 20070061043A1 · Ermakov et al. · 2007 [cited by applicant]
US 20070276270A1 · Tran · 2007 [cited by applicant]
US 20090010570A1 · Yamada et al. · 2009 [cited by applicant]
US 20100033579A1 · Yokohata et al. · 2010 [cited by applicant]
US 20100042000A1 · Schuhrke et al. · 2010 [cited by applicant]
US 20100091181A1 · Capps · 2010 [cited by applicant]
US 20100110100A1 · Anadasivam et al. · 2010 [cited by applicant]
US 20100324423A1 · El-Aklouk et al. · 2010 [cited by applicant]
US 20100328352A1 · Shamir et al. · 2010 [cited by applicant]
US 20110019027A1 · Fujita et al. · 2011 [cited by applicant]
US 20110152729A1 · Oohashi et al. · 2011 [cited by applicant]
US 20120207218A1 · Asamura et al. · 2012 [cited by applicant]
US 20130060571A1 · Soemo et al. · 2013 [cited by applicant]
US 20130176424A1 · Weil · 2013 [cited by applicant]
US 20130201316A1 · Binder et al. · 2013 [cited by applicant]
US 20130342691A1 · Lewis et al. · 2013 [cited by applicant]
US 20140002667A1 · Cheben et al. · 2014 [cited by applicant]
US 20140072190A1 · Wu et al. · 2014 [cited by applicant]
US 20140072228A1 · Rubinstein et al. · 2014 [cited by applicant]
US 20140072229A1 · Wadhwa et al. · 2014 [cited by applicant]
US 20140112537A1 · Frank et al. · 2014 [cited by applicant]
US 20140169763A1 · Nayak et al. · 2014 [cited by applicant]
US 20140205175A1 · Tanaka et al. · 2014 [cited by applicant]
US 20140236036A1 · de Haan et al. · 2014 [cited by applicant]
US 20140341470A1 · Lee et al. · 2014 [cited by applicant]
US 20140368528A1 · Konnola et al. · 2014 [cited by applicant]
US 20150134545A1 · Mann et al. · 2015 [cited by applicant]
US 20150221534A1 · van der Meulen · 2015 [cited by applicant]
US 20160144404A1 · Houston · 2016 [cited by examiner]
US 20160171309A1 · Hay · 2016 [cited by applicant]
US 20160210747A1 · Hay · 2016 [cited by examiner]
US 20160217587A1 · Hay · 2016 [cited by applicant]
US 20160217588A1 · Hay · 2016 [cited by applicant]
US 20160232686A1 · Park et al. · 2016 [cited by applicant]
US 20160300341A1 · Hay · 2016 [cited by applicant]
US 20170000356A1 · Smith, Sr. · 2017 [cited by applicant]
US 20170000392A1 · Smith · 2017 [cited by applicant]
US 20170119258A1 · Kotanko · 2017 [cited by applicant]
US 20170135626A1 · Singer · 2017 [cited by applicant]
US 20170221216A1 · Chen et al. · 2017 [cited by applicant]
US 20180061063A1 · Buyukozturk et al. · 2018 [cited by applicant]
US 20180177464A1 · DeBusschere et al. · 2018 [cited by applicant]
US 20180225803A1 · Elgharib et al. · 2018 [cited by applicant]
US 20180276823A1 · Barral et al. · 2018 [cited by applicant]
US 20180296075A1 · Meglan et al. · 2018 [cited by applicant]
US 20180335366A1 · Qiao et al. · 2018 [cited by applicant]
US 20190206068A1 · Stark et al. · 2019 [cited by applicant]
US 20200029891A1 · Swisher · 2020 [cited by applicant]
US 20200065957A1 · Hay et al. · 2020 [cited by applicant]
CN 103578112A · 2014 [cited by applicant]
Rubinstein et al. (“Revealing Invisible Changes in the World (YouTube)”, YouTube https://www.youtube.com/watch?v=e9ASH8IBJ2U, 2012. [cited by applicant]
Hay, J.R. “High Dynamic Range Imaging for the Detection of Motion”\ pp. 18-141; dissertation University of Louisville (Kentucky); May 2011. [cited by applicant]
Liu et al., “Motion magnification”, ACM Transactions on Graphics (TOG)—Proceedings of Acm Siggraph 2005 TOG Homepage, vol. 24 Issue 3, Jul. 2005. [cited by applicant]
Mazen, et al.; A vision-based approach for the direct measurement of displacements in vibrating systems; article from Smart Materials and Structures; 2003; 12; pp. 785-794; IOP Publishing LTD; Uk. [cited by applicant]
Meyer S., Sorkine-Hornung A., Gross M. (2016) Phase-Based Modification Transfer for Video. In: Leibe B., Matas J., Sebe N., Welling M. (eds) Computer Vision—ECCV 2016. ECCV 201 6. Lecture Notes in Computer Science, vol.… [cited by applicant]
Miyatake K, Yamagishi M, Tanaka N, Uematsu M, Yamazaki N, Mine Y, Sano A, Hirama. M. New method for evaluating left ventricular wall motion by color-coded tissue Doppler imaging: in vitro and in vivo studies. J Am Coll … [cited by applicant]
Nobuo Yamazaki et al.“Analysis of Ventricular Wall Motion Using Color-Coded Tissue Doppler Imaging System” 1994 Jpn. J. Appl. Phys. 33 3141 (Year: 1994). [cited by applicant]
Wadhwa et al., “Phase-based Video Motion Processing”, also see YouTube https://www.youtube.com/watch?v=W7ZQFG7Nvw, SIGGRAPH 2013. [cited by applicant]
Wu et al., “Eulerian Video Magnification for Revealing Subtle Changes in the World”, ACM Transactions on Graphics (TOG)—Proceedings of ACM SIGGRAPH 2012 TOG Homepage, vol. 31 Issue 4, Jul. 2012, Article No. 65. [cited by applicant]