IP Library › Granted Patent US 12,190,532
Granted Patent B1
US 12,190,532 · App. 17/866,689 · Granted Jan 7, 2025

Enhanced presentation methods for visualizing motion of physical structures and machinery

Inventors: Jeffrey R. Hay (Prospect, KY); Mark William Slemp (Tellico Plains, TN)
Assignee: RDI TECHNOLOGIES, INC.
G06T7/292G01N29/44G06T7/215G06T7/285G06T7/55G06T7/70G06T11/001H04N1/62H04N13/204H04N23/6811H04N23/80H04N23/90G01N2291/028G06T2200/24G06T2207/10016G06T2207/30164G06T2210/62
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,190,532
App. No.
17/866,689
Filed
Jul 18, 2022
Granted
Jan 7, 2025
Kind
B1
Art Unit
2485
USPC
348/47
Abstract

Embodiments described herein enhance the visualization of certain conditions contained in a video depicting motion in a field of view, in which the enhancements include but are not limited to one or more of: adjusting the appearance of video when objects are at different distances from a video acquisition device; aligning phase of motion obtained from different video acquisition devices; accentuating frequency phenomena that may be masked or obstructed in the presence of other frequencies of motion; differentiating motion data to obtain velocity or acceleration waveforms or spectra; applying a color scheme to pixels in a scene to highlight motion with specific characteristics or to amplify motion or provide indication of absolute motion; and determining spatial or temporal regions in the video to amplify based on the predetermined parameters.

Claims (16)

1. A motion evaluation method for evaluating motion of an object using a plurality of video acquisition devices, wherein an output of at least one of said video acquisition devices comprises recorded video of the object as video files divisible into individual image frames, with each frame providing a static image of the object in a scene, and with each frame being divisible into a plurality of pixels, comprising:

obtaining a first video of the object located in the scene using a first video acquisition device, wherein each video generates a signal indicative of an intensity of at least one pixel contained in at least one frame, wherein the intensity of the at least one pixel varies with the motion of the object;

obtaining a second video of the object using a second video acquisition device;

selecting a first location on the object and obtaining a position of the first location relative to the second video acquisition device, and selecting at least a second location on the object and obtaining a position of at least the second location relative to the second video acquisition device;

determining distance information from the second video acquisition device to each selected location on the object and calculating a difference in distance between at least the position of the first selected location on the object and the position of the second selected location on the object based on said distance information;

receiving by the first video acquisition device at least one of the distance information determined by the second video acquisition device or the calculated difference in distance between the first selected location on the object and the second selected location on the object; and

modifying the first video obtained with the first video acquisition device by adjusting for the difference in distance between the first selected location on the object and the second selected location on the object.

2. The motion evaluation method of claim 1 , wherein the first video acquisition device comprises a first video camera and the second video acquisition device comprises a second video camera.

3. The motion evaluation method of claim 1 , wherein the first video acquisition device comprises a video camera and the second video acquisition device comprises a 3-D camera.

4. The motion evaluation method of claim 1 , further comprising configuring a monitor to display the modified first video.

5. The motion evaluation method of claim 1 , further comprising measuring an amplitude of the motion of the object, wherein the amplitude is proportional to a difference in intensity of at least one pixel contained in a first frame and the intensity of at least one pixel in a second frame.

6. The motion evaluation method of claim 5 , further comprising modifying video obtained with one or both of the video acquisition devices so motion of the object begins at a point of maximum amplitude in the scene.

7. The motion evaluation method of claim 5 , further comprising modifying video obtained with one or both of the video acquisition devices so motion of the object begins at a point of minimum amplitude in the scene.

8. The motion evaluation method of claim 5 , further comprising creating a waveform as a representation of the motion of the object.

9. The motion evaluation method of claim 5 , further comprising visually amplifying the motion of the object depicted in the first video by modifying at least one frame of the first video by multiplying an amplitude in at least one pixel by an amplification factor.

10. The motion evaluation method of claim 9 , further comprising overlaying at least one color scheme on the object whose motion is amplified.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 18, 2022
From: HAY, JEFFREY R.; SLEMP, MARK WILLIAM
To: RDI TECHNOLOGIES, INC.
Reel/Frame 060534/0197 →
Continuity (3)
Division 16656003 · Oct 17, 2019
Provisional Application 62787963 · Jan 3, 2019
Provisional Application 62746709 · Oct 17, 2018
References Cited (132)
US 4523230A · Carlson et al. · 1985 [cited by applicant]
US 5517251A · Rector et al. · 1996 [cited by applicant]
US 5604856A · Guenter · 1997 [cited by applicant]
US 5666157A · Aviv · 1997 [cited by applicant]
US 6028628A · Aviv · 2000 [cited by applicant]
US 6295383B1 · Smitt et al. · 2001 [cited by applicant]
US 6422741B2 · Murphy et al. · 2002 [cited by applicant]
US 6456296B1 · Cataudella et al. · 2002 [cited by applicant]
US 6474166B1 · Osawa et al. · 2002 [cited by applicant]
US 6727725B2 · Devaney et al. · 2004 [cited by applicant]
US 6774601B2 · Swartz et al. · 2004 [cited by applicant]
US 6792811B2 · Argento et al. · 2004 [cited by applicant]
US 7622715B2 · Ignatowicz · 2009 [cited by applicant]
US 7672369B2 · Garakani et al. · 2010 [cited by applicant]
US 7710280B2 · McLellan · 2010 [cited by applicant]
US 7862188B2 · Luty et al. · 2011 [cited by applicant]
US 7903158B2 · Nobori et al. · 2011 [cited by applicant]
US 8119986B1 · Garvey, III et al. · 2012 [cited by applicant]
US 8149273B2 · Liu et al. · 2012 [cited by applicant]
US 8170109B2 · Gaude et al. · 2012 [cited by applicant]
US 8242445B1 · Scanion et al. · 2012 [cited by applicant]
US 8351571B2 · Brinks et al. · 2013 [cited by applicant]
US 8374498B2 · Pastore · 2013 [cited by applicant]
US 8475390B2 · Heaton et al. · 2013 [cited by applicant]
US 8483456B2 · Nagatsuka et al. · 2013 [cited by applicant]
US 8502821B2 · Louise et al. · 2013 [cited by applicant]
US 8515711B2 · Mitchell et al. · 2013 [cited by applicant]
US 8523674B2 · Patti · 2013 [cited by applicant]
US 8537203B2 · Seibel et al. · 2013 [cited by applicant]
US 8693735B2 · Keilkopf et al. · 2014 [cited by applicant]
US 8720781B2 · Wang et al. · 2014 [cited by applicant]
US 8731241B2 · Johnson et al. · 2014 [cited by applicant]
US 8765121B2 · Maslowski et al. · 2014 [cited by applicant]
US 8774280B2 · Tourapis et al. · 2014 [cited by applicant]
US 8797439B1 · Coley et al. · 2014 [cited by applicant]
US 8803977B2 · Uchima et al. · 2014 [cited by applicant]
US 8811708B2 · Fischer et al. · 2014 [cited by applicant]
US 8823813B2 · Manzel et al. · 2014 [cited by applicant]
US 8831370B2 · Archer · 2014 [cited by applicant]
US 8874374B2 · Bogucki · 2014 [cited by applicant]
US 8879789B1 · Figov et al. · 2014 [cited by applicant]
US 8879894B2 · Neuman et al. · 2014 [cited by applicant]
US 8884741B2 · Cavallaro et al. · 2014 [cited by applicant]
US 8897491B2 · Ambrus et al. · 2014 [cited by applicant]
US 8924163B2 · Hudson et al. · 2014 [cited by applicant]
US 9006617B2 · Mullen · 2015 [cited by applicant]
US 9075136B1 · Joao · 2015 [cited by applicant]
US 9135720B2 · Huang et al. · 2015 [cited by applicant]
US 9805475B2 · Rubinstein et al. · 2017 [cited by applicant]
US 10021371B2 · Pacheco · 2018 [cited by examiner]
US 10489912B1 · Brailovskiy · 2019 [cited by examiner]
US 10582137B1 · Benemann · 2020 [cited by examiner]
US 20040032924A1 · Judge, Jr. · 2004 [cited by applicant]
US 20040081369A1 · Gindele et al. · 2004 [cited by applicant]
US 20040160336A1 · Hoch et al. · 2004 [cited by applicant]
US 20040184529A1 · Henocq et al. · 2004 [cited by applicant]
US 20040252230A1 · Winder · 2004 [cited by applicant]
US 20060009700A1 · Brumfield et al. · 2006 [cited by applicant]
US 20060049707A1 · Vuyyuru · 2006 [cited by applicant]
US 20060147116A1 · Le Clerc et al. · 2006 [cited by applicant]
US 20060251170A1 · Ali · 2006 [cited by applicant]
US 20070061043A1 · Ermakov et al. · 2007 [cited by applicant]
US 20070276270A1 · Tran · 2007 [cited by applicant]
US 20090010570A1 · Yamada et al. · 2009 [cited by applicant]
US 20090222228A1 · Gao et al. · 2009 [cited by applicant]
US 20100033579A1 · Yokohata et al. · 2010 [cited by applicant]
US 20100042000A1 · Schuhrke et al. · 2010 [cited by applicant]
US 20100091181A1 · Capps · 2010 [cited by applicant]
US 20100110100A1 · Anandasivam et al. · 2010 [cited by applicant]
US 20100324423A1 · El-Aklouk et al. · 2010 [cited by applicant]
US 20100328352A1 · Shamier · 2010 [cited by applicant]
US 20110019027A1 · Fujita et al. · 2011 [cited by applicant]
US 20110152729A1 · Oohashi et al. · 2011 [cited by applicant]
US 20120007960A1 · Kim · 2012 [cited by examiner]
US 20120182397A1 · Heinzle · 2012 [cited by examiner]
US 20120207218A1 · Asamura et al. · 2012 [cited by applicant]
US 20130010093A1 · Redmann · 2013 [cited by examiner]
US 20130060571A1 · Soemo et al. · 2013 [cited by applicant]
US 20130176424A1 · Weil · 2013 [cited by applicant]
US 20130201316A1 · Binder et al. · 2013 [cited by applicant]
US 20130342891A1 · Lewis et al. · 2013 [cited by applicant]
US 20140002667A1 · Cheben et al. · 2014 [cited by applicant]
US 20140072190A1 · Wu et al. · 2014 [cited by applicant]
US 20140072228A1 · Rubinstein et al. · 2014 [cited by applicant]
US 20140072229A1 · Wadhwa et al. · 2014 [cited by applicant]
US 20140112537A1 · Frank et al. · 2014 [cited by applicant]
US 20140169783A1 · Nayak et al. · 2014 [cited by applicant]
US 20140205175A1 · Tanaka et al. · 2014 [cited by applicant]
US 20140236036A1 · de Hann et al. · 2014 [cited by applicant]
US 20140341470A1 · Lee et al. · 2014 [cited by applicant]
US 20140368528A1 · Konnola et al. · 2014 [cited by applicant]
US 20150134545A1 · Mann et al. · 2015 [cited by applicant]
US 20150221534A1 · van der Meulen · 2015 [cited by applicant]
US 20150379370A1 · Clifton et al. · 2015 [cited by applicant]
US 20160144404A1 · Houston et al. · 2016 [cited by applicant]
US 20160171309A1 · Hay · 2016 [cited by applicant]
US 20160217587A1 · Hay · 2016 [cited by applicant]
US 20160217588A1 · Hay · 2016 [cited by applicant]
US 20160232686A1 · Park et al. · 2016 [cited by applicant]
US 20160284072A1 · Hsu · 2016 [cited by applicant]
US 20160300341A1 · Hay et al. · 2016 [cited by applicant]
US 20170000356A1 · Smith, Sr. · 2017 [cited by applicant]
US 20170000392A1 · Smith · 2017 [cited by applicant]
US 20170078644A1 · Chen · 2017 [cited by examiner]
US 20170119258A1 · Kotanko et al. · 2017 [cited by applicant]
US 20170135626A1 · Singer · 2017 [cited by applicant]
US 20170221216A1 · Chen et al. · 2017 [cited by applicant]
US 20170374354A1 · Zhu · 2017 [cited by examiner]
US 20180061063A1 · Buyukozturk et al. · 2018 [cited by applicant]
US 20180101090A1 · Lablans · 2018 [cited by examiner]
US 20180177464A1 · DeBusschere et al. · 2018 [cited by applicant]
US 20180225803A1 · Elgharib et al. · 2018 [cited by applicant]
US 20180276823A1 · Barral et al. · 2018 [cited by applicant]
US 20180296075A1 · Meglan et al. · 2018 [cited by applicant]
US 20180335366A1 · Qiao et al. · 2018 [cited by applicant]
US 20190035104A1 · Cuban · 2019 [cited by examiner]
US 20190043259A1 · Wang · 2019 [cited by examiner]
US 20190206068A1 · Stark et al. · 2019 [cited by applicant]
US 20200029891A1 · Swisher · 2020 [cited by applicant]
US 20200065957A1 · Hay et al. · 2020 [cited by applicant]
US 20200184638A1 · Meglan et al. · 2020 [cited by applicant]
Meyer S., Sorkine-Hornung A., Gross M. (2016) Phase-Based Modification Transfer for Video. In: Leibe B., Matas J., Sebe N., Welling M. (eds) Computer Vision—ECCV 2016. ECCV 2016. Lecture Notes in Computer Science, vol. … [cited by applicant]
Ce Liu, Antonio Torralba, William T. Freeman, Fredo Durand, and Edward H. Adelson. 2005. Motion magnification. ACM Trans. Graph. 24, 3 (Jul. 2005), 519-526. (Year: 2005). [cited by applicant]
Hay, J.R. “High Dynamic Range Imaging for the Detection of Motion”\ pp. 18-141; dissertation University of Louisville (Kentucky); May 2011. [cited by applicant]
Liu et al., “Motion magnification”, ACM Transactions on Graphics (TOG)—Proceedings of ACM SIGGRAPH 2005 TOG Homepage, vol. 24 Issue 3, Jul. 2005. [cited by applicant]
Mazen, et al.; A vision-based approach for the direct measurement of displacements in vibrating systems; article from Smart Materials and Structures; 2003; 12; pp. 785-794; IOP Publishing LTD; UK. [cited by applicant]
Rubinstein et al. (“Revealing Invisible Changes In The World (YouTube)”, YouTube https://www.youtube.com/watch?y=e9ASH8IBJ2U, 2012. [cited by applicant]
Wadhwa et al., “Phase-based Video Motion Processing”, also see YouTube https://www.youtube.com/watch?v=W7ZQFG7Nvw, SIGGRAPH 2013. [cited by applicant]
Wu et al., “Eulerian Video Magnification for Revealing Subtle Changes in the World”, ACM Transactions on Graphics (TOG)—Proceedings of ACM SIGGRAPH 2012 TOG Homepage, vol. 31 Issue 4, Jul. 2012, Article No. 65. [cited by applicant]
Rubinstein et al. (“Eulerian Video Magnification” (YouTube), You Tube https:/twww.youtube.com/watch?v=ONZcjs1Pjmk, 2012). [cited by applicant]
Miyatake K, Yamagishi M, Tanaka N, Uematsu M, Yamazaki N, Mine Y, Sano A, Hirama M. New method for evaluating left ventricular wall motion by color-coded tissue Doppler imaging: in vitro and in vivo studies. J Am Coll C… [cited by applicant]
Nobuo Yamazaki et al “Analysis of Ventricular Wall Motion Using Color-Coded Tissue Doppler Imaging System” 1994 Jpn. J. Appl. Phys. 33 3141 (Year: 1994). [cited by applicant]