IP Library Granted Patent US 11,457,815
Granted Patent B2
US 11,457,815 · App. 16/634,445 · Granted Oct 4, 2022

Mobile-platform compression-induced imaging for subsurface and surface object characterization

Inventor: Chang-Hee Won (Maple Glen, PA)
Assignee: TEMPLE UNIVERSITY—OF THE COMMONWEALTH SYSTEM OF HIGHER EDUCATION
A61B5/0053A61B5/0059A61B5/444A61B5/6843A61B5/6898A61B5/7267A61B5/7275G01N3/08G01N19/00G06T7/0012H04M1/04A61B5/0022A61B2090/306A61B2562/0238A61B2576/00G06T2207/30096H04M2250/12
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,457,815
App. No.
16/634,445
Granted
Oct 4, 2022
Kind
B2
Abstract

A mobile-platform imaging device uses compression of the target region to generate an image of an object. A tactile sensor has an optical waveguide with a flexible, transparent first layer. Light is directed into the waveguide. Light is scattered out of the first layer when the first layer is deformed. The first layer is deformed by the tactile sensor being pressed against the object, A force sensor detects a force pressing the tactile sensor against the object and outputs corresponding force information. A first communication unit receives the force information from the force sensor. A receptacle holds a mobile device with a second communication unit and an imager that can generate image information using light scattered out of the first layer. The first communication unit communicates with the second communication unit and the mobile device communicates with an external network.

Claims (72)

1. A method of determining the surface or subsurface size of an object using a mobile-platform imaging device that uses compression of a target region to generate an image of the object, the mobile imaging device comprising:

a tactile sensor comprising an optical waveguide comprising at least a first layer that is flexible and transparent, the tactile sensor further comprising at least one light source configured to direct light into the optical waveguide, wherein the optical waveguide is configured so that at least some of the light directed into the optical waveguide is scattered out of the first layer when the first layer is deformed, and wherein the first layer is deformed by the tactile sensor being pressed against the target region;

a support structure for maintaining the optical waveguide in place when force is applied to the optical waveguide;

a force sensor that detects a force being applied to press the tactile sensor against the target region and outputs corresponding force information;

a first communication unit connected to receive the force information from the force sensor; and

a receptacle for holding a mobile device having a second communication unit and an imager so positioned that the imager can generate image information using at least some of the light scattered out of the first layer; wherein the first communication unit is configured of communicated with the second communication unit and the mobile device is configured of communicated with an external network;

the method comprising the steps of:

obtaining the image information and corresponding force information at a plurality of applied forces; and

estimating the size of the object using 3D interpolation;

wherein the obtaining step comprises:

obtaining a series of images over a time period while varying the force; and

selecting images from a part of the time period over which the force varies with time more smoothly and/or more linearly than during other parts of the time period.

2. A method for aligning at least one light source of a mobile platform imaging device that uses compression of a target region to generate an image of an object, the mobile-platform imaging device comprising:

a tactile sensor comprising an optical waveguide comprising at least a first layer that is flexible and transparent, the tactile sensor further comprising at least one light source configured to direct light into the optical waveguide, wherein the optical waveguide is configured so that at least some of the light directed into the optical waveguide is scattered out of the first layer when the first layer is deformed, and wherein the first layer is deformed by the tactile sensor being pressed against the target region;

a support structure for maintaining the optical waveguide in place when force is applied to the optical waveguide;

a force sensor that detects a force being applied to press the tactile sensor against the target region and outputs corresponding force information;

a first communication unit connected to receive the force information from the force sensor; and

a receptacle for holding a mobile device having a second communication unit and an imager so positioned that the imager can generate image information using at least some of the light scattered out of the first layer; wherein the first communication unit is configured to communicated with the second communication unit and the mobile device is configured to communicated with an external network; the method comprising the steps of:

applying the tactile sensor with a preselected force to a known object;

processing the image information to identify an asymmetry of the scattered light; and

adjusting the at least one light source to reduce the asymmetry.

3. A method for detecting a cut or damage to an optical waveguide of a mobile-platform imaging device that uses compression of a target region to generate an image of an object, the mobile-platform imaging device comprising:

a tactile sensor comprising the optical waveguide comprising at least a first layer that is flexible and transparent, the tactile sensor further comprising at least one light source configured to direct light into the optical waveguide, wherein the optical waveguide is configured so that at least some of the light directed into the optical waveguide is scattered out of the first layer when the first layer is deformed, and wherein the first layer is deformed by the tactile sensor being pressed against the target region;

a support structure for maintaining the optical waveguide in place when force is applied to the optical waveguide;

a force sensor that detects a force being applied to press the tactile sensor against the target region and outputs corresponding force information;

a first communication unit connected to receive the force information from the force sensor; and

a receptacle for holding a mobile device having a second communication unit and an imager so positioned that the imager can generate image information using at least some of the light scattered out of the first layer;

wherein the first communication unit is configured to communicated with the second communication unit and the mobile device is configured to communicated with an external network;

the method comprising the steps of:

applying the tactile sensor with a preselected force to a known object;

processing the image information to identify an asymmetry of the scattered light; and

when the asymmetry exceeds a threshold, indicating a cut or damage to the optical waveguide.

4. The method of claim 1 , wherein at least the first layer of the optical waveguide is semi-cylindrical.

5. A method for detecting a cut or damage to the optical waveguide of the mobile-platform imaging device comprising:

a tactile sensor comprising an optical waveguide with a front surface arranged for contacting a target region, the optical waveguide comprising at least a first layer at the front surface that is flexible and transparent, the tactile sensor further comprising multiple light sources configured to direct light into the optical waveguide, the optical waveguide configured to constrain the light within the optical waveguide when the optical waveguide is not deformed, wherein the optical waveguide is configured so that at least some of the light directed into the optical waveguide is scattered out of the first layer when the first layer is deformed, and wherein the first layer is deformed by the tactile sensor being pressed against the target region, the tactile sensor including a diffuser positioned adjacent to the light sources for diffusing light from the light sources to cause the light to distribute uniformly within the optical waveguide;

a support structure for maintaining the optical waveguide in place when force is applied to the optical waveguide;

a force sensor that detects a force being applied to press the tactile sensor against the target region and outputs corresponding force information, the force sensor mounted so as to permit calculation of an applied force in a direction normal to the front surface of the optical waveguide;

a first communication unit connected to receive the force information from the force sensor and to associate with the force information a force time when the force information was captured; and

a receptacle for holding a mobile device having a second communication unit and an imager so positioned that the imager can generate image information using at least some of the light scattered out of the first layer;

wherein the first communication unit is configured to communicated with the second communication unit and the mobile device is configured to communicated with an external network;

wherein a stress value for each image is determined from the applied force associated with the image information that is generated for each image by the imager from light scattered out of the first layer due to the respective applied force; and

wherein a deformation of the first layer is determined based on the image information;

wherein a softness value of an object is determined based on the deformation and the stress value; and

wherein the second communication unit is programmed to control activation of the imager and, when the imager is activated to capture an image, to associate an image time with the captured image, and to retrieve from the first communication unit the force information that was received from the force sensor at the force time that the image was captured, the second communication unit further programmed to associate the captured image with retrieved applied force at the common force time and image time;

wherein the method comprises the steps of:

applying the tactile sensor with a preselected force to a known object;

processing the image information to identify an asymmetry of the scattered light; and

when the asymmetry exceeds a threshold, indicating a cut or damage to the optical waveguide.

6. The method of claim 1 , wherein the mobile device is a mobile telephone.

7. The method of claim 1 , wherein the mobile telephone is programmed to generate the image information, synchronize the image information with the force information, and transmit the associated information to an external device.

8. The method of claim 2 , wherein the associated information further includes information selected from a current date, a current time, a user ID of a current user of the mobile device, and a target ID of the object.

9. The method of claim 1 , wherein the image information is selected from the group consisting of a single image, multiple images, and a video image.

10. The method of claim 1 , wherein the mobile device is programmed to exchange a plurality of messages with the external device, generate a hash from content of the plurality of messages, and encrypt the synchronized information using an encryption key determined from the hash.

11. The method of claim 1 , wherein the receptacle is configured as a frame defining a cradle for selective removable receipt of the mobile device such that an imaging unit of the mobile device is positioned opposite of and along a line of sight with the optical waveguide.

12. The method of claim 11 , wherein the frame comprises a holder having a cutout for installation therein of the optical waveguide.

13. The method of claim 12 , wherein multiple holes are formed spaced about the holder for installation of the multiple light sources for providing selective side- illumination of the optical waveguide.

14. The method of claim 12 , wherein an aperture is formed centered within the cutout for providing the line of sight between the imaging unit and the optical waveguide.

15. The method of claim 11 , wherein the cradle comprises raised sides for engagement with the mobile device.

16. The method of claim 1 , wherein the force sensor is located between the tactile sensor and the receptacle for holding the mobile device.

17. The method of claim 1 , further comprising a handle, wherein the force sensor is located between the handle and the receptacle for holding the mobile device.

18. The method of claim 17 , wherein the handle is defined by a frame of the receptacle.

19. The method of claim 17 , wherein the handle is defined by a housing operably installed on the frame.

20. The method of claim 19 , further comprising a motor operably installed on the housing for controlled application of the force to the tactile sensor through the receptacle as sensed by the force sensor.

21. The method of claim 1 , further comprising a motor operably installed on the receptacle for controlled application of the force to the tactile sensor through the receptacle as sensed by the force sensor.

22. The method of claim 1 , further comprising a constant current driver circuitry for powering the at least one light source.

23. The method of claim 1 , wherein the support structure comprises a rigid frame mounted against a surface of the optical waveguide spaced apart from the front surface.

24. The method of claim 1 , wherein the support structure is provided by the structural configuration of the waveguide.

25. The method of claim 1 , wherein at least the first layer of the optical waveguide is curved.

26. The method of claim 25 , wherein at least the first layer of the optical waveguide is semi-spherical.

27. The method of claim 1 , wherein at least the first layer of the optical waveguide is rectangular.

28. The method of claim 1 , wherein at least the first layer of the optical waveguide is an elastomer.

29. The method of claim 28 , wherein the elastomer is Polydimethylsiloxane (PDMS).

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 10, 2020
From: WON, CHANG-HEE
To: TEMPLE UNIVERSITY - OF THE COMMONWEALTH SYSTEM OF HIGHER EDUCATION
Reel/Frame 053174/0061 →
Continuity (2)
Provisional Application 62538032 · Jul 28, 2017
Related Publication 20200205665A1 · Jul 2, 2020