IP Library Granted Patent US 9,019,422
Granted Patent B2
US 9,019,422 · App. 13/378,230 · Granted Apr 28, 2015

Degree-of-focus determination module, position-of-best-focus selection modules, image processing module, imaging system, and corresponding method

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,019,422
App. No.
13/378,230
Granted
Apr 28, 2015
Kind
B2
Abstract

A system for imaging a structure of an object is provided. The imaging system includes a degree-of-focus determination module that may comprise logic for taking into account at least one of a first and a second dimension of a topological element of the structure to be imaged. An image processing module of the system may comprise: a control module for controlling a motorized focus driver; a memory for storing images; and said degree-of-focus determination module. The imaging system may comprise: a stage; a motorized focus driver for driving the stage; at least one of microscope optics, a lens, an illumination system; a camera; and an image processing module.

Claims (52)

1. An imaging system, configured to image a structure of an object, the object comprising a plurality of buses or vias or contacts, wherein the buses respectively have at least one prevailing orientation OX, the imaging system comprising:

a stage upon which the object having the structure comprising a plurality of topological elements is to be mounted;

a motorized focus driver for driving the stage;

optics, wherein the imaging system is for:

positioning the object such that the prevailing orientation OX is perpendicular to a scanning direction OY; and

producing an image stack comprising a set of images, each image made with a different coordinate along an optical axis; and

an image processing module configured to process a set of electronic images, the image processing module comprising

a degree-of-focus determination module for taking into account at least one of a first and a second dimension of a topological element of the structure to be imaged, the degree-of-focus determination module for controlling the motorized focus driver, wherein the image processing module filters the images of the set of images using a filter matrix, the filter matrix calculated using dimensions of topological elements of the structure, wherein the structure comprises a plurality of topological elements; and

wherein the degree-of-focus determination module further performs the steps of:

determining a position of best focus along the optical axis;

determining a position of focus to guarantee focused images of the buses or vias;

if the position of best focus lies below or at the position of focus to guarantee focused images, selecting the position of best focus as a focus position; and

if the position of best focus lies above the position of focus to guarantee focused images, selecting the position of focus to guarantee focused images as the focus position.

2. The imaging system of claim 1 wherein the degree-of-focus determination module comprises a filter having a first filter parameter adapted to the first dimension of the topological element of the structure to be imaged.

3. The imaging system of claim 2 wherein the filter has a second filter parameter adapted to the second dimension of the topological element of the structure to be imaged and wherein the filter is represented by a two-dimensional array, wherein a dimension of the filter is based upon a minimum value of the first dimension and the second dimension of the topological element.

4. The imaging system of claim 3 wherein a first direction of the first dimension and a second direction of the second dimension are substantially perpendicular to each other.

5. The imaging system of claim 1 wherein the image processing module further comprises:

a position-of-best-focus selection module for selecting a position of position of best focus by taking into account a degree-of-focus histogram H z determined by the degree-of-focus determination module, wherein H z is a number of pixels with highest degree-of-focus at a distance z along an optical axis of the optics.

6. The imaging system of claim 1 wherein the image processing module further comprises:

a position-of-best-focus selection module for selecting a position of best focus by taking into account a third dimension of the topological element of the structure to be imaged.

7. The imaging system of claim 6 , wherein the third dimension of the topological element is one of a thickness of a layer, a thickness of an interlayer, and a sum of both thicknesses, wherein the structure comprises a plurality of layers.

8. The imaging system of claim 1 wherein the image processing module further comprises:

a camera; and

a memory for storing images.

9. The imaging system of claim 1 , wherein the illumination system is capable to illuminate the object surface in bright field or in dark field.

10. The imaging system of claim 1 , wherein the illumination system is capable to illuminate the object surface for observation of the object in transmitted light or in reflected light.

11. The imaging system of claim 1 , wherein the illumination system is capable to illuminate the object surface for observation of the fluorescence of the object.

12. The imaging system of claim 1 wherein the object comprises a die.

13. The imaging system of claim 12 wherein:

the die comprises a plurality of layers; and

the topological element lies within one of the plurality of layers.

14. A method for determining a degree-of-focus for imaging a structure of an object, wherein the structure comprises a plurality of buses or vias or contacts, wherein the buses respectively have at least one prevailing orientation OX, the method comprising:

positioning the object such that the prevailing orientation OX is perpendicular to a scanning direction OY;

producing an image stack comprising a set of images, each image made with a different among along an optical axis;

filtering the images of the set of images using a filter matrix, the filter matrix calculated using dimensions of topological elements of the structure, wherein the structure comprises a plurality of topological elements;

determining a position of best focus along the optical axis;

determining a geometric center of the image stack;

if the position of best focus lies above the geometric center, selecting the position of best focus as a focus position; and

if the position of best focus lies below the geometric center, selecting a position above the geometric center as the focus position.

15. The method of claim 14 further comprising composing an image with focus extension comprising:

for each two dimensional pixel position x, y, selecting a value z along the optical axis such that a pixel S x,y,z has a best focus; and

assembling the selected pixels S x,y,z into an image.

16. A non-transitory computer-readable storage medium storing instructions executable by a processor, wherein the instructions when executed by the processor determine a degree-of-focus for imaging a structure of an object, wherein the structure comprises a plurality of buses or vias or contacts, wherein the buses respectively have at least one prevailing orientation OX, the instructions comprising:

instructions to position the obiect such that the prevailing orientation OX is perpendicular to a scanning direction OY;

instructions to produce an image stack comprising a set of images, each image made with a different coordinate along an optical axis;

instructions to filter the images of the set of images using a filter matrix, the filter matrix calculated using dimensions of topological elements of the structure, wherein the structure comprises a plurality of topological elements;

instructions to determine a position of best focus along the optical axis;

instructions to determine a geometric center of the image stack;

instructions to select the position of best focus as a focus position if the position of best focus lies above the geometric center; and

instructions to select a position above the geometric center as the focus position if the position of best focus lies below the geometric center.

17. The computer-readable storage medium of claim 16 , wherein the instructions further take into account a third dimension of the topological element of the structure to be imaged.

18. The computer-readable storage medium of claim 17 , wherein the third dimension of the topological element is one of a thickness of a layer, a thickness of an interlayer, and a sum of the layer and the interlayer.

Assignments (31)
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 11759915 AND REPLACE IT WITH APPLICATION 11759935 PREVIOUSLY RECORDED ON REEL 040925 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE RELEASE OF SECURITY INTEREST. Recorded Feb 17, 2020
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP, B.V. F/K/A FREESCALE SEMICONDUCTOR, INC.
Reel/Frame 052917/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 11759915 AND REPLACE IT WITH APPLICATION 11759935 PREVIOUSLY RECORDED ON REEL 040928 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE RELEASE OF SECURITY INTEREST. Recorded Jan 17, 2020
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP B.V.
Reel/Frame 052915/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 11759915 AND REPLACE IT WITH APPLICATION 11759935 PREVIOUSLY RECORDED ON REEL 037486 FRAME 0517. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT AND ASSUMPTION OF SECURITY INTEREST IN PATENTS. Recorded Dec 10, 2019
From: CITIBANK, N.A.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 053547/0421 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12298143 PREVIOUSLY RECORDED ON REEL 042985 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded Oct 22, 2019
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 051029/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12298143 PREVIOUSLY RECORDED ON REEL 042762 FRAME 0145. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded Oct 22, 2019
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 051145/0184 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12298143 PREVIOUSLY RECORDED ON REEL 038017 FRAME 0058. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded Oct 22, 2019
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 051030/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12298143 PREVIOUSLY RECORDED ON REEL 039361 FRAME 0212. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded Oct 22, 2019
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 051029/0387 →
RELEASE OF SECURITY INTEREST Recorded Sep 10, 2019
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP B.V.
Reel/Frame 050745/0001 →
RELEASE OF SECURITY INTEREST Recorded Sep 10, 2019
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP B.V.
Reel/Frame 050744/0097 →
CORRECTIVE ASSIGNMENT TO CORRECT THE TO CORRECT THE APPLICATION NO. FROM 13,883,290 TO 13,833,290 PREVIOUSLY RECORDED ON REEL 041703 FRAME 0536. ASSIGNOR(S) HEREBY CONFIRMS THE THE ASSIGNMENT AND ASSUMPTION OF SECURITY INTEREST IN PATENTS.. Recorded Feb 20, 2019
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: SHENZHEN XINGUODU TECHNOLOGY CO., LTD.
Reel/Frame 048734/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE NATURE OF CONVEYANCE PREVIOUSLY RECORDED AT REEL: 040632 FRAME: 0001. ASSIGNOR(S) HEREBY CONFIRMS THE MERGER AND CHANGE OF NAME. Recorded Sep 21, 2017
From: FREESCALE SEMICONDUCTOR INC.
To: NXP USA, INC.
Reel/Frame 044209/0047 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12681366 PREVIOUSLY RECORDED ON REEL 039361 FRAME 0212. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded May 9, 2017
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 042762/0145 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12681366 PREVIOUSLY RECORDED ON REEL 038017 FRAME 0058. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded May 9, 2017
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 042985/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE PATENTS 8108266 AND 8062324 AND REPLACE THEM WITH 6108266 AND 8060324 PREVIOUSLY RECORDED ON REEL 037518 FRAME 0292. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT AND ASSUMPTION OF SECURITY INTEREST IN PATENTS. Recorded Feb 1, 2017
From: CITIBANK, N.A.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 041703/0536 →
CHANGE OF NAME Recorded Nov 8, 2016
From: FREESCALE SEMICONDUCTOR, INC.
To: NXP USA, INC.
Reel/Frame 040632/0001 →
RELEASE OF SECURITY INTEREST Recorded Nov 7, 2016
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP B.V.
Reel/Frame 040928/0001 →
RELEASE OF SECURITY INTEREST Recorded Sep 21, 2016
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP, B.V., F/K/A FREESCALE SEMICONDUCTOR, INC.
Reel/Frame 040925/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12092129 PREVIOUSLY RECORDED ON REEL 038017 FRAME 0058. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded Jul 14, 2016
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 039361/0212 →
SUPPLEMENT TO THE SECURITY AGREEMENT Recorded Jun 16, 2016
From: FREESCALE SEMICONDUCTOR, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 039138/0001 →
SECURITY AGREEMENT SUPPLEMENT Recorded Mar 7, 2016
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 038017/0058 →
ASSIGNMENT AND ASSUMPTION OF SECURITY INTEREST IN PATENTS Recorded Jan 13, 2016
From: CITIBANK, N.A.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 037518/0292 →
ASSIGNMENT AND ASSUMPTION OF SECURITY INTEREST IN PATENTS Recorded Jan 12, 2016
From: CITIBANK, N.A.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 037486/0517 →
PATENT RELEASE Recorded Dec 21, 2015
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: FREESCALE SEMICONDUCTOR, INC.
Reel/Frame 037357/0379 →
PATENT RELEASE Recorded Dec 21, 2015
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: FREESCALE SEMICONDUCTOR, INC.
Reel/Frame 037357/0439 →
PATENT RELEASE Recorded Dec 21, 2015
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: FREESCALE SEMICONDUCTOR, INC.
Reel/Frame 037357/0447 →
SECURITY AGREEMENT Recorded Nov 6, 2013
From: FREESCALE SEMICONDUCTOR, INC.
To: CITIBANK, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 031591/0266 →
SECURITY AGREEMENT Recorded Jun 18, 2013
From: FREESCALE SEMICONDUCTOR, INC.
To: CITIBANK, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 030633/0424 →
SUPPLEMENT TO IP SECURITY AGREEMENT Recorded Mar 7, 2012
From: FREESCALE SEMICONDUCTOR, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 027821/0967 →
SUPPLEMENT TO IP SECURITY AGREEMENT Recorded Mar 7, 2012
From: FREESCALE SEMICONDUCTOR, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 027821/0662 →
SUPPLEMENT TO IP SECURITY AGREEMENT Recorded Mar 7, 2012
From: FREESCALE SEMICONDUCTOR, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 027821/0982 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 14, 2011
From: BOROVYTSKY, VOLODYMYR
To: FREESCALE SEMICONDUCTOR INC
Reel/Frame 027385/0275 →