IP Library Granted Patent US 8,139,867
Granted Patent B2
US 8,139,867 · App. 12/315,642 · Granted Mar 20, 2012

Image segregation system architecture

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,139,867
App. No.
12/315,642
Granted
Mar 20, 2012
Kind
B2
Abstract

In an exemplary embodiment of the present invention, an automated, computerized method is provided for processing an image. According to a feature of the present invention, the method comprises the steps of generating spatio-spectral information for the image, defining a constraint as a function of the spatio-spectral information, and performing an optimization operation as a function of the constraint to generate an intrinsic image corresponding to the image.

Claims (72)

1. An automated, computerized method for processing an image, comprising the steps of:

providing an image;

generating spatio-spectral operators for the image;

defining a constraint between the spatio-spectral operators; and

performing an optimization operation as a function of the constraint to generate an intrinsic image corresponding to the image, the intrinsic image comprising a representation of one of material or illumination, expressed as a separate, multi-band representation for the one of material or illumination, independent of the other of the material or illumination, wherein each band corresponds to a segment of the electro-magnetic spectrum.

2. The method of claim 1 wherein the step of performing an optimization operation is carried out by performing a convex optimization operation.

3. The method of claim 1 wherein the step of performing an optimization operation includes the further step of introducing factors established as a function of real world illumination and material phenomena, to keep material/illumination values determined in the optimization operation, to within physically plausible limits.

4. The method of claim 3 , wherein the factors include bounds.

5. An automated, computerized method for processing an image, comprising the steps of:

providing an image;

generating spatio-spectral operators for the image, wherein the spatio-spectral operators comprise operators selected from the group consisting of tokens, token map information, log chromaticity representation values, X-junctions, BIDR model representations, textons, and combinations thereof;

defining a constraint between the spatio-spectral operators; and

performing an optimization operation as a function of the constraint to generate an intrinsic image corresponding to the image.

6. An automated, computerized method for processing an image, comprising the steps of:

providing an image;

generating spatio-spectral operators for the image;

defining a constraint between the spatio-spectral operators, wherein the constraint comprises a constraint selected from the group consisting of an anchor constraint, a same illumination constraint, a smooth illumination constraint, a Type B token constraint, a Linear token constraint, a BIDR enforcement constraint, a same texton histogram constraint, a log chromaticity similarity constraint, an X junction constraint, and combinations thereof; and

performing an optimization operation as a function of the constraint to generate an intrinsic image corresponding to the image.

7. An automated, computerized method for processing an image, comprising the steps of :

providing an image;

organizing spatio-spectral information for the image in a matrix equation expressed by:

[A] [x]=[b], wherein [A] expresses values determined by a constraining relationship imposed upon the spatio-spectral information, [b] expresses recorded information for the image, and [x] expresses an unknown material/illumination component of the image;

performing an optimization operation to determine a solution for the equation; and

utilizing the solution to generate an intrinsic image corresponding to the image.

8. The method of claim 7 wherein the step of performing an optimization operation is carried out by performing an optimization operation selected from the group consisting of a least squares solver and a preconditioned conjugate gradient solver.

9. The method of claim 7 wherein the step of performing an optimization operation includes the further step of introducing factors established as a function of real world illumination and material phenomena, to keep material/illumination values determined in the optimization operation, to within physically plausible limits.

10. The method of claim 9 , wherein the factors include bounds.

11. The method of claim 10 , wherein the step of performing an optimization operation is carried out by performing an optimization operation selected from the group consisting of a limit 1, limit infinity solver, a bounded least squares solver and a bounded limit 1, limit infinity solver.

12. The method of claim 7 wherein the intrinsic image comprises one of a material image and an illumination image.

13. A computer system which comprises:

a CPU; and

a memory storing an image file containing an image;

the CPU arranged and configured to execute a routine to perform a routine to generate spatio-spectral operators for the image, define a constraint between the spatio-spectral operators, and perform an optimization operation as a function of the constraint to generate an intrinsic image corresponding to the image, the intrinsic image comprising a representation of one of material or illumination, expressed as a separate, multi-band representation for the one of material or illumination, independent of the other of the material or illumination, wherein each band corresponds to a segment of the electro-magnetic spectrum.

14. A computer system which comprises:

a CPU; and

a memory storing an image file containing an image;

the CPU arranged and configured to execute a routine to perform a routine to organize spatio-spectral information for the image in a matrix equation expressed by: [A] [x]=[b], wherein [A] expresses values determined by a constraining relationship imposed upon the spatio-spectral information, [b] expresses recorded information for the image, and [x] expresses an unknown material/illumination component of the image, perform an optimization operation to determine a solution for the equation, and utilize the solution to generate an intrinsic image corresponding to the image.

15. A computer system comprising:

a memory storing an image file containing an image;

a constraint generator library storing a plurality of constraint software modules, each one of the constraint software modules defining spatio-spectral information utilized by the respective one of the constraint software modules and an expression of a constraining relationship imposed upon the respective spatio-spectral information;

a service provider; and

a solver; wherein:

the service provider operates to select a constraint software module from the plurality of constraint software modules, arrange spatio-spectral information relevant to the image as a function of the selected constraint software module, and input the arranged spatio-spectral information relevant to the image to the solver, the solver operates to perform an optimization operation as a function of the arranged spatio-spectral information relevant to the image, to generate an intrinsic image corresponding to the image.

16. The computer system of claim 15 , further comprising an operator cache for storing spatio-spectral information defined by the plurality of constraint software modules.

17. The computer system of claim 15 further comprising a GUI for a user input; the service provider operates to select a constraint software module as a function of the user input.

18. The computer system of claim 15 wherein the arranged spatio-spectral information relevant to the image comprises a matrix equation expressed by:

[A] [x]=[b], wherein [A] expresses values determined by a constraining relationship imposed upon the spatio-spectral information, [b] expresses recorded information for the image, and [x] expresses an unknown material/illumination component of the image.

19. An automated, computerized method for processing an image, comprising the steps of:

providing an image;

generating spatio-spectral information for the image;

defining a constraint as a function of the spatio-spectral information; and

performing an optimization operation as a function of the constraint to generate an intrinsic image corresponding to the image, the intrinsic image comprising a representation of one of material or illumination, expressed as a separate, multi-band representation for the one of material or illumination, independent of the other of the material or illumination, wherein each band corresponds to a segment of the electro-magnetic spectrum.

20. An automated, computerized method for processing an image, comprising the steps of:

providing an image;

generating spatio-spectral information for the image;

defining a constraint as a function of the spatio-spectral information, wherein the constraint comprises a constraint selected from the group consisting of an absolute material color constraint, a same material constraint and a relative reflectance constraint; and

performing an optimization operation as a function of the constraint to generate an intrinsic image corresponding to the image.

21. An automated, computerized method for processing an image, comprising the steps of:

providing an image;

generating spatio-spectral information for the image, wherein the spatio-spectral information for the image comprises an operator selected from the group consisting of tokens, token map information, log chromaticity representation values, X-junctions, BIDR model representations, textons, and combinations thereof;

defining a constraint as a function of the spatio-spectral information; and

performing an optimization operation as a function of the constraint to generate an intrinsic image corresponding to the image.

22. A computer system which comprises:

a CPU; and

a memory storing an image file containing an image;

the CPU arranged and configured to execute a routine to generate spatio-spectral information for the image, define a constraint as a function of the spatio-spectral information, and perform an optimization operation as a function of the constraint to generate an intrinsic image corresponding to the image, the intrinsic image comprising a representation of one of material or illumination, expressed as a separate, multi-band representation for the one of material or illumination, independent of the other of the material or illumination, wherein each band corresponds to a segment of the electro-magnetic spectrum.

23. An automated, computerized method for processing an image, comprising the steps of:

providing an image;

generating spatio-spectral information for the image;

defining a set of constraints as a function of the spatio-spectral information; and

performing an optimization operation as a function of the constraints, wherein individual ones of the set of constraints are weighted relative to one another, in the optimization operation, according to preselected factors, to generate an intrinsic image corresponding to the image, wherein the preselected factors are selected from a group consisting of perceived importance of the respective ones of the constraints, strength, an empirically determined confidence level and combinations thereof.

24. A computer program product, disposed on a non-transitory computer readable media, the product including computer executable process steps operable to control a computer to: provide an image file depicting an image, in a computer memory, generate spatio-spectral information for the image, define a constraint as a function of the spatio-spectral information, and perform an optimization operation as a function of the constraint to generate an intrinsic image corresponding to the image, the intrinsic image comprising a representation of one of material or illumination, expressed as a separate, multi-band representation for the one of material or illumination, independent of the other of the material or illumination, wherein each band corresponds to a segment of the electro-magnetic spectrum.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 7, 2022
From: TANDENT COMPUTER VISION LLC
To: INNOVATION ASSET COLLECTIVE
Reel/Frame 061387/0149 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 3, 2019
From: TANDENT VISION SCIENCE, INC.
To: TANDENT COMPUTER VISION LLC
Reel/Frame 049080/0636 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 2, 2009
From: MAXWELL, BRUCE ALLEN; SMITH, CASEY ARTHUR; TOLLIVER, DAVID ALLEN; BAGNELL, JAMES ANDREW; STEIN, ANDREW NEIL; KWAK, IIJUNG SAMUEL; DANA, KRISTIN JEAN; BUSHELL, STEVEN JOSEPH; RODGERS, JR., TIMOTHY KING; NABBE, BARTHOLOMEUS CHRISTIANUS LEONARDUS; DIEBEL, MILAN; FRIEDHOFF, RICHARD MARK
To: TANDENT VISION SCIENCE, INC.
Reel/Frame 022348/0993 →