IP Library › Granted Patent US 11,637,967
Granted Patent B2
US 11,637,967 · App. 17/044,533 · Granted Apr 25, 2023

Information processing apparatus, information processing method, and calibration apparatus

Inventors: Ying Lu (Kanagawa, JP); Yasutaka Hirasawa (Tokyo, JP); Yuhi Kondo (Tokyo, JP); Tuo Zhuang (Tokyo, JP); Legong Sun (Tokyo, JP)
Assignee: SONY CORPORATION
H04N5/243G01J4/04G01N21/21G06T7/80H04N5/2256H04N5/2351H04N17/002G06T2207/10152
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,637,967
App. No.
17/044,533
Granted
Apr 25, 2023
Kind
B2
Abstract

Provided is a polarization imaging unit that acquires a polarization image using a lens. In a parameter storage unit of an information processing unit, parameters related to a change in polarization state due to the lens which are estimated in advance from polarization state information acquired by imaging a light source in a predetermined polarization state using the lens and polarization state information indicating the polarization state of the light source, for example, change parameters indicating the change in polarization state due to the lens or correction parameters for correcting the change in polarization state due to the lens are stored. A polarization state correction unit of the information processing unit corrects the change in polarization state due to the lens, using the parameters stored in advance in the parameter storage unit.

Claims (43)

1. An information processing apparatus, comprising:

a memory configured to store a plurality of parameters; and

a processor configured to:

acquire, from an image sensor that images a light source using a lens, a polarization image;

generate polarization state information based on the polarization image, wherein the polarization state information indicates a polarization state of light from the light source; and

correct a change in the polarization state of the light in the polarization image, wherein

the change in the polarization state of the light is due to the lens,

the correction of the change in the polarization state is based on the stored plurality of parameters, and

the stored plurality of parameters is related to the change in the polarization state of the light due to the lens.

2. The information processing apparatus according to claim 1 , wherein the plurality of parameters includes one of change parameters representing the change in the polarization state or correction parameters to correct the change in the polarization state.

3. The information processing apparatus according to claim 1 , wherein

the polarization state information includes a Stokes vector obtained from a plurality of pixel values with different polarization directions, and

the plurality of parameters correspond to component values of a matrix representing an amount of change of the polarization state information.

4. The information processing apparatus according to claim 1 , wherein

the polarization state information includes a plurality of pixel values with different polarization directions, and

the plurality of parameters correspond to component values of a matrix calculated using a matrix representing a relationship between the plurality of pixel values with the different polarization directions and a Stokes vector,

the Stokes vector is obtained from the plurality of pixel values with the different polarization directions, and

the matrix represents an amount of change of the polarization state information in a case where the polarization state information indicates the Stokes vector.

5. The information processing apparatus according to claim 1 , wherein

the polarization state information includes an azimuth angle, a degree of polarization, and an average intensity, and

the plurality of parameters correspond to component values of a matrix representing an amount of change of the polarization state information.

6. The information processing apparatus according to claim 1 , wherein the plurality of parameters are stored on a pixel-by-pixel basis of the polarization image.

7. The information processing apparatus according to claim 1 , wherein the polarization image includes at least three or more polarization components.

8. The information processing apparatus according to claim 1 , wherein the processor is further configured to:

perform one of defect correction or sensitivity correction of the polarization image; and

generate the polarization state information based on the polarization image that has been corrected.

9. The information processing apparatus according to claim 1 , further comprising the image sensor configured to acquire the polarization image by imaging using the lens.

10. An information processing method, comprising:

storing, by a memory, a plurality of parameters;

acquiring, by a processor, a polarization image from an image sensor that images a light source using a lens;

generating, by the processor, polarization state information based on the polarization image, wherein the polarization state information indicates a polarization state of light from the light source; and

correcting, by the processor, a change in the polarization state of the light in the polarization image, wherein

the change in the polarization state of the light is due to the lens,

the correction of the change in the polarization state is based on the stored plurality of parameters, and

the stored plurality of parameters is related to the change in the polarization state of the light due to the lens.

11. A non-transitory computer-readable medium having stored thereon, computer-executable instructions that, when executed by a processor, cause the processor to execute operations, the operations comprising:

storing a plurality of parameters is stored in a memory;

acquiring, from an image sensor that images a light source using a lens, a polarization image;

generating polarization state information based on the polarization image, wherein the polarization state information indicates a polarization state of light from the light source; and

correcting a change in the polarization state of the light in the polarization image, wherein

the change in the polarization state of the light is due to the lens,

the correction of the change in the polarization state is based on the stored plurality of parameters, and

the stored plurality of parameters is related to the change in the polarization state of the light due to the lens.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 10, 2021
From: LU, YING; HIRASAWA, YASUTAKA; KONDO, YUHI; ZHUANG, TUO; SUN, LEGONG
To: SONY CORPORATION
Reel/Frame 056492/0647 →
Priority Claims (1)
JP JP2018-074597 · Apr 9, 2018 · national
Continuity (1)
Related Publication 20210152748A1 · May 20, 2021