IP Library Patent Application 14608357
Patent Application
App. No. 14/608,357

Method and System for Optimizing Image Processing in Driver Assistance Systems

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
14/608,357
Abstract

An imager simulator configured to be used in lieu of an imager within a vehicle is provided. The imager simulator includes an image source configured to store pre-determined reference data; and an imager interface unit configured to generate image data based on the pre-determined reference data. The image data conforms to a pre-determined format; and wherein the pre-determined format corresponds to a format of image data generated by the imager.

Claims (72)

1 . An imager simulator configured to be used in lieu of an imager within a vehicle, the imager simulator comprising:

an image source configured to store pre-determined reference data; and

an imager interface unit configured to generate image data based on the pre-determined reference data, wherein

the image data conforms to a pre-determined format, and

the pre-determined format corresponds to a format of image data generated by the imager.

2 . The imager simulator according to claim 1 , wherein the pre-determined format comprises at least one of:

a pre-determined standard;

a resolution of a frame of the image data;

a frame-rate of succeeding frames of the image data;

a color space used to represent color information included within the image data;

a chroma subsampling scheme;

a number of bits used to encode a pixel of the image data;

a rate at which the bits which encode the pixel of the image data are transmitted;

a use of synchronization signals;

an interlaced or de-interlaced operation of the imager;

timing information for synchronization of the imager simulator with one or more components downstream of the imager; or

a serial or parallel transmission of the image data.

3 . The imager simulator according to claim 1 , wherein the imager simulator comprises a physical connector which conforms to a physical connector of the imager.

4 . An evaluation system for determining a performance indicator of an imager-based driver assistance system, the evaluation system comprising:

an imager simulator configured to be used, in lieu of an imager of the driver assistance system, wherein the imager simulator comprises:

an image source configured to store pre-determined reference data; and

an imager interface unit configured to generate image data based on the pre-determined reference data, wherein

the image data conforms to a pre-determined format, and

the pre-determined format corresponds to a format of image data generated by the imager;

an image analysis unit configured to analyze data derived from the image data, thereby generating analyzed image data; and

an evaluation unit configured to determine the performance indicator based on the analyzed image data.

5 . The evaluation system according to claim 4 , wherein the evaluation unit is configured to determine the performance indicator also based on benchmark data derived from the pre-determined reference data.

6 . The evaluation system according to claim 5 , wherein

the benchmark data is indicative of one or more benchmark objects,

the analyzed image data is indicative of zero or more detected objects, and

the performance indicator comprises a detection rate of the one or more benchmark objects within the analyzed image data.

7 . The evaluation system according to claim 6 , further comprising:

a compression unit configured to encode the image data using a lossy compressing scheme, thereby yielding compressed image data; and

a decompression unit configured to decode the compressed image data, thereby yielding decoded image data; wherein the image analysis unit is configured to analyze the decoded image data to provide the analyzed image data.

8 . The evaluation system according to claim 4 , further comprising:

a compression unit configured to encode the image data using a lossy compressing scheme, thereby yielding compressed image data; and

a decompression unit configured to decode the compressed image data, thereby yielding decoded image data; wherein the image analysis unit is configured to analyze the decoded image data to provide the analyzed image data.

9 . The evaluation system according to claim 7 , wherein the compression unit comprises at least one of the following adjustable settings:

the compression scheme used within the compression unit;

an overall target bit-rate or an overall compression ratio implemented by the compression scheme;

a maximum bit-rate per frame of the image data or a maximum bit-rate per subregion of a frame of the image data;

a target average bit-rate per pre-determined time interval;

a maximum bit-rate per pre-determined time interval;

a minimum value for a quality of the compressed image data with respect to the image data; or

a quality criteria applied by the compression scheme when encoding the image data.

10 . The evaluation system according to claim 7 , further comprising:

a reference image analysis unit configured to analyze the image data, thereby generating reference analyzed image data; and

a comparison unit configured to determine a performance deterioration of the imager-based driver assistance system due to the lossy compressing scheme applied to the image data, based on the reference analyzed image data and based on the analyzed image data.

11 . A method for determining a performance indicator of an imager-based driver assistance system, the method comprising the acts of:

generating image data based on pre-determined reference data using an imager simulator in lieu of an imager of the driver assistance system;

analyzing data derived from the image data using a first image analysis algorithm, thereby generating analyzed image data; and

determining the performance indicator based on the analyzed image data.

12 . The method according to claim 11 , wherein the pre-determined reference data comprises at least one of:

image data recorded using the imager of the driver assistance system;

image data generated by a pattern generator; or

image data representing a freeze image.

13 . The method according to claim 12 , further comprising the acts of:

encoding the image data using a lossy compressing scheme and a set of settings for the compression scheme, thereby yielding compressed image data; and

decoding the compressed image data, thereby yielding decoded image data; wherein the analyzed image data is determined based on the decoded image data.

14 . The method according to claim 11 , further comprising the acts of:

encoding the image data using a lossy compressing scheme and a set of settings for the compression scheme, thereby yielding compressed image data; and

decoding the compressed image data, thereby yielding decoded image data; wherein the analyzed image data is determined based on the decoded image data.

15 . The method according to claim 13 , further comprising the acts of:

repeating the generating, the encoding, the decoding, the analyzing and the determining acts using the same pre-determined reference data and using a plurality of different sets of settings of the compression scheme, thereby yielding a corresponding plurality of performance indicators; and

selecting a set of settings from the plurality of different set of settings based on the plurality of performance indicators.

16 . The method according to claim 14 , further comprising the act of determining the plurality of performance indicators using a second image analysis algorithm, different from the first image analysis algorithm.

17 . An imager-based driver assistance system for a vehicle, comprising:

an imager configured to generate image data;

a compression unit configured to encode the image data using a lossy compressing scheme, thereby yielding compressed image data; wherein the compression scheme is adjustable using one or more settings;

a decompression unit configured to decode the compressed image data, thereby yielding decoded image data;

an image analysis unit configured to analyze the decoded image data using at least one of a plurality of image analysis algorithms, thereby yielding analyzed image data; wherein the analyzed image data is usable for assisting a driver of the vehicle; and

a memory unit configured to store one or more settings of the compression scheme for each of the plurality of image analysis algorithms, respectively; wherein the driver assistance system is configured to set the one or more settings stored in the memory unit, in dependence of the at least one image analysis algorithm used by the image analysis unit.

Assignments (22)
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 11759915 AND REPLACE IT WITH APPLICATION 11759935 PREVIOUSLY RECORDED ON REEL 040925 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE RELEASE OF SECURITY INTEREST. Recorded Feb 17, 2020
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP, B.V. F/K/A FREESCALE SEMICONDUCTOR, INC.
Reel/Frame 052917/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 11759915 AND REPLACE IT WITH APPLICATION 11759935 PREVIOUSLY RECORDED ON REEL 040928 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE RELEASE OF SECURITY INTEREST. Recorded Jan 17, 2020
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP B.V.
Reel/Frame 052915/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12298143 PREVIOUSLY RECORDED ON REEL 042762 FRAME 0145. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded Oct 22, 2019
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 051145/0184 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12298143 PREVIOUSLY RECORDED ON REEL 042985 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded Oct 22, 2019
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 051029/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12298143 PREVIOUSLY RECORDED ON REEL 038017 FRAME 0058. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded Oct 22, 2019
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 051030/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12298143 PREVIOUSLY RECORDED ON REEL 039361 FRAME 0212. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded Oct 22, 2019
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 051029/0387 →
RELEASE OF SECURITY INTEREST Recorded Sep 10, 2019
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP B.V.
Reel/Frame 050745/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12681366 PREVIOUSLY RECORDED ON REEL 039361 FRAME 0212. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded May 9, 2017
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 042762/0145 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12681366 PREVIOUSLY RECORDED ON REEL 038017 FRAME 0058. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded May 9, 2017
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 042985/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE NATURE OF CONVEYANCE PREVIOUSLY RECORDED AT REEL: 040626 FRAME: 0683. ASSIGNOR(S) HEREBY CONFIRMS THE MERGER AND CHANGE OF NAME EFFECTIVE NOVEMBER 7, 2016. Recorded Jan 12, 2017
From: NXP SEMICONDUCTORS USA, INC. (MERGED INTO); FREESCALE SEMICONDUCTOR, INC. (UNDER)
To: NXP USA, INC.
Reel/Frame 041414/0883 →
CHANGE OF NAME Recorded Nov 16, 2016
From: FREESCALE SEMICONDUCTOR INC.
To: NXP USA, INC.
Reel/Frame 040626/0683 →
RELEASE OF SECURITY INTEREST Recorded Nov 7, 2016
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP B.V.
Reel/Frame 040928/0001 →
RELEASE OF SECURITY INTEREST Recorded Sep 21, 2016
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP, B.V., F/K/A FREESCALE SEMICONDUCTOR, INC.
Reel/Frame 040925/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12092129 PREVIOUSLY RECORDED ON REEL 038017 FRAME 0058. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded Jul 14, 2016
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 039361/0212 →
SECURITY AGREEMENT SUPPLEMENT Recorded Mar 7, 2016
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 038017/0058 →
ASSIGNMENT AND ASSUMPTION OF SECURITY INTEREST IN PATENTS Recorded Jan 7, 2016
From: CITIBANK, N.A.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 037458/0341 →
ASSIGNMENT AND ASSUMPTION OF SECURITY INTEREST IN PATENTS Recorded Jan 7, 2016
From: CITIBANK, N.A.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 037458/0359 →
PATENT RELEASE Recorded Dec 21, 2015
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: FREESCALE SEMICONDUCTOR, INC.
Reel/Frame 037357/0974 →
SUPPLEMENT TO IP SECURITY AGREEMENT Recorded May 4, 2015
From: FREESCALE SEMICONDUCTOR, INC.
To: CITIBANK, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 035571/0112 →
SUPPLEMENT TO IP SECURITY AGREEMENT Recorded May 4, 2015
From: FREESCALE SEMICONDUCTOR, INC.
To: CITIBANK, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 035571/0080 →
SUPPLEMENT TO IP SECURITY AGREEMENT Recorded May 4, 2015
From: FREESCALE SEMICONDUCTOR, INC.
To: CITIBANK, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 035571/0095 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 24, 2015
From: GERSTER, JOCHEN; NEFF, ALBRECHT; SINGER, STEFAN
To: BAYERISCHE MOTOREN WERKE AKTIENGESELLSCHAFT; FREESCALE SEMICONDUCTOR INC.
Reel/Frame 035018/0219 →