IP Library Granted Patent US 7,746,390
Granted Patent B2
US 7,746,390 · App. 11/087,603 · Granted Jun 29, 2010

Method and device for processing pixel array data of mobile terminal equipped with digital camera function

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,746,390
App. No.
11/087,603
Granted
Jun 29, 2010
Kind
B2
Abstract

Disclosed is a technique for processing pixel array data of a mobile terminal with a digital camera function. A device for processing pixel array data includes: an image sensor having (x×y)-sized pixel capacity, converting an optical signal received via a lens into an electric signal, and generating (x×y)-sized pixel array data; and an image signal processor for generating an (X×Y)-sized extended pixel array data area, receiving pixel values of the (x×y)-sized pixel array data from the image sensor, arranging the pixel values of the (x×y)-sized pixel array data in the (X×Y)-sized extended pixel array data area, arranging pixel values obtained by performing an arithmetical operation on pixel values of (x×y)-sized pixel array data, adjacent to remaining pixel areas of the (X×Y)-sized extended pixel array data other than the pixel areas having the pixel values of the (x×y)-sized pixel array data, in the remaining pixel areas, and outputting the (X×Y)-sized extended pixel array data.

Claims (32)

1. A device for processing pixel array data in a mobile terminal equipped with a digital camera function, the device comprising:

an image sensor having (x×y)-sized pixel capacity, the image sensor to convert an optical signal received via a lens into an electric signal, and to generate (x×y)-sized pixel array data, where x is a total number of pixel columns of the image sensor, and y is a total number of pixel rows of the image sensor; and

an image signal processor to generate an (X×Y)-sized extended pixel array data area in a data storage area satisfying a predetermined condition of x×n=X and y×n=Y (where n=natural number greater than 1), to receive individual pixel values of the (x×y)-sized pixel array data from the image sensor, to arrange all the pixel values of the (x×y)-sized pixel array data in the (X×Y)-sized extended pixel array data area in the data storage area to be spaced apart from each other by a pixel size of (n−1), to arrange corresponding pixel values obtained by performing an arithmetical operation on corresponding pixel values of (x×y)-sized pixel array data, which are adjacent to remaining pixel areas of the (X×Y)-sized extended pixel array data in the data storage area other than the pixel areas having the pixel values of the (x×y)-sized pixel array data, in the remaining pixel areas, and to output the (X×Y)-sized extended pixel array data in which the pixel values are arranged in the respective pixel areas so that the (X×Y)-sized extended pixel array data can be displayed.

2. The device of claim 1 , wherein the mobile terminal equipped with a digital camera function is a mobile communication terminal.

3. The device of claim 1 , wherein the mobile terminal equipped with a digital camera function is a digital camera.

4. The device of claim 1 , further comprising:

an image encoder to encode the (X×Y)-sized extended pixel array data in which corresponding pixel values are arranged in the pixel areas; and

an external communication port to transmit the encoded (X×Y)-sized extended pixel array data to an external device.

5. The device of claim 1 , wherein the image signal processor performs digital signal processing operations including at least one of white balance adjusting, auto-focus adjusting, and dead pixel recovering operations on the (X×Y)-sized extended pixel array data in which pixel values are arranged in the pixel areas.

6. The device of claim 1 , wherein the image signal processor receives the (x×y)-sized pixel array data from the image sensor, performs digital signal processing operations including at least one of white balance adjusting, auto-focus adjusting, and dead pixel recovering operations on the received (x×y)-sized pixel array data, and performs the arranging and outputting operations.

7. The device of claim 1 , wherein the image signal processor differently arranges pixel values in the remaining pixel areas according to the following three cases when the value of n is 2, wherein

in the first case where (x×y)-sized pixel values are arranged to be vertically adjacent to each of corresponding pixel areas contained in the remaining pixel areas, a mean value of the two vertically adjacent pixel values is arranged in each of the corresponding pixel areas;

in the second case where (x×y)-sized pixel values are arranged to be horizontally adjacent to each of corresponding pixel areas contained in the remaining pixel areas, a mean value of the two horizontally adjacent pixel values is arranged in each of the corresponding pixel areas; and

in the third case where (x×y)-sized pixel values are arranged in four directions (i.e., upper-left side, lower-left side, upper-right side, and lower-right side) to be adjacent to a corresponding pixel area contained in the remaining pixel areas, a mean value obtained by dividing by 4 the sum of a mean value of upper-left and upper-right (x×y)-sized pixel values, a mean value of upper-left and lower-left (x×y)-sized pixel values, a mean value of lower-left and lower-right (x×y)-sized pixel values, and a mean value of lower-right and upper-right (x×y)-sized pixel values is arranged in the corresponding pixel area.

8. A method of processing pixel array data in a mobile terminal equipped with a digital camera function, the method comprising the steps of:

a) generating, by an image signal processor, an (X×Y)-sized extended pixel array data area in a data storage area satisfying a predetermined condition of x×n=X and y×n=Y (where n=natural number greater than 1), receiving individual pixel values of an (x×y)-sized pixel array data from an image sensor, arranging all the pixel values of the (x×y)-sized pixel array data in the (X×Y)-sized extended pixel array data area in the data storage area to be spaced apart from each other by a pixel size of (n−1), where x is a total number of pixel columns of the image sensor, and y is a total number of pixel rows of the image sensor;

b) arranging, by the image signal processor, corresponding pixel values obtained by performing an arithmetical operation on corresponding pixel values of (x×y)-sized pixel array data, which are adjacent to remaining pixel areas of the (X×Y)-sized extended pixel array data in the data storage area other than the pixel areas having the pixel values of the (x×y)-sized pixel array data, in the remaining pixel areas; and

c) outputting, by the image signal processor, the (X×Y)-sized extended pixel array data in which the pixel values are arranged in the respective pixel areas so that the (X×Y)-sized extended pixel array data can be displayed.

9. The method of claim 8 , wherein the mobile terminal equipped with a digital camera function is a mobile communication terminal.

10. The method of claim 8 , wherein the mobile terminal equipped with a digital camera function is a digital camera.

11. The method of claim 8 , further comprising the steps of:

encoding, by an image encoder, the (X×Y)-sized extended pixel array data in which corresponding pixel values are arranged in the pixel areas; and

transmitting, by an external communication port, the encoded (X×Y)-sized extended pixel array data to an external device.

12. The method of claim 8 , wherein the step (b) includes differently arranging, by the image signal processor, pixel values in the remaining pixel areas according to the following three cases when the value of n is 2, wherein

in the first case where (x×y)-sized pixel values are arranged to be vertically adjacent to each of corresponding pixel areas contained in the remaining pixel areas, a mean value of the two vertically adjacent pixel values is arranged in each of the corresponding pixel areas;

in the second case where (x×y)-sized pixel values are arranged to be horizontally adjacent to each of corresponding pixel areas contained in the remaining pixel areas, a mean value of the two horizontally adjacent pixel values is arranged in each of the corresponding pixel areas; and

in the third case where (x×y)-sized pixel values are arranged in four directions (i.e., upper-left side, lower-left side, upper-right side, and lower-right side) to be adjacent to a corresponding pixel area contained in the remaining pixel areas, a mean value obtained by dividing by 4 the sum of a mean value of upper-left and upper-right (x×y)-sized pixel values, a mean value of upper-left and lower-left (x×y)-sized pixel values, a mean value of lower-left and lower-right (x×y)-sized pixel values, and a mean value of lower-right and upper-right (x×y)-sized pixel values is arranged in the corresponding pixel area.

13. The method of claim 8 , further comprising the step of:

performing, by the image signal processor, digital signal processing operations including at least one of white balance adjusting, auto-focus adjusting, and dead pixel recovering operations on the (X×Y)-sized extended pixel array data in which pixel values are arranged in the pixel areas.

14. The method of claim 8 , further comprising the steps of:

receiving, by the image signal processor, the (x×y)-sized pixel array data from the image sensor, and performing digital signal processing operations including at least one of white balance adjusting, auto-focus adjusting, and dead pixel recovering operations on the received (x×y)-sized pixel array data; and

performing the arranging and outputting operations.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 14, 2020
From: PANTECH INC.
To: PANTECH CORPORATION
Reel/Frame 052662/0609 →
CORRECTIVE ASSIGNMENT TO CORRECT THE THE LISTED PATENTS PREVIOUSLY RECORDED AT REEL: 039695 FRAME: 0820. ASSIGNOR(S) HEREBY CONFIRMS THE CORRECTIVE ASSIGNMENT. Recorded Apr 3, 2017
From: PANTECH & CURITEL COMMUNICATIONS INC.
To: PANTECH CO., LTD.
Reel/Frame 042133/0339 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVAL OF PATENTS 6510327, 7356363, 7512428 PREVIOUSLY RECORDED AT REEL: 039982 FRAME: 0988. ASSIGNOR(S) HEREBY CONFIRMS THE CHANGE OF NAME. Recorded Jan 19, 2017
From: CURITEL COMMUNICATIONS INC.
To: PANTECH & CURITEL COMMUNICATIONS INC.
Reel/Frame 041413/0909 →
CORRECTIVE ASSIGNMENT TO CORRECT THE TO REMOVE PATENT NUMBERS 6510327, 7356363 AND 75112248 PREVIOUSLY RECORDED AT REEL: 039983 FRAME: 0344. ASSIGNOR(S) HEREBY CONFIRMS THE DE-MERGER. Recorded Jan 19, 2017
From: PANTECH CO., LTD.
To: PANTECH INC.
Reel/Frame 041420/0001 →