IP Library Granted Patent US 11,044,407
Granted Patent B2
US 11,044,407 · App. 16/359,153 · Granted Jun 22, 2021

Image sensor and electronic device including the image sensor, and method of image zoom processing

Inventors: Il Yun Jeong (Hwaseong-si, KR); Je Suk Lee (Hwaseong-si, KR)
Assignee: Samsung Electronics Co., Ltd.
H04N5/23296H04N1/2112H04N1/3935H04N19/42
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,044,407
App. No.
16/359,153
Granted
Jun 22, 2021
Kind
B2
Abstract

An image sensor may include a pixel array having an N×M array of merged pixels arranged in a Bayer pattern, each merged pixel including an k*l matrix of unit pixels of a same color, where k and l are integers greater than two; and an image signal processor to process signals output by the pixel array in accordance with a normal mode or a zoom-in mode. In the zoom-in mode, signals from the pixel array may be remosaiced such that signals corresponding to the unit pixels are arranged in a p*q matrix of unit pixels of a same color, wherein p is a non-negative integer that is less than k and q is a non-negative integer less than 1, the p*q matrixes being arranged in a Bayer pattern.

Claims (29)

1. An image sensor, comprising:

a pixel array having an N×M array of merged pixels arranged in a Bayer pattern, each merged pixel including a k*1 matrix of unit pixels of a same color, where k and 1 are integers greater than two;

an image signal processor to process signals output by the array of merged pixels in accordance with a normal mode or a zoom-in mode; and

a remosaic processor, wherein, in the zoom-in mode, the remosaic processor is to remosaic the pixel array such that signals corresponding to the unit pixels are arranged in a p*q matrix of unit pixels of a same color, wherein p is a non-negative integer that is less than k and q is a non-negative integer less than 1, the p*q matrix being arranged in a Bayer pattern.

2. The image sensor as claimed in claim 1 , wherein, in the normal mode, the image signal processor is to crop an image output by the pixel array.

3. The image sensor as claimed in claim 1 , wherein an image in the normal mode and an image in the zoom-in mode have a same resolution, the same resolution being less than N×M.

4. The image sensor as claimed in claim 3 , wherein p and q are determined such that the image in the normal mode and the image in the zoom-in mode have the same resolution.

5. The image sensor as claimed in claim 1 , wherein a number of Bayer patterns in zoom-in mode corresponding to a single Bayer pattern of the N×M array of merged pixels equals (k*l)/(p*q).

6. The image sensor as claimed in claim 1 , further comprising a further zoom-in mode, wherein, in the further zoom-in mode, signals from the pixel array are remosaiced such that signals corresponding to the unit pixels are arranged in a r*s matrix of unit pixels of a same color, wherein r is a non-negative integer that is less than p and s is a non-negative integer less than q, the r*s matrix being arranged in a Bayer pattern.

7. The image sensor as claimed in claim 6 , wherein an image in the normal mode, an image in the zoom-in mode, and an image in the further zoom-in mode have a same resolution.

8. The image sensor as claimed in claim 1 , wherein the image signal processor is to further process signals in accordance with a zoom-out mode.

9. The image sensor as claimed in claim 8 , wherein an image in the normal mode, an image in the zoom-in mode, and an image in the zoom-out mode have a same resolution, the same resolution being less than or equal to N×M.

10. The image sensor as claimed in claim 8 , wherein, in the zoom-out mode, the image signal processor is to output signals having a resolution of N/2×M/2.

11. The image sensor as claimed in claim 10 , wherein, in the zoom-out mode, the image signal processor is remosaic signals from the pixel array such that signals corresponding to the unit pixels are arranged in a k 2 *l 2 matrix of unit pixels of a same color.

12. The image sensor as claimed in claim 10 , wherein, in the zoom-out mode, the image signal processor is to bin signals from the pixel array such that signals are arranged in an N/2×M/2 matrix.

13. The image sensor as claimed in claim 1 , wherein, in the normal mode, each merged pixel includes the k*l matrix of unit pixels of a same color.

14. The image sensor as claimed in claim 1 , wherein, in the normal mode or the zoom-in mode, an image is cropped from the N×M array of merged pixels.

15. The image sensor as claimed in claim 1 , wherein p and q are both 1.

16. An electronic device, comprising:

a pixel array having an N×M array of merged pixels arranged in a Bayer pattern, each merged pixel including a k*l matrix of unit pixels of a same color, where k and l are integers greater than two;

a signal processor to process signals output by the array of merged pixels in accordance with a normal mode or a zoom-in mode; and

a remosaic processor, wherein, in the zoom-in mode, the remosaic processor is to remosaic the pixel array such that signals corresponding to the unit pixels are arranged in a p*q matrix of unit pixels of a same color, wherein p is a non-negative integer that is less than k and q is a non-negative integer less than 1, the p*q matrix being arranged in a Bayer pattern.

17. The electronic device as claimed in claim 16 , wherein the remosaic processor is outside the signal processor.

18. The electronic device as claimed in claim 16 , wherein the remosaic processor is internal to the signal processor.

19. A method of image zoom processing of an image sensor including a pixel array, the method comprising:

driving a plurality of merged pixels in the pixel array to generate a full resolution image;

processing signals output by the pixel array, having an N×M array of merged pixels arranged in a Bayer pattern, each merged pixel including a k*l matrix of unit pixels of a same color, where k and l are integers greater than two, in accordance with a normal mode or a zoom-in mode; and

remosaicing, in the zoom-in mode, signals from the pixel array such that signals corresponding to the unit pixels are arranged in a p*q matrix of unit pixels of a same color, wherein p is a non-negative integer that is less than k and q is a non-negative integer less than 1, the p*q matrix being arranged in a Bayer pattern.

20. The method as claimed in claim 19 , further comprising processing signals in accordance with a zoom-out mode, wherein an image in the normal mode, an image in the zoom-in mode, and an image in the zoom-out mode have a same resolution, the same resolution being less than or equal to N×M.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 20, 2019
From: JEONG, IL YUN; LEE, JE SUK
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 048648/0416 →
Priority Claims (1)
KR 10-2018-0101965 · Aug 29, 2018 · national
Continuity (1)
Related Publication 20200077026A1 · Mar 5, 2020
Cited By (4)
US 12,389,117 US 12,495,220 US 12,526,535 US 12,705,698