IP Library Granted Patent US 11,627,257
Granted Patent B2
US 11,627,257 · App. 17/493,185 · Granted Apr 11, 2023

Electronic device including image sensor having multi-crop function

Inventors: Sungjun Kim (Hwaseong-si, KR); Kwangjin An (Suwon-si, KR); Jonha Lee (Seoul, KR); Su-Young Lee (Daejeon, KR)
Assignee: Samsung Electronics Co., Ltd.
H04N5/232945H04N5/2258H04N5/232933H04N5/347
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,627,257
App. No.
17/493,185
Granted
Apr 11, 2023
Kind
B2
Abstract

An electronic device includes first and second image sensors, an image signal processor, and a main processor. The first and second image sensors photograph an object in first and second FOVs to generate first and second signals, respectively. The image signal processor generates first image data based on the first signal, generates second image data based on the second signal, and generates cropped image data based on cropping ROI from the second image data. The main processor generates a first video stream based on the first image data, generates a second video stream based on the cropped image data, and outputs the first video stream to a display device. The main processor stops outputting the first video stream to the display device and initiates outputting the second video stream to the display device in response to receiving a user input command.

Claims (81)

1. An electronic device, comprising:

a first image sensor configured to photograph an object in a first field of view to generate a first signal;

a second image sensor configured to photograph the object in a second field of view to generate a second signal;

an image signal processor configured to

generate first image data of a current frame based on the first signal, the first image data having a first resolution,

generate second image data of the current frame based on the second signal, the second image data having a second resolution that is greater than the first resolution, and

generate cropped image data based on cropping a region of interest from the second image data; and

a main processor configured to

generate a first video stream based on the first image data,

generate a second video stream based on the cropped image data, and

output the first video stream to a display device,

wherein the main processor is further configured to stop outputting the first video stream to the display device and initiate outputting the second video stream to the display device in response to receiving a user input command.

2. The electronic device of claim 1 , wherein the main processor is configured to

detect the region of interest based on first image data which correspond to a previous frame of the current frame and are generated by the first image sensor, and

calculate values associated with the region of interest.

3. The electronic device of claim 2 , wherein the image signal processor includes:

a camera control interface configured to receive the values associated with the region of interest from the main processor; and

a register configured to store the received values associated with the region of interest.

4. The electronic device of claim 3 , wherein the image signal processor is configured to crop the region of interest from the second image data with reference to the values associated with the region of interest, which are stored in the register.

5. The electronic device of claim 2 , wherein the values associated with the region of interest include

a value indicating whether the region of interest is present in the first image data,

coordinates of the region of interest on the first image data,

a length of the region of interest in a first direction, and

a length of the region of interest in a second direction that is different from the first direction.

6. The electronic device of claim 1 , wherein the image signal processor is configured to transmit the first image data and the cropped image data to the main processor through a camera serial interface (CSI).

7. The electronic device of claim 6 , wherein the image signal processor is configured to generate the cropped image data based on a bandwidth of the camera serial interface.

8. The electronic device of claim 6 , wherein

the image signal processor includes a camera serial interface (CSI) transmitter and a physical layer configured to transmit the first image data and the cropped image data, and

the main processor includes a CSI receiver and a separate physical layer configured to receive the first image data and the cropped image data.

9. The electronic device of claim 1 , wherein the first field of view and the second field of view are identical.

10. The electronic device of claim 1 , wherein

the first image sensor includes a first pixel array, wherein the first signal generated by the first image sensor is associated with a first image,

the second image sensor includes a second pixel array, wherein the second signal generated by the second image sensor is associated with a second image, and

the second pixel array has a higher resolution than a resolution of the first pixel array, such that the second signal generated by the second image sensor is associated with a higher-resolution image than the first signal generated by the first image sensor.

11. An electronic device, comprising:

an image sensor configured to photograph an object in a first field of view to generate a first signal;

an image signal processor configured to

generate first image data of a current frame based on the first signal,

generate second image data of the current frame based on performing binning on the first image data, and

generate cropped image data based on cropping a region of interest from the first image data; and

a main processor configured to

generate a first video stream based on the second image data,

generate a second video stream based on the cropped image data, and

output the first video stream to a display device,

wherein the main processor is configured to stop outputting the first video stream to the display device and initiate outputting the second video stream to the display device in response to receipt of a user input command.

12. The electronic device of claim 11 , wherein the main processor is configured to

detect the region of interest based on second image data which correspond to a previous frame of the current frame and are generated by the image sensor, and

calculate values associated with the region of interest.

13. The electronic device of claim 12 , wherein the image signal processor includes:

a camera control interface configured to receive the values associated with the region of interest from the main processor; and

a register configured to store the received values associated with the region of interest.

14. The electronic device of claim 13 , wherein the image signal processor is configured to the region of interest from the second image data with reference to the values associated with the region of interest, which are stored in the register.

15. The electronic device of claim 11 , wherein

the image signal processor includes a camera serial interface (CSI) transmitter and a physical layer configured to transmit the first image data and the cropped image data, and

the main processor includes a CSI receiver and a separate physical layer configured to receive the first image data and the cropped image data.

16. An electronic device, comprising:

a first image sensor configured to photograph an object in a first field of view to generate a first signal;

a second image sensor configured to photograph the object in a second field of view to generate a second signal;

an image signal processor configured to

generate first image data of a current frame based on the first signal,

generate second image data of the current frame based on the second signal,

generate third image data based on performing binning on the first image data,

generate fourth image data based on performing binning on the second image data,

generate first cropped image data based on cropping a first region of interest from the first image data, and

generate second cropped image data based on cropping a second region of interest from the second image data; and

a main processor configured to

generate a first video stream based on the first image data and the second image data,

generate a second video stream based on the first cropped image data,

generate a third video stream based on the second cropped image data, and

output the first video stream to a display device,

wherein the main processor is configured to stop outputting the first video stream to the display device and initiate outputting one of the second video stream or the third video stream to the display device in response to receiving a user input command.

17. The electronic device of claim 16 , wherein a field of view of the first video stream is greater than the first field of view and is greater than the second field of view.

18. The electronic device of claim 16 , wherein the main processor is configured to

detect the first region of interest based on first image data which correspond to a previous frame of the current frame and are generated by the first image sensor, and

calculate values associated with the first region of interest.

19. The electronic device of claim 18 , wherein the image signal processor includes:

a camera control interface configured to receive the values associated with the first region of interest from the main processor; and

a register configured to store the received values associated with the first region of interest.

20. The electronic device of claim 16 , wherein

the image signal processor includes a camera serial interface (CSI) transmitter and a physical layer configured to transmit the first image data, the first cropped image data, and the second cropped image data, and

the main processor includes a CSI receiver and a separate physical layer configured to transmit the first image data, the first cropped image data, and the second cropped image data.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 7, 2021
From: KIM, SUNGJUN; AN, KWANGJIN; LEE, JONHA; LEE, SU-YOUNG
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 057728/0522 →
Priority Claims (1)
KR 10-2020-0161348 · Nov 26, 2020 · national
Continuity (1)
Related Publication 20220166936A1 · May 26, 2022