IP Library Granted Patent US 11,528,400
Granted Patent B2
US 11,528,400 · App. 16/754,752 · Granted Dec 13, 2022

Image-processing microprocessor for supporting an application processor and multiple cameras

Inventors: Huan Jian (Fujian, CN); Ning Luo (Fujian, CN); Shanxu Zhang (Fujian, CN); Jiang Han (Fujian, CN); Shengqin Zhang (Fujian, CN); Shuai Zhang (Fujian, CN); Yongle Lai (Fujian, CN)
Assignee: FUZHOU ROCKCHIP ELECTRONICS CO., LTD.
H04N5/23203H04N5/23229H04N5/247
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,528,400
App. No.
16/754,752
Granted
Dec 13, 2022
Kind
B2
Abstract

An image-processing unit for an electronic device is disclosed. The image-processing unit may include a digital signal processor (DSP), a first control interface configured for receiving an AP-instruction from an application processor (AP) external to the image-processing unit, and a second control interface configured for transmitting an intermediary-instruction generated by DSP based on the AP-instruction. The image-processing unit may further include a first data interface configured for receiving sensor-data generated in response to the intermediary-instruction by a sensor external to the image-processing unit, and a second data interface configured for bi-directionally transmitting intermediary-data to the AP or receiving AP-data from the AP, wherein the intermediary-data is generated by the DSP based on the sensor-data.

Claims (52)

1. An image-processing unit for an electronic device, comprising:

a digital signal processor (DSP);

a first control interface configured for receiving an AP-instruction from an application processor (AP) external to the image-processing unit;

a second control interface configured for transmitting an intermediary-instruction to a sensor external to the image-processing unit, wherein the intermediary-instruction is generated by the DSP based on the AP-instruction, and the intermediary-instruction is configured to control the sensor:

a first data interface configured for receiving sensor-data, wherein the sensor-data is generated by the sensor in response to the intermediary-instruction from the DSP; and

a second data interface configured for bi-directionally transmitting intermediary-data to the AP or receiving AP-data from the AP, wherein the intermediary-data is generated by the DSP based on the sensor-data, and the AP is configured to process the intermediary-data.

2. The image-processing unit as recited in claim 1 , wherein the AP generates the AP-data based on the received intermediary-data.

3. The image-processing unit as recited in claim 1 , wherein the AP-data contain information that cannot be processed by the AP but can be processed by the image-processing unit.

4. The image-processing unit as recited in claim 1 , wherein the AP and the image-processing unit synchronously process the AP-data.

5. An electronic device, comprising:

a first camera and a second camera;

an application processor (AP); and

an image-processing unit (IPU) coupled with the first camera, the second camera, and the AP, wherein the IPU is configured to

receive a first AP-instruction from the AP for controlling the first camera and the second camera,

generate a first intermediary-instruction and a second intermediary-instruction based on the first AP-instruction, wherein the first intermediary-instruction is configured to control the first camera, and the second intermediary-instruction is configured to control the second camera,

transmit the first intermediary-instruction to the first camera,

transmit the second intermediary-instruction to the second camera,

receive a first camera-data from the first camera in response to the first intermediary-instruction,

receive a second camera-data from the second camera in response to the second intermediary-instruction,

generate a first intermediary-data based on the first camera-data, the second camera-data, and the first AP-instruction, and

transmit the first intermediary-data to the AP in response to the first AP-instruction, wherein the AP is configured to process the first intermediary-data.

6. The electronic device as recited in claim 5 , wherein the AP is configured to transmit the first AP-instruction directly to the first camera without utilizing the IPU.

7. The electronic device as recited in claim 5 , wherein the AP is configured to receive the first camera-data directly from the first camera without utilizing the IPU.

8. The electronic device as recited in claim 5 , wherein the AP is configured to transmit AP-data to the IPU, and the IPU is configured to generate second intermediary-data based on the AP-data.

9. The electronic device as recited in claim 5 , wherein the AP-data is generated by the AP based on the first intermediary-data received from the IPU.

10. A method for providing image-processing functionality to an electronic device, the method comprising:

receiving, by an image-processing unit (IPU) of the electronic device from an application processor (AP), an AP-instruction for controlling a camera in the electronic device;

generating, by the IPU, an intermediary-instruction based on the AP-instruction, wherein the intermediary-instruction is configured to control the camera:

transmitting, by the image-processing unit, the intermediary-instruction to the camera;

receiving, by the image-processing unit, a camera-data from the camera in response to the intermediary-instruction;

generating, by the image-processing unit, an intermediary-data based on the camera-data and the AP-instruction; and

transmitting, by the image-processing unit, the intermediary-data to the AP in response to the AP-instruction using a bi-directional data link between the IPU and the AP, wherein the AP is configured to transmit AP-data to the IPU using the bi-directional data link, and the AP is configured to process the intermediary-data.

11. The method as recited in claim 10 , wherein the generating of the intermediary-instruction based on the AP-instruction comprises:

generating a plurality of control instructions as the intermediary-instruction, wherein each of the plurality of control instructions is configured to control the camera in performing a corresponding operation.

12. The method as recited in claim 10 , wherein the generating of the intermediary-data based on the camera-data comprises:

receiving a plurality of images generated by the camera in response to the plurality of control instruction; and

generating the intermediary-data based on the plurality of images.

13. An electronic device, comprising:

a sensor group containing a plurality of sensors;

an application processor (AP); and

an image-processing unit (IPU) group coupled with the plurality of sensors and the AP, wherein

the IPU group contains a plurality of IPUs,

the AP is connected with a first IPU selected from the plurality of IPUs,

each of the plurality of sensors is connected with one of the plurality of IPUs,

each one of the plurality of IPUs is configured to connect with at least one of the plurality of IPUs,

and the IPU group is configured to

receive, by the first IPU, an AP-instruction from the AP for controlling the plurality of sensors,

generate a plurality of intermediary-instructions based on the first AP-instruction, wherein each of the plurality of intermediary-instructions is configured to control a corresponding one of the plurality of sensors,

transmit the plurality of intermediary-instructions from the first IPU to the plurality of sensors via the plurality of IPUs,

receive sensor-data from the plurality of sensors in response to the plurality of intermediary-instructions,

generate a plurality of intermediary-data based on the plurality of sensor-data and the first AP-instruction, and

transmit the plurality of sensor-data to the AP via the plurality of the IPUs.

Assignments (1)
CHANGE OF NAME Recorded Jan 19, 2024
From: FUZHOU ROCKCHIP ELECTRONICS CO., LTD.
To: ROCKCHIP ELECTRONICS CO., LTD.
Reel/Frame 066174/0861 →
Priority Claims (3)
CN 201711091202.1 · Nov 8, 2017 · national
CN 201711171819.4 · Nov 22, 2017 · national
CN 201711464053.9 · Dec 28, 2017 · national
Continuity (1)
Related Publication 20200314321A1 · Oct 1, 2020