IP Library › Granted Patent US 11,430,209
Granted Patent B2
US 11,430,209 · App. 16/844,115 · Granted Aug 30, 2022

Image signal processing method, apparatus, and device

Inventors: Jin Cai (Shanghai, CN); Guoxiang Liu (Shanghai, CN); Hui Chen (Shenzhen, CN)
Assignee: Huawei Technologies Co., Ltd.
G06V20/10G06K9/6262G06N3/04G06N3/08G06T5/00G06T7/70H04N5/2351G06T2207/20084
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,430,209
App. No.
16/844,115
Granted
Aug 30, 2022
Kind
B2
Abstract

The present disclosure relates to image signal processing methods, apparatus, and devices. One example image signal processing method includes obtaining an image signal, where the image signal is derived based on a sensor signal collected by an image sensor, recognizing, by using a neural network, a scene to which the image signal belongs, determining, by using attribute information of the image signal, whether the scene is accurate, and in response to determining that the scene is accurate, performing enhancement processing on the image signal based on the scene to generate an enhanced image signal.

Claims (48)

1. An image signal processing method, wherein the method comprises:

obtaining an image signal, wherein the image signal is derived based on a sensor signal collected by an image sensor;

recognizing, by using a neural network, a scene to which the image signal belongs;

determining, by using attribute information of the image signal, whether the scene is accurate, wherein the attribute information of the image signal comprises light intensity information and foreground location information in the image signal; and

in response to determining that the scene is accurate, performing enhancement processing on the image signal based on the scene to generate an enhanced image signal.

2. The method according to claim 1 ,

wherein the determining, by using attribute information of the image signal, whether the scene is accurate comprises:

determining, based on the light intensity information, whether a light intensity of the image signal is within a preset light intensity threshold range.

3. The method according to claim 1 ,

wherein the determining, by using attribute information of the image signal, whether the scene is accurate comprises:

determining, based on the foreground location information, whether a foreground location of the image signal is within a preset distance threshold range.

4. The method according to claim 1 , wherein the image signal is an image signal obtained by processing the sensor signal by using an image signal processor; and

wherein the attribute information of the image signal is attribute information of the image signal obtained by processing the sensor signal by using the image signal processor.

5. The method according to claim 1 , wherein the performing enhancement processing on the image signal based on the scene comprises:

performing the enhancement processing on the image signal by using an enhancement algorithm corresponding to the scene.

6. The method according to claim 1 , wherein the enhancement processing is performed by at least one of an image signal processor or an operation processor.

7. The method according to claim 1 , wherein the determining, by using attribute information of the image signal, whether the scene is accurate is executed by the at least one of an image signal processor or an operation processor.

8. The method according to claim 1 , wherein the light intensity information in the image signal reflects brightness of a corresponding image, and the foreground location information in the image signal reflects a distance from a foreground in the corresponding image to an image signal processing device that comprises the image sensor.

9. The method according to claim 1 , wherein determining, by using the attribute information of the image signal, whether the scene is accurate comprises:

determining, by using the attribute information of the image signal, a second scene to which the image signal belongs; and

comparing the scene with the second scene to determine whether the scene is accurate.

10. A non-transitory computer-readable storage medium storing instructions which, when executed by one or more processors, cause the one or more processors to perform operations comprising:

obtaining an image signal, wherein the image signal is derived based on a sensor signal collected by an image sensor;

recognizing, by using a neural network, a scene to which the image signal belongs;

determining, by using attribute information of the image signal, whether the scene is accurate, wherein the attribute information of the image signal comprises light intensity information and foreground location information in the image signal; and

in response to determining that the scene is accurate, performing enhancement processing on the image signal based on the scene, to generate an enhanced image signal.

11. The non-transitory computer-readable storage medium according to claim 10 ,

wherein the determining, by using attribute information of the image signal, whether the scene is accurate comprises:

determining, based on the light intensity information, whether a light intensity of the image signal is within a preset light intensity threshold range.

12. The non-transitory computer-readable storage medium according to claim 10 ,

wherein the determining, by using attribute information of the image signal, whether the scene is accurate comprises:

determining, based on the foreground location information, whether a foreground location of the image signal is within a preset distance threshold range.

13. The non-transitory computer-readable storage medium according to claim 10 , wherein the image signal is an image signal obtained by processing the sensor signal by using an image signal processor; and

wherein the attribute information of the image signal is attribute information of the image signal obtained by processing the sensor signal by using the image signal processor.

14. The non-transitory computer-readable storage medium according to claim 10 , wherein performing the enhancement processing on the image signal comprises performing the enhancement processing on the image signal by using an enhancement algorithm corresponding to the scene.

15. An image signal processing device, comprising an image signal processor, an operation processor, and a neural network operation processor, wherein:

the neural network operation processor is configured to:

obtain an image signal, wherein the image signal is derived based on a sensor signal collected by an image sensor; and

recognize, by using a neural network, a scene to which the image signal belongs; and

at least one of the image signal processor or the operation processor is configured to:

determine, by using attribute information of the image signal, whether the scene recognized by using the neural network operation processor is accurate, wherein the attribute information of the image signal comprises light intensity information and foreground location information in the image signal; and

in response to determining that the scene is accurate, perform enhancement processing on the image signal based on the scene to generate an enhanced image signal.

16. The image signal processing device according to claim 15 ,

wherein the at least one of the image signal processor or the operation processor is configured to determine, based on the light intensity information, whether a light intensity of the image signal is within a preset light intensity threshold range to determine whether the scene is accurate.

17. The image signal processing device according to claim 15 ,

wherein the at least one of the image signal processor or the operation processor is configured to determine, based on the foreground location information, whether a foreground location of the image signal is within a preset distance threshold range to determine whether the scene is accurate.

18. The image signal processing device according to claim 15 , wherein the image signal processor is further configured to process the sensor signal collected by the image sensor to obtain the image signal and the attribute information of the image signal.

19. The image signal processing device according to claim 15 , wherein the at least one of the image signal processor or the operation processor is configured to perform the enhancement processing on the image signal by using an enhancement algorithm corresponding to the scene.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 7, 2020
From: CAI, JIN; LIU, GUOXIANG; CHEN, HUI
To: HUAWEI TECHNOLOGIES CO., LTD.
Reel/Frame 054565/0958 →
Priority Claims (1)
CN 201710952413.3 · Oct 13, 2017 · national
Continuity (2)
Continuation PCTCN2018104678 · Sep 7, 2018
Related Publication 20200234044A1 · Jul 23, 2020