Granted Patent B2

US 12,579,619 · App. 18/309,445 · Granted Mar 17, 2026

Inventors: Eran Scharam (Misgav, IL); Tomer Livneh (Pardes Hana-Karkur, IL); Esther Toledano (Kiryat yam, IL); Diana Shaposhnik (Haifa, IL); Oren Shirak (Atlit, IL); Yan Gershfeld (Acco, IL)

Assignee: QUALCOMM Incorporated

G06T5/70G06T5/20G06T5/50G06T2200/24G06T2207/20221

Abstract

Claims (89)

1 . A method, comprising:

receiving, by an image signal processor, first image data;

receiving an indication of a first blur shape;

determining, by the image signal processor, a first output image frame based on the first image data by applying a photographic effect to a first image frame of the first image data, wherein applying the photographic effect comprises performing, by logic circuitry of the image signal processor, a blurring operation on the first image data based on the first blur shape;

receiving an indication of a second blur shape;

determining, by the image signal processor, a second output image frame based on the first image data by applying a photographic effect to a second image frame of the first image data, wherein applying the photographic effect comprises performing, by the logic circuitry of the image signal processor, a blurring operation on the first image data based on the second blur shape; and

storing the second output image frame.

2 . The method of claim 1 , wherein receiving the indication of the first blur shape comprises receiving a user input to a user interface (UI) indicating the first blur shape.

3 . The method of claim 1 , wherein receiving the indication of the first blur shape comprises receiving an indication of a characteristic of a region of interest in the first image frame and the characteristic corresponds to the first blur shape.

4 . The method of claim 1 , wherein:

receiving the first image data comprises receiving a higher-resolution image frame, a lower-resolution image frame, and a blur map, and

determining the first output image frame comprises:

performing the blurring operation on the lower-resolution image frame based on the blur map to determine a blurred image frame; and

blending the higher-resolution image frame and the blurred image frame.

5 . The method of claim 4 , further comprising:

applying a low pass filter to the higher-resolution image frame to determine a filtered image frame,

wherein determining the first output image frame comprises blending the higher-resolution image frame, the filtered image frame, and the blurred image frame with the blur map.

6 . The method of claim 5 , wherein performing the blurring operation on the first image data based on the first blur shape comprises applying higher blur to pixels satisfying a criteria based on brightness and lower blur to pixels not satisfying the criteria.

7 . The method of claim 6 , wherein:

receiving the first image data comprises receiving the higher-resolution image frame through a first image front end (IFE) of the image signal processor (ISP);

receiving the first image data comprises receiving depth information through a second IFE of the ISP; and

the blur map is based on the depth information.

8 . The method of claim 1 , wherein performing the blurring operation on the first image data based on the first blur shape comprises applying higher blur to pixels satisfying a criteria based on brightness and lower blur to pixels not satisfying the criteria.

9 . The method of claim 1 , further comprising:

receiving, by an application processor, the second output image frame; and

executing, by the application processor, a camera application for receiving user input and determining a corrected output image frame based on the second output image frame.

10 . An apparatus, comprising:

a memory; and

at least one image signal processor coupled to the memory, the at least one image signal processor configured to perform operations including:

receiving, by the image signal processor, first image data;

receiving an indication of a first blur shape;

determining, by the image signal processor, a first output image frame based on the first image data by applying a photographic effect to a first image frame of the first image data, wherein applying the photographic effect comprises performing, by logic circuitry of the image signal processor, a blurring operation on the first image data based on the first blur shape;

receiving an indication of a second blur shape;

determining, by the image signal processor, a second output image frame based on the first image data by applying a photographic effect to a second image frame of the first image data, wherein applying the photographic effect comprises performing, by the logic circuitry of the image signal processor, a blurring operation on the first image data based on the second blur shape; and

storing the second output image frame.

11 . The apparatus of claim 10 , wherein receiving the indication of the first blur shape comprises receiving a user input to a user interface (UI) indicating the first blur shape.

12 . The apparatus of claim 10 , wherein receiving the indication of the first blur shape comprises receiving an indication of a characteristic of a region of interest in the first image frame and the characteristic corresponds to the first blur shape.

13 . The apparatus of claim 11 , wherein:

receiving the first image data comprises receiving a higher-resolution image frame, a lower-resolution image frame, and a blur map, and

determining the first output image frame comprises:

performing the blurring operation on the lower-resolution image frame based on the blur map to determine a blurred image frame; and

blending the higher-resolution image frame and the blurred image frame.

14 . The apparatus of claim 13 , wherein the operations further include:

applying a low pass filter to the higher-resolution image frame to determine a filtered image frame,

wherein determining the first output image frame comprises blending the higher-resolution image frame, the filtered image frame, and the blurred image frame with the blur map.

15 . The apparatus of claim 14 , wherein performing the blurring operation on the first image data based on the first blur shape comprises applying higher blur to pixels satisfying a criteria based on brightness and lower blur to pixels not satisfying the criteria.

16 . The apparatus of claim 15 , wherein:

receiving the first image data comprises receiving the higher-resolution image frame through a first image front end (IFE) of the image signal processor (ISP);

receiving the first image data comprises receiving depth information through a second IFE of the ISP; and

the blur map is based on the depth information.

17 . The apparatus of claim 10 , wherein performing the blurring operation on the first image data based on the first blur shape comprises applying higher blur to pixels satisfying a criteria based on brightness and lower blur to pixels not satisfying the criteria.

18 . The apparatus of claim 10 , wherein the operations further include:

receiving, by an application processor, the second output image frame; and

executing, by the application processor, a camera application for receiving user input and determining a corrected output image frame based on the second output image frame.

19 . A non-transitory computer-readable medium storing instructions that, when executed by an image signal processor, cause the image signal processor to perform operations comprising:

receiving, by the image signal processor, first image data;

receiving an indication of a first blur shape;

determining, by the image signal processor, a first output image frame based on the first image data by applying a photographic effect to a first image frame of the first image data, wherein applying the photographic effect comprises performing, by logic circuitry of the image signal processor, a blurring operation on the first image data based on the first blur shape;

receiving an indication of a second blur shape;

determining, by the image signal processor, a second output image frame based on the first image data by applying a photographic effect to a second image frame of the first image data, wherein applying the photographic effect comprises performing, by the logic circuitry of the image signal processor, a blurring operation on the first image data based on the second blur shape; and

storing the second output image frame.

20 . The non-transitory computer-readable medium of claim 19 , wherein:

receiving the first image data comprises receiving a higher-resolution image frame, a lower-resolution image frame, and a blur map, and

determining the first output image frame comprises:

performing the blurring operation on the lower-resolution image frame based on the blur map to determine a blurred image frame; and

blending the higher-resolution image frame and the blurred image frame.

21 . The non-transitory computer-readable medium of claim 20 , wherein the operations further comprise:

applying a low pass filter to the higher-resolution image frame to determine a filtered image frame,

wherein determining the first output image frame comprises blending the higher-resolution image frame, the filtered image frame, and the blurred image frame with the blur map.

22 . The non-transitory computer-readable medium of claim 21 , wherein performing the blurring operation on the first image data based on the first blur shape comprises applying higher blur to pixels satisfying a criteria based on brightness and lower blur to pixels not satisfying the criteria.

23 . An image capture device, comprising:

an image sensor;

a memory; and

at least one image signal processor coupled to the memory and to the image sensor, the at least one image signal processor configured to perform operations comprising:

receiving, by the image signal processor, first image data;

receiving an indication of a first blur shape;

determining, by the image signal processor, a first output image frame based on the first image data by applying a photographic effect to a first image frame of the first image data, wherein applying the photographic effect comprises performing, by logic circuitry of the image signal processor, a blurring operation on the first image data based on the first blur shape;

receiving an indication of a second blur shape;

determining, by the image signal processor, a second output image frame based on the first image data by applying a photographic effect to a second image frame of the first image data, wherein applying the photographic effect comprises performing, by the logic circuitry of the image signal processor, a blurring operation on the first image data based on the second blur shape; and

storing the second output image frame.

24 . The image capture device of claim 23 , wherein:

receiving the first image data comprises receiving a higher-resolution image frame, a lower-resolution image frame, and a blur map, and

determining the first output image frame comprises:

performing the blurring operation on the lower-resolution image frame based on the blur map to determine a blurred image frame; and

blending the higher-resolution image frame and the blurred image frame.

25 . The image capture device of claim 24 , wherein the operations further comprise:

applying a low pass filter to the higher-resolution image frame to determine a filtered image frame,

wherein determining the first output image frame comprises blending the higher-resolution image frame, the filtered image frame, and the blurred image frame with the blur map.

26 . The image capture device of claim 25 , wherein performing the blurring operation on the first image data based on the first blur shape comprises applying higher blur to pixels satisfying a criteria based on brightness and lower blur to pixels not satisfying the criteria.

Assignments (1)

Continuity (2)

References Cited (13)