IP Library › Granted Patent US 11,792,351
Granted Patent B2
US 11,792,351 · App. 17/868,633 · Granted Oct 17, 2023

Image processing method, electronic device, and computer-readable storage medium

Inventor: Jianwei Yuan (Chang'an Dongguan, CN)
Assignee: VIVO MOBILE COMMUNICATION CO., LTD.
H04N5/2628H04N5/265H04N23/62H04N23/67
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,792,351
App. No.
17/868,633
Granted
Oct 17, 2023
Kind
B2
Abstract

An image processing method, an electronic device, and a computer-readable storage medium are provided. The method includes: obtaining N images; determining a reference image in the N images; where the reference image is an image in which a target tilt-shift object has a sharpness greater than a preset threshold; obtaining tilt-shift parameters input by a user, where the tilt-shift parameters are used to indicate an azimuth of a target focal plane and a tilt-shift area range; determining, based on the tilt-shift parameters, to-be-composited image(s) in intersection with the target focal plane; and performing, based on focal lengths of the to-be-composited image(s) and the reference image, image composite on the N images to output a target tilt-shift image.

Claims (71)

1. An image processing method, comprising:

obtaining N images, wherein the N images are taken based on a same photographing location and have different in-focus subjects, and the different in-focus subjects correspond to different focal lengths;

determining a reference image in the N images, wherein the reference image is an image in which a target tilt-shift object has a sharpness greater than a preset threshold;

obtaining tilt-shift parameters input by a user, wherein the tilt-shift parameters are used to indicate an azimuth of a target focal plane and a tilt-shift area range;

determining, based on the tilt-shift parameters, to-be-composited image(s) in intersection with the target focal plane; and

performing, based on focal lengths of the to-be-composited image(s) and the reference image, image composite on the N images to output a target tilt-shift image.

2. The method according to claim 1 , wherein

the tilt-shift parameters comprise a target tilt-shift point, a tilt-shift inclination, and a depth-of-field width; wherein

the target tilt-shift point is a coordinate location at which the target tilt-shift object is located; the tilt-shift inclination is an included angle between the target focal plane at which the target tilt-shift point is located and an imaging plane of the reference image, the target focal plane being a plane at which a tilt-shift axis formed by connecting photographed objects is located; and the depth-of-field width is a width of an area with a tilt-shift effect.

3. The method according to claim 2 , wherein the determining, based on the tilt-shift parameters, to-be-composited image(s) in intersection with the target focal plane comprises:

determining, based on the target tilt-shift point and the tilt-shift inclination, a tilt-shift azimuth of the target focal plane; and

determining, based on the tilt-shift azimuth and the depth-of-field width, the to-be-composited image(s) in intersection with the target focal plane.

4. The method according to claim 1 , wherein

the to-be-composited image(s) comprise at least one of a first to-be-composited image or a second to-be-composited image, wherein

the first to-be-composited image is an image with a focal length less than a reference distance in the N images, the second to-be-composited image is an image with a focal length greater than the reference distance in the N images, and the reference distance is a focal length of the reference image.

5. The method according to claim 1 , wherein the performing, based on focal lengths of the to-be-composited image(s) and the reference image, image composite on the N images to output a target tilt-shift image comprises:

in a case that in-focus subject(s) of the to-be-composited image(s) intersect the target focal plane, stacking and compositing the to-be-composited image(s) and the reference image; and

in a case that the in-focus subject(s) of the to-be-composited image(s) do not intersect the target focal plane, performing, based on image(s) of the N images in which in-focus subject(s) intersect with the target focal plane, sharpness processing on the in-focus subject(s) of the to-be-composited image(s), and stacking and compositing the to-be-composited image(s) and the reference image.

6. The method according to claim 5 , wherein the stacking and compositing the to-be-composited image(s) and the reference image comprises:

cutting out the in-focus subject(s) from the to-be-composited image(s) and setting the in-focus subject(s) as a foreground layer;

setting the reference image as a background layer; and

stacking and compositing the foreground layer and the background layer.

7. The method according to claim 1 , wherein the obtaining N images comprises:

performing a photographing operation on each of N different in-focus subjects to obtain N images; and

storing the N images.

8. The method according to claim 1 , wherein the obtaining N images comprises:

accessing a target device through a removable storage medium or wirelessly; and

obtaining N images prestored by the target device.

9. The method according to claim 7 , wherein the storing the N images comprises:

determining a focal length of each of the N different in-focus subjects with respect to a camera;

sorting the N images in order of their focal lengths; and

storing the sorted N images.

10. The method according to claim 1 , wherein the determining a reference image in the N images comprises:

receiving object location information of the target tilt-shift object input by the user, wherein the object location information comprises a location area at which the target tilt-shift object is located in the N images; and

determining the reference image from the N images based on the object location information.

11. The method according to claim 10 , wherein the determining the reference image from the N images based on the object location information comprises:

obtaining a sharpness of each of the N images; and

determining an image in which the target tilt-shift object has a sharpness greater than the preset threshold as the reference image.

12. An electronic device, comprising a processor, a memory, and a computer program stored in the memory and capable of running on the processor, wherein when the computer program is executed by the processor, the following steps are implemented:

obtaining N images, wherein the N images are taken based on a same photographing location and have different in-focus subjects, and the different in-focus subjects correspond to different focal lengths;

determining a reference image in the N images, wherein the reference image is an image in which a target tilt-shift object has a sharpness greater than a preset threshold;

obtaining tilt-shift parameters input by a user, wherein the tilt-shift parameters are used to indicate an azimuth of a target focal plane and a tilt-shift area range;

determining, based on the tilt-shift parameters, to-be-composited image(s) in intersection with the target focal plane; and

performing, based on focal lengths of the to-be-composited image(s) and the reference image, image composite on the N images to output a target tilt-shift image.

13. The electronic device according to claim 12 , wherein

the tilt-shift parameters comprise a target tilt-shift point, a tilt-shift inclination, and a depth-of-field width; wherein

the target tilt-shift point is a coordinate location at which the target tilt-shift object is located; the tilt-shift inclination is an included angle between the target focal plane at which the target tilt-shift point is located and an imaging plane of the reference image, the target focal plane being a plane at which a tilt-shift axis formed by connecting photographed objects is located; and the depth-of-field width is a width of an area with a tilt-shift effect.

14. The electronic device according to claim 13 , wherein the step of determining, based on the tilt-shift parameters, to-be-composited image(s) in intersection with the target focal plane comprises:

determining, based on the target tilt-shift point and the tilt-shift inclination, a tilt-shift azimuth of the target focal plane; and

determining, based on the tilt-shift azimuth and the depth-of-field width, the to-be-composited image(s) in intersection with the target focal plane.

15. The electronic device according to claim 12 , wherein

the to-be-composited image(s) comprise at least one of a first to-be-composited image or a second to-be-composited image, wherein

the first to-be-composited image is an image with a focal length less than a reference distance in the N images, the second to-be-composited image is an image with a focal length greater than the reference distance in the N images, and the reference distance is a focal length of the reference image.

16. The electronic device according to claim 12 , wherein the step of performing, based on focal lengths of the to-be-composited image(s) and the reference image, image composite on the N images to output a target tilt-shift image comprises:

in a case that in-focus subject(s) of the to-be-composited image(s) intersect the target focal plane, stacking and compositing the to-be-composited image(s) and the reference image; and

in a case that the in-focus subject(s) of the to-be-composited image(s) do not intersect the target focal plane, performing, based on image(s) of the N images in which in-focus subject(s) intersect with the target focal plane, sharpness processing on the in-focus subject(s) of the to-be-composited image(s), and stacking and compositing the to-be-composited image(s) and the reference image.

17. The electronic device according to claim 12 , wherein the step of obtaining N images comprises:

performing a photographing operation on each of N different in-focus subjects to obtain N images; and

storing the N images.

18. The electronic device according to claim 12 , wherein the step of determining a reference image in the N images comprises:

receiving object location information of the target tilt-shift object input by the user, wherein the object location information comprises a location area at which the target tilt-shift object is located in the N images; and

determining the reference image from the N images based on the object location information.

19. The electronic device according to claim 18 , wherein the step of determining the reference image from the N images based on the object location information comprises:

obtaining a sharpness of each of the N images; and

determining an image in which the target tilt-shift object has a sharpness greater than the preset threshold as the reference image.

20. A non-transitory computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the following steps are implemented:

obtaining N images, wherein the N images are taken based on a same photographing location and have different in-focus subjects, and the different in-focus subjects correspond to different focal lengths;

determining a reference image in the N images, wherein the reference image is an image in which a target tilt-shift object has a sharpness greater than a preset threshold;

obtaining tilt-shift parameters input by a user, wherein the tilt-shift parameters are used to indicate an azimuth of a target focal plane and a tilt-shift area range;

determining, based on the tilt-shift parameters, to-be-composited image(s) in intersection with the target focal plane; and

performing, based on focal lengths of the to-be-composited image(s) and the reference image, image composite on the N images to output a target tilt-shift image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 21, 2022
From: YUAN, JIANWEI
To: VIVO MOBILE COMMUNICATION CO., LTD.
Reel/Frame 060583/0854 →
Priority Claims (1)
CN 202010075815.1 · Jan 22, 2020 · national
Continuity (2)
Continuation PCTCN2021072921 · Jan 20, 2021
Related Publication 20220353436A1 · Nov 3, 2022
Cited By (1)
US 12,556,798