IP Library › Granted Patent US 12,356,063
Granted Patent B2
US 12,356,063 · App. 17/923,276 · Granted Jul 8, 2025

Photographing method and device

Inventors: Lei Wu (Shanghai, CN); Yihua Zeng (Shenzhen, CN); Huanwen Peng (Shenzhen, CN); Hongqiao Li (Shenzhen, CN)
Assignee: HUAWEI TECHNOLOGIES CO., LTD.
H04N23/61H04N23/631H04N23/634H04N23/667H04N23/80H04N5/272
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,356,063
App. No.
17/923,276
Granted
Jul 8, 2025
Kind
B2
Abstract

A photographing method and a device configured to capture, in a slow shutter exposure mode, a photo in which a subject image is clear and a background image has a motion blur, so as to improve a photographing experience. The device may display a preview image with an image of a first object in a preview background image having a motion blur, and a preview subject image not having a motion blur. The device may display an intermediate image on a photographing interface after detecting a photographing operation. On the intermediate image, an image of a second object in an intermediate background image has a motion blur, and an intermediate subject image does not have a motion blur. On a generated photo, an image of the second object in a target background image has a motion blur, and a target subject image does not have a motion blur.

Claims (89)

1. A method applied to an electronic device having a camera, wherein the method comprises:

entering a photo mode;

automatically entering, when detecting a moving object within a photographing range, a target photographing mode;

displaying a first preview image on a preview interface of the electronic device, wherein the first preview image comprises a preview subject image and a preview background image, wherein an image of a first object in the preview background image has a motion blur, and wherein the preview subject image does not have a motion blur;

displaying an intermediate image on a photographing interface of the electronic device after detecting a photographing operation, wherein the intermediate image comprises an intermediate subject image and an intermediate background image, wherein an image of a second object in the intermediate background image has a motion blur, and wherein the intermediate subject image does not have a motion blur;

stopping photographing; and

generating a photo, wherein the photo comprises a target subject image and a target background image,

wherein an image of the second object in the target background image has a motion blur, and

wherein the target subject image does not have a motion blur.

2. The method of claim 1 , wherein detecting the moving object within the photographing range comprises detecting the moving object within a background range of the photographing range.

3. The method of claim 1 , wherein after entering the target photographing mode, the method further comprises:

generating a RAW image based on an image captured by the camera;

displaying the RAW image on the preview interface;

recognizing a subject based on the RAW image; and

prompting a user that the subject is recognized.

4. The method of claim 3 , further comprising:

prompting, when not recognizing the subject, the user to specify a subject;

determining the subject based on an indication operation of the user on an object in the RAW image; and

prompting the user that the subject is recognized.

5. The method of claim 3 , wherein displaying the first preview image on the preview interface comprises:

performing image segmentation on a plurality of generated frames of RAW images based on the subject;

separately obtaining a subject image and a background image, wherein the subject image comprises the subject, and wherein the background image comprises the first object that moves;

registering and overlaying background images in an i th group of N adjacent frames of RAW images to generate a preview background image i, wherein i is a positive integer, wherein N is an integer greater than 1, and wherein an image of the first object in the preview background image i has a motion blur, wherein a middlemost frame of subject image or a frame of subject image close to the middle in the i th group of N adjacent frames of RAW images is a preview subject image i, or a subject image in a last captured frame of RAW image in the N adjacent frames of RAW images is the preview subject image i;

fusing the preview background image i and the preview subject image i to generate a preview image i; and

displaying the preview image i on the preview interface,

wherein the preview image i is the first preview image,

wherein when i is two consecutive integers, two adjacent groups of N frames of RAW images are slid in a sliding window mode.

6. The method of claim 1 , wherein the preview interface comprises one or more of the following:

first prompt information prompting that the target photographing mode has been entered;

second prompt information prompting a photographer and a subject to keep still after the photographing is started;

third prompt information prompting that a countdown is performed after the photographing is started;

fourth prompt information prompting a speed of a moving object; and

fifth prompt information prompting a recommended rate value, wherein the recommended rate value is used to indicate a quantity K of overlaid frames of background images in a photographing process after the photographing is started.

7. The method of claim 1 , wherein the preview interface further comprises a rate control that sets a rate value, and wherein the rate value indicates a quantity K of overlaid frames of background images in a photographing process after the photographing is started.

8. The method of claim 1 , wherein the photographing interface comprises one or more of the following:

sixth prompt information prompting a photographer and a subject to keep still after the photographing is started; and

seventh prompt information prompting the subject.

9. The method of claim 1 , further comprising:

starting, after detecting the photographing operation, a countdown of a first duration using a countdown control of the photographing interface; and

prompting a user with a remaining duration of the countdown,

wherein the stopping photographing comprises:

stopping photographing before the countdown ends when a photographing stop operation is detected;

stopping photographing before the countdown ends when detecting that a shake amplitude of the electronic device is greater than or equal to a first preset value or a shake amplitude of a subject is greater than or equal to a second preset value; or

stopping photographing after the countdown ends.

10. The method of claim 9 , wherein the first duration is associated with one or more of the following: a moving speed of the first object, a capture frame rate of the camera, or a rate value, and wherein the rate value indicates a quantity K of overlaid frames of background images in a photographing process after the photographing is started.

11. The method of claim 9 , wherein displaying the intermediate image on the photographing interface after detecting the photographing operation comprises:

generating, after detecting the photographing operation, a first RAW image based on the image captured by the camera;

performing image segmentation on the first RAW image to obtain a first subject image and a first background image;

generating, after detecting the photographing operation, a j th RAW image based on the image captured by the camera, wherein j is an integer greater than 1 and less than or equal to K, wherein K corresponds to a rate value, and wherein the rate value indicates a quantity K of overlaid frames of background images in a photographing process after the photographing is started;

performing image segmentation on the j th RAW image to obtain a j th subject image and a j th background image;

registering the j th background image and the first background image;

overlaying the j th background image and the (j−2) th overlaid background image to obtain the (j−1) th overlaid background image, wherein the (j−2) th background image comprises the second object, wherein an image of the second object has a motion blur, and wherein when j is 2, the (j−2) th overlaid background image is the first background image, wherein the j th intermediate subject image is a frame of subject image with highest brightness in frames of subject images;

fusing the (j−1) th overlaid background image and the j th intermediate subject image to generate the (j−1) th composite image; and

displaying the (j−1) th composite image on the photographing interface, wherein the (j−1) th composite image is the intermediate image.

12. The method of claim 11 , further comprising:

determining that a quantity of frames of images captured by the camera in the first duration is less than K; and

performing, after the photographing operation is detected, frame interpolation on the first RAW image that is generated based on the image captured by the camera to obtain K frames of RAW images in the first duration.

13. The method of claim 11 , wherein the photo is the (j−1) th composite image recently generated before the photographing is stopped, wherein when the photographing is stopped before the countdown ends, j is less than or equal to K, or wherein when the photographing is stopped after the countdown ends, j is equal to K.

14. The method of claim 1 , wherein a subject is one person, or wherein the subject is a plurality of persons with a same depth of field.

15. An electronic device, comprising:

a camera configured to capture an image;

a memory configured to store one or more computer programs comprising instructions; and

one or more processors coupled to the memory and the camera, wherein the one or more processors are configured to execute the instructions and enable the electronic device to:

enter a photo mode;

automatically enter, when detecting a moving object within a photographing range, a target photographing mode;

display a first preview image on a preview interface, wherein the first preview image comprises a preview subject image and a preview background image, wherein an image of a first object in the preview background image has a motion blur, and wherein the preview subject image does not have a motion blur;

display an intermediate image on a photographing interface after detecting a photographing operation, wherein the intermediate image comprises an intermediate subject image and an intermediate background image, wherein an image of a second object in the intermediate background image has a motion blur, and wherein the intermediate subject image does not have a motion blur; and

stop photographing and generating a photo, wherein the photo comprises a target subject image and a target background image, wherein an image of the second object in the target background image has a motion blur, and wherein the target subject image does not have a motion blur.

16. The electronic device of claim 15 , wherein the electronic device is further enabled to detect the moving object within a background range of the photographing range.

17. The electronic device of claim 15 , wherein the electronic device is further enabled to:

generate a RAW image based on an image captured by the camera;

display the RAW image on the preview interface;

recognize a subject based on the RAW image; and

prompt a user that the subject is recognized.

18. The electronic device of claim 17 , wherein the electronic device is further enabled to:

prompt, when not recognizing the subject, the user to specify a subject;

determine the subject based on an indication operation of the user on an object in the RAW image; and

prompt the user that the determined subject is recognized.

19. A method applied to an electronic device having a camera, wherein the method comprises:

entering a target photographing mode;

displaying a first preview image on a preview interface of the electronic device, wherein the first preview image comprises a preview subject image and a preview background image, wherein an image of a first object in the preview background image has a motion blur, wherein the preview subject image does not have a motion blur, and wherein the preview interface further comprises a rate control that sets a rate value, and wherein the rate value indicates a quantity K of overlaid frames of background images in a photographing process after photographing is started;

displaying an intermediate image on a photographing interface of the electronic device after detecting a photographing operation, wherein the intermediate image comprises an intermediate subject image and an intermediate background image, wherein an image of a second object in the intermediate background image has a motion blur, and wherein the intermediate subject image does not have a motion blur;

stopping the photographing; and

generating a photo, wherein the photo comprises a target subject image and a target background image,

wherein an image of the second object in the target background image has a motion blur, and

wherein the target subject image does not have a motion blur.

20. The method of claim 19 , wherein before entering the target photographing mode, the method further comprises:

entering a photo mode; and

automatically entering, when detecting a moving object within a photographing range, the target photographing mode.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 21, 2025
From: WU, LEI; ZENG, YIHUA; PENG, HUANWEN; LI, HONGQIAO
To: HUAWEI TECHNOLOGIES CO., LTD.
Reel/Frame 070586/0882 →
Priority Claims (1)
CN 202010378102.2 · May 7, 2020 · national
Continuity (1)
Related Publication 20230328356A1 · Oct 12, 2023
References Cited (23)
US 8212895B2 · Nakamura · 2012 [cited by examiner]
US 20060017837A1 · Sorek et al. · 2006 [cited by applicant]
US 20090096897A1 · Saito · 2009 [cited by examiner]
US 20100265353A1 · Koyama · 2010 [cited by examiner]
US 20140211034A1 · Tanaka · 2014 [cited by examiner]
US 20160125633A1 · Windmark · 2016 [cited by examiner]
US 20160301868A1 · Acharya et al. · 2016 [cited by applicant]
US 20170019608A1 · Ono · 2017 [cited by applicant]
US 20170034429A1 · Huysegems et al. · 2017 [cited by applicant]
US 20170318226A1 · Jung · 2017 [cited by examiner]
US 20180160021A1 · Zhou · 2018 [cited by examiner]
US 20200051218A1 · Hyun · 2020 [cited by examiner]
US 20210287343A1 · Kaida · 2021 [cited by examiner]
US 20220210343A1 · Leshem Gat · 2022 [cited by examiner]
CN 104270565A · 2015 [cited by applicant]
CN 105589506A · 2016 [cited by applicant]
CN 105847674A · 2016 [cited by applicant]
CN 106165389A · 2016 [cited by applicant]
CN 106170976A · 2016 [cited by applicant]
CN 106791380A · 2017 [cited by applicant]
CN 106791382A · 2017 [cited by applicant]
CN 107333056A · 2017 [cited by applicant]
CN 108055477A · 2018 [cited by applicant]