IP Library Granted Patent US 12,579,709
Granted Patent B2
US 12,579,709 · App. 17/888,216 · Granted Mar 17, 2026

Image special effect processing method and apparatus

Inventors: Juntao Sun (Beijing, CN); Yang Lv (Beijing, CN); Gao Liu (Beijing, CN); Ruifeng Ma (Beijing, CN)
Assignee: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
G06T11/60G06F3/0482G06F3/04845G06T7/194G06T2200/24
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,579,709
App. No.
17/888,216
Granted
Mar 17, 2026
Kind
B2
Abstract

The present disclosure discloses an image special effect processing method and apparatus, an electronic device and a computer-readable storage medium. The method includes: in response to an instruction for adding a special effect object on an initial image, determining a target display region of the special effect object on the initial image, where the target display region is a foreground region or a background region of the initial image, the foreground region is an image region where a target object is located in the initial image, and the background region is an image region other than the foreground region in the initial image; and displaying a part of the special effect object located in the target display region on the initial image to obtain a target image.

Claims (61)

1 . An image special effect processing method, comprising:

in response to an operation by a user on a special effect parameter setting option on a special effect setting interface, generating an instruction for adding one special effect object on an initial image, wherein the special effect parameter setting option comprises at least two of a special effect option for displaying on a foreground region, a special effect option for displaying on a background region, or a special effect option for marking an edge of the foreground region;

in response to the instruction for adding the one special effect object on the initial image, and in response to a switch operation by the user on a switch option on a special effect setting interface provided for the user to choose whether to distinguish between the foreground region and the background region when the one special effect object is added:

in a disabling switch operation, displaying the one special effect object on the initial image; and

in an enabling switch operation:

determining a target display region of the one special effect object on the initial image, wherein the target display region is the foreground region or the background region of the initial image, the foreground region is an image region where a target object is located in the initial image, and the background region is an image region other than the foreground region in the initial image; and

displaying a first part of the one special effect object located in the target display region on the initial image to obtain a target image, wherein the one special effect object comprises the first part and a second part, wherein the second part of the one special effect object is located outside the target display region and is not displayed;

wherein displaying the first part of the one special effect object located in the target display region on the initial image to obtain the target image comprises:

determining an overlapping region of a position region of the one special effect object on the initial image and the target display region;

cutting the first part located in the overlapping region from the one special effect object as a target display object; and

displaying the target display object on an upper layer of the initial image to obtain the target image;

wherein determining the target display region of the one special effect object on the initial image comprises:

when the one special effect object comprises a plurality of sub-effect objects, determining a target display region of each of the sub-effect objects in the one special effect object respectively;

correspondingly, wherein displaying the first part of the one special effect object located in the target display region on the initial image to obtain the target image comprises:

determining a display order of a respective sub-effect object in the one special effect object respectively; and

displaying a first part of the respective sub-effect object in the one special effect object located in a respective target display region of the respective sub-effect object on the initial image in sequence according to the display sequence of the respective sub-effect object in the one special effect object, to obtain the target image.

2 . The method according to claim 1 , wherein in response to the operation by the user on the special effect parameter setting option on the special effect setting interface, generating the instruction for adding the one special effect object on the initial image comprises:

in response to a selecting operation on a special effect navigation tree on a first interface, determining the one special effect object;

in response to a selecting operation on a display region setting option on a second interface, determining the target display region; and

generating the instruction according to the one special effect object and the target display region.

3 . The method according to claim 1 , wherein the one special effect object is at least one of a sticker and a frame marking the target display region.

4 . An image special effect processing apparatus, comprising:

at least one processor; and

a memory communicatively connected to the at least one processor; wherein, the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor, so that the at least one processor is configured to:

in response to an operation by a user on a special effect parameter setting option on a special effect setting interface, generating an instruction for adding one special effect object on an initial image, wherein the special effect parameter setting option comprises at least two of a special effect option for displaying on a foreground region, a special effect option for displaying on a background region, or a special effect option for marking an edge of the foreground region;

in response to the instruction for adding one the special effect object on the initial image, and in response to a switch operation by the user on a switch option on a special effect setting interface provided for the user to choose whether to distinguish between the foreground region and the background region when the one special effect object is added:

in a disabling switch operation, display the one special effect object on the initial image; and

in an enabling switch operation, determine a target display region of the one special effect object on the initial image, wherein the target display region is the foreground region or the background region of the initial image, the foreground region is an image region where a target object is located in the initial image, and the background region is an image region other than the foreground region in the initial image; and

display a first part of the one special effect object located in the target display region on the initial image to obtain a target image, wherein the one special effect object comprises the first part and a second part, wherein the second part of the one special effect object is located outside the target display region and is not displayed;

wherein the at least one processor is configured to:

determine an overlapping region of a position region of the one special effect object on the initial image and the target display region;

cut the first part located in the overlapping region from the one special effect object as a target display object;

display the target display object on an upper layer of the initial image to obtain the target image;

when the one special effect object to be added includes a plurality of sub-effect objects, determine a target display region of each of the sub-effect objects respectively; and

correspondingly, the at least one processor is specifically configured to:

determine a display order of a respective sub-effect object in the one special effect object respectively;

display a first part of the respective sub-effect object in the one special effect object located in a respective target display region of the respective sub-effect object on the initial image in sequence according to the display sequence of the respective sub-effect object in the one special effect object, to obtain the target image.

5 . The apparatus according to claim 4 , wherein the at least one processor is configured to:

in response to a selecting operation on a special effect navigation tree on a first interface, determine the one special effect object;

in response to a selecting operation on a display region setting option on a second interface, determine the target display region; and

generate the instruction according to the one special effect object and the target display region.

6 . The apparatus according to claim 4 , wherein the one special effect object is at least one of a sticker and a frame marking the target display region.

7 . A non-transitory computer-readable storage medium, configured to store non-transitory computer-readable instructions, wherein when the non-transitory computer-readable instructions are executed by a computer, the computer is caused to execute steps of:

in response to an operation by a user on a special effect parameter setting option on a special effect setting interface, generate an instruction for adding one special effect object on an initial image, wherein the special effect parameter setting option comprises at least two of a special effect option for displaying on a foreground region, a special effect option for displaying on a background region, or a special effect option for marking an edge of the foreground region;

in response to the instruction for adding the one special effect object on the initial image, and in response to a switch operation by the user on a switch option on a special effect setting interface provided for the user to choose whether to distinguish between the foreground region and the background region when the one special effect object is added:

in a disabling switch operation, displaying the one special effect object on the initial image; and

in an enabling switch operation:

determining a target display region of the one special effect object on the initial image, wherein the target display region is the foreground region or the background region of the initial image, the foreground region is an image region where a target object is located in the initial image, and the background region is an image region other than the foreground region in the initial image; and

displaying a first part of the one special effect object located in the target display region on the initial image to obtain a target image, wherein the one special effect object comprises the first part and a second part, wherein the second part of the one special effect object is located outside the target display region and is not displayed;

wherein the computer instructions are further used to perform the following steps:

determining an overlapping region of a position region of the one special effect object on the initial image and the target display region;

cutting the first part located in the overlapping region from the one special effect object as a target display object; and

displaying the target display object on an upper layer of the initial image to obtain the target image;

when the one special effect object comprises a plurality of sub-effect objects, determining a target display region of each of the sub-effect objects in the one special effect object respectively:

correspondingly, wherein displaying the first part of the one special effect object located in the target display region on the initial image to obtain the target image comprises:

determining a display order of a respective sub-effect object in the one special effect object respectively; and

displaying a first part of the respective sub-effect object in the one special effect object located in a respective target display region of the respective sub-effect object on the initial image in sequence according to the display sequence of the respective sub-effect object in the special effect object, to obtain the target image.

8 . The non-transitory computer-readable storage medium according to claim 7 , wherein the computer instructions are further used to perform the following steps:

in response to a selecting operation on a special effect navigation tree on a first interface, determining the one special effect object;

in response to a selecting operation on a display region setting option on a second interface, determining the target display region; and

generating the instruction according to the one special effect object and the target display region.

Assignments (8)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 10, 2023
From: SUN, JUNTAO
To: BEIJING ZITIAO NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 063596/0054 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 10, 2023
From: LV, YANG
To: HANGZHOU OCEAN ENGINE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 063596/0092 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 10, 2023
From: LIU, GAO
To: SHENZHEN JINRITOUTIAO TECHNOLOGY CO., LTD.
Reel/Frame 063596/0145 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 10, 2023
From: MA, RUIFENG
To: SHANGHAI SUIXUNTONG ELECTRONIC TECHNOLOGY CO., LTD.
Reel/Frame 063596/0170 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 10, 2023
From: BEIJING ZITIAO NETWORK TECHNOLOGY CO., LTD.
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 063596/0221 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 10, 2023
From: HANGZHOU OCEAN ENGINE NETWORK TECHNOLOGY CO., LTD.
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 063596/0277 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 10, 2023
From: SHENZHEN JINRITOUTIAO TECHNOLOGY CO., LTD.
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 063596/0376 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 10, 2023
From: SHANGHAI SUIXUNTONG ELECTRONIC TECHNOLOGY CO., LTD.
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 063596/0413 →
Priority Claims (1)
CN 202010122421.7 · Feb 27, 2020 · national
Continuity (2)
Continuation PCTCN2021077737 · Feb 24, 2021
Related Publication 20220392130A1 · Dec 8, 2022
References Cited (66)
US 10269164B1 · Song · 2019 [cited by examiner]
US 11640683B2 · Xu · 2023 [cited by examiner]
US 20040130736A1 · Lee · 2004 [cited by examiner]
US 20090043674A1 · Minsky · 2009 [cited by examiner]
US 20090060334A1 · Rayner · 2009 [cited by applicant]
US 20090204880A1 · Ko · 2009 [cited by examiner]
US 20100299621A1 · Piehler · 2010 [cited by examiner]
US 20130063468A1 · Hikida · 2013 [cited by applicant]
US 20130239056A1 · Ubillos · 2013 [cited by examiner]
US 20140029804A1 · Kawaguchi · 2014 [cited by examiner]
US 20150117777A1 · Hsun · 2015 [cited by applicant]
US 20150235389A1 · Miller · 2015 [cited by examiner]
US 20150278986A1 · Edwin · 2015 [cited by examiner]
US 20170139573A1 · Li · 2017 [cited by examiner]
US 20170192651A1 · Yang · 2017 [cited by examiner]
US 20180068475A1 · Blue · 2018 [cited by examiner]
US 20180234708A1 · Chong · 2018 [cited by examiner]
US 20180341647A1 · Hiraishi · 2018 [cited by examiner]
US 20190058827A1 · Park · 2019 [cited by examiner]
US 20190132642A1 · Wang · 2019 [cited by examiner]
US 20190187880A1 · Dalonzo · 2019 [cited by examiner]
US 20190213713A1 · Tsai et al. · 2019 [cited by applicant]
US 20200051304A1 · Choi · 2020 [cited by examiner]
US 20200174656A1 · Shin · 2020 [cited by examiner]
US 20200177823A1 · Zhu · 2020 [cited by examiner]
US 20200334875A1 · Xu · 2020 [cited by examiner]
US 20200342631A1 · Bickerstaff · 2020 [cited by examiner]
US 20200351450A1 · Kim · 2020 [cited by examiner]
US 20200380625A1 · Watson · 2020 [cited by examiner]
US 20200380635A1 · Bushell · 2020 [cited by examiner]
US 20210042950A1 · Wantland · 2021 [cited by examiner]
US 20210074067A1 · Kwon · 2021 [cited by examiner]
US 20210287439A1 · Goodrich · 2021 [cited by examiner]
US 20210375022A1 · Lee · 2021 [cited by examiner]
US 20210383588A1 · Lee · 2021 [cited by examiner]
US 20220014819A1 · Liu · 2022 [cited by examiner]
US 20220067888A1 · Yu · 2022 [cited by examiner]
US 20220070385A1 · Van Os · 2022 [cited by examiner]
US 20220084168A1 · Lee · 2022 [cited by examiner]
US 20220139016A1 · Wei · 2022 [cited by examiner]
US 20220232172A1 · Wang · 2022 [cited by examiner]
US 20220270215A1 · Lee · 2022 [cited by examiner]
US 20230305688A1 · Triverio · 2023 [cited by examiner]
CN 107181976A · 2017 [cited by applicant]
CN 107347166A · 2017 [cited by applicant]
CN 108012091A · 2018 [cited by applicant]
CN 108109161A · 2018 [cited by applicant]
CN 109302619A · 2019 [cited by applicant]
CN 109859102A · 2019 [cited by applicant]
CN 110012352A · 2019 [cited by applicant]
CN 110147805A · 2019 [cited by applicant]
CN 110475150A · 2019 [cited by applicant]
CN 110493630A · 2019 [cited by applicant]
CN 110536151A · 2019 [cited by applicant]
CN 110751659A · 2020 [cited by applicant]
JP 2013077296A · 2013 [cited by applicant]
JP 2016184864A · 2016 [cited by applicant]
JP 2018181044A · 2018 [cited by applicant]
JP 2019192061A · 2019 [cited by applicant]
International Search Report and Written Opinion issued in International Patent Application No. PCT/CN2021/077737 on May 20, 2021. [cited by applicant]
Chinese First Office Action issued in Chinese Patent Application No. 202010122421.7 on Dec. 14, 2021. [cited by applicant]
Chinese Second Office Action issued in Chinese Patent Application No. 202010122421.7 on Jun. 14, 2022. [cited by applicant]
Extended European Search Report in EP21759634.5, mailed Jul. 7, 2023, 8 pages. [cited by applicant]
Office Action in JP2022552171, mailed Oct. 3, 2023, 6 pages. [cited by applicant]
Communication pursuant to Article 94(3) EPC in European Patent Application No. 21759634.5, mailed Mar. 21, 2024, 5 pages. [cited by applicant]
Notice of Allowance for Korean Patent Application No. 10-2022-7030386, mailed on Oct. 27, 2024, 6 pages. [cited by applicant]