IP Library › Granted Patent US 12,356,107
Granted Patent B2
US 12,356,107 · App. 18/417,881 · Granted Jul 8, 2025

Image special effect processing method and apparatus, and electronic device and computer readable storage medium

Inventors: Guangyao Ni (Beijing, CN); Shentao Wang (Beijing, CN); Hui Yang (Beijing, CN)
Assignee: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
H04N5/272G06T13/00H04N5/265
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,356,107
App. No.
18/417,881
Granted
Jul 8, 2025
Kind
B2
Abstract

A method and a device for performing special effect processing on an image, an electronic apparatus, and a computer-readable storage medium are provided. The method includes: acquiring a video; arranging a preset movable window on the video, where the window moves on the video; determining a current image based on a current play progress of the video; acquiring, from a data storage layer by an image acquisition unit of a rendering layer, a historical image when the window is moved to a preset position; combining the historical image and the current image by an animation logic processing unit of a script layer and a special effect unit of the rendering layer; and outputting the combined image and displaying the combined image on a terminal screen.

Claims (55)

1. A method for performing special effect processing on an image, comprising:

acquiring a video;

setting a movable window in a video playing interface of playing the video, wherein the movable window is configured to move from a side to another side of the video playing interface for a plurality of rounds during playing the video;

acquiring a first image from the video in response to determining that the movable window moves to a rightmost side of the video playing interface in a first round among the plurality of rounds, wherein the first image is a frame of the video being displayed when the movable window moves to the rightmost side of the video playing interface;

determining a current image based on a current play progress of the video while the movable window moving in a second round among the plurality of rounds;

generating a new image by combining the first image and the current image; and

outputting the new image and displaying the new image on the video playing interface.

2. The method according to claim 1 , further comprising:

storing the first image in a cache.

3. The method according to claim 1 , wherein the combining the first image and the current image into a new image comprises:

determining a position of the movable window in a blank image; and

drawing the movable window at the position, drawing a part of the first image outside the movable window, and drawing a part of the current image in the movable window.

4. The method according to claim 1 , further comprising:

controlling a movement period of the movable window in each of the plurality of rounds to be less than a time length of the video.

5. A device for performing special effect processing on an image, comprising:

at least one processor; and

at least one memory communicatively coupled to the at least one processor and storing instructions that upon execution by the at least one processor cause the device to perform operations comprising:

acquiring a video;

setting a movable window in a video playing interface of playing the video, wherein the movable window is configured to move from a side to another side of the video playing interface for a plurality of rounds during playing the video;

acquiring a first image from the video in response to determining that the movable window moves to a rightmost side of the video playing interface in a first round among the plurality of rounds, wherein the first image is a frame of the video being displayed when the movable window moves to the rightmost side of the video playing interface;

determining a current image based on a current play progress of the video while the movable window moving in a second round among the plurality of rounds;

generating a new image by combining the first image and the current image; and

outputting the new image and displaying the new image on the video playing interface.

6. The device according to claim 5 , the operations further comprising:

storing the first image in a cache.

7. The device according to claim 5 , wherein the combining the first image and the current image into a new image comprises:

determining a position of the movable window in a blank image; and

drawing the movable window at the position, drawing a part of the first image outside the movable window, and drawing a part of the current image in the movable window.

8. The device according to claim 5 , the operations further comprising:

controlling a movement period of the movable window in each of the plurality of rounds to be less than a time length of the video.

9. A non-transitory computer-readable storage medium, configured to store non-transitory computer-readable instructions that, when being executed by a computer, cause the computer to implement operations comprising:

acquiring a video;

setting a movable window in a video playing interface of playing the video, wherein the movable window is configured to move from a side to another side of the video playing interface for a plurality of rounds during playing the video;

acquiring a first image from the video in response to determining that the movable window moves to a rightmost side of the video playing interface in a first round among the plurality of rounds, wherein the first image is a frame of the video being displayed when the movable window moves to the rightmost side of the video playing interface;

determining a current image based on a current play progress of the video while the movable window moving in a second round among the plurality of rounds;

generating a new image by combining the first image and the current image; and

outputting the new image and displaying the new image on the video playing interface.

10. The method according to claim 1 , wherein the movable window is configured to move from a leftmost side to a rightmost side of the video playing interface in each of the plurality of rounds.

11. The method according to claim 1 , further comprising:

automatically moving the movable window from a leftmost side of the video playing interface while starting to play the video.

12. The method according to claim 1 , further comprising:

performing Gaussian blur processing on the first image to obtain a processed image; and

generating the new image by combining the processed image and the current image.

13. The device according to claim 5 , wherein the movable window is configured to move from a leftmost side to a rightmost side of the video playing interface in each of the plurality of rounds.

14. The device according to claim 5 , the operations further comprising:

automatically moving the movable window from a leftmost side of the video playing interface while starting to play the video.

15. The device according to claim 5 , the operations further comprising:

performing Gaussian blur processing on the first image to obtain a processed image; and

generating the new image by combining the processed image and the current image.

16. The non-transitory computer-readable storage medium according to claim 9 , wherein the movable window is configured to move from a leftmost side to a rightmost side of the video playing interface in each of the plurality of rounds.

17. The non-transitory computer-readable storage medium according to claim 9 , the operations further comprising:

automatically moving the movable window from a leftmost side of the video playing interface while starting to play the video.

18. The non-transitory computer-readable storage medium according to claim 9 , the operations further comprising:

performing Gaussian blur processing on the first image to obtain a processed image; and

generating the new image by combining the processed image and the current image.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 21, 2025
From: NI, GUANGYAO; WANG, SHENTAO; YANG, HUI
To: SHANGHAI SUIXUNTONG ELECTRONIC TECHNOLOGY CO., LTD.
Reel/Frame 070589/0258 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 21, 2025
From: SHANGHAI SUIXUNTONG ELECTRONIC TECHNOLOGY CO., LTD.
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 070589/0513 →
Priority Claims (1)
CN 201910735603.9 · Aug 9, 2019 · national
Continuity (3)
Continuation In Part 17590797 · Feb 1, 2022
Continuation PCTCN2020106236 · Jul 31, 2020
Related Publication 20240163392A1 · May 16, 2024
References Cited (48)
US 5815143A · Jenney · 1998 [cited by examiner]
US 5920325A · Morgan · 1999 [cited by examiner]
US 6504990B1 · Abecassis · 2003 [cited by examiner]
US 7346920B2 · Lamkin · 2008 [cited by examiner]
US 7364306B2 · Margulis · 2008 [cited by examiner]
US 7404645B2 · Margulis · 2008 [cited by examiner]
US 7430360B2 · Abecassis · 2008 [cited by examiner]
US 7432940B2 · Brook · 2008 [cited by examiner]
US 7511718B2 · Subramanian · 2009 [cited by examiner]
US 8374383B2 · Long · 2013 [cited by examiner]
US 9183560B2 · Abelow · 2015 [cited by examiner]
US 9554037B2 · Lee · 2017 [cited by examiner]
US 9589354B2 · Wells · 2017 [cited by examiner]
US 9669306B2 · Perlman · 2017 [cited by examiner]
US 9756349B2 · Perlman · 2017 [cited by examiner]
US 10416952B2 · Cyr · 2019 [cited by examiner]
US 10499118B2 · Todd · 2019 [cited by examiner]
US 10771863B2 · Mathur · 2020 [cited by examiner]
US 10820067B2 · Mathur · 2020 [cited by examiner]
US 20040095474A1 · Matsufune · 2004 [cited by examiner]
US 20050251732A1 · Lamkin · 2005 [cited by examiner]
US 20110107220A1 · Perlman · 2011 [cited by examiner]
US 20120262462A1 · Montan et al. · 2012 [cited by applicant]
US 20140320529A1 · Roberts · 2014 [cited by examiner]
US 20150010234A1 · Daisy · 2015 [cited by applicant]
US 20150206444A1 · Vahid · 2015 [cited by examiner]
US 20200007956A1 · Mathur · 2020 [cited by examiner]
CN 101617531A · 2009 [cited by applicant]
CN 103209312A · 2013 [cited by applicant]
CN 103702220A · 2014 [cited by applicant]
CN 104766361A · 2015 [cited by applicant]
CN 107820026A · 2018 [cited by applicant]
CN 108055477A · 2018 [cited by applicant]
CN 109064539A · 2018 [cited by applicant]
CN 109168026A · 2019 [cited by applicant]
CN 109712013A · 2019 [cited by applicant]
CN 110049371A · 2019 [cited by applicant]
CN 110070585A · 2019 [cited by applicant]
EP 2808871A1 · 2014 [cited by applicant]
JP H05227475A · 1993 [cited by applicant]
JP 2001285711A · 2001 [cited by applicant]
JP 2003078817A · 2003 [cited by examiner]
JP 2004297399A · 2004 [cited by applicant]
JP 2011166594A · 2011 [cited by applicant]
WO WO2007111206A1 · 2007 [cited by applicant]
WO WO2017029849A1 · 2017 [cited by applicant]
International Patent Application No. PCT/CN2020/106236; Int'l Search Report; dated Nov. 3, 2020; 3 pages. [cited by applicant]
Written Opinion for International Application No. PCT/CN2020/106236, mailed Nov. 3, 2020, 07 Pages. [cited by applicant]