IP Library › Granted Patent US 11,379,520
Granted Patent B2
US 11,379,520 · App. 17/384,189 · Granted Jul 5, 2022

Image deformation control method and device and hardware device

Inventors: Yanhao Shen (Beijing, CN); Xu Fan (Beijing, CN); Guangyao Ni (Beijing, CN); Hui Yang (Beijing, CN)
Assignee: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
G06F16/7834G06F16/686G06F16/7837G06F16/7867
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,379,520
App. No.
17/384,189
Granted
Jul 5, 2022
Kind
B2
Abstract

A method and a device for controlling deformation on an image, and a hardware device are provided. In the method for controlling deformation on an image, a to-be-processed image is acquired; an audio file is acquired; the audio file is played and a first attribute value of the audio file corresponding to a current time point is acquired; an extent of the deformation on the image is determined based on the first attribute value; and deformation processing is performed on the to-be-processed image based on the extent of the deformation on the image. With the method for controlling deformation on an image, the extent of the deformation on the image is controlled based on the attribute value of the audio file, thereby solving the technical problem in the conventional technology that the special effects of deformation cannot be flexibly generated.

Claims (82)

1. A method for controlling deformation on an image, comprising:

acquiring a to-be-processed image;

acquiring an audio file;

playing the audio file and acquiring a first attribute value of the audio file corresponding to a current time point;

determining an extent of the deformation on the image based on the first attribute value;

performing deformation processing on the to-be-processed image based on the extent of the deformation on the image, wherein the performing deformation processing on the to-be-processed image based on the extent of the deformation on the image further comprises:

acquiring a type of the deformation, and

performing the deformation processing on the to-be-processed image based on the type of the deformation and the extent of the deformation, wherein the type of the deformation is acquired based on acquiring a state serial number of a current image;

wherein the acquiring a state serial number of a current image further comprises:

acquiring the extent of the deformation on the image;

in response to determining that the extent of the deformation on the image is greater than a first threshold, setting a value of a deformation bit to be true and acquiring the state serial number of the current image;

in response to determining that the extent of the deformation on the image is less than the first threshold and the value of the deformation bit is true, increasing the state serial number of the current image by one to acquire a first state serial number; and

determining a remainder acquired by dividing the first state serial number by a total number of state serial numbers, as the state serial number of the current image.

2. The method for controlling deformation on an image according to claim 1 , wherein the acquiring a to-be-processed image comprises:

acquiring a video image and acquiring a video frame image comprised in the video image as the to-be-processed image.

3. The method for controlling deformation on an image according to claim 2 , wherein the acquiring an audio file comprises:

acquiring an audio file comprised in the video image.

4. The method for controlling deformation on an image according to claim 3 , wherein the playing the audio file and acquiring a first attribute value of the audio file corresponding to a current time point comprises:

playing the audio file;

acquiring a currently played video frame image in the video image;

calculating a current time point based on the video frame image; and

acquiring the first attribute value of the audio file based on the current time point.

5. The method for controlling deformation on an image according to claim 1 , wherein the acquiring an audio file comprises:

acquiring the audio file and analyzing the audio file to acquire a correspondence table storing corresponding relationships between time points in the audio file and first attribute values of the audio file.

6. The method for controlling deformation on an image according to claim 5 , wherein the playing the audio file and acquiring a first attribute value of the audio file corresponding to a current time point comprises:

playing the audio file;

acquiring a current playing time point of the audio file; and

acquiring a first attribute value corresponding to the current playing time point according to the correspondence table.

7. The method for controlling deformation on an image according to claim 1 , wherein the determining an extent of the deformation on the image based on the first attribute value comprises:

acquiring a corresponding relationship between the first attribute value and the extent of the deformation on the image; and

calculating the extent of the deformation on the image based on the first attribute value and the corresponding relationship.

8. The method for controlling deformation on an image according to claim 1 , wherein the acquiring a type of the deformation comprises:

acquiring the type of the deformation based on the state serial number.

9. A device for controlling deformation on an image, comprising:

at least one processor; and

at least one memory communicatively coupled to the at least one processor and storing instructions that upon execution by the at least one processor cause the device to perform:

acquiring a to-be-processed image;

acquiring an audio file;

playing the audio file and acquiring a first attribute value of the audio file corresponding to a current time point;

determining an extent of the deformation on the image based on the first attribute value;

performing deformation processing on the to-be-processed image based on the extent of the deformation on the image, wherein the performing deformation processing on the to-be-processed image based on the extent of the deformation on the image further comprises:

acquiring a type of the deformation, and

performing the deformation processing on the to-be-processed image based on the type of the deformation and the extent of the deformation, wherein the type of the deformation is acquired based on acquiring a state serial number of a current image;

wherein the acquiring a state serial number of a current image further comprises:

acquiring the extent of the deformation on the image;

in response to determining that the extent of the deformation on the image is greater than a first threshold, setting a value of a deformation bit to be true and acquiring the state serial number of the current image;

in response to determining that the extent of the deformation on the image is less than the first threshold and the value of the deformation bit is true, increasing the state serial number of the current image by one to acquire a first state serial number; and

determining a remainder acquired by dividing the first state serial number by a total number of state serial numbers, as the state serial number of the current image.

10. The device according to claim 9 , wherein the acquiring an audio file comprises:

acquiring the audio file and analyzing the audio file to acquire a correspondence table storing corresponding relationships between time points in the audio file and first attribute values of the audio file.

11. The device according to claim 10 , wherein the playing the audio file and acquiring a first attribute value of the audio file corresponding to a current time point comprises:

playing the audio file;

acquiring a current playing time point of the audio file; and

acquiring a first attribute value corresponding to the current playing time point according to the correspondence table.

12. The device according to claim 9 , wherein the determining an extent of the deformation on the image based on the first attribute value comprises:

acquiring a corresponding relationship between the first attribute value and the extent of the deformation on the image; and

calculating the extent of the deformation on the image based on the first attribute value and the corresponding relationship.

13. An electronic device, comprising:

a memory configured to store a non-transitory computer-readable instruction; and

a processor configured to execute the computer-readable instruction to perform the method for controlling deformation on an image according to claim 1 .

14. A non-transitory computer-readable storage medium configured to store a non-transitory computer-readable instruction, wherein the non-transitory computer-readable instruction, when executed by a computer, causes the computer to perform operations comprising:

acquiring a to-be-processed image;

acquiring an audio file;

playing the audio file and acquiring a first attribute value of the audio file corresponding to a current time point;

determining an extent of the deformation on the image based on the first attribute value;

performing deformation processing on the to-be-processed image based on the extent of the deformation on the image, wherein the performing deformation processing on the to-be-processed image based on the extent of the deformation on the image further comprises:

acquiring a type of the deformation, and

performing the deformation processing on the to-be-processed image based on the type of the deformation and the extent of the deformation, wherein the type of the deformation is acquired based on acquiring a state serial number of a current image;

wherein the acquiring a state serial number of a current image further comprises:

acquiring the extent of the deformation on the image;

in response to determining that the extent of the deformation on the image is greater than a first threshold, setting a value of a deformation bit to be true and acquiring the state serial number of the current image;

in response to determining that the extent of the deformation on the image is less than the first threshold and the value of the deformation bit is true, increasing the state serial number of the current image by one to acquire a first state serial number; and

determining a remainder acquired by dividing the first state serial number by a total number of state serial numbers, as the state serial number of the current image.

15. The device according to claim 9 , wherein the acquiring a to-be-processed image comprises:

acquiring a video image and acquiring a video frame image comprised in the video image as the to-be-processed image.

16. The device according to claim 15 , wherein the acquiring an audio file comprises:

acquiring an audio file comprised in the video image.

17. The device according to claim 16 , wherein the playing the audio file and acquiring a first attribute value of the audio file corresponding to a current time point comprises:

playing the audio file;

acquiring a currently played video frame image in the video image;

calculating a current time point based on the video frame image; and

acquiring the first attribute value of the audio file based on the current time point.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 6, 2021
From: FAN, XU; NI, GUANGYAO; YANG, HUI
To: SHANGHAI SUIXUNTONG ELECTRONIC TECHNOLOGY CO., LTD.
Reel/Frame 057110/0233 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 6, 2021
From: SHEN, YANHAO
To: ZHEJIANG JINRITOUTIAO TECHNOLOGY CO., LTD.
Reel/Frame 057110/0319 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 6, 2021
From: ZHEJIANG JINRITOUTIAO TECHNOLOGY CO., LTD.
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 057110/0365 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 6, 2021
From: SHANGHAI SUIXUNTONG ELECTRONIC TECHNOLOGY CO., LTD.
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 057110/0409 →
Priority Claims (1)
CN 201910073610.7 · Jan 25, 2019 · national
Continuity (2)
Continuation PCTCN2020070729 · Jan 7, 2020
Related Publication 20210406305A1 · Dec 30, 2021