IP Library › Granted Patent US 10,713,470
Granted Patent B2
US 10,713,470 · App. 16/108,198 · Granted Jul 14, 2020

Method of determining image background, device for determining image background, and a non-transitory medium for same

Inventor: Hanwen Chang (Beijing, CN)
Assignee: BEIJING KINGSOFT INTERNET SECURITY SOFTWARE CO., LTD.
G06K9/00234G06K9/627G06T7/11G06T7/194G06T2207/20081G06T2207/20084G06T2207/30201
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,713,470
App. No.
16/108,198
Granted
Jul 14, 2020
Kind
B2
Abstract

The present disclosure provides a method and an apparatus of determining an image background, a device and a medium. The method includes: recognizing a face region in an image, and obtaining a face distance based on the face region; obtaining a face distance parameter of each pixel in the image based on the face distance; processing the face distance parameter and corresponding color parameter of each pixel in the image by applying a pre-trained image region segmentation model to determine an image region type corresponding to each pixel; determining a background region of the image based on the image region type corresponding to each pixel and performing preset background image processing on the background region.

Claims (54)

1. A method of determining an image background, comprising:

recognizing a face region in an image, and obtaining a face distance based on the face region;

obtaining a face distance parameter of each pixel in the image based on the face distance;

processing the face distance parameter and corresponding color parameter of each pixel in the image by applying a pre-trained image region segmentation model to determine an image region type corresponding to each pixel;

determining a background region of the image based on the image region type corresponding to each pixel and performing preset background image processing on the background region;

wherein obtaining the face distance based on the face region comprises:

detecting a width of a central horizontal axis of the face region to obtain a face horizontal axis distance; and/or,

detecting a length of a central vertical axis of the face region to obtain a face vertical axis distance; and

wherein obtaining the face distance parameter of each pixel in the image based on the face distance comprises:

detecting a first distance from each pixel in the image to the central horizontal axis of the face region and calculating a first ratio of the first distance to the face horizontal axis distance;

and/or,

detecting a second distance from each pixel in the image to the central vertical axis of the face region and calculating a second ratio of the second distance to the face vertical axis distance.

2. The method according to claim 1 , further comprising:

recognizing a sample face region of each sample image in an image sample set, and obtaining a sample face distance based on the sample face region;

obtaining a face distance parameter of each pixel in a background region and a face distance parameter of each pixel in a user region in each sample image based on the sample face distance;

training the face distance parameter and corresponding color parameter of each pixel through a back-propagation algorithm by applying a preset neural network to determine neuron parameters on the neural network to obtain the image region segmentation model.

3. The method according to claim 1 , further comprising:

determining a user region of the image based on the image region type corresponding to each pixel and performing preset user image processing on the user region.

4. A terminal device, comprising a memory, a processor and computer programs stored in the memory and executable by the processor, wherein when the computer programs are executed by the processor, the processor is configured to perform acts of:

recognizing a face region in an image, and obtaining a face distance based on the face region;

obtaining a face distance parameter of each pixel in the image based on the face distance;

processing the face distance parameter and corresponding color parameter of each pixel in the image by applying a pre-trained image region segmentation model to determine an image region type corresponding to each pixel;

determining a background region of the image based on the image region type corresponding to each pixel and performing preset background image processing on the background region;

wherein the processor is configured to obtain the face distance based on the face region by acts of:

detecting a width of a central horizontal axis of the face region to obtain a face horizontal axis distance; and/or,

detecting a length of a central vertical axis of the face region to obtain a face vertical axis distance; and

wherein the processor is configured to obtain the face distance parameter of each pixel in the image based on the face distance by acts of:

detecting a first distance from each pixel in the image to the central horizontal axis of the face region and calculating a first ratio of the first distance to the face horizontal axis distance;

and/or,

detecting a second distance from each pixel in the image to the central vertical axis of the face region and calculating a second ratio of the second distance to the face vertical axis distance.

5. The terminal device according to claim 4 , wherein the processor is further configured to perform acts of:

recognizing a sample face region of each sample image in an image sample set, and obtaining a sample face distance based on the sample face region;

obtaining a face distance parameter of each pixel in a background region and a face distance parameter of each pixel in a user region in each sample image based on the sample face distance;

training the face distance parameter and corresponding color parameter of each pixel through a back-propagation algorithm by applying a preset neural network to determine neuron parameters on the neural network to obtain the image region segmentation model.

6. The terminal device according to claim 4 , wherein the processor is further configured to perform acts of:

determining a user region of the image based on the image region type corresponding to each pixel and performing preset user image processing on the user region.

7. A non-transitory computer readable storage medium, having stored therein computer programs that, when executed by a processor, causes the processor to perform a method of determining an image background, the method comprises:

recognizing a face region in an image, and obtaining a face distance based on the face region;

obtaining a face distance parameter of each pixel in the image based on the face distance;

processing the face distance parameter and corresponding color parameter of each pixel in the image by applying a pre-trained image region segmentation model to determine an image region type corresponding to each pixel;

determining a background region of the image based on the image region type corresponding to each pixel and performing preset background image processing on the background region;

wherein obtaining the face distance based on the face region comprises:

detecting a width of a central horizontal axis of the face region to obtain a face horizontal axis distance; and/or,

detecting a length of a central vertical axis of the face region to obtain a face vertical axis distance; and

wherein obtaining the face distance parameter of each pixel in the image based on the face distance comprises:

detecting a first distance from each pixel in the image to the central horizontal axis of the face region and calculating a first ratio of the first distance to the face horizontal axis distance;

and/or,

detecting a second distance from each pixel in the image to the central vertical axis of the face region and calculating a second ratio of the second distance to the face vertical axis distance.

8. The non-transitory computer readable storage medium according to claim 7 , wherein the method further comprises:

recognizing a sample face region of each sample image in an image sample set, and obtaining a sample face distance based on the sample face region;

obtaining a face distance parameter of each pixel in a background region and a face distance parameter of each pixel in a user region in each sample image based on the sample face distance;

training the face distance parameter and corresponding color parameter of each pixel through a back-propagation algorithm by applying a preset neural network to determine neuron parameters on the neural network to obtain the image region segmentation model.

9. The non-transitory computer readable storage medium according to claim 7 , wherein the method further comprises:

determining a user region of the image based on the image region type corresponding to each pixel and performing preset user image processing on the user region.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 28, 2023
From: JOYINME PTE. LTD.
To: JUPITER PALACE PTE. LTD.
Reel/Frame 064158/0835 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 26, 2021
From: BEIJING KINGSOFT INTERNET SECURITY SOFTWARE CO., LTD.
To: JOYINME PTE. LTD.
Reel/Frame 055745/0877 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 24, 2018
From: CHANG, HANWEN
To: BEIJING KINGSOFT INTERNET SECURITY SOFTWARE CO., LTD.
Reel/Frame 046691/0293 →
Priority Claims (1)
CN 2017 1 0944351 · Sep 30, 2017 · national
Continuity (1)
Related Publication 20190102604A1 · Apr 4, 2019
Cited By (1)
US 12,450,946