IP Library › Granted Patent US 10,776,970
Granted Patent B2
US 10,776,970 · App. 16/709,551 · Granted Sep 15, 2020

Method and apparatus for processing video image and computer readable medium

Inventors: Qing Luan (Beijing, CN); Jianping Shi (Beijing, CN)
Assignee: Beijing Sensetime Technology Development Co., Ltd.
G06T11/40G06N3/0454G06N3/08G06T7/11G06T7/194G06T7/73G06T11/00G11B27/036H04N21/23418H04N21/23424H04N21/44008H04N21/44016H04N21/4666H04N21/812G06N3/0481G06T2207/10016G06T2207/20081G06T2207/20084
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,776,970
App. No.
16/709,551
Granted
Sep 15, 2020
Kind
B2
Abstract

Embodiments of the present application provide a method and an apparatus for processing a video image. The method includes: obtaining a video image to be processed and a business object to be displayed, wherein the video image comprises a background area and a foreground area comprising a target object non-overlapping with the background area; determining the background area of the video image; performing an action detection on the target object in the foreground area to obtain action detection data; determining a display position of the business object in the video image according to the action detection data; and drawing, according to the display position, the business object in the background area of the video image by means of computer graphics.

Claims (53)

1. A method for processing a video image, comprising:

obtaining a video image to be processed and a business object to be displayed, wherein the video image comprises a background area and a foreground area comprising a target object non-overlapping with the background area;

determining the background area of the video image;

performing an action detection on the target object in the foreground area to obtain action detection data;

determining a display position of the business object in the video image according to the action detection data; and

drawing, according to the display position, the business object in the background area of the video image by means of computer graphics, wherein the determining a display position of the business object in the video image according to the action detection data comprises:

determining the display position of the business object in the video image according to the action detection data and preset action data, wherein the action detection data comprises data of an action performed by the target object, and the preset action data comprises data of a preset action of the target object.

2. The method according to claim 1 , wherein the action comprises at least one of an action of head, an action of hand, or an action of body.

3. The method according to claim 1 , wherein the determining a display position of the business object in the video image according to the action detection data comprises:

determining the display position of the business object in the video image using a pre-trained convolutional neural network model and the action detection data.

4. The method according to claim 1 , wherein the determining a display position of the business object in the video image according to the action detection data comprises:

determining the display position of the business object in the video image according to a type of the business object and the action detection data.

5. The method according to claim 4 , wherein the determining the display position of the business object in the video image according to a type of the business object and the action detection data comprises:

obtaining a plurality of display positions of the business object in the video image according to the action detection data and the type of the business object; and

selecting at least one display position from the plurality of display positions as the final display position of the business object in the video image.

6. The method according to claim 1 , wherein the determining the display position of the business object in the video image according to preset action data and the action detection data comprises:

determining whether the action detection data matches the preset action data; and

in response to determining that the action detection data matches the preset action data, obtaining a target display position corresponding to the preset action data as the display position of the business object in the video image.

7. The method according to claim 6 , wherein the determining whether the action detection data matches the preset action data comprises:

determining a plurality of matching degrees between the action detection data and a plurality of pieces of preset action data;

obtaining the maximum matching degree of the plurality of matching degrees; and

in response to the maximum matching degree being greater than a preset matching threshold, determining that a piece of preset data having the maximum matching degree matches the action detection data.

8. An apparatus for processing a video image, the apparatus comprising:

a processor; and

a memory storing instructions to cause the processor to perform operations, the operations comprising:

obtaining a video image to be processed and a business object to be displayed, wherein the video image comprises a background area and a foreground area comprising a target object non-overlapping with the background area;

determining the background area of the video image;

performing an action detection on the target object in the foreground area to obtain action detection data;

determining a display position of the business object in the video image according to the action detection data; and

drawing, according to the display position; the business object in the background area of the video image by means of computer graphics, wherein the determining a display position of the business object in the video image according to the action detection data comprises:

determining the display position of the business object in the video image according to the action detection data and preset action data, wherein the action detection data comprises data of an action performed by the target object, and the preset action data comprises data of a preset action of the target object.

9. The apparatus according to claim 8 , wherein the action comprises at least one of an action of head, an action of hand, or an action of body.

10. The apparatus according to claim 8 , wherein the determining a display position of the business object in the video image according to the action detection data comprises:

determining the display position of the business object in the video image using a pre-trained convolutional neural network model and the action detection data.

11. The apparatus according to claim 8 , wherein the determining a display position of the business object in the video image according to the action detection data comprises:

determining the display position of the business object in the video image according to a type of the business object and the action detection data.

12. The apparatus according to claim 11 , wherein the determining the display position of the business object in the video image according to a type of the business object and the action detection data comprises:

obtaining a plurality of display positions of the business object in the video image according to the action detection data and the type of the business object; and

selecting at least one display position from the plurality of display positions as the final display position of the business object in the video image.

13. The apparatus according to claim 8 , wherein the determining the display position of the business object in the video image according preset action data and the action detection data comprises:

determining whether the action detection data matches the preset action data; and

in response to determining that the action detection data matches the preset action data, obtaining a target display position corresponding to the preset action data as the display position of the business object in the video image.

14. The apparatus according to claim 13 , wherein the determining whether the action detection data matches the preset action data comprises:

determining a plurality of matching degrees between the action detection data and a plurality of pieces of preset action data;

obtaining the maximum matching degree of the plurality of matching degrees; and

in response to the maximum matching degree being greater than a preset matching threshold, determining that a piece of preset data having the maximum matching degree matches the action detection data.

15. A non-transitory computer readable medium, storing a computer program thereon, the program, when executed by a processor, causes the processor to perform operations, the operations comprising:

obtaining a video image to be processed and a business object to be displayed, wherein the video image comprises a background area and a foreground area comprising a target object non-overlapping with the background area;

determining the background area of the video image;

performing an action detection on the target object in the foreground area to obtain action detection data;

determining a display position of the business object in the video image according to the action detection data; and

drawing, according to the display position, the business object in the background area of the video image by means of computer graphics, wherein the determining a display position of the business object in the video image according to the action detection data comprises:

determining the display position of the business object in the video image according to the action detection data and preset action data; wherein the action detection data comprises data of an action performed by the target object, and the preset action data comprises data of a preset action of the target object.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 2, 2020
From: LUAN, QING; SHI, JIANPING
To: BEIJING SENSETIME TECHNOLOGY DEVELOPMENT CO., LTD.
Reel/Frame 053111/0971 →
Priority Claims (3)
CN 2016 1 0694601 · Aug 19, 2016 · national
CN 2016 1 0694814 · Aug 19, 2016 · national
CN 2016 1 0697316 · Aug 19, 2016 · national
Continuity (3)
Continuation 15845802 · Dec 18, 2017
Continuation PCTCN2017098216 · Aug 21, 2017
Related Publication 20200111241A1 · Apr 9, 2020
Cited By (1)
US 12,567,212