IP Library Granted Patent US 9,916,668
Granted Patent B2
US 9,916,668 · App. 14/716,511 · Granted Mar 13, 2018

Methods and systems for identifying background in video data using geometric primitives

Inventors: Cong Nguyen (Ho Chi Minh, VN); Quang Nguyen (Ho Ch Minh, VN); Dennis Lin (Chicago, IL)
Assignee: Personify, Inc.
G06T11/001G06K9/00718G06K9/38G06K9/4604G06K9/4638G06K9/4652G06K9/6267G06T7/12G06T7/194H04N5/2226
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,916,668
App. No.
14/716,511
Granted
Mar 13, 2018
Kind
B2
Abstract

Systems and methods for using geometric primitives to identify background in video data. In one embodiment, a method obtains video data depicting at least a portion of a user. The video data is processed with at least one persona identification module comprising a geometric primitive module for generating a first persona probability map at least in part by: detecting at least one geometric primitive within the video data; identifying a respective region within the video data associated with each of the at least one detected geometric primitives; and assigning the respective regions an increased background-probability in the first persona probability map; and outputting a persona image by extracting pixels from the video data based on the persona probability map.

Claims (42)

1. A method comprising:

obtaining video data comprising at least one frame of pixel data and depicting at least a portion of a user;

processing the video data with at least one persona identification module to generate at least one persona probability map, the at least one persona identification module comprising a geometric primitive module for generating a first persona probability map at least in part by:

detecting at least one geometric primitive depicted within the video data, wherein the at least one detected geometric primitive is a type of geometric primitive included in a set of geometric-primitive models;

identifying a respective region within the video data associated with each of the at least one detected geometric primitives; and

assigning the respective regions an increased background-probability in the first persona probability map; and

outputting a persona image depicting at least the portion of the user by extracting pixels from the at least one frame of pixel data based on the at least one persona probability map.

2. The method of claim 1 , wherein obtaining the video data comprises obtaining the video data via at least one of a video camera, a depth camera, a 3-D camera, and a data store.

3. The method of claim 1 , wherein the set of geometric-primitive models includes a straight line.

4. The method of claim 3 , wherein:

at least one of the detected geometric primitives is a straight line; and

the respective region within the video data associated with the detected straight line is a rectangle.

5. The method of claim 4 , wherein the rectangle (i) has a length that is equal to a length of the detected straight line and (ii) is bisected by the detected straight line.

6. The method of claim 4 , wherein the rectangle (i) has a length that is less than a length of the detected straight line and (ii) is bisected by the detected straight line.

7. The method of claim 1 , wherein the set of geometric-primitive models includes a straight line longer than a threshold length.

8. The method of claim 1 , wherein the set of geometric-primitive models includes an angle.

9. The method of claim 8 , wherein:

at least one of the detected geometric primitives is an angle; and

the respective region within the video data associated with the detected angle is a triangle that is made up of two line segments that form the detected angle and one line segment that connects the two line segments that form the detected angle.

10. The method of claim 8 , wherein:

at least one of the detected geometric primitives is an angle; and

the respective region within the video data associated with the detected angle is a sub-region of a triangle that is made up of two line segments that form the detected angle and one line segment that connects the two line segments that form the detected angle.

11. The method of claim 10 , wherein the sub-region is a quadrilateral sub-region formed by two triangular sub-regions sharing one common side.

12. The method of claim 1 , wherein the set of geometric-primitive models include an angle within a threshold tolerance of being a right angle.

13. The method of claim 1 , wherein the set of geometric-primitive models includes an angle made up of two line segments, wherein each of the two line segments is longer than a threshold length.

14. The method of claim 1 , further comprising updating a background-color model at least in part by using at least one identified respective region.

15. The method of claim 14 , wherein updating the background-color model comprises:

identifying a respective color of at least one pixel included in the at least one identified respective region; and

adding to the background-color model the identified respective color of the at least one pixel.

16. The method of claim 1 , wherein detecting at least one geometric primitive comprises edge detection using high-frequency-information recognition.

17. The method of claim 1 , wherein the set of geometric-primitive models comprises at least one of: right angles, long straight lines, squares, triangles, and circles.

18. The method of claim 1 , wherein the set of geometric-primitive models define shapes or geometric structures that are not part of an extracted persona.

19. A system comprising:

a communication interface;

a processor; and

computer-readable non-transitory data storage containing instructions executable by the processor for causing the system to carry out a set of functions, the set of functions including:

obtaining video data comprising at least one frame of pixel data and depicting at least a portion of a user;

processing the video data with at least one persona identification module to generate at least one persona probability map, the at least one persona identification module comprising a geometric primitive module for generating a first persona probability map at least in part by:

detecting at least one geometric primitive depicted within the video data, wherein the at least one detected geometric primitive is a type of geometric primitive included in a set of geometric-primitive models;

identifying a respective region within the video data associated with each of the at least one detected geometric primitives; and

assigning the respective regions an increased background-probability in the first persona probability map; and

outputting a persona image depicting at least the portion of the user by extracting pixels from the at least one frame of pixel data based on the at least one persona probability map.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 13, 2021
From: HONGFUJIN PRECISION INDUSTRY WUHAN
To: PERSONIFY, INC.
Reel/Frame 057467/0738 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 26, 2019
From: PERSONIFY, INC.
To: HONGFUJIN PRECISION INDUSTRY (WUHAN) CO. LTD.
Reel/Frame 051367/0920 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 3, 2015
From: NGUYEN, CONG; NGUYEN, QUANG; LIN, DENNIS
To: PERSONIFY, INC.
Reel/Frame 035779/0700 →
Continuity (1)
Related Publication 20160343148A1 · Nov 24, 2016