IP Library Granted Patent US 11,380,102
Granted Patent B2
US 11,380,102 · App. 16/934,430 · Granted Jul 5, 2022

Method for video surveillance of the crossing of a line by people, associated computer program and device

Inventors: Rémi Druihle (Saint-Martin-d'Hères, FR); Cécile Boukamel-Donnou (Échirolles, FR); Benoit Pelletier (Saint-Étienne-de-Crossey, FR)
Assignee: BULL SAS
G06V20/46G06V20/41G06V20/49G06V40/103G06V2201/07
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,380,102
App. No.
16/934,430
Granted
Jul 5, 2022
Kind
B2
Abstract

The method includes for each of a plurality of successive images of a video stream from a camera, the search for at least one person present in the image and the definition, for each person found, of a zone in the image, known as person zone, surrounding this person at least partially; for each of at least one person, the grouping together into one tracklet of several person zones from successive images and surrounding this same person at least partially; for each tracklet: the identification of the person in this tracklet from person zones, the determination of a moment at which the line is crossed by the person identified from person zones and the addition of the name found and of the moment of crossing determined in at least some of the images containing the person zones.

Claims (50)

1. A method for video surveillance of a crossing of a line by people, the method comprising:

for each image of a plurality of successive images of a video stream from a camera pointing towards the line, a search for at least one person present in the each image and a definition, for each person found of the at least one person present, of a zone in the each image, wherein said zone is a person zone, surrounding said each person found at least partially;

for said each person found of at least one person found, a grouping together into one tracklet of several person zones from successive images and surrounding said each person found at least partially;

for each tracklet:

identification of the each person found in the tracklet from said several person zones in the tracklet;

determination of a moment at which the line is crossed by the each person found that is identified from the several person zones in the tracklet,

wherein the line comprises a fixed and predefined position in the successive images,

wherein the line is divided into two parts comprising an upstream part and a downstream part,

wherein said determination of the moment at which the line is crossed by the each person found comprises a determination of when the person zone of the each person found extends at least partly into the downstream part, such that all other person zones of the several person zones extend into the upstream part; and

addition of a name found and of the moment of crossing determined in at least some of the successive images containing the several person zones in the tracklet.

2. The method according to claim 1 , wherein the identification of the each person found comprises:

for each person zone of the several person zones in the tracklet, determination of a visual signature of the each person found, wherein said visual signature is a local visual signature;

determination of an aggregate visual signature of the each person found from local visual signatures;

search for an identification number in the several person zones;

if the identification number is not found, a search, from identification numbers each associated with one or more reference visual signatures, for the visual signature or visual signatures associated that comprise a smallest distance with the aggregate visual signature; and

if the identification number is found, association of the aggregate visual signature with the identification number that is found, in order to become a reference visual signature.

3. The method according to claim 2 , wherein the aggregate visual signature is an average of the local visual signatures.

4. The method according to claim 2 , further comprising, for said determination of said local visual signature for said each person found, an assessment of a reliability of said local visual signature and wherein the aggregate visual signature is determined from, in addition to local visual signatures, their associated reliabilities.

5. The method according to claim 2 , wherein a distance of the aggregate visual signature in relation to several reference visual signatures is an average of a respective distances between the aggregate visual signature and the several reference visual signatures.

6. The method according to claim 2 , wherein the search for the identification number comprises:

for each person zone in the tracklet, searching for at least one number present in the each person zone and defining, in the each person zone, for each number found, a number zone surrounding said each number found;

for said number zone of said each person zone in the tracklet, recognition of the at least one number present in the number zone and, for each number of the at least one number that is recognized, an assessment of a reliability of the recognition;

selecting one number of the at least one number that is recognized from the reliability of said each number of the at least one number that is recognized; and

searching for the one number that is selected among predefined identification numbers.

7. The method according to claim 6 , wherein the selecting of said one number of the at least one number that is recognized from the reliability of said each number of the at least one number that is recognized comprises:

filtering each number of the at least one number for which the reliability is below a predefined threshold; and

selecting one other number of the other numbers of the at least one number, wherein said other numbers comprise reliable numbers, from their associated reliabilities.

8. The method according to claim 1 , wherein the determination of the moment at which the line is crossed comprises:

determination, from the several person zones in the tracklet, of one first crossing, in a predefined direction, a line with a fixed and predefined position in the successive images; and

determination of a moment at which the line is crossed from a moment associated with an image containing the person zone crossing the line first.

9. A non-transitory computer readable medium comprising a program including instructions for execution of a method for video surveillance of a crossing of a line by people, when said program is executed on a computer;

wherein said method comprises

for each image of a plurality of successive images of a video stream from a camera pointing towards the line, a search for at least one person present in the each image and a definition, for each person found of the at least one person present, of a zone in the each image, wherein said zone is a person zone, surrounding said each person found at least partially;

for said each person found of at least one person found, a grouping together into one tracklet of several person zones from successive images and surrounding said each person found at least partially;

for each tracklet:

identification of the each person found in the tracklet from said several person zones in the tracklet;

determination of a moment at which the line is crossed by the each person found that is identified from the several person zones in the tracklet,

wherein the line comprises a fixed and predefined position in the successive images,

wherein the line is divided into two parts comprising an upstream part and a downstream part,

wherein said determination of the moment at which the line is crossed by the each person found comprises a determination of when the person zone of the each person found extends at least partly into the downstream part, such that all other person zones of the several person zones extend into the upstream part; and

addition of a name found and of the moment of crossing determined in at least some of the successive images containing the several person zones in the tracklet.

10. A device for a video surveillance of a crossing of a line by people, comprising:

means designed, for each image of a plurality of successive images of a video stream from a camera pointing towards the line, to search for at least one person present in the each image and to define, for each person found, a zone in the image surrounding said each person found at least partially, wherein said zone comprises a person zone;

means designed, for said each person found of at least one person found, to group together into one tracklet several person zones from successive images and surrounding said each person found at least partially;

means designed, for said tracklet, to identify the each person found in the tracklet from said several person zones in the tracklet;

means designed, for tracklet, to determine a moment at which the line is crossed by the each person found that is identified from said several person zones in the tracklet,

wherein the line comprises a fixed and predefined position in the successive images,

wherein the line is divided into two parts comprising an upstream part and a downstream part,

wherein said determine the moment at which the line is crossed by the each person found comprises a determination of when the person zone of the each person found extends at least partly into the downstream part, such that all other person zones of the several person zones extend into the upstream part; and

means designed, for said tracklet, to add a name found and the moment at which the line is crossed determined in at least some of the successive images containing the several person zones in the tracklet.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 21, 2020
From: DRUILHE, RÉMI; BOUKAMEL-DONNOU, CÉCILE; PELLETIER, BENOIT
To: BULL SAS
Reel/Frame 053826/0001 →
Priority Claims (1)
FR 1908293 · Jul 22, 2019 · national
Continuity (1)
Related Publication 20210027067A1 · Jan 28, 2021