IP Library Granted Patent US 11,562,307
Granted Patent B2
US 11,562,307 · App. 16/718,016 · Granted Jan 24, 2023

Vehicle passenger flow statistical method, apparatus, device, and storage medium

Inventors: Zijie Wang (Beijing, CN); Yingnan Liu (Beijing, CN); Wenlong Rao (Beijing, CN); Jingjing Xue (Beijing, CN); Yue Wang (Beijing, CN)
Assignee: APOLLO INTELLIGENT DRIVING TECHNOLOGY (BEIJING) CO., LTD.
G06Q10/06315G06V20/59G06V40/172G08G1/133H04N21/2187
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,562,307
App. No.
16/718,016
Granted
Jan 24, 2023
Kind
B2
Abstract

The present disclosure provides a vehicle passenger flow statistical method, including: acquiring, by a server, door opening time and door closing time of a vehicle during any one door opening and closing process of door opening and closing processes in a pending statistical period; acquiring, by the server, a first set of images and a second set of images in a carriage of the vehicle according to the door opening time and the door closing time; and acquiring, by the server, the number of on-board people and the number of off-board people during the door opening and closing process according to the first set of images and the second set of images. The present disclosure can improve efficiency and accuracy of passenger flow statistics according to which an operation plan of the vehicle may be optimized timely and effectively.

Claims (45)

1. A method for controlling an operation of a vehicle, comprising:

receiving, by a server, door opening time and door closing time of a vehicle during any one door opening and closing process of door opening and closing processes in a pending statistical period from the vehicle;

acquiring, by the server, a video captured in real time by each image capturing device in a carriage, and performing image analysis on the video to acquire a first set of images and a second set of images in the carriage of the vehicle according to the door opening time and the door closing time, wherein the first set of images comprises an image captured by each image capturing device in the carriage prior to the door opening time, and the second set of images comprises an image captured by each image capturing device in the carriage subsequent to the door closing time;

performing, by the server, face identification according to passengers in the first set of images and the second set of images, and configuring a passenger identifier for each identified passenger;

determining, by the server, a different passenger identifier between passenger identifiers of the first set of images and the second set of images, and acquiring a differentiated passenger corresponding to the different passenger identifier;

acquiring, by the server, a number of on-board people and a number of off-board people during the door opening and closing process according to the differentiated passenger; and

controlling, by the server, the operation of the vehicle according to the number of on-board people and the number of off-board people during the door opening and closing process.

2. The method according to claim 1 , wherein after the acquiring the number of on-board people and the number of off-board people during the door opening and closing process, the method further comprises:

acquiring, by the server, a total number of on-board people and a total number of off-board people in the pending statistical period according to the number of on-board people and the number of off-board people during each door opening and closing process in the pending statistical period.

3. The method according to claim 1 , further comprising:

acquiring, by the server, emotion information of a passenger according to the video; and

controlling, by the server, the vehicle according to the emotion information of the passenger.

4. The method according to claim 3 , wherein the acquiring, by the server, emotion information of a passenger according to the video comprises:

acquiring, by the server, a key frame in the video;

extracting, by the server, an emotion feature of the passenger in the key frame, wherein the emotion feature comprises an expression and/or a behavior; and

inputting, by the server, the emotion feature into an emotion analyzing model to acquire the emotion information of the passenger.

5. The method according to claim 3 , wherein the emotion information comprises a parameter characterizing an abnormal emotion;

the controlling, by the server, the vehicle according to the emotion information of the passenger comprises:

determining, by the server, whether the parameter characterizing the abnormal emotion is greater than a first preset threshold, and transmitting a deceleration or stop instruction to the vehicle if the parameter characterizing the abnormal emotion is greater than the first preset threshold; and

determining, by the server, whether the parameter characterizing the abnormal emotion is greater than a second preset threshold if the parameter characterizing the abnormal emotion is not greater than the first preset threshold, and if the parameter characterizing the abnormal emotion is greater than the second preset threshold, transmitting alert information to enable an operator to monitor the passenger in real time according to the alert information.

6. A system, comprising: a processor, and a memory for storing a computer program which, when executed by the processor, causes the processor to:

receive door opening time and door closing time of a vehicle during any one door opening and closing process of door opening and closing processes in a pending statistical period from the vehicle; acquire a video captured in real time by each image capturing device in a carriage, and perform image analysis on the video to acquire a first set of images and a second set of images in the carriage of the vehicle according to the door opening time and the door closing time, wherein the first set of images comprises an image captured by each image capturing device in the carriage prior to the door opening time, and the second set of images comprises an image captured by each image capturing device in the carriage subsequent to the door closing time;

perform face identification according to passengers in the first set of images and the second set of images, and configure a passenger identifier for each identified passenger;

determine a different passenger identifier between passenger identifiers of the first set of images and the second set of images, and acquire a differentiated passenger corresponding to the different passenger identifier;

acquire a number of on-board people and a number of off-board people during the door opening and closing process according to the differentiated passenger; and

control the operation of the vehicle according to the number of on-board people and the number of off-board people during the door opening and closing process.

7. The system according to claim 6 , wherein the computer program further causes the processor to:

acquire a total number of on-board people and a total number of off-board people in the pending statistical period according to the number of on-board people and the number of off-board people during each door opening and closing process in the pending statistical period.

8. The system according to claim 6 , wherein the computer program further causes the processor to:

acquire emotion information of a passenger according to the video; and control the vehicle according to the emotion information of the passenger.

9. The system according to claim 8 , wherein the computer program further causes the processor to:

acquire a key frame in the video;

extract an emotion feature of the passenger in the key frame, wherein the emotion feature comprises an expression and/or a behavior; and

input the emotion feature into an emotion analyzing model to acquire the emotion information of the passenger.

10. The system according to claim 8 , wherein the emotion information comprises a parameter characterizing an abnormal emotion;

the computer program further causes the processor to:

determine whether the parameter characterizing the abnormal emotion is greater than a first preset threshold, and transmit a deceleration or stop instruction to the vehicle if the parameter characterizing the abnormal emotion is greater than the first preset threshold; and

determine whether the parameter characterizing the abnormal emotion is greater than a second preset threshold if the parameter characterizing the abnormal emotion is not greater than the first preset threshold, and if the parameter characterizing the abnormal emotion is greater than the second preset threshold, transmit alert information to enable an operator to monitor the passenger in real time according to the alert information.

11. A non-transitory computer readable storage medium having a computer program stored thereon, wherein the computer program implements a method for controlling an operation of a vehicle, the method comprising:

receiving, by a server, door opening time and door closing time of a vehicle during any one door opening and closing process of door opening and closing processes in a pending statistical period from the vehicle;

acquiring, by the server, a video captured in real time by each image capturing device in a carriage, and performing image analysis on the video to acquire a first set of images and a second set of images in the carriage of the vehicle according to the door opening time and the door closing time, wherein the first set of images comprises an image captured by each image capturing device in the carriage prior to the door opening time, and the second set of images comprises an image captured by each image capturing device in the carriage subsequent to the door closing time;

performing, by the server, face identification according to passengers in the first set of images and the second set of images, and configuring a passenger identifier for each identified passenger;

determining, by the server, a different passenger identifier between passenger identifiers of the first set of images and the second set of images, and acquiring a differentiated passenger corresponding to the different passenger identifier;

acquiring, by the server, a number of on-board people and a number of off-board people during the door opening and closing process according to the differentiated passenger; and

controlling, by the server, the operation of the vehicle according to the number of on-board people and the number of off-board people during the door opening and closing process.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 13, 2021
From: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.
To: APOLLO INTELLIGENT DRIVING TECHNOLOGY (BEIJING) CO., LTD.
Reel/Frame 058241/0248 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 17, 2019
From: WANG, ZIJIE; LIU, YINGNAN; RAO, WENLONG; XUE, JINGJING; WANG, YUE
To: BEIJING BAIDU NETCOM SCIENCE TECHNOLOGY CO., LTD.
Reel/Frame 051310/0679 →
Priority Claims (1)
CN 201811540092.7 · Dec 17, 2018 · national
Continuity (1)
Related Publication 20200193347A1 · Jun 18, 2020