IP Library Granted Patent US 10,694,357
Granted Patent B2
US 10,694,357 · App. 15/366,623 · Granted Jun 23, 2020

Using vehicle sensor data to monitor pedestrian health

Inventor: Austin Newman (San Jose, CA)
Assignee: NIO USA, Inc.
H04W4/80G06K9/00369G06K9/2018H04N7/183H04N5/144
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,694,357
App. No.
15/366,623
Granted
Jun 23, 2020
Kind
B2
Abstract

A system and method for monitoring pedestrians based upon information is collected by a wide array of sensors already included in modern motor vehicles. Also included, is a system of monitoring pedestrians by aggregating data collected by an array of vehicles.

Claims (40)

1. An apparatus of a vehicle for monitoring pedestrian health comprising:

one or more thermal imagers,

one or more high definition imagers,

a real time communication interface,

a short range communication interface, and

a vehicle computer communicatively coupled to the one or more thermal imagers, the one or more high definition imagers, the real time communication interface and the short range communication interface;

wherein the vehicle computer:

acquires a plurality of thermal images of a pedestrian sidewalk from the one or more thermal imagers as the vehicle is driving on a roadway located adjacent the pedestrian sidewalk,

acquires a plurality of high definition images of the pedestrian sidewalk from the one or more high definition imagers as the vehicle is driving on the roadway located adjacent the pedestrian sidewalk,

determines whether the plurality of thermal images and the plurality of high definition images contain one or more pedestrians on the pedestrian sidewalk,

determines, based on the plurality of thermal images and the plurality of high definition images containing the one or more pedestrians on the pedestrian sidewalk, whether a pedestrian of the one or more pedestrians who was previously walking on the pedestrian sidewalk is falling or lying on the pedestrian sidewalk and exhibiting an injured pedestrian behavior,

selectively displays an alert on a display communicatively coupled to the vehicle computer in response to determining that the pedestrian is falling or lying on the pedestrian sidewalk, and

selectively transmits via the real time interface the plurality of thermal images and the plurality of high definition images to a database server in response to determining that the pedestrian is falling or lying on the pedestrian sidewalk.

2. The apparatus of claim 1 , wherein the vehicle computer further:

selectively transmits via the real time communication interface the plurality of thermal images and the plurality of high definition images along with an alert to emergency services, wherein the alert includes one or more of time, location, and an identification of the injured pedestrian.

3. The apparatus of claim 1 , wherein the vehicle computer further:

when the plurality of thermal images and the plurality of high definition images are determined to contain the one or more pedestrians, analyzes the plurality of thermal images and the plurality of high definition images to determine if the one or more pedestrians are displaying a predetermined pedestrian behavior indicating the one or more pedestrians have an elevated thermal profile.

4. The apparatus of claim 3 , wherein the injured pedestrian behavior is associated with a criminal activity.

5. The apparatus of claim 1 , wherein the vehicle computer further:

determines, based on the plurality of thermal images, a thermal profile of the pedestrian, and

determines, based on the thermal profile of the pedestrian, that the pedestrian is having a heart attack.

6. The apparatus of claim 1 , wherein

determining whether the plurality of thermal images and the plurality of high definition images contain one or more pedestrians on the pedestrian sidewalk further comprises determining whether a moving object on the pedestrian sidewalk has a kinematic profile that corresponds to a pedestrian movement associated with the one or more pedestrians.

7. A method for monitoring pedestrian health comprising:

acquiring, by a vehicle computer of a vehicle, a plurality of thermal images of a pedestrian sidewalk from one or more thermal imagers as the vehicle is driving on a roadway located adjacent the pedestrian sidewalk;

acquiring, by the vehicle computer, a plurality of high definition images of the pedestrian sidewalk from one or more high definition imagers as the vehicle is driving on the roadway located adjacent the pedestrian sidewalk,

determining, by the vehicle computer, whether the plurality of thermal images and the plurality of high definition images contain one or more pedestrians on the pedestrian sidewalk,

determining, based on the plurality of thermal images and the plurality of high definition images contain the one or more pedestrians on the pedestrian sidewalk, whether a pedestrian of the one or more pedestrians who was previously walking on the pedestrian sidewalk is falling or lying on the pedestrian sidewalk and exhibiting an injured pedestrian behavior,

selectively displaying, by the vehicle computer, an alert on a display communicatively coupled to the vehicle computer in response to determining the pedestrian is falling or lying on the pedestrian sidewalk; and

selectively transmitting, via a real time interface of the vehicle computer, the plurality of thermal images and the plurality of high definition images to a database server in response to determining that the pedestrian is falling or lying on the pedestrian sidewalk.

8. The method of claim 7 , further comprising:

selectively transmitting, via the real time communication interface of the vehicle computer, the plurality of thermal images and the plurality of high definition images along with an alert to emergency services, wherein the alert includes one or more of time, location, and an identification of the injured pedestrian behavior.

9. The method of claim 7 , further comprising:

when the plurality of thermal images and the plurality of high definition images are determined to contain the one or more pedestrians, analyzing, by the vehicle computer, the plurality of thermal images and the plurality of high definition images to determine if the one or more pedestrians are displaying a predetermined pedestrian behavior indicating the one or more pedestrians have an elevated thermal profile.

10. The method of claim 9 , wherein the injured pedestrian behavior is associated with a criminal activity.

11. The method of claim 7 , further comprising:

determining, by the vehicle computer and based on the plurality of thermal images a thermal signature of the pedestrian, and

determining, based on the thermal signature of the pedestrian, that the pedestrian is having a heart attack.

12. The method of claim 7 , wherein

determining whether the plurality of thermal images and the plurality of high definition images contain one or more pedestrians on the pedestrian sidewalk further comprises determining whether a moving object on the pedestrian sidewalk has a kinematic profile that corresponds to a pedestrian movement associated with the one or more pedestrians.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 24, 2022
From: NIO USA, INC.
To: NIO TECHNOLOGY (ANHUI) CO., LTD.
Reel/Frame 060171/0724 →
CHANGE OF NAME Recorded Aug 18, 2017
From: NEXTEV USA, INC.
To: NIO USA, INC.
Reel/Frame 043600/0972 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 17, 2017
From: NEWMAN, AUSTIN L.
To: NEXTEV USA, INC.
Reel/Frame 042414/0893 →
Continuity (2)
Provisional Application 62420985 · Nov 11, 2016
Related Publication 20180137372A1 · May 17, 2018