IP Library › Granted Patent US 10,829,072
Granted Patent B2
US 10,829,072 · App. 15/560,383 · Granted Nov 10, 2020

Detection of occupant size and pose with a vehicle interior camera

Inventors: James Stephen Miller (Dexter, MI); Patrick Graf (Southfield, MI)
Assignee: Robert Bosch GmbH
B60R21/01538B60R21/01552G06K9/00832B60R2021/006B60R2021/0032B60R2021/01211
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,829,072
App. No.
15/560,383
Filed
Sep 21, 2017
Granted
Nov 10, 2020
Kind
B2
Examiner
MOTT, ADAM R
Art Unit
3669
USPC
701/45
Abstract

A method and system for determining a size and pose of an occupant ( 305, 310, 315 ) within a vehicle interior. In one embodiment, the method includes receiving one or more images (FIG. 3 ) of a vehicle interior from a camera ( 114 ). The method also includes classifying interior regions ( 130, 132, 134, 136, 138 ) of the vehicle interior ( 100 ) in the one or more images. The method also includes identifying an occupant ( 305, 310, 315 ) in the one or more images based on the classification of the interior regions ( 130, 132, 134, 136, 138 ) of the vehicle interior ( 100 ). The method also includes determining a size range of the occupant ( 305, 310, 315 ) based on the classification ( 404 ) of the interior regions of the vehicle interior ( 100 ). The method also includes determining a pose of the occupant ( 305, 310, 315 ) based on the classification ( 404 ) of the interior regions of the vehicle interior ( 100 ). The method also includes controlling one or more vehicle systems ( 122, 124, 126, 128 ) based on the size and the pose of the occupant ( 305, 310, 315 ).

Claims (48)

1. A method of determining a size and pose of one or more occupants within a vehicle interior, the method comprising:

receiving, with an electronic control unit, one or more images of a vehicle interior from a camera that has a field-of-view of a portion of a front vehicle region of the vehicle interior and a portion of a rear vehicle region of the vehicle interior;

classifying, with the electronic control unit, the portion of the front vehicle region in the one or more images with a first classifier;

classifying, with the electronic control unit, the portion of the rear vehicle region in the one or more images with a second classifier that is different from the first classifier;

identifying, with the electronic control unit, a first occupant in the front vehicle region from a second occupant in the rear vehicle region based on the classification of the front vehicle region with the first classifier and the classification of the rear vehicle region with the second classifier;

determining, with the electronic control unit, a size of the first occupant based on the classification of the front vehicle region with the first classifier;

determining, with the electronic control unit, a pose of the first occupant based on the classification of the front vehicle region with the first classifier; and

controlling one or more vehicle systems based on the size and the pose of the first occupant.

2. The method of claim 1 , wherein identifying the first occupant in the front vehicle region from the second occupant in the rear vehicle region based on the classification of the portion of the front vehicle region with the first classifier and the classification of the portion of the rear vehicle region with the second classifier includes determining, with the electronic control unit, whether the first occupant is located in a driver seat of the vehicle interior.

3. The method of claim 1 , wherein controlling the one or more vehicle systems based on the size and the pose of the first occupant includes

transmitting, with the electronic control unit, the size and the pose of the first occupant to an airbag control unit; and

activating, with the airbag control unit, one or more airbags for deployment based at least in part on the size and the pose of the first occupant.

4. The method of claim 3 , further comprising determining, with the airbag control unit, one or more deployment characteristics of the one or more airbags based on the size and the pose of the first occupant.

5. The method of claim 4 , wherein the one or more deployment characteristics of the one or more airbags include at least one a strength of deployment or an angle of deployment.

6. The method of claim 1 , wherein controlling the one or more vehicle systems based on the size and the pose of the first occupant includes

transmitting, with the electronic control unit, the size and the pose of the first occupant to a seatbelt system; and

determining, with the seatbelt system, whether the first occupant has properly engaged a seatbelt based at least in part on the size and the pose of the first occupant.

7. The method of claim 1 , further comprising:

determining, with the electronic control unit, a size of the second occupant based on the classification of the portion of the rear vehicle region with the second classifier;

determining, with the electronic control unit, a pose of the second occupant based on the classification of the portion of the rear vehicle region with the second classifier; and

controlling a second one or more vehicle systems based on the size and the pose of the second occupant.

8. The method of claim 1 , further comprising:

classifying, with the electronic control unit, the portion of the front vehicle region in the one or more images with a third classifier that is different from the first classifier and the second classifier; and

classifying, with the electronic control unit, the portion of the rear vehicle region in the one or more images with the third classifier, wherein the third classifier detects an infant carrier.

9. The method of claim 1 , further comprising determining, with the electronic control unit, a position for a vehicle seat based on the size and pose of the first occupant.

10. The method of claim 9 , further comprising determining, with the electronic control unit, a position for one or more vehicle pedals based on the position of the vehicle seat.

11. The method of claim 10 , further comprising determining, with the electronic control unit, a position for one or more vehicle mirrors based on the position of the vehicle seat.

12. The method of claim 11 , further comprising determining, with the electronic control unit, a position for a vehicle steering wheel based on the position of the vehicle seat.

13. The method of claim 1 , wherein the camera is positioned in the front vehicle region.

14. A system for determining a size and pose of one or more occupants within a vehicle interior, the system comprising:

a camera configured to capture one or more images of a vehicle interior, the camera having a field-of-view of a portion of a front vehicle region of the vehicle interior and a portion of a rear vehicle region of the vehicle interior; and

an electronic control unit having memory and an electronic processor electrically coupled to the memory, wherein the electronic control unit is configured to

receive the one or more images from the camera,

classify the portion of the front vehicle region in the one or more images with a first classifier,

classify the portion of the rear vehicle region in the one or more images with a second classifier that is different from the first classifier,

identify a first occupant in the front vehicle region from a second occupant in the rear vehicle region based on the classification of the front vehicle region with the first classifier and the classification of the rear vehicle region with the second classifier,

determine a size of the first occupant based on the classification of the front vehicle region with the first classifier,

determine a pose of the first occupant based on the classification of the front vehicle region with the first classifier, and

control one or more vehicle systems based on the size and the pose of the first occupant.

15. The system of claim 14 , wherein, to identify the first occupant in the front vehicle region from the second occupant in the rear vehicle region based on the classification of the portion of the front vehicle region with the first classifier and the classification of the portion of the rear vehicle region with the second classifier, the electronic processor is further configured to determine whether the first occupant is located in a driver seat of the vehicle interior.

16. The system of claim 14 , further comprising an airbag control unit, wherein, to control the one or more vehicle systems based on the size and the pose of the first occupant, the electronic processor is further configured to transmit the size and the pose of the first occupant to the airbag control unit, and wherein the airbag control unit is configured to activate one or more airbags for deployment based at least in part on the size and the pose of the first occupant.

17. The system of claim 16 , wherein the airbag control unit is further configured to determine one or more deployment characteristics of the one or more airbags based on the size and the pose of the first occupant.

18. The system of claim 17 , wherein the one or more deployment characteristics of the one or more airbags include at least one a strength of deployment or an angle of deployment.

19. The system of claim 14 , further comprising a seatbelt system, wherein, to control the one or more vehicle systems based on the size and the pose of the first occupant, the electronic processor is further configured to transmit the size and the pose of the first occupant to the seatbelt system, and wherein the seatbelt system is configured to determine whether the first occupant has properly engaged a seatbelt based at least in part on the size and the pose of the first occupant.

20. The system of claim 14 , wherein the electronic processor is further configured to

determine a size of the second occupant based on the classification of the portion of the rear vehicle region with the second classifier,

determining a pose of the second occupant based on the classification of the portion of the rear vehicle region with the second classifier, and

control a second one or more vehicle systems based on the size and the pose of the second occupant.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 21, 2017
From: MILLER, JAMES STEPHEN; GRAF, PATRICK
To: ROBERT BOSCH GMBH
Reel/Frame 043656/0061 →
Continuity (2)
Provisional Application 62145931 · Apr 10, 2015
Related Publication 20180065582A1 · Mar 8, 2018
Cited By (1)
US 12,444,209