IP Library Granted Patent US 11,380,009
Granted Patent B2
US 11,380,009 · App. 17/070,050 · Granted Jul 5, 2022

Physique estimation device and posture estimation device

Inventors: Godai Tanaka (Kariya, JP); Yoshiaki Tomatsu (Kariya, JP); Takayuki Nakagome (Kariya, JP)
Assignee: AISIN CORPORATION
G06T7/73G06V20/59G06V40/103G06T2207/20081G06T2207/30196G06T2207/30268
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,380,009
App. No.
17/070,050
Granted
Jul 5, 2022
Kind
B2
Abstract

A physique estimation device includes: a camera capturing an image of an inside of a vehicle; a skeleton point coordinate acquisition unit acquiring positions of skeleton points of a body image of an occupant included in a captured image of the inside as skeleton point coordinates in a two-dimensional coordinate system of the captured image; a front coordinate estimation unit machine learned such that, by receiving a distance between preset skeleton points and an angle of a skeleton line obtained by connecting the skeleton points with respect to a reference line, a front coordinate that is an arrangement of the skeleton points when the occupant is viewed from front is estimated and output; and a physique determination unit determining a physique of the occupant based on the front coordinate.

Claims (28)

1. A physique estimation device comprising:

a camera configured to capture an image of an inside of a vehicle; and

circuitry configured to:

acquire positions of a plurality of skeleton points of a body image of an occupant included in a captured image obtained by capturing an image of the inside by the camera as skeleton point coordinates in a two-dimensional coordinate system of the captured image;

apply a machine learned parameter to distance information that is a distance between a plurality of preset skeleton points among the plurality of skeleton points specified by the skeleton point coordinates and angle information that is an angle of a skeleton line obtained by connecting the plurality of the skeleton points specified by the skeleton point coordinates with respect to a reference line to estimate a front coordinate in the two-dimensional coordinate system that is an arrangement of the plurality of skeleton points whose positions were acquired by capturing the image when the occupant is viewed from front; and

determine a physique of the occupant based on the estimated front coordinate.

2. The physique estimation device according to claim 1 , wherein the distance information is a distance between skeleton points on left and right shoulders of the occupant and a distance between skeleton points on left and right portions of a waist of the occupant.

3. The physique estimation device according to claim 1 wherein the angle information is an angle of a spine line along a spine of the occupant with respect to a reference spine line.

4. The physique estimation device according to claim 1 , wherein the angle information is an angle of a shoulder line obtained by connecting skeleton points on left and right shoulders of the occupant with respect to a reference shoulder line.

5. The physique estimation device according to claim 1 , wherein the angle information is an angle of a spine line along a spine of the occupant with respect to a waist line obtained by connecting skeleton points of left and right portions of a waist of the occupant.

6. The physique estimation device according to claim 1 , wherein the circuitry is configured to:

store physiques divided into a plurality of types of physiques; and

determine which of the plurality of types of physiques the physique of the occupant belongs to.

7. The physique estimation device according to claim 1 , wherein the circuitry is configured to:

acquire a position of a seat base and a leaning posture of a seat back of a seat in the vehicle; and

correct the skeleton point coordinates based on the position of the seat base and the leaning posture of the seat back.

8. The physique estimation device according to claim 1 , wherein the circuitry is configured to determine, based on the angle information, a posture of an upper body of the occupant seated in a seat in the vehicle.

9. The physique estimation device according to claim 1 , wherein the circuitry is configured to:

acquire the skeleton point coordinates of an upper body of the occupant seated in a seat in the vehicle; and

estimate the front coordinate based on the skeleton point coordinates of the upper body.

10. A posture estimation device comprising:

a camera configured to capture an image of an inside of a vehicle; and

circuitry configured to:

acquire positions of a plurality of skeleton points of a body image of an occupant included in a captured image obtained by capturing an image of the inside by the camera as skeleton point coordinates in a two-dimensional coordinate system of the captured image;

acquire a position of a seat base and a leaning posture of a seat back of a seat in the vehicle;

correct the skeleton point coordinates in the two-dimensional coordinate system of the captured image based on the position of the seat base and the leaning posture of the seat back; and

estimate, with reference to machine learned data, a posture of the occupant based on distance information that is a distance between a plurality of preset skeleton points among the plurality of skeleton points specified by the skeleton point coordinates and angle information that is an angle of a skeleton line obtained by connecting the plurality of the skeleton points specified by the corrected skeleton point coordinates with respect to a reference line.

11. The posture estimation device according to claim 10 , wherein the circuitry is configured to determine a physique of the occupant based on the estimated posture.

Assignments (2)
CHANGE OF NAME Recorded Jan 13, 2022
From: AISIN SEIKI KABUSHIKI KAISHA
To: AISIN CORPORATION
Reel/Frame 058746/0869 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 14, 2020
From: TANAKA, GODAI; TOMATSU, YOSHIAKI; NAKAGOME, TAKAYUKI
To: AISIN SEIKI KABUSHIKI KAISHA
Reel/Frame 054050/0204 →
Priority Claims (1)
JP JP2019-206877 · Nov 15, 2019 · national
Continuity (1)
Related Publication 20210150754A1 · May 20, 2021