IP Library Granted Patent US 11,688,095
Granted Patent B2
US 11,688,095 · App. 17/072,197 · Granted Jun 27, 2023

Tiptoe position estimating device and fingertip position estimating device

Inventors: Hiroyuki Fujii (Kariya, JP); Takahiro Izuno (Kariya, JP); Masahiro Takeuchi (Kariya, JP)
Assignee: AISIN CORPORATION
G06T7/73G06T2207/30196G06T2207/30268
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,688,095
App. No.
17/072,197
Granted
Jun 27, 2023
Kind
B2
Abstract

A tiptoe position estimating device includes: a camera configured to capture an image of an interior of a vehicle; and a human body information acquisition unit configured to acquire, from a captured image obtained by capturing an image of a person seated on a seat in the interior by the camera, position information of skeleton points at a plurality of positions of a body of the person. The human body information acquisition unit is configured to acquire thigh information which is position information of a skeleton point of a thigh of the person, and lower leg information which is position information of a skeleton point of a lower leg of the person. The human body information acquisition unit includes a tiptoe position estimating part configured to estimate a tiptoe position of a foot of the person based on the acquired thigh information and the acquired lower leg information.

Claims (13)

1. A tiptoe position estimating device, comprising:

a camera configured to capture an image of an interior of a vehicle; and

a human body information acquisition unit configured to acquire, from a captured image obtained by capturing an image of a person seated on a seat in the interior by the camera, position information of skeleton points at a plurality of positions of a body of the person, the position information including coordinates of a plurality of joint positions of the body as the skeleton points by image processing wherein

the human body information acquisition unit is configured to acquire thigh information which is position information of a skeleton point of a thigh of the person from the captured image, and lower leg information which is position information of a skeleton point of a lower leg of the person from the captured image, and

the human body information acquisition unit includes a tiptoe position estimating part configured to estimate a tiptoe position of a foot of the person based on the acquired thigh information and the acquired lower leg information, the tiptoe position being coordinates separated by a foot length from coordinates of a skeleton point at an ankle joint position.

2. The tiptoe position estimating device according to claim 1 , wherein

the human body information acquisition unit is configured to acquire, as the thigh information, coordinates of a skeleton point at a hip joint position and a skeleton point at a knee joint position in the captured image and a thigh length which is a distance between the skeleton point at the hip joint position and the skeleton point at the knee joint position, and acquire, as the lower leg information, the coordinates of the skeleton point at the ankle joint position, and

the tiptoe position estimating part is configured to set the foot length of the foot in a relationship proportional to the thigh length.

3. The tiptoe position estimating device according to claim 2 , wherein

the human body information acquisition unit is configured to acquire coordinates of skeleton points of shoulders on left and right and/or skeleton points on left and right of a waist of the person in the captured image, and acquire a shoulder length and/or a waist length which is a distance between the skeleton points of the shoulders on left and right and/or the skeleton points on left and right of the waist, and

the tiptoe position estimating part is configured to calculate a proportional constant based on the acquired shoulder length and/or the waist length and the thigh length, and set the foot length from the thigh length based on the proportional constant.

4. The tiptoe position estimating device according to claim 2 , wherein

the tiptoe position estimating part is configured to acquire a direction along the thigh from the coordinates of the skeleton point at the hip joint position and the skeleton point at the knee joint position of the thigh, set a relative posture in which the direction along the thigh is parallel to a direction from the coordinates of the skeleton point at the ankle joint position of the foot toward the tiptoe position as a reference posture of the foot, and estimate the tiptoe position within a predetermined angle range from the reference posture.

Assignments (2)
CHANGE OF NAME Recorded Jan 13, 2022
From: AISIN SEIKI KABUSHIKI KAISHA
To: AISIN CORPORATION
Reel/Frame 058746/0869 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 16, 2020
From: FUJII, HIROYUKI; IZUNO, TAKAHIRO; TAKEUCHI, MASAHIRO
To: AISIN SEIKI KABUSHIKI KAISHA
Reel/Frame 054074/0888 →
Priority Claims (1)
JP 2019-191471 · Oct 18, 2019 · national
Continuity (1)
Related Publication 20210118170A1 · Apr 22, 2021
Cited By (1)
US 12,597,159