IP Library › Granted Patent US 11,479,148
Granted Patent B2
US 11,479,148 · App. 16/535,642 · Granted Oct 25, 2022

Personalization settings based on body measurements

Inventors: Yasen Hu (Warren, MI); Kausalya Singuru (Troy, MI); Shiming Duan (Ann Arbor, MI); Yao Hu (Sterling Heights, MI); Nicholas W. Pinto (Shelby Township, MI); Bradley R. Frieberg (Farmington Hills, MI)
Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
B60N2/0244B60R1/07G06T7/60G06T7/73G06V40/103B60N2002/0268G06T2207/30196G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,479,148
App. No.
16/535,642
Granted
Oct 25, 2022
Kind
B2
Abstract

A system and method for personalization of adjustable features of a vehicle. The system includes a processor and an actuator. The processor detectors key points of a person from a two-dimensional image and predicts a pose of the person. The processor translates a respective position of the key points from a two-dimensional coordinate system to a three-dimensional coordinate system based in part on the pose and measurements of distances between the key points. The processor determines a baseline configuration of an adjustable feature of the vehicle based in part on measurements between the key points in the three-dimensional coordinate system. The processor causes an actuator to adjust the adjustable feature to conform to the baseline configuration.

Claims (46)

1. A method for personalization of adjustable features of a vehicle, the method comprising:

capturing a two-dimensional image of a person with a camera;

processing, by a processor, the two-dimensional image to detect key points of the person comprising extracting coordinates of the key points with a neural network and predict a pose of the person using a classifier;

translating, by the processor, the positions of the key points from a two-dimensional coordinate system to a three-dimensional coordinate system, comprising converting two-dimensional coordinates to three dimensional coordinates using the positions of the two-dimensional key points, parameters of the camera, and constraints based upon the predicted pose;

determining, by the processor, a baseline configuration of an adjustable feature of the vehicle based in part on measurements between the key points in the three-dimensional coordinate system; and

causing, by the processor, an actuator to adjust the adjustable feature of the vehicle to conform to the baseline configuration.

2. The method of claim 1 , wherein the adjustable feature of the vehicle is one of seat, a side mirror, or a rear-view mirror.

3. The method of claim 1 , wherein the pose is one of standing, sitting, and walking.

4. The method of claim 1 , wherein the measurements are based in part on the pose.

5. The method of claim 1 further comprising:

associating the baseline configuration of the adjustable feature of the vehicle with an identity of the person; and

storing the associated identity and baseline configuration in a remote database.

6. The method of claim 1 further comprising:

recording a change in the adjustable feature of the vehicle from the baseline configuration by the person; and

updating the baseline configuration in the database, based on the change to the adjustable feature of the vehicle exceeding a threshold amount.

7. A system for personalization of adjustable features of a vehicle, the system comprising:

a camera for capturing a two-dimensional image of a person;

a memory having computer readable instructions; and

a processor for executing the computer readable instructions, the computer readable instructions controlling the one or more processors to perform operations comprising:

processing, by the processor, the two-dimensional image to detect key points of the person comprising extracting coordinates of the key points with a neural network and predict a pose of the person using a classifier;

translating, by the processor, the positions of the key points from a two-dimensional coordinate system to a three-dimensional coordinate system and measurements of distances between the key points, comprising converting two-dimensional coordinates to three dimensional coordinates using the positions of the two-dimensional key points, parameters of the camera, and constraints based upon the predicted pose;

determining, by the processor, a baseline configuration of an adjustable feature of the vehicle based in part on measurements between the key points in the three-dimensional coordinate system; and

causing, by the processor, an actuator to adjust the adjustable feature of the vehicle to conform to the baseline configuration.

8. The system of claim 7 , wherein the adjustable feature of the vehicle is one of a seat, side view mirror, or a rear-view mirror.

9. The system of claim 7 , wherein the pose is one of standing, sitting, and walking.

10. The system of claim 7 , wherein the measurements are based in part on the pose.

11. The system of claim 7 , the operations further comprise:

associating the baseline configuration of the adjustable feature of the vehicle with an identity of the person; and

storing the associated identity and baseline configuration in a remote database.

12. The system of claim 7 , the operations further comprising:

recording a change in the adjustable feature of the vehicle from the baseline configuration by the person; and

updating the baseline configuration in the database, based change to the adjustable feature of the vehicle exceeding a threshold amount.

13. A computer program product comprising a computer readable storage medium having program instructions embodied therein, the program instructions executable by a processor to cause the processor to perform operations comprising:

processing, by the processor, the two-dimensional image from a camera to detect key points of the person comprising extracting coordinates of the key points with a neural network and predict a pose of the person using a classifier;

translating, by the processor, the positions of the key points from a two-dimensional coordinate system to a three-dimensional coordinate system and measurements of distances between the key points, comprising converting two-dimensional coordinates to three dimensional coordinates using the positions of the two-dimensional key points, parameters of the camera, and constraints based upon the predicted pose;

determining, by the processor, a baseline configuration of an adjustable feature of the vehicle based in part on measurements between the key points in the three-dimensional coordinate system; and

causing, by the processor, an actuator to adjust the adjustable feature of the vehicle to conform to the baseline configuration.

14. The computer program product of claim 13 , wherein the adjustable feature of the vehicle is one of a seat, side view mirror, or a rear-view mirror.

15. The computer program product of claim 13 , wherein the pose is at least one of standing, sitting, and walking.

16. The computer program product of claim 13 , wherein the measurements are based in part on the pose.

17. The computer program product of claim 13 , the operations further comprising:

associating the baseline configuration of the adjustable feature of the vehicle with an identity of the person; and

storing the associated identity and baseline configuration in a remote database.

18. The method of claim 1 wherein the parameters of the camera comprise a focal length, a principal point offset, a rotational matrix and a translational matrix.

19. The system of claim 7 , wherein the parameters of the camera comprise a focal length, a principal point offset, a rotational matrix and a translational matrix.

20. The computer program product of claim 13 , wherein the parameters of the camera comprise a focal length, a principal point offset, a rotational matrix and a translational matrix.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 8, 2019
From: HU, YASEN; SINGURU, KAUSALYA; DUAN, SHIMING; HU, YAO; PINTO, NICHOLAS W.; FRIEBERG, BRADLEY R
To: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Reel/Frame 050002/0399 →
Continuity (1)
Related Publication 20210039521A1 · Feb 11, 2021