IP Library › Granted Patent US 12,315,265
Granted Patent B2
US 12,315,265 · App. 17/518,762 · Granted May 27, 2025

Method and apparatus with estimation of distance between pedestrian and camera

Inventors: Yonggonjong Park (Suwon-si, KR); Cheolhun Jang (Pohang-si, KR); Dae Hyun Ji (Hwaseong-si, KR)
Assignee: Samsung Electronics Co., Ltd.
G06V20/58G01B11/026G06T7/215G06T7/70G06T2207/30261
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,315,265
App. No.
17/518,762
Granted
May 27, 2025
Kind
B2
Abstract

A method with distance estimation includes detecting a pedestrian region of a pedestrian comprised in a plurality of images received from a camera; determining a static point in the detected pedestrian region; and determining a distance between the pedestrian and the camera based on the static point in each of the images and a position of the camera corresponding to each of the images.

Claims (37)

1. A method with distance estimation, the method comprising:

detecting a pedestrian region of a pedestrian comprised in a plurality of images obtained from a camera at different positions;

determining a static point in the detected pedestrian region, including extracting a plurality of joint regions of the pedestrian from the pedestrian region and determining the static point of the pedestrian based on the extracted joint regions;

determining 3D (Three-dimensional) points based on a vector associated with the extracted joint regions and determining 3D coordinates of each of the extracted joint regions; and

determining a distance between the pedestrian and the camera, using the 3D points and the 3D coordinates, based on a difference between the static point in each of the images and the different positions of the camera corresponding to each of the images.

2. The method of claim 1 , wherein the static point corresponds to a position of a stepping foot of the pedestrian.

3. The method of claim 1 , wherein the determining of the static point comprises:

determining, to be the static point, a point corresponding to a position of a stepping foot of the pedestrian in the joint region.

4. The method of claim 1 , wherein the determining of the static point comprises:

determining, to be the static point, a point at which a height is lowest in the joint regions.

5. The method of claim 1 , wherein the determining of the distance between the pedestrian and the camera comprises:

determining the distance between the pedestrian and the camera based on a difference between three-dimensional (3D) points determined by a vector comprising the static point in each of the images and a point corresponding to a position of the different positions of the camera.

6. A non-transitory computer-readable storage medium storing instructions that, when executed by a processor, configure the processor to perform the method of claim 1 .

7. An apparatus with distance estimation, the apparatus comprising:

a processor configured to:

detect a pedestrian region of a pedestrian comprised in a plurality of images obtained from a camera at different positions;

determine a static point in the detected pedestrian region, including extracting a plurality of joint regions of the pedestrian from the pedestrian region and determining the static point of the pedestrian based on the extracted joint regions;

determine 3D (Three-dimensional) points based on a vector associated with the extracted joint regions, and determine 3D coordinates of each of the extracted joint regions; and

determine a distance between the pedestrian and the camera, using the 3D points and the 3D coordinates, based on a difference between the static point in each of the images and the different positions of the camera corresponding to each of the images.

8. The apparatus of claim 7 , wherein the static point corresponds to a position of a stepping foot of the pedestrian.

9. The apparatus of claim 7 , wherein, for the determining of the static point, the processor is configured to:

determine, to be the static point, a point corresponding to a position of a stepping foot of the pedestrian in the joint regions.

10. The apparatus of claim 7 , wherein, for the determining of the static point, the processor is configured to:

determine, to be the static point, a point at which a height is lowest in the joint regions.

11. The apparatus of claim 7 , wherein, for the determining of the distance between the pedestrian and the camera, the processor is configured to:

determine the distance between the pedestrian and the camera based on a difference between three-dimensional (3D) points determined by a vector comprising the static point in each of the images and a point corresponding to a position of the different positions of the camera.

12. The apparatus of claim 7 , further comprising the camera, wherein the camera is configured to collect the images.

13. A method with distance estimation, the method comprising:

determining a static point of a target in each of images obtained by a camera at different positions, including extracting a plurality of joint regions of the target from a target region, included in each of the images, and determining the static point of the target based on the extracted joint regions;

determining 3D (Three-dimensional) points based on a vector associated with the extracted joint regions and determining 3D coordinates of each of the extracted joint regions; and

determining a distance between the target and the camera, using the 3D points and the 3D coordinates, based on the static point in each of the images and the different positions of the camera.

14. The method of claim 13 , wherein, for each of the images, the determining of the static point comprises determining, to be the static point, a lowest point among points in the joint regions.

15. The method of claim 13 , wherein

the camera obtains the images at the different positions by a movement of the camera, and

the determining of the distance between the target and the camera comprises:

determining a structure from motion (SFM) based on the static point in each of the images and the different positions corresponding to the images; and

determining the distance based on the SFM.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 4, 2021
From: PARK, YONGGONJONG; JANG, CHEOLHUN; JI, DAE HYUN
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 058018/0363 →
Priority Claims (1)
KR 10-2021-0061827 · May 13, 2021 · national
Continuity (1)
Related Publication 20220366177A1 · Nov 17, 2022
References Cited (17)
US 9254846B2 · Dolgov et al. · 2016 [cited by applicant]
US 10008002B2 · Lalonde et al. · 2018 [cited by applicant]
US 10318826B2 · Zhang · 2019 [cited by examiner]
US 20130176425A1 · Lerner · 2013 [cited by examiner]
US 20180164439A1 · Droz et al. · 2018 [cited by applicant]
JP 5829155B2 · 2015 [cited by applicant]
JP 2018179911A · 2018 [cited by applicant]
JP 201911971A · 2019 [cited by applicant]
JP 201996027A · 2019 [cited by applicant]
JP 2019133324A · 2019 [cited by applicant]
KR 101684095B1 · 2016 [cited by applicant]
KR 101849373B1 · 2018 [cited by applicant]
KR 1020200017917A · 2020 [cited by applicant]
WO WO2020245654A1 · 2020 [cited by examiner]
Dolatabadi et al., “Multiple-Joint Pedestrian Tracking Using Periodic Models” Sensors 2020, 20, 6917; doi:10.3390/s20236917 Examiner Note: Estimates distance of a pedestrian (ankle, knee) to vehicle or camera (Year: 202… [cited by examiner]
Ali, Ahmed et al. “Real-time vehicle distance estimation using single view geometry” [cited by applicant]
Young-Hak, Kim “Stereo Vision—Challenges and Opportunities in ADAS Applications” https://www.elec4.co.kr/article/article View asp?idx=15526 Oct. 7, 2016 (12 pages in Korean). [cited by applicant]