IP Library › Granted Patent US 12,211,318
Granted Patent B2
US 12,211,318 · App. 17/686,448 · Granted Jan 28, 2025

Processing apparatus, mobile object, processing method, and storage medium

Inventor: Yuji Yasui (Wako, JP)
Assignee: HONDA MOTOR CO., LTD.
G06V40/20G06T5/50G06V10/34G06V40/172
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,211,318
App. No.
17/686,448
Granted
Jan 28, 2025
Kind
B2
Abstract

A processing apparatus converts a first image into a second image with a lower resolution than a resolution of the first image, specifies a target region including a predetermined objective target in the second image on the basis of the second image, and specifies a target region including the objective target in the first image on the basis of the specified target region in the second image.

Claims (40)

1. A processing apparatus comprising:

a storage device configured to store instructions; and

one or more processors,

wherein the one or more processors execute the instructions stored in the storage device to:

convert a first image into a second image with a lower resolution than a resolution of the first image, and

specify a target region including a predetermined objective target in the second image on the basis of the second image and specify a target region including the objective target in the first image on the basis of the specified target region in the second image,

wherein the one or more processors execute the instructions to specify the target region including the objective target in the first image before conversion into the second image on the basis of the target region in the second image and execute predetermined image recognition processing on the specified target region in the first image

wherein the predetermined image recognition processing includes processing for recognizing a gesture of the objective target on the basis of information regarding a specific region in the target region in the first image, and

wherein the predetermined image recognition processing includes the processing of recognizing the gesture using, with priority, the information regarding the specific region with a high degree of chronological change in motions of the objective target in two or more specific regions in the target region in the first image.

2. The processing apparatus according to claim 1 , wherein the one or more processors execute the instructions to analyze the second image obtained by converting the first image captured at a first clock time and the second image obtained by converting the first image captured at a second clock time later than the first clock time and track, in the second image corresponding to the second clock time, an objective target included in the target region in the second image corresponding to the first clock time.

3. The processing apparatus according to claim 1 , wherein the one or more processors execute the instructions to track the objective target in the second image on the basis of a change in position of the objective target in second images in a time series manner obtained by converting first images captured in a time series manner.

4. The processing apparatus according to claim 1 ,

wherein the objective target is a person, and

the one or more processors execute the instructions to track the person in the second image on the basis of one or more pieces of information out of a color of clothes of the person, a gender of the person, and a hairstyle of the person obtained from the second image, which is obtained by converting the first image captured in the past, or stored in a storage.

5. The processing apparatus according to claim 1 , wherein the predetermined image recognition processing includes specifying the specific region on the basis of recognition of a skeleton or joint points in the target region in the first image.

6. The processing apparatus according to claim 5 , wherein the predetermined image recognition processing includes processing of regarding a region including arms or hands of the objective target as the specific region on the basis of a result of recognizing the skeleton or the joint points.

7. The processing apparatus according to claim 1 , wherein the two or more specific regions include at least a specific region specified as a region including a right arm or a right hand of the objective target and a specific region specified as a region including a left arm or a left hand of the objective target.

8. The processing apparatus according to claim 1 ,

wherein the objective target is a person, and

the one or more processors execute the instructions to extract a region including a face of the person in the first image, match feature amounts of the face included in the extracted region with feature amounts of the face of the person stored in a storage in advance, and track the person as the objective target.

9. The processing apparatus according to claim 1 ,

wherein the objective target is a person, and

the one or more processors execute the instructions to

track, in the second image obtained by converting the first image captured at a second clock time later than a first clock time, the person included in the target region of the second image obtained by converting the first image captured at the first clock time, and

extract a region including arms or hands of the person tracked in the first image captured at the second clock time on the basis of a result of the tracking and recognize a gesture of the person on the basis of the extracted region.

10. A processing apparatus according to claim 1 , wherein the one or more processors execute the instructions to control a mobile object on the basis of the gesture.

11. A mobile object comprising:

the processing apparatus according to claim 1 mounted therein.

12. A processing method comprising, by a computer:

converting a first image into a second image with a lower resolution than a resolution of the first image; and

specifying a target region including a predetermined objective target in the second image on the basis of the second image and specifying a target region including the objective target in the first image on the basis of the specified target region in the second image,

wherein the specifying the target region comprises specifying the target region including the objective target in the first image before conversion into the second image on the basis of the target region in the second image and execute predetermined image recognition processing on the specified target region in the first image

wherein the predetermined image recognition processing includes processing for recognizing a gesture of the objective target on the basis of information regarding a specific region in the target region in the first image, and

wherein the predetermined image recognition processing includes the processing of recognizing the gesture using, with priority, the information regarding the specific region with a high degree of chronological change in motions of the objective target in two or more specific regions in the target region in the first image.

13. A non-transitory computer storage medium storing instructions causing a computer to execute:

converting a first image into a second image with a lower resolution than a resolution of the first image; and

specifying a target region including a predetermined objective target in the second image on the basis of the second image and specifying a target region including the objective target in the first image on the basis of the specified target region in the second image,

wherein the specifying the target region comprises specifying the target region including the objective target in the first image before conversion into the second image on the basis of the target region in the second image and execute predetermined image recognition processing on the specified target region in the first image

wherein the predetermined image recognition processing includes processing for recognizing a gesture of the objective target on the basis of information regarding a specific region in the target region in the first image, and

wherein the predetermined image recognition processing includes the processing of recognizing the gesture using, with priority, the information regarding the specific region with a high degree of chronological change in motions of the objective target in two or more specific regions in the target region in the first image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 21, 2022
From: YASUI, YUJI
To: HONDA MOTOR CO., LTD.
Reel/Frame 060263/0311 →
Priority Claims (1)
JP 2021-036624 · Mar 8, 2021 · national
Continuity (1)
Related Publication 20220284736A1 · Sep 8, 2022
References Cited (26)
US 10839203B1 · Guigues · 2020 [cited by examiner]
US 11232294B1 · Banerjee · 2022 [cited by examiner]
US 11568624B1 · Ramanathan · 2023 [cited by examiner]
US 20080298643A1 · Lawther et al. · 2008 [cited by applicant]
US 20100033579A1 · Yokohata et al. · 2010 [cited by applicant]
US 20140002604A1 · Ohba et al. · 2014 [cited by applicant]
US 20210350570A1 · Hibi et al. · 2021 [cited by applicant]
CN 101605209 · 2009 [cited by applicant]
CN 103460242 · 2013 [cited by applicant]
CN 109376730 · 2019 [cited by applicant]
CN 110390295 · 2019 [cited by applicant]
CN 111344644 · 2020 [cited by applicant]
CN 111062312B · 2023 [cited by examiner]
JP 2001092976 · 2001 [cited by applicant]
JP 2017052490 · 2017 [cited by applicant]
JP 2018088234 · 2018 [cited by applicant]
JP 2020071720 · 2020 [cited by applicant]
WO 2018150569 · 2018 [cited by applicant]
WO 2020100664 · 2020 [cited by applicant]
Chinese Office Action for Chinese Patent Application No. 202210184131.4 mailed Dec. 26, 2023. [cited by applicant]
Chinese Office Action for Chinese Patent Application No. 202210184131.4 mailed Jun. 14, 2024. [cited by applicant]
Japanese Office Action for Japanese Patent Application No. 2021-036624 mailed Sep. 3, 2024. [cited by applicant]
Kobayashi et al., “The Study on the multi smart sensors system and the application”, Information processing society research report, Japan, Incorporated, Information Processing Society, Oct. 24, 2003, vol. 2003, No. 105… [cited by applicant]
Koide et al., “Construction of the active human recognition system using autonomous robot”, The Research Institute, Japan, Electric Society, Dec. 1, 2000, pp. 15 to 20. [cited by applicant]
Nishimura et al., “Spotting recognition of Gestures Performed by Moving Person from Time-Varying Image”, The technical research report of the Institute of Electronics, Information and Communication Engineers, Jan. 12, 1… [cited by applicant]
Van Den Bergh et al., “Real-time 3D hand gesture interaction with a robot for understanding directions from humans”, IEEE, 2011, and 2011 RO-MAN [online] pp. 357-362, [date of search Aug. 27, 2024], Internet:<URL:https:… [cited by applicant]