IP Library › Granted Patent US 12,538,009
Granted Patent B2
US 12,538,009 · App. 18/275,626 · Granted Jan 27, 2026

Image processing method, recording medium, image processing apparatus, and image-capturing apparatus which first detects a region of a person and then detects a state of the person

Inventor: Kenichiroh Nomura (Tokyo, JP)
Assignee: RICOH COMPANY, LTD.
H04N23/611G06T7/60G06T7/74G06V10/22G06V40/103G06V40/16G06V40/20G06T2207/30201
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,538,009
App. No.
18/275,626
Granted
Jan 27, 2026
Kind
B2
Abstract

An image processing method includes acquiring an image; identifying a position of a region of a person in the acquired image; setting an object detection range based on the identified position of the region of the person; and detecting a state of the person based on the set object detection range.

Claims (46)

1 . An image processing method comprising:

acquiring an image which is an equirectangular image, the image having a circular view in at least one direction;

identifying a position of a region of a person in the acquired image;

setting an object detection range based on the identified position of the region of the person;

detecting a state of the person based on the set object detection range; and

duplicating one end portion of the image, in at least the object detection range, to obtain a duplicated one end portion to allow the duplicated one end portion to be continuous with another end portion of the image, the duplicating including adding the duplicated one end portion to the another end portion to generate another image,

the method further comprising:

determining position and size of the object detection range based on a size of the region of the person; and

determining whether to perform the duplicating, based on the position and size of the object detection range,

wherein based on determination that the duplicating is to be performed in the determining, the duplicating is performed after the identifying of the position of the region of the person, and

wherein the detecting of the state of the person is performed based on the generated another image and based on the equirectangular image in which the one end portion has been duplicated and the object detection range.

2 . The image processing method according to claim 1 , wherein:

the duplicating is performed before the identifying of the position of the region of the person, and

the identifying of the position of the region of the person is performed based on the generated another image.

3 . The image processing method according to claim 1 , wherein:

the image has an angle of view of 360 degrees at least a direction.

4 . The image processing method according to claim 1 , wherein:

the detecting of the state of the person includes detecting a skeletal frame of the person based on the image and detecting a posture of the person based on the detected skeletal frame.

5 . The image processing method according to claim 1 , wherein the identifying of the position of the region of the person involves one of:

detecting a person based on the image;

detecting a face based on the image; and

obtaining a difference between images of multiple frames continuously captured and detecting a moving object based on the difference.

6 . The image processing method according to claim 1 , further comprising:

controlling the acquiring of the image based on the state of the person.

7 . A non-transitory recording medium storing a computer-readable code for controlling a computer to carry out the method according to claim 1 .

8 . An image processing apparatus comprising:

an image acquisition circuitry configured to acquire an image which is an equirectangular image, the image having a view that circulates in at least one direction;

a position identification circuitry configured to identify a position of a region of a person in the image acquired by the image acquisition circuitry;

a range setting circuitry configured to set an object detection range based on the position of the region of the person, identified by the position identification circuitry;

a detection circuitry configured to detect a state of the person based on the object detection range set by the range setting circuitry;

duplication circuitry configured to duplicate one end portion of the image to obtain a duplicated one end portion, in at least the object detection range, to allow the duplicated one end portion to be continuous with another end portion of the image, the duplication circuitry further configured to add the duplicated one end portion to the another end portion to generate another image;

a size determination circuitry configured to determine position and size of the object detection range based on a size of the region of the person; and

a necessity-or-unnecessity determination circuitry configured to determine whether to perform duplication by the duplication circuitry, based on the position and size of the object detection range,

wherein based on determination of the necessity-or-unnecessity determination circuitry that duplication is to be performed by the duplication circuitry, the duplication circuitry performs the duplication, and

wherein the detection circuitry detects the state of the person based on the generated another image.

9 . The image processing apparatus according to claim 8 ,

wherein the duplication circuitry performs the duplication before the identification of the position identification circuitry, and

wherein the position identification circuitry identifies the position of the region of the person based on said another image generated by the duplication circuitry.

10 . The image processing apparatus according to claim 8 , wherein:

the image has an angle of view of 360 degrees at least a direction.

11 . The image processing apparatus according to claim 8 , wherein;

the detection circuitry detects a skeletal frame of the person based on the image and detects a posture of the person based on the detected skeletal frame.

12 . An image-capturing apparatus comprising:

the image processing apparatus according to claim 8 ; and

an image sensor to capture the image;

wherein the image processing apparatus further includes an image-capturing control circuitry configured to control the image sensor based on the state of the person detected by the image processing apparatus.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 3, 2023
From: NOMURA, KENICHIROH
To: RICOH COMPANY, LTD.
Reel/Frame 064479/0200 →
Priority Claims (1)
JP 2021-043464 · Mar 17, 2021 · national
Continuity (1)
Related Publication 20240089580A1 · Mar 14, 2024
References Cited (26)
US 10027888B1 · Mackraz · 2018 [cited by examiner]
US 12322075B2 · Miles · 2025 [cited by examiner]
US 20050151837A1 · Cutler · 2005 [cited by applicant]
US 20100208099A1 · Nomura · 2010 [cited by applicant]
US 20100231746A1 · Nomura · 2010 [cited by applicant]
US 20140071227A1 · Takenaka et al. · 2014 [cited by applicant]
US 20160127641A1 · Gove · 2016 [cited by examiner]
US 20180205889A1 · Abbas · 2018 [cited by examiner]
US 20190317594A1 · Stent · 2019 [cited by applicant]
US 20200288136A1 · Fang · 2020 [cited by examiner]
US 20210034904A1 · Lee · 2021 [cited by examiner]
US 20220198803A1 · Tanaka · 2022 [cited by examiner]
US 20220383653A1 · Yoshida · 2022 [cited by examiner]
CN 105872354A · 2016 [cited by applicant]
JP 2001051338A · 2001 [cited by applicant]
JP 2006191535A · 2006 [cited by applicant]
JP 2009212787A · 2009 [cited by applicant]
JP 2010213213A · 2010 [cited by applicant]
JP 2017227957A · 2017 [cited by applicant]
JP 2018057596A · 2018 [cited by applicant]
WO 2020202865A1 · 2020 [cited by applicant]
WO 2020261101A1 · 2020 [cited by applicant]
International Search Report and Written Opinion issued on May 30, 2022 in PCT/IB2022/051503 filed on Feb. 21, 2022, 10 pages. [cited by applicant]
Li Junnan et al, “Weakly-Supervised Multi-Person Action Recognition in 360° Videos”, 2020 IEEE Winter Conference on Applications of Computer Vision (WACV), IEEE,Mar. 1, 2020 (Mar. 1, 2020), p. 497-505. [cited by applicant]
Office Action issued Nov. 26, 2024 in Japanese Patent Application No. 2021-043464, 9 pages. [cited by applicant]
Office Action issued Nov. 28, 2025 in Chinese Patent Application No. 202280014996.4, 8 pages. [cited by applicant]