IP Library › Granted Patent US 12,518,400
Granted Patent B2
US 12,518,400 · App. 18/028,708 · Granted Jan 6, 2026

Information processing device, information processing system, and information processing method

Inventors: Hayato Itsumi (Tokyo, JP); Koichi Nihei (Tokyo, JP); Yusuke Shinohara (Tokyo, JP); Takanori Iwai (Tokyo, JP); Florian Beye (Tokyo, JP); Charvi Vitthal (Tokyo, JP)
Assignee: NEC CORPORATION
G06T7/215G06T5/20G06T5/50G06T2207/10016G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,518,400
App. No.
18/028,708
Granted
Jan 6, 2026
Kind
B2
Abstract

A region prediction unit predicts the target region in the second image frame based on the target region detected in a first image frame and a time interval between the first and second image frames. The region prediction unit predicts the target region in the third image frame based on the target region detected in the second image frame and a time interval between the second and third image frames. A region determination unit determines, as an image-processing region, a region obtained by adding a margin to the target prediction region in the third image frame in accordance with an overlapping portion between the detected target region in the second image frame and the prediction region in the second image frame.

Claims (35)

1 . An information processing device comprising:

at least one memory storing instructions, and

at least one processor configured to execute the instructions to;

acquire a first image frame, a second image frame subsequent to the first image frame, and a third image frame subsequent to the second image frame, which are captured by an imaging unit;

detect a target region including a target in the image frame;

predict a region of the target in the second image frame based on the region of the target detected in the first image frame and a time interval between the first and second image frames, and predict the region of the target in the third image frame based on the region of the target detected in the second image frame and a time interval between the second and third image frames; and

determine, as an image-processing region having a higher image quality than other regions, a region obtained by adding a margin to the prediction region of the target in the third image frame in accordance with an overlapping portion between the target region in the second image frame and the prediction region in the second image frame.

2 . The information processing device according to claim 1 , wherein the at least one processor configured to execute the instructions to enlarge the margin when the overlapping portion is equal to or less than a threshold.

3 . The information processing device according to claim 1 , wherein the margin is set step by step so that the margin increases as the overlapping portion decreases.

4 . The information processing device according to claim 1 , wherein the at least one processor configured to execute the instructions to implement the region prediction using a Kalman filter.

5 . The information processing device according to claim 1 , wherein the first, second, and third image frames are consecutive image frames.

6 . An information processing system comprising:

at least one memory storing instructions, and

at least one processor configured to execute the instructions to;

acquire a first image frame, a second image frame subsequent to the first image frame, and a third image frame subsequent to the second image frame, which are captured by an imaging unit;

detect a target region including a target in the image frame;

predict a region of the target in the second image frame based on the region of the target detected in the first image frame and a time interval between the first and second image frames, and predict the region of the target in the third image frame based on the region of the target detected in the second image frame and a time interval between the second and third image frames; and

determine, as an image-processing region having a higher image quality than other regions, a region obtained by adding a margin to the prediction region of the target in the third image frame in accordance with an overlapping portion between the target region in the second image frame and the prediction region in the second image frame.

7 . The information processing system according to claim 6 , wherein the at least one processor configured to execute the instructions to enlarge the margin when the overlapping portion is equal to or less than a threshold.

8 . The information processing system according to claim 6 , wherein the margin is set step by step so that the margin increases as the overlapping portion decreases.

9 . The information processing system according to claim 6 , wherein the at least one processor configured to execute the instructions to implement the region prediction using a Kalman filter.

10 . The information processing system according to claim 6 , wherein the at least one processor configured to execute the instructions to perform image processing to improve image quality of the determined region than other regions; and

transmit image data subjected to the image processing to a remote monitoring device.

11 . The information processing system according to claim 6 , wherein the first, second, and third image frames are consecutive image frames.

12 . An information processing method comprising:

acquiring a first image frame, a second image frame subsequent to the first image frame, and a third image frame subsequent to the second image frame, which are captured by an imaging unit;

detecting a target region including a target in the image frame;

predicting a region of the target in the second image frame based on the region of the target detected in the first image frame and a time interval between the first and second image frames, and predicting the region of the target in the third image frame based on the region of the target detected in the second image frame and a time interval between the second and third image frames; and

determining, as an image-processing region having a higher image quality than other regions, a region obtained by adding a margin to the prediction region of the target in the third image frame in accordance with an overlapping portion between the target region in the second image frame and the prediction region in the second image frame.

13 . The information processing method according to claim 12 , wherein the margin is enlarged when the overlapping portion is equal to or less than a threshold.

14 . The information processing method according to claim 12 , wherein the margin is set step by step so that the margin increases as the overlapping portion decreases.

15 . The information processing method according to claim 12 , wherein the prediction is performed using a Kalman filter.

16 . The information processing method according to claim 12 , wherein the first, second, and third image frames are consecutive image frames.

17 . The information processing device according to claim 1 , wherein the imaging unit is mounted on a vehicle, and

wherein the at least one processor is configured to execute the instructions to transmit image data processed by image processing to other network nodes via a wireless network.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 8, 2024
From: ITSUMI, HAYATO; NIHEI, KOICHI; SHINOHARA, YUSUKE; IWAI, TAKANORI; BEYE, FLORIAN; VITTHAL, CHARVI
To: NEC CORPORATION
Reel/Frame 066698/0293 →
Continuity (1)
Related Publication 20230334672A1 · Oct 19, 2023
References Cited (17)
US 20100079590A1 · Kuehnle · 2010 [cited by examiner]
US 20170124405A1 · Gupta · 2017 [cited by examiner]
US 20180345958A1 · Lo · 2018 [cited by examiner]
US 20200250836A1 · Li · 2020 [cited by examiner]
US 20210133947A1 · Li · 2021 [cited by examiner]
US 20210350145A1 · Park · 2021 [cited by examiner]
US 20220076037A1 · Hochman · 2022 [cited by examiner]
JP 2005141517A · 2005 [cited by applicant]
JP 2011118889A · 2011 [cited by applicant]
JP 2015115760A · 2015 [cited by applicant]
JP 2015195018A · 2015 [cited by examiner]
JP 2016181072A · 2016 [cited by applicant]
JP 2017062638A · 2017 [cited by applicant]
JP 2017194787A · 2017 [cited by applicant]
JP 2019125894A · 2019 [cited by applicant]
International Search Report for PCT Application No. PCT/JP2020/037673, mailed on Dec. 15, 2020. [cited by applicant]
JP Office Action for JP Application No. 2022-554977, mailed on Apr. 16, 2024 with English Translation. [cited by applicant]