IP Library › Granted Patent US 12,711,773
Granted Patent B2
US 12,711,773 · App. 19/366,653 · Granted Aug 18, 2026

Apparatus for generating a pseudo-reproducing image, and non-transitory computer-readable medium

Inventor: Hiroki Itsukaichi (Tokyo, JP)
Assignee: NEC CORPORATION
G06T11/60G06T7/70G06V20/58G08G1/166G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,711,773
App. No.
19/366,653
Filed
Oct 23, 2025
Granted
Aug 18, 2026
Kind
B2
Art Unit
2617
USPC
345/629
Abstract

An image generation apparatus ( 20 ) includes an acquisition unit ( 210 ), a data processing unit ( 220 ), and a display ( 230 ). The acquisition unit ( 210 ) repeatedly acquires analysis data from at least one sending apparatus ( 10 ). The analysis data include at least type data and relative position data. The data processing unit ( 220 ) generates a reconfigured image by using the analysis data each time the data processing unit ( 220 ) acquires the analysis data, and displays the reconfigured image on the display ( 230 ). The reconfigured image includes an indication based on the type data in a position associated with the relative position data. The display may be a mark imitating an outer shape of a kind indicated by the type data, or may be an abstract mark.

Claims (44)

1 . An apparatus comprising:

at least one memory configured to store instructions; and

at least one processor configured to execute the instructions to perform operations comprising:

based on analysis data including type data, relative position data and road data, generating a reconfigured image by arranging an indication of an object located in the vicinity of a vehicle, the analysis data being generated by processing sensor data from a sensor loaded in the vehicle, the type data indicating a kind of the object, the relative position data indicating a relative position of the object with respect to the vehicle, the road data indicating a state of a road in the vicinity of the vehicle;

determining whether the relative position of the object is anomalous;

acquiring a captured image from a camera loaded in the vehicle; and

displaying the reconfigured image and the captured image in parallel on a display, the reconfigured image including the indication of the object whose relative position is determined to be anomalous.

2 . The apparatus according to claim 1 , the operations further comprise

in a case where a change of the relative position of the object is anomalous, determining the relative position of the object is anomalous.

3 . The apparatus according to claim 1 , wherein the state of the road includes a sign drawn on the road.

4 . The apparatus according to claim 1 , wherein the reconfigured image is an image that reproduces the vicinity of the vehicle.

5 . The apparatus according to claim 1 , wherein the object in the reconfigured image is displayed in human form in a case where the kind of the object is a human.

6 . The apparatus according to claim 1 , wherein the operations comprise:

acquiring vehicle position data indicating a position of the vehicle;

acquiring map data including a location associated with the vehicle position data; and

generating the reconfigured image by arranging, based on the type data and the relative position data, an indication of the object on a road image generated from the map data.

7 . An image generation method executed by a computer, comprising:

based on analysis data including type data, relative position data and road data, generating a reconfigured image by arranging an indication of an object located in the vicinity of a vehicle, the analysis data being generated by processing sensor data from a sensor loaded in the vehicle, the type data indicating a kind of the object, the relative position data indicating a relative position of the object with respect to the vehicle, the road data indicating a state of a road in the vicinity of the vehicle;

determining whether the relative position of the object is anomalous;

acquiring a captured image from a camera loaded in the vehicle; and

displaying the reconfigured image and the captured image in parallel on a display, the reconfigured image including the indication of the object whose relative position is determined to be anomalous.

8 . The image generation method according to claim 7 , further comprising

in a case where a change of the relative position of the object is anomalous, determining the relative position of the object is anomalous.

9 . The image generation method according to claim 7 , wherein the state of the road includes a sign drawn on the road.

10 . The image generation method according to claim 7 , wherein the reconfigured image is an image that reproduces the vicinity of the vehicle.

11 . The image generation method according to claim 7 , wherein the object in the reconfigured image is displayed in human form in a case where the kind of the object is a human.

12 . The image generation method according to claim 7 , further comprising:

acquiring vehicle position data indicating a position of the vehicle;

acquiring map data including a location associated with the vehicle position data; and

generating the reconfigured image by arranging, based on the type data and the relative position data, an indication of the object on a road image generated from the map data.

13 . A non-transitory computer-readable medium storing a program causing a computer to perform operations comprising:

based on analysis data including type data, relative position data and road data, generating a reconfigured image by arranging an indication of an object located in the vicinity of a vehicle, the analysis data being generated by processing sensor data from a sensor loaded in the vehicle, the type data indicating a kind of the object, the relative position data indicating a relative position of the object with respect to the vehicle, the road data indicating a state of a road in the vicinity of the vehicle;

determining whether the relative position of the object is anomalous;

acquiring a captured image from a camera loaded in the vehicle; and

displaying the reconfigured image and the captured image in parallel on a display, the reconfigured image including the indication of the object whose relative position is determined to be anomalous.

14 . The non-transitory computer-readable medium according to claim 13 , the operations further comprise

in a case where a change of the relative position of the object is anomalous, determining the relative position of the object is anomalous.

15 . The non-transitory computer-readable medium according to claim 13 , wherein the state of the road includes a sign drawn on the road.

16 . The non-transitory computer-readable medium according to claim 13 , wherein the reconfigured image is an image that reproduces the vicinity of the vehicle.

17 . The non-transitory computer-readable medium according to claim 13 , wherein the object in the reconfigured image is displayed in human form in a case where the kind of the object is a human.

18 . The non-transitory computer-readable medium according to claim 13 , wherein the operations comprise:

acquiring vehicle position data indicating a position of the vehicle;

acquiring map data including a location associated with the vehicle position data; and

generating the reconfigured image by arranging, based on the type data and the relative position data, an indication of the object on a road image generated from the map data.

Priority Claims (1)
JP 2020-049868 · Mar 19, 2020 · national
Continuity (3)
Continuation 19248626 · Jun 25, 2025
Continuation 17801468 · Jan 7, 2021
Related Publication 20260179284A1 · Jun 25, 2026
References Cited (48)
US 10401852B2 · Levinson et al. · 2019 [cited by applicant]
US 10924679B2 · Lee · 2021 [cited by applicant]
US 20120257058A1 · Kinoshita · 2012 [cited by examiner]
US 20140002660A1 · Takahashi · 2014 [cited by examiner]
US 20150077562A1 · Heckel · 2015 [cited by examiner]
US 20170158134A1 · Shigemura · 2017 [cited by examiner]
US 20170220877A1 · Kakegawa · 2017 [cited by applicant]
US 20170316575A1 · Adachi · 2017 [cited by applicant]
US 20180105040A1 · Ryu · 2018 [cited by applicant]
US 20180164114A1 · Chiu · 2018 [cited by applicant]
US 20180208199A1 · Fujita et al. · 2018 [cited by applicant]
US 20180225963A1 · Kobayashi et al. · 2018 [cited by applicant]
US 20180257489A1 · Watanabe · 2018 [cited by applicant]
US 20190061742A1 · Kubo · 2019 [cited by examiner]
US 20190066382A1 · Kubo · 2019 [cited by examiner]
US 20190113926A1 · Sim · 2019 [cited by applicant]
US 20190137999A1 · Taguchi et al. · 2019 [cited by applicant]
US 20190333380A1 · Kobayashi et al. · 2019 [cited by applicant]
US 20190339692A1 · Sakai et al. · 2019 [cited by applicant]
US 20190382003A1 · Jiang et al. · 2019 [cited by applicant]
US 20200180502A1 · Mitsuya · 2020 [cited by examiner]
US 20200183157A1 · Suzuki · 2020 [cited by applicant]
US 20200184654A1 · Kim · 2020 [cited by applicant]
US 20200231210A1 · Anderson · 2020 [cited by examiner]
US 20200302657A1 · Shimazu · 2020 [cited by applicant]
US 20200327333A1 · Kunitsu · 2020 [cited by applicant]
US 20200391751A1 · Fujiyoshi · 2020 [cited by examiner]
US 20210081684A1 · Yamamoto · 2021 [cited by examiner]
US 20210158623A1 · Suzuki · 2021 [cited by applicant]
US 20210174099A1 · Okubi · 2021 [cited by examiner]
US 20210224560A1 · Kim · 2021 [cited by applicant]
US 20220048502A1 · Kim · 2022 [cited by applicant]
US 20220383645A1 · Hayashi · 2022 [cited by examiner]
US 20230031419A1 · Shimizu · 2023 [cited by applicant]
US 20230297103A1 · Otaki · 2023 [cited by examiner]
JP 2005227947A · 2005 [cited by applicant]
JP 2013092992A · 2013 [cited by applicant]
JP 2013095375A · 2013 [cited by applicant]
JP 2017151798A · 2017 [cited by applicant]
JP 2020009428A · 2020 [cited by applicant]
WO 2013042767A1 · 2013 [cited by applicant]
WO 2017013750A1 · 2017 [cited by applicant]
WO 2017047176A1 · 2017 [cited by applicant]
WO 2017079219A1 · 2017 [cited by applicant]
WO 2018102475A1 · 2018 [cited by applicant]
International Search Report for PCT Application No. PCT/JP2021/000331, mailed on Mar. 23, 2021. [cited by applicant]
Japanese Office Action for JP Application No. 2022-508078 mailed on Jan. 23, 2024 with English Translation. [cited by applicant]
JP Office Communication for JP Application No. 2022-508078, mailed on Jun. 25, 2024 with English Translation. [cited by applicant]