IP Library › Granted Patent US 12,367,624
Granted Patent B2
US 12,367,624 · App. 17/801,468 · Granted Jul 22, 2025

Apparatus for generating a pseudo-reproducing image, and non-transitory computer-readable medium

Inventor: Hiroki Itsukaichi (Tokyo, JP)
Assignee: NEC CORPORATION
G06T11/60G06T7/70G06V20/58G08G1/166G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,367,624
App. No.
17/801,468
Granted
Jul 22, 2025
Kind
B2
Abstract

An image generation apparatus ( 20 ) includes an acquisition unit ( 210 ), a data processing unit ( 220 ), and a display ( 230 ). The acquisition unit ( 210 ) repeatedly acquires analysis data from at least one sending apparatus ( 10 ). The analysis data include at least type data and relative position data. The data processing unit ( 220 ) generates a reconfigured image by using the analysis data each time the data processing unit ( 220 ) acquires the analysis data, and displays the reconfigured image on the display ( 230 ). The reconfigured image includes an indication based on the type data in a position associated with the relative position data. The display may be a mark imitating an outer shape of a kind indicated by the type data, or may be an abstract mark.

Claims (68)

1. An apparatus placed away from a vehicle, the apparatus comprising:

at least one memory configured to store instructions; and

at least one processor configured to execute the instructions to perform operations comprising:

acquiring, from a sending apparatus loaded in the vehicle, analysis data generated by processing a captured image from an image sensor loaded in the vehicle, the analysis data including type data and relative position data, the type data indicating a kind of an object located in a vicinity of the vehicle and the relative position data indicating a relative position of the object with respect to the vehicle;

generating a first reconfigured image by arranging an indication of the object based on the type data and the relative position data;

determining whether a change of the relative position of the object is anomalous;

acquiring the captured image from the sending apparatus; and

displaying the first reconfigured image and the captured image in parallel on a display, wherein the first reconfigured image includes the indication of the object whose change of the relative position is determined to be anomalous.

2. The apparatus according to claim 1 , wherein

the analysis data further include road data indicating a state of a road located in the vicinity of the vehicle, and

the operations further comprise including an indication of the road according to the road data in the first reconfigured image.

3. The apparatus according to claim 1 , wherein the operations comprise:

acquiring vehicle position data indicating a position of the vehicle;

generating a second reconfigured image by arranging, based on the type data and the relative position data, an indication of the object on a road image generated from the map data; and

displaying the first reconfigured image and the second reconfigured image in parallel on the display.

4. The apparatus according to claim 1 , wherein the operations comprise:

in response to determining that the change of the relative position of the object is not anomalous, generating the first reconfigured image of the captured image and displaying the first reconfigured image on the display; and

in response to determining that the change of the relative position of the object is anomalous, acquiring the captured image from the sending apparatus loaded in the vehicle and displaying the first reconfigured image and the captured image in parallel on the display.

5. The apparatus according to claim 1 , wherein

the indication of the object is a block shape in a case where the kind of the object is a vehicle.

6. The apparatus according to 1 , wherein

the operations comprise generating a bird's-eye view as the first reconfigured image.

7. The apparatus according to claim 1 , wherein the operations comprise

determining that the change of the relative position of the object is anomalous in a case where the change of the relative position of the object indicates a physically improbable behavior.

8. The image generation method according to claim 1 , further comprising:

in response to determining that the change of the relative position of the object is not anomalous, generating the first reconfigured image of the captured image and displaying the first reconfigured image on the display; and

in response to determining that the change of the relative position of the object is anomalous, acquiring the captured image from the sending apparatus loaded in the vehicle and displaying the first reconfigured image and the captured image in parallel on the display.

9. An image generation method, comprising:

by a computer placed away from a vehicle,

acquiring, from a sending apparatus loaded in the vehicle, analysis data generated by processing a captured image from an image sensor loaded in the vehicle, the analysis data including type data and relative position data, the type data indicating a kind of an object located in a vicinity of the vehicle and the relative position data indicating a relative position of the object with respect to the vehicle;

generating a first reconfigured image by arranging an indication of the object based on the type data and the relative position data;

determining whether a change of the relative position of the object is anomalous;

acquiring the captured image from the sending apparatus; and

displaying the first reconfigured image and the captured image in parallel on a display, wherein the first reconfigured image includes the indication of the object whose change of the relative position is determined to be anomalous.

10. The image generation method to claim 9 , wherein

the analysis data further include road data indicating a state of a road located in the vicinity of the vehicle, and

the image generation method further comprises including an indication of the road according to the road data in the first reconfigured image.

11. The image generation method according to claim 9 , further comprising:

acquiring vehicle position data indicating a position of the vehicle;

acquiring map data including a location associated with the vehicle position data;

generating a second reconfigured image by arranging, based on the type data and the relative position data, an indication of the object on a road image generated from the map data; and

displaying the first reconfigured image and the second reconfigured image in parallel on the display.

12. The image generation method according to claim 9 , wherein

the indication of the object is a block shape in a case where the kind of the object is a vehicle.

13. The image generation method according to claim 9 , further comprising

generating a bird's-eye view as the first reconfigured image.

14. The image generation method according to claim 9 , further comprising

determining that the change of the relative position of the object is anomalous in a case where the change of the relative position of the object indicates a physically improbable behavior.

15. A non-transitory computer-readable medium storing a program causing a computer placed away from a vehicle to perform operations comprising:

acquiring, from a sending apparatus loaded in the vehicle, analysis data generated by processing a captured image from an image sensor loaded in the vehicle, the analysis data including type data and relative position data, the type data indicating a kind of an object located in a vicinity of the vehicle and the relative position data indicating a relative position of the object with respect to the vehicle;

generating a first reconfigured image by arranging an indication of the object based on the type data and the relative position data;

determining whether a change of the relative position of the object is anomalous;

acquiring the captured image from the sending apparatus; and

displaying the first reconfigured image and the captured image in parallel on a display, wherein the first reconfigured image includes the indication of the object whose change of the relative position is determined to be anomalous.

16. The non-transitory computer-readable medium according to claim 15 , wherein

the analysis data further include road data indicating a state of a road located in the vicinity of the vehicle, and

the operations further comprise including an indication of the road according to the road data in the first reconfigured image.

17. The non-transitory computer-readable medium according to claim 15 , wherein the operations comprise:

acquiring vehicle position data indicating a position of the vehicle;

acquiring map data including a location associated with the vehicle position data;

generating a second reconfigured image by arranging, based on the type data and the relative position data, an indication of the object on a road image generated from the map data; and

displaying the first reconfigured image and the second reconfigured image in parallel on the display.

18. The non-transitory computer-readable medium according to claim 15 , wherein the operations comprise:

in response to determining that the change of the relative position of the object is not anomalous, generating the first reconfigured image of the captured image and displaying the first reconfigured image on the display; and

in response to determining that the change of the relative position of the object is anomalous, acquiring the captured image from the sending apparatus loaded in the vehicle and displaying the first reconfigured image and the captured image in parallel on the display.

19. The non-transitory computer-readable medium according to claim 15 , wherein

the indication of the object is a block shape in a case where the kind of the object is a vehicle.

20. The non-transitory computer-readable medium according to claim 15 , wherein the operations comprise generating a bird's-eye view as the first reconfigured image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 22, 2022
From: ITSUKAICHI, HIROKI
To: NEC CORPORATION
Reel/Frame 060860/0667 →
Priority Claims (1)
JP 2020-049868 · Mar 19, 2020 · national
Continuity (1)
Related Publication 20230104858A1 · Apr 6, 2023
References Cited (43)
US 10924679B2 · Lee · 2021 [cited by examiner]
US 20120257058A1 · Kinoshita · 2012 [cited by examiner]
US 20140002660A1 · Takahashi · 2014 [cited by examiner]
US 20150077562A1 · Heckel · 2015 [cited by examiner]
US 20170158134A1 · Shigemura · 2017 [cited by examiner]
US 20170220877A1 · Kakegawa · 2017 [cited by examiner]
US 20170316575A1 · Adachi · 2017 [cited by examiner]
US 20180105040A1 · Ryu · 2018 [cited by examiner]
US 20180164114A1 · Chiu · 2018 [cited by examiner]
US 20180208199A1 · Fujita et al. · 2018 [cited by applicant]
US 20180225963A1 · Kobayashi et al. · 2018 [cited by applicant]
US 20180257489A1 · Watanabe · 2018 [cited by examiner]
US 20190061742A1 · Kubo · 2019 [cited by examiner]
US 20190066382A1 · Kubo · 2019 [cited by examiner]
US 20190113926A1 · Sim · 2019 [cited by examiner]
US 20190333380A1 · Kobayashi et al. · 2019 [cited by applicant]
US 20190382003A1 · Jiang et al. · 2019 [cited by applicant]
US 20200180502A1 · Mitsuya · 2020 [cited by examiner]
US 20200183157A1 · Suzuki · 2020 [cited by examiner]
US 20200184654A1 · Kim · 2020 [cited by examiner]
US 20200231210A1 · Anderson · 2020 [cited by examiner]
US 20200302657A1 · Shimazu · 2020 [cited by examiner]
US 20200327333A1 · Kunitsu · 2020 [cited by examiner]
US 20200391751A1 · Fujiyoshi · 2020 [cited by examiner]
US 20210081684A1 · Yamamoto · 2021 [cited by examiner]
US 20210158623A1 · Suzuki · 2021 [cited by examiner]
US 20210174099A1 · Okubi · 2021 [cited by examiner]
US 20210224560A1 · Kim · 2021 [cited by examiner]
US 20220048502A1 · Kim · 2022 [cited by examiner]
US 20220383645A1 · Hayashi · 2022 [cited by examiner]
US 20230031419A1 · Shimizu · 2023 [cited by examiner]
US 20230297103A1 · Otaki · 2023 [cited by examiner]
JP 2005227947A · 2005 [cited by applicant]
JP 2013092992A · 2013 [cited by applicant]
JP 2013095375A · 2013 [cited by applicant]
JP 2017151798A · 2017 [cited by applicant]
JP 2020009428A · 2020 [cited by applicant]
WO 2013042767A1 · 2013 [cited by applicant]
WO 2017013750A1 · 2017 [cited by applicant]
WO 2017047176A1 · 2017 [cited by applicant]
International Search Report for PCT Application No. PCT/JP2021/000331, mailed on Mar. 23, 2021. [cited by applicant]
Japanese Office Action for JP Application No. 2022-508078 mailed on Jan. 23, 2024 with English Translation. [cited by applicant]
JP Office Communication for JP Application No. 2022-508078, mailed on Jun. 25, 2024 with English Translation. [cited by applicant]