IP Library › Granted Patent US 12,322,190
Granted Patent B2
US 12,322,190 · App. 17/626,740 · Granted Jun 3, 2025

Information processing device, information processing method, and information processing program

Inventor: Mitsunori Nakamura (Kanagawa, JP)
Assignee: NISSAN MOTOR CO., LTD.
G06V20/58B60W30/095B60W2554/4048B60W2554/4049
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,322,190
App. No.
17/626,740
Granted
Jun 3, 2025
Kind
B2
Abstract

In an information processing device, a first viewpoint object detecting unit detects an object in a first viewpoint, and an area setting unit sets a predetermined blind spot area among blind spot areas where objects are not able to be detected as a priority area based on detection results of detecting the object. Further, a second viewpoint object detecting unit detects the object in a second viewpoint, and an object selection unit selects the object in an area where the object can be newly detected in the second viewpoint within the priority area where the object could not be detected in the first viewpoint.

Claims (88)

1. An information processing device comprising:

a first communication unit including a processor that receives a non-detection area data, the non-detection area in which an object is not able to be detected in a first viewpoint by a sensor installed in a first moving body;

a selection unit including a second processor that selects a detection area in which the object becomes detectable in a second viewpoint at a detection time different from that of the first viewpoint by the sensor installed in the first moving body, wherein

the first communication unit is configured to obtain the detection area data and to trigger transmitting, in response to the object becoming detectable by the sensor installed in the first moving body, at least the detection area data to a second moving body or a server, the second moving body differing from the first moving body, the first moving body and the second moving body are vehicles;

a setting unit including a third processor that sets a predetermined area to be prioritized among an area where an object is not able to be detected as a priority area based on a detection result of detecting the object on a road; and

a second communication unit including a fourth processor that transmits, to a requested vehicle, request data for requesting object information included in the priority area and receives, from the requested vehicle, the object information included in the priority area.

2. The information processing device according to claim 1 , wherein

the non-detection area is a non-detection area in which the object could not be detected by a sensor installed in the second moving body; and

the first communication unit receives the non-detection area data from the second moving body, and transmits the detection area data based on the received non-detection area to the second moving body.

3. The information processing device according to claim 1 , wherein

the setting unit acquires future position information of a requesting vehicle requesting the object information, and sets an area where the requesting vehicle is not able to detect the object in the future as the priority area based on the future position information and the detection result.

4. The information processing device according to claim 1 comprising:

a memory that stores map information, wherein

the setting unit sets the priority area based on a lane link ID on a map by using the map information.

5. The information processing device according to claim 1 , wherein

the priority area is an area based on a boundary based on a predetermined object detected by the requested vehicle at least at a predetermined timing.

6. The information processing device according to claim 5 , wherein

the predetermined object is a white line or a vehicle on the road.

7. The information processing device according to claim 1 , wherein

the setting unit sets a temporary shielded area where the object is not able to be detected in the first viewpoint and the object can be detected in the second viewpoint, based on the detection result; and

the second communication unit transmits the temporary shielded area to any one of the requested vehicle, a vehicle other than the requested vehicle, and a server.

8. The information processing device according to claim 1 , wherein

the request data includes information on a position and a planned travel route of the requesting vehicle requesting the object information, in addition to information on the priority area.

9. The information processing device according to claim 1 , wherein

the setting unit sets an area with a predetermined road shape as the priority area.

10. The information processing device according to claim 9 , wherein

the predetermined road shape is any one of an intersection, a curve, and a curve gradient inflection point.

11. The information processing device according to claim 1 , wherein

the object information includes object information detected in an area different from the priority area or object information detectable in the future in an area different from the priority area, in addition to the object information detected in the priority area by the requested vehicle.

12. The information processing device according to claim 1 , wherein the object information includes vehicle information or position information of an obstacle on the road detected by the requested vehicle.

13. The information processing device according to claim 1 , wherein

the requested vehicle includes a sensor that monitors a side of the road, and the requested vehicle detects a vehicle or an obstacle by detecting a road boundary line or a background object, detecting an object on the road, and determining an intersecting point between the detected object and a parting line.

14. The information processing device according to claim 1 , wherein

the information processing device is provided in the vehicle.

15. The information processing device according to claim 1 , wherein

the selection unit selects object information included in the priority area among object information on the road detected by the requested vehicle, the priority area being set by the setting unit of a requesting vehicle, and

the first communication unit receives the request data from the second communication unit of the requesting vehicle and transmits, to the second communication unit of the requesting vehicle, the object information included in the priority area selected by the selection unit.

16. The information processing device according to claim 15 , wherein

if the requested vehicle is not able to travel in the priority area, the selection unit selects an area adjacent to the priority area as an extension area, and

the first communication unit transmits, to the requesting vehicle, object information detected in the extension area in addition to the object information included in the priority area.

17. An information processing method performed by an information processing device, comprising the steps of:

receiving a non-detection area data, the non-detection area in which an object is not able to be detected in a first viewpoint by a sensor installed in a first moving body,

selecting a detection area in which the object becomes detectable in a second viewpoint at a detection time different from that of the first viewpoint by the sensor installed in the first moving body;

obtaining the detection area data and triggering transmitting, in response to the object becoming detectable by the sensor installed in the first moving body, at least the detection area data to a second moving body or a server, the second moving body differs from the first moving body,

wherein the first moving body and the second moving body are vehicles;

before the receiving step,

setting a predetermined area to be prioritized among an area where an object is not able to be detected as a priority area based on a detection result of detecting the object on a road;

transmitting, to a requested vehicle, request data for requesting object information included in the priority area; and

after the transmitting step, receiving the object information included in the priority area from the requested vehicle.

18. The information processing method according to claim 17 , wherein

the non-detection area is a non-detection area in which the object could not be detected by a sensor installed in the second moving body; and

in the transmitting step, receive the non-detection area data from the second moving body, and transmits the detection area data based on the received non-detection area to the second moving body.

19. The information processing method according to claim 17 , wherein

the receiving step includes receiving, from a requesting vehicle, the request data for requesting object information included in the priority area, the priority area being set by the requesting vehicle

the selecting step includes selecting object information included in the priority area among object information on the road detected by the requested vehicle; and

the transmitting step, includes transmitting, to the requesting vehicle, the object information included in the priority area.

20. A non-transitory recording medium storing an information processing program for causing an information processing device to perform the procedures of:

receiving a non-detection area data, the non-detection area in which an object is not able to be detected in a first viewpoint by a sensor installed in a first moving body;

selecting a detection area in which the object becomes detectable in a second viewpoint at a detection time different from that of the first viewpoint by the sensor installed in the first moving body;

obtaining the detection area data and triggering transmitting, in response to the object becoming detectable by the sensor installed in the first moving body, at least the detection area data to a second moving body or a server, the second moving body differs from the first moving body,

wherein the first moving body and the second moving body are vehicles;

before the receiving procedure,

setting a predetermined area to be prioritized among an area where an object is not able to be detected as a priority area based on a detection result of detecting the object on a road;

transmitting, to a requested vehicle, request data for requesting object information included in the priority area; and

after the transmitting procedure, receiving the object information included in the priority area from the requested vehicle.

21. The non-transitory recording medium according to claim 20 , wherein

the non-detection area is a non-detection area in which the object could not be detected by a sensor installed in the second moving body; and

in the transmitting procedure, receive the non-detection area data from the second moving body, and transmits the detection area data based on the received non-detection area to the second moving body.

22. The non-transitory recording medium according to claim 20 , wherein

the receiving procedure includes receiving, from a requesting vehicle, the request data for requesting object information included in the priority area, the priority area being set by the requesting vehicle,

the selecting procedure includes selecting object information included in the priority area among object information on the road detected by the requested vehicle, and

the transmitting procedure includes transmitting, to the requesting vehicle, the object information included in the priority area.

23. The information processing device according to claim 1 , wherein

the second communication unit receives in advance, from the requested vehicle, distribution order information set with a distribution order in which the priority area is prioritized over an extension area of the priority area adjacent to the priority area, and receives, from the requested vehicle, the object information included in the priority area and object information included in the extension area in the distribution order set in the distribution order information.

24. The information processing device according to claim 15 , wherein

the first communication unit transmits in advance, to the requesting vehicle, distribution order information set with a distribution order in which the priority area is prioritized over the extension area of the priority area adjacent to the priority area, and transmits, to the requesting vehicle, the object information included in the priority area and the object information included in the extension area in the distribution order set in the distribution order information.

25. The information processing method according to claim 17 , wherein

in the object information receiving step,

distribution order information set with a distribution order in which the priority area is prioritized over an extension area of the priority area adjacent to the priority area is received in advance, from the requested vehicle, and the object information included in the priority area and object information included in the extension area are received from the requested vehicle in the distribution order set in the distribution order information.

26. The information processing method according to claim 19 , wherein

in the transmitting step,

distribution order information set with a distribution order in which the priority area is prioritized over an extension area of the priority area adjacent to the priority area is transmitted in advance to the requesting vehicle and the object information included in the priority area and object information included in the extension area are transmitted to the requesting vehicle in the distribution order set in the distribution order information.

27. The non-transitory recording medium according to claim 20 , wherein

in the object information receiving procedure,

distribution order information set with a distribution order in which the priority area is prioritized over an extension area of the priority area adjacent to the priority area is received in advance from the requested vehicle, and the object information included in the priority area and object information included in the extension area are received from the requested vehicle in the distribution order set in the distribution order information.

28. The non-transitory recording medium according to claim 22 , wherein

in the transmitting procedure,

distribution order information set with a distribution order in which the priority area is prioritized over an extension area of the priority area adjacent to the priority area is transmitted in advance to the requesting vehicle, and the object information included in the priority area and object information included in the extension area are transmitted to the requesting vehicle in the distribution order set in the distribution order information.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 17, 2022
From: NAKAMURA, MITSUNORI
To: NISSAN MOTOR CO., LTD
Reel/Frame 058670/0716 →
Continuity (1)
Related Publication 20220262128A1 · Aug 18, 2022
References Cited (16)
US 10518769B2 · Sen · 2019 [cited by examiner]
US 20070016372A1 · Browne · 2007 [cited by examiner]
US 20100099353A1 · Komori · 2010 [cited by examiner]
US 20170334441A1 · Sen et al. · 2017 [cited by applicant]
US 20180233049A1 · Ishii · 2018 [cited by examiner]
US 20220176952A1 · Nanri · 2022 [cited by examiner]
CN 101632109A · 2010 [cited by applicant]
CN 108447302A · 2018 [cited by applicant]
CN 110962744A · 2020 [cited by examiner]
JP 2008225786A · 2008 [cited by applicant]
JP 2008299676A · 2008 [cited by applicant]
JP 2017207967A · 2017 [cited by applicant]
JP 2018133072A · 2018 [cited by applicant]
WO WO2018189913A1 · 2018 [cited by examiner]
Li, F., Zhang, R. and You, F. (2017), Fast pedestrian detection and dynamic tracking for intelligent vehicles within V2V cooperative environment. IET Image Processing, 11: 833-840. https://doi.org/10.1049/iet-ipr.2016.0… [cited by examiner]
R. Fukatsu and K. Sakaguchi, “Millimeter-Wave V2V Communications with Cooperative Perception for Automated Driving,” 2019 IEEE 89th Vehicular Technology Conference (VTC2019-Spring), Kuala Lumpur, Malaysia, 2019, pp. 1-5… [cited by examiner]
Cited By (1)
US 12,518,546