Display method and display device for providing surrounding information based on driving condition
A display method is a display method performed by a display device that operates in conjunction with a mobile object, and includes: determining which one of first surrounding information, which is video showing a surrounding condition of the mobile object and is generated using two-dimensional information, and second surrounding information, which is video showing the surrounding condition of the mobile object and is generated using three-dimensional data, is to be displayed, based on a driving condition of the mobile object; and displaying the one of the first surrounding information and the second surrounding information that is determined to be displayed.
1. A data generation method performed by a data generation device that operates in conjunction with a mobile object, the data generation method comprising:
generating first surrounding information and second surrounding information, the first surrounding information being information which indicates a surrounding condition of the mobile object and is generated using two-dimensional information, the second surrounding information being information which indicates the surrounding condition of the mobile object and is generated using three-dimensional data;
determining which one of first surrounding information and second surrounding information is to be used, based on a driving condition of the mobile object; and
using the one of the first surrounding information and the second surrounding information, wherein
the driving condition is whether the mobile object is under autonomous travel or under manual driving, and
the three-dimensional data is data obtained by extracting, from three dimensional point cloud data, a point cloud having a feature amount greater than or equal to a threshold for each predetermined data unit, the feature amount being based on at least one of luminance information and color information.
2. The data generation method according to claim 1 , wherein
in the determining, the first surrounding information is determined to be used when the mobile object is under autonomous travel, and the second surrounding information is determined to be used when the mobile object is under manual driving.
3. The data generation method according to claim 1 , wherein
the driving condition is an area in which the mobile object is located.
4. The data generation method according to claim 1 , wherein
the three-dimensional data is data having a mesh structure generated from three-dimensional point cloud data.
5. The data generation method according to claim 1 , wherein
the point cloud extracted from the three dimension point cloud data is necessary for one of self-location estimation, drive assist, and self-driving.
6. The data generation method according to claim 1 , wherein
the three-dimensional data is three-dimensional point cloud data.
7. The data generation method according to claim 1 , wherein
in the using, the second surrounding information is displayed on a head-up display,
the data generation method further comprising:
adjusting a display position of the second surrounding information according to one of posture, physique, and eye position of a user aboard the mobile object.
8. A data generation device that operates in conjunction with a mobile object, the data generation device comprising:
a processor; and
memory, wherein
using the memory, the processor:
generates first surrounding information and second surrounding information, the first surrounding information being information which indicates a surrounding condition of the mobile object and is generated using two-dimensional information, the second surrounding information being information which indicates the surrounding condition of the mobile object and is generated using three-dimensional data;
determines which one of first surrounding information and second surrounding information is to be used, based on a driving condition of the mobile object; and
uses the one of the first surrounding information and the second surrounding information,
the driving condition is whether the mobile object is under autonomous travel or under manual driving, and
the three-dimensional data is data obtained by extracting, from three dimensional point cloud data, a point cloud having a feature amount greater than or equal to a threshold for each predetermined data unit, the feature amount being based on at least one of luminance information and color information.
9. A data generation device that operates in conjunction with a mobile object, the data generation device comprising:
a processor; and
memory, wherein
using the memory, the processor:
generates first surrounding information and second surrounding information, the first surrounding information being information which indicates a surrounding condition of the mobile object and is generated using two-dimensional information, the second surrounding information being information which indicates the surrounding condition of the mobile object and is generated using three-dimensional data;
determines which one of first surrounding information and second surrounding information is to be used, based on a driving condition of the mobile object; and
uses the one of the first surrounding information and the second surrounding information,
the driving condition is whether the mobile object is under autonomous travel or under manual driving,
the three-dimensional data is data obtained by extracting, from three dimensional point cloud data, a point cloud having a feature amount greater than or equal to a threshold for each predetermined data unit, and
the feature amount is a signature of histograms of orientations (SHOT) feature amount, a point feature histograms (PFH) feature amount, or a point pair feature (PPF) feature amount.